1. Technical Field
This disclosure generally relates to computer systems, and more specifically relates to management of a distributed database.
2. Background Art
Distributed databases have been developed that include multiple computer systems or nodes that each include a portion of data in the distributed database. Many distributed databases need to be highly available, so they are implemented in a cloud-based manner that uses advanced virtualization techniques to mask the underlying hardware implementation. These virtualization techniques, by masking the underlying hardware implementation, can make it more difficult to identify and address some performance issues in the distributed database.
A database performance monitor monitors performance of a distributed database, identifies a database performance issue for the distributed database, determines from a distributed virtual network mechanism which physical networks are related to the database performance issue, determines a potential solution to the database performance issue that changes configuration of the distributed database, and applies the potential solution by automatically changing configuration of the distributed database without intervention of a user to address the database performance issue.
The foregoing and other features and advantages will be apparent from the following more particular description, as illustrated in the accompanying drawings.
The disclosure will be described in conjunction with the appended drawings, where like designations denote like elements, and:
The disclosure and claims herein disclose a database performance monitor that monitors performance of a distributed database, identifies a database performance issue for the distributed database, determines from a distributed virtual network mechanism which physical networks are related to the database performance issue, determines a potential solution to the database performance issue that changes configuration of the distributed database, and applies the potential solution by automatically changing configuration of the distributed database without intervention of a user to address the database performance issue.
Referring to
Main memory 120 preferably contains data 121, an operating system 122, a distributed virtual Ethernet mechanism 123, and a distributed database 126. Data 121 represents any data that serves as input to or output from any program in computer system 100. Operating system 122 is a multitasking operating system. Distributed virtual Ethernet mechanism 123 is a distributed virtual networking mechanism that virtualizes underlying hardware for a variety of different types of network connections into a single virtual view that allows easy interaction between components connected to the distributed virtual Ethernet mechanism 123. The representation of distributed virtual Ethernet mechanism 123 shown in the main memory 120 in
There is an inherent problem that arises from virtualizing all underlying hardware networks in the distributed virtual Ethernet switch 124. This virtualization provides a very convenient single point of contact for managing network communications in a networked computer system such as a distributed database. However, by virtualizing the underlying hardware networks, the specific implementation and even performance of the hardware networks are not visible to software that uses the distributed virtual Ethernet mechanism. Thus, the convenient virtualized interface provided by the distributed virtual Ethernet mechanism comes at the cost of masking performance of the underlying hardware. The distributed virtual Ethernet mechanism 123 solves this problem by providing a network monitor mechanism 125 that not only monitors usage of virtual networks, but underlying hardware networks as well. The distributed virtual Ethernet mechanism 123 thus provides a convenient single point where performance of both virtual and hardware networks may be managed.
The distributed database 126 in
Computer system 100 utilizes well known virtual addressing mechanisms that allow the programs of computer system 100 to behave as if they only have access to a large, contiguous address space instead of access to multiple, smaller storage entities such as main memory 120 and local mass storage device 155. Therefore, while data 121, operating system 122, distributed virtual Ethernet mechanism 123 and distributed database 126 are shown to reside in main memory 120, those skilled in the art will recognize that these items are not necessarily all completely contained in main memory 120 at the same time. It should also be noted that the term “memory” is used herein generically to refer to the entire virtual memory of computer system 100, and may include the virtual memory of other computer systems coupled to computer system 100.
Processor 110 may be constructed from one or more microprocessors and/or integrated circuits. Processor 110 executes program instructions stored in main memory 120. Main memory 120 stores programs and data that processor 110 may access. When computer system 100 starts up, processor 110 initially executes the program instructions that make up operating system 122. Processor 110 also executes the distributed virtual Ethernet mechanism 123, the distributed database manager 127, and the database performance monitor 128.
Although computer system 100 is shown to contain only a single processor and a single system bus, those skilled in the art will appreciate that a database performance monitor may be practiced using a computer system that has multiple processors and/or multiple buses. In addition, the interfaces that are used preferably each include separate, fully programmed microprocessors that are used to off-load compute-intensive processing from processor 110. However, those skilled in the art will appreciate that these functions may be performed using I/O adapters as well.
Display interface 140 is used to directly connect one or more displays 165 to computer system 100. These displays 165, which may be non-intelligent (i.e., dumb) terminals or fully programmable workstations, are used to provide system administrators and users the ability to communicate with computer system 100. Note, however, that while display interface 140 is provided to support communication with one or more displays 165, computer system 100 does not necessarily require a display 165, because all needed interaction with users and other processes may occur via network interface 150.
Network interface 150 is used to connect computer system 100 to other computer systems or workstations 175 via network 170. Network interface 150 thus connects the apparatus 100 to other computer systems (e.g., 175 in
As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or computer program product. Accordingly, aspects of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a “circuit,” “module” or “system.” Furthermore, aspects of the present invention may take the form of a computer program product embodied in one or more computer readable medium(s) having computer readable program code embodied thereon.
Any combination of one or more computer readable medium(s) may be utilized. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the “C” programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).
Aspects of the present invention are described below with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer readable medium that can direct a computer, other programmable data processing apparatus, or other devices to function in a particular manner, such that the instructions stored in the computer readable medium produce an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
Referring to
Referring to
Referring to
Referring to
When the database performance issue is not resolved (step 650=NO), method 600 determines whether there are any other potential solutions to the identified database performance issue (step 660). If so (step 660=YES), method 600 loops back to step 630 and continues. When there is no other potential solution (step 660=NO), a notification is sent to a system administrator of the performance issue that could not be resolved automatically (step 670). Method 600 is then done. Note that method 600 uses database cluster information, including utilization for virtual networks, in identifying potential solutions and reconfiguring the distributed database accordingly. Note, however, that considering only virtual network utilization can mask network problems in the hardware networks. Thus, even though a virtual network NW1 may have only 40% utilization, its underlying hardware link could be used by other virtual networks as well, resulting in the hardware link having 100% utilization. Thus, in the most preferred implementation, utilization of both virtual networks and hardware networks is considered, as shown in method 700 in
Referring to
A simple example will illustrate the concepts in
We now assume for the simple example given above that method 700 in
The presence of a distributed virtual Ethernet switch provides a single point in a database system or cluster where network utilization for both virtual and hardware networks may be determined. The distributed virtual Ethernet switch can thus provide its virtualization functions, effectively hiding the underlying implementation of hardware networks when needed, while also providing detailed information regarding hardware network topology and performance that allows a database performance monitor to automatically reconfigure a distributed database to address performance issues at either the virtual network level or at the hardware network level.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
A database performance monitor monitors performance of a distributed database, identifies a database performance issue for the distributed database, determines from a distributed virtual network mechanism which physical networks are related to the database performance issue, determines a potential solution to the database performance issue that changes configuration of the distributed database, and applies the potential solution by automatically changing configuration of the distributed database without intervention of a user to address the database performance issue.
One skilled in the art will appreciate that many variations are possible within the scope of the claims. Thus, while the disclosure is particularly shown and described above, it will be understood by those skilled in the art that these and other changes in form and details may be made therein without departing from the spirit and scope of the claims.
Number | Name | Date | Kind |
---|---|---|---|
7778257 | Bishara et al. | Aug 2010 | B1 |
20030009540 | Benfield et al. | Jan 2003 | A1 |
20030041238 | French et al. | Feb 2003 | A1 |
20040252722 | Wybenga et al. | Dec 2004 | A1 |
20050086195 | Tan et al. | Apr 2005 | A1 |
20070156919 | Potti et al. | Jul 2007 | A1 |
20090161569 | Corlett | Jun 2009 | A1 |
20110225232 | Casalaina et al. | Sep 2011 | A1 |
20120089410 | Mikurak | Apr 2012 | A1 |
Entry |
---|
Anonymous; “System and method for the dynamic optimization of query tables”; http://priorartdatabase.com/IPCOM/000197961; Jul. 23, 2010. |
IBM; “Physical network optimization based on virtual network characteristics and job requirements in a multi-nodal system”; http://www.ip.com/pubview/IPCOM000188729D, Oct. 20, 2009. |
Anonymous; “Method for Ethernet traffic path control for isolated sub-networks by VLAN and an algorithm for two-layer network optimization of VLAN isolated sub-networks”; http://priorartdatabase.com/IPCOM/000216616; Apr. 10, 2012. |
Henschen, Doug, “Oracle Makes Big Data Appliance Move With Cloudera”, http://www.informationweek.com/software/information-management/oracle-makes-big-data-appliance-move-wit/232400021, Jan. 10, 2012. |
Thomson, Iain, “AWS takes NoSQL database to the cloud with DynamoDB”, http://www.theregister.co.uk/2012/01/19/aws—amazondb—cloud—database/, Jan. 19, 2012. |
Number | Date | Country | |
---|---|---|---|
20140136475 A1 | May 2014 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 13675032 | Nov 2012 | US |
Child | 13707683 | US |