Patent Application
20070083573
1. Field
Embodiments of the invention relate to reduction of join operations when archiving related database tables.
2. Description of the Related Art
Relational DataBase Management System (RDBMS) software uses relational techniques for storing and retrieving data in a relational database. Relational databases are computerized information storage and retrieval systems. Relational databases are organized into tables that consist of rows and columns of data. The rows may be called tuples or records or rows. A database typically has many tables, and each table typically has multiple records and multiple columns. A RDBMS may use a Structured Query Language (SQL) interface.
A table in a database may be accessed using an index. An index is an ordered set of references (e.g., pointers) to the records in the table. The index is used to access each record in the table using a key (i.e., one of the fields or attributes of the record, which corresponds to a column). The term “key” may also be referred to as “index key”. Without an index, finding a record requires a scan (e.g., linearly) of an entire table. Indexes provide an alternate technique to accessing data in a table. Users may create indexes on a table after the table is built. An index is based on one or more columns of the table.
A query may be described as a request for information from a database based on specific conditions. A query typically includes one or more predicates. A predicate may be described as an element of a search condition that expresses or implies a comparison operation (e.g., A=3). When a query is received by the RDBMS, the RDBMS executes the query.
A join may be described as an SQL relational operation that allows retrieval of data from two or more tables based on matching column values.
Tables may be archived to reduce the size of the tables by removing data that is old and/or not being accessed anymore. Reduction in size of the tables leads to better overall application performance for applications accessing the tables. Thus, archiving may be described as moving certain data from “original” tables to “archive” tables, so that the data no longer resides in the original tables, but is still available if needed in the archive tables. The typical solution to archiving multiple related tables is, for each table, joining the table being archived to all of the parent tables of that table to ensure the correct rows are being qualified for archival. A parent table may be described as a table that is related to another table (also referred to as a child table) by referential integrity (RI). Referential integrity may be described as a condition that exists when intended references from data in one column of a table to data in another column of the same or a different table are valid. Referential integrity may be enforced by DataBase Management System (DBMS) constraints (System referential integrity) or programmatically within a DBMS application (Application referential integrity). Note that a table may be a parent of one or more tables (i.e., a parent may have multiple children) and a child of one or more tables (i.e., a child may have multiple parents). Unfortunately, this solution requires multi-table database joins. Database joins are very expensive from a resource usage perspective and from a performance perspective.
In conventional systems, when archiving a set of related tables (also referred to as an “archive unit”), an archive unit tree is walked from bottom to top or top to bottom. That is, the archive unit is the set of related tables to be archived, and an archive unit tree may be described as a representation of the related tables in an archive unit. The root table of an archive unit tree is a starting point table. The purpose of the archive unit is to ensure that data being archived is referentially intact. That is, the data being archived is directly or indirectly related to the rows qualified in the starting point table. Rows are qualified based on a predicate provided with a query (also referred to as a statement) requesting the archive.
As a result of walking the archive tree unit from bottom to top or top to bottom, when tables are archived within the archive tree unit, a JOIN operation is performed between the table to be archived and the parent tables of that table up to the root table in order to qualify the rows to be archived. For example, in
The following Statements (1 ), (2 ), and (3) illustrate the processing to archive the PROJ table 130.
Statement (1 ) is a sample statement that selects rows from the EMP table 110 for which the WORKDEPT column 112 has a value of D11.
Statement (2 ) is a sample statement that selects a DEPTNO column 122 value from the DEPT table 120 for each row for which the row is in the result set of Statement (1 ), and the DEPTNO column 122 value equals the WORKDEPT column 112 value. Statement (2 ) requires a join between the EMP table 110 and the DEPT table 120.
Statement (3 ) is a sample statement that selects a PROJNO column value (not shown in
Thus, conventional solutions may require many expensive joins to archive a table, and, therefore, there is a need in the art for improved archiving of tables.
Provided are a method, computer program product, and system for receiving a request to archive a child table. In response to receiving the request, a join operation is performed on the child table and parent archive data to create child archive data.
Referring now to the drawings in which like reference numbers represent corresponding parts throughout:
In the following description, reference is made to the accompanying drawings which form a part hereof and which illustrate several embodiments of the invention. It is understood that other embodiments may be utilized and structural and operational changes may be made without departing from the scope of the invention.
Embodiments avoid performing multi-table join operations when related database tables are being archived. Embodiments walk the related tables from root to leaves, creating archive data for a parent table that is then used to qualify the rows to be archived for a child table of the parent table. The archive data may be stored either in a table or as a file.
The server computer 220 includes system memory 222, which may be implemented in volatile and/or non-volatile devices. System memory 222 stores an archival system 230 and may include one or more server applications 240 and/or other components 250. The server computer 220 provides the client computer 200 with access to data in a data store 270. Data store 270 may store archived tables and the tables for which the archived tables were created.
In alternative embodiments, the computer programs may be implemented as hardware, software, or a combination of hardware and software.
The client computer 200 and server computer 220 may comprise any computing device known in the art, such as a server, mainframe, workstation, personal computer, hand held computer, laptop telephony device, network appliance, etc.
The network 290 may comprise any type of network, such as, for example, a Storage Area Network (SAN), a Local Area Network (LAN), Wide Area Network (WAN), the Internet, an Intranet, etc.
The data store 270 may comprise an array of storage devices, such as Direct Access Storage Devices (DASDs), Just a Bunch of Disks (JBOD), Redundant Array of Independent Disks (RAID), virtualization device, etc.
In block 306, the archival system 230 determines whether there are any tables remaining to be archived in the list. If so, processing continues to block 308, otherwise, processing continues to block 316. In block 308, the archival system 230 selects a child table from the list whose parent table has archive data (e.g., the parent table has been archived into a parent archive table or file). Parent archive data may be described as rows archived from a parent table, while child archive data may be described as rows archived from a child table.
In block 310, the archival system 230 generates a statement (e.g., Statement (4 )) to archive rows of the child table, and the statement includes a predicate (e.g., PROJ.depno=ARCDEPT.deptno in Statement (4 )) to qualify the rows of the child table that are to be archived. That is, the predicate is used to identify the particular rows of the child table to be archived. In certain embodiments, information to generate the predicate may be provided to the archival system 230 by a user via the user interface.
In block 312, the archival system 230 executes the generated statement to perform a join operation on the selected child table and the parent archive data to create child archive data. In particular, the archival system 230 identifies rows based on unique connection key column values using the predicate in the statement. Embodiments use the knowledge that parent archive data has the correct data qualified.
Statement (4 ) is a sample statement that joins a child table (PROJ) to a parent archive table (ARCDEPT).
In block 314, the archival system 230 stores the created child archive data in a child archive data structure. In particular, the archival system 230 inserts the identified rows into a child archive data structure (e.g., a table or file). Statement (5 ) is a sample statement that inserts rows of a child table to be archived into an archive table.
From block 314, processing continues to block 306.
In block 316, the archival system 230 creates an index for each archive data (e.g., the root archive data, each parent archive data, and each child archive data). In block 318, the archival system 230 commits changes. Committing changes may be described as releasing locks so that database changes made by that unit of work may be perceived by other processes, and committing makes the data changes permanent.
With the logic of
Although examples herein may refer to archive tables, embodiments are applicable to various archive data structures. Again,
For example, a row in the PROJ table 450 is archived based on a join between the DEPTNO column 442 in the ARCDEPT archive table 440 and the DEPTNO column 452 in the PROJ table 450. The DEPTNO columns 442, 452 from the tables 440, 450, respectively, are used in the join because they represent the connection key between the DEPT table 430 and the PROJ table 450.
With embodiments, first the EMP table 410 is archived, then the DEPT table 430 is archived, and then the PROJ table 450 is archived.
Statement (6 ) is a sample statement that selects distinct rows from the EMP table 410 for which the WORKDEPT column 412 has a value of D11.
Statement (7 ) is a sample statement that selects a distinct DEPTNO column 432 value from the DEPT table 430 for each row for which the WORKDEPT column value 422 from the ARCEMP archive table 420 equals the DEPTNO column 432 value from the DEPT table 430.
Statement (8 ) is a sample statement that selects a distinct PROJNO column value (not shown in
Thus, when comparing the SELECT Statements (6 ), (7 ), and (8 ) for the PROJ table 450 to the SELECT Statements (1 ), (2 ), and (3 ), it can be seen that embodiments provide a simpler solution, with fewer joins. In particular, one join is used to form the
Thus, embodiments avoid multi-table joins and, at most, one join between the table being archived and a parent archive table is performed. Embodiments reduce the need for resources and improve performance so that customers may get more system administration and DBMS administration activities done (e.g., in limited batch processing windows).
The described operations may be implemented as a method, computer program product or apparatus using standard programming and/or engineering techniques to produce software, firmware, hardware, or any combination thereof.
Each of the embodiments may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment containing both hardware and software elements. The embodiments may be implemented in software, which includes but is not limited to firmware, resident software, microcode, etc.
Furthermore, the embodiments may take the form of a computer program product accessible from a computer-usable or computer-readable medium providing program code for use by or in connection with a computer or any instruction execution system. For the purposes of this description, a computer-usable or computer readable medium may be any apparatus that may contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
The described operations may be implemented as code maintained in a computer-usable or computer readable medium, where a processor may read and execute the code from the computer readable medium. The medium may be an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system (or apparatus or device) or a propagation medium. Examples of a computer-readable medium include a semiconductor or solid state memory, magnetic tape, a removable computer diskette, a rigid magnetic disk, an optical disk, magnetic storage medium (e.g., hard disk drives, floppy disks, tape, etc.), volatile and non-volatile memory devices (e.g., a random access memory (RAM), DRAMs, SRAMs, a read-only memory (ROM), PROMs, EEPROMs, Flash Memory, firmware, programmable logic, etc.). Current examples of optical disks include compact disk—read only memory (CD-ROM), compact disk—read/write (CD-R/W) and DVD.
The code implementing the described operations may further be implemented in hardware logic (e.g., an integrated circuit chip, Programmable Gate Array (PGA), Application Specific Integrated Circuit (ASIC), etc.). Still further, the code implementing the described operations may be implemented in “transmission signals”, where transmission signals may propagate through space or through a transmission media, such as an optical fiber, copper wire, etc. The transmission signals in which the code or logic is encoded may further comprise a wireless signal, satellite transmission, radio waves, infrared signals, Bluetooth, etc. The transmission signals in which the code or logic is encoded is capable of being transmitted by a transmitting station and received by a receiving station, where the code or logic encoded in the transmission signal may be decoded and stored in hardware or a computer readable medium at the receiving and transmitting stations or devices.
A computer program product may comprise computer useable or computer readable media, hardware logic, and/or transmission signals in which code may be implemented. Of course, those skilled in the art will recognize that many modifications may be made to this configuration without departing from the scope of the embodiments, and that the computer program product may comprise any suitable information bearing medium known in the art.
The term logic may include, by way of example, software, hardware, firmware, and/or combinations of software and hardware.
Certain implementations may be directed to a method for deploying computing infrastructure by a person or automated processing integrating computer-readable code into a computing system, wherein the code in combination with the computing system is enabled to perform the operations of the described implementations.
The logic of
The illustrated logic of
Input/Output (I/O) devices 512, 514 (including but not limited to keyboards, displays, pointing devices, etc.) may be coupled to the system either directly or through intervening I/O controllers 510.
Network adapters 508 may also be coupled to the system to enable the data processing system to become coupled to other data processing systems or remote printers or storage devices through intervening private or public networks. Modems, cable modem and Ethernet cards are just a few of the currently available types of network adapters 508.
The system architecture 500 may be coupled to storage 516 (e.g., a non-volatile storage area, such as magnetic disk drives, optical disk drives, a tape drive, etc.). The storage 516 may comprise an internal storage device or an attached or network accessible storage. Computer programs 506 in storage 516 may be loaded into the memory elements 504 and executed by a processor 502.
The system architecture 500 may include fewer components than illustrated, additional components not illustrated herein, or some combination of the components illustrated and additional components. The system architecture 500 may comprise any computing device known in the art, such as a mainframe, server, personal computer, workstation, laptop, handheld computer, telephony device, network appliance, virtualization device, storage controller, etc.
The foregoing description of embodiments of the invention has been presented for the purposes of illustration and description. It is not intended to be exhaustive or to limit the embodiments to the precise form disclosed. Many modifications and variations are possible in light of the above teaching. It is intended that the scope of the embodiments be limited not by this detailed description, but rather by the claims appended hereto. The above specification, examples and data provide a complete description of the manufacture and use of the composition of the embodiments. Since many embodiments may be made without departing from the spirit and scope of the embodiments, the embodiments reside in the claims hereinafter appended or any subsequently-filed claims, and their equivalents.
