Patent Application
20120185658
1. Technical Field
The present invention relates to computer system management or storage system management. More specifically, it relates to a method and apparatus for maintaining a queue of available pages of a main store of a computer system, so as to provide a steady stream of input/output (I/O) operations to a backing store of the computer system.
2. Background Information
A computer system usually has a main store and a backing store. The main store, also known as the main storage, main memory or primary store, is a storage device closely associated with the processor of the computer system, and from which program instructions and data can be retrieved rapidly and copied directly into the processor registers, and in which the resulting data is stored prior to being transferred to the backing store. An example of the main store is the RAM (Random Access Memory). The main store usually stores data waiting processing, being processed, or resulted from processing. The backing store of a computer system, on the other hand, has a much larger storage capacity, is less expensive, and usually provides slower access than the main store, for storing instructions or data received from the main store. A disk subsystem of the computer system is an example of the backing store.
The main store of a computer system is composed of a number of pages, which is the unit of interchange between the main store and the backing store. A page includes a fixed number of words or bytes for a given computer system, and is used to keep, for exchanging between the main store and the backing store, program instructions, data or both.
For many applications, a write operation of a computer system requires two steps: a processing step for processing the data associated with a write request, and a writing step to write the processed data to the backing store. For example, for data security purposes, many users of a computer system require that the data on the backing store (e.g. the disk media) to be encrypted. As such, the user data have to be processed (i.e. encrypted) in the main store and then sent to the backing store. However, a piece of data cannot be encrypted “in place” in the main store, because doing so would prevent other applications of the computer system from using the piece of data both during the processing step (i.e. the entire encryption process in the main store), and during the writing step (i.e. the process of write the encrypted data to the backing store). Therefore, the piece of data, of one page in the main store, is usually encrypted into another page in the main store, which can be subsequently sent, via DMA (Direct Memory Access), to the backing store such as the disk subsystem, as illustrated in
A method for performing a write operation on a computer system having a main store, including a plurality of pages, and a backing store, the write operation including a processing step for processing data of the write operation and a writing step for writing the processed data to the backing store. The method includes reserving a set of pages, among the plurality of pages, in the main store, retrieving a required number of pages from the reserved set in accordance with the size of the data, processing the required number of pages of the data using the retrieved pages, writing the processed data to the backing store, and returning the retrieved pages to the reserved set upon finishing the writing.
The invention will now be described in more detail by way of example with reference to the embodiments shown in the accompanying Figures. It should be kept in mind that the following described embodiments are only presented by way of example and should not be construed as limiting the inventive concept to any particular physical configuration. Further, if used and unless otherwise stated, the terms “upper,” “lower,” “front,” “back,” “over,” “under,” and similar such terms are not to be construed as limiting the invention to a particular orientation. Instead, these terms are used only on a relative basis.
As will be appreciated by one skilled in the art, the present invention may be embodied as a system, method or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a “circuit,” “module” or “system.” Furthermore, the present invention may take the form of a computer program product embodied in any tangible medium of expression having computer-usable program code embodied in the medium.
Any combination of one or more computer usable or computer readable media may be utilized. The computer-usable or computer-readable medium may be, for example but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, device, or propagation medium. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a transmission media such as those supporting the Internet or an intranet, or a magnetic storage device. Note that the computer-usable or computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via, for instance, optical scanning of the paper or other medium, then compiled, interpreted, or otherwise processed in a suitable manner, if necessary, and then stored in a computer memory. In the context of this document, a computer-usable or computer-readable medium may be any medium that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. The computer-usable medium may include a propagated data signal with the computer-usable program code embodied therewith, either in baseband or as part of a carrier wave. The computer usable program code may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc.
Computer program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the “C” programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).
The present invention is described below with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable medium that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable medium produce an article of manufacture including instruction means which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In one embodiment of the present invention, rather than serializing the I/O operations waiting for main store pages so that data can be encrypted into the main store pages, a queue of available pages (QOAP) may be used to maintain the I/O operations (specifically, write operations) flowing to the disk subsystem, so as to improve the writing and encryption performance and to avoid deadlocks.
In one embodiment of the invention as illustrated in
In one embodiment of the invention, as illustrated in
However, if M is larger than N, the main store pages reserved for each I/O request is not sufficient for finishing the requested operation. If so, a main store page shortage, i.e. the difference between M and N, is calculated and compared to the number m of the maximum available main store pages in the QOAP 200 (step 420).
If m is larger than or equal to the main storage page shortage (M−N), the QOAP 200 can provide enough main store pages for finishing the writing request. Therefore, a number (M−N) of main store pages are de-queued from the QOAP 200 (step 421), the corresponding user data is encrypted into the (M−N) pages (step 422) as well as the N pages associated with each I/O request (step 423), and then the write operation is issued to the disk subsystem (step 424). At the completion of the write operation, the (M—N) main store pages are returned to the QOAP 200 (step 425).
However, if m is smaller than the main storage page shortage (M−N), and accordingly the QOAP 200 cannot provide enough main store pages for finishing the writing request, the m main store pages in the QOAP 200 are de-queued (step 431), (m+N) pages of the user data are encrypted into the m main store pages (step 432) as well as the N pages associated with the write operation (step 433), and then the write operation is issued to the disk subsystem (step 434). Upon the completion of the write operation, the m main store pages are returned to the QOAP 200 (step 435), and another write request with M=(M−N−m) pages is created (step 436), and the process restarts from step 410.
The computer system also includes input/output ports (530) to input signals to couple the computer system. Such coupling may include direct electrical connections, wireless connections, networked connections, etc., for implementing automatic control functions, remote control functions, etc. Suitable interface cards may be installed to provide the necessary functions and signal levels.
The computer system may also include special purpose logic devices (e.g., application specific integrated circuits (ASICs)) or configurable logic devices (e.g., generic array of logic (GAL) or re-programmable field programmable gate arrays (FPGAs)), which may be employed to replace the functions of any part or all of the method as described with reference to
The computer system may be coupled via bus (504) to a display (514), such as a cathode ray tube (CRT), liquid crystal display (LCD), voice synthesis hardware and/or software, etc., for displaying and/or providing information to a computer user. The display may be controlled by a display or graphics card. The computer system includes input devices (516), such as a keyboard and a cursor control (518), for communicating information and command selections to processor (506). Such command selections can be implemented via voice recognition hardware and/or software functioning as the input devices (516). The cursor control (518), for example, is a mouse, a trackball, cursor direction keys, touch screen display, optical character recognition hardware and/or software, etc., for communicating direction information and command selections to processor (506) and for controlling cursor movement on the display (514). In addition, a printer (not shown) may provide printed listings of the data structures, information, etc., or any other data stored and/or generated by the computer system.
The computer system performs a portion or all of the processing steps of the invention in response to processor executing one or more sequences of one or more instructions contained in a memory, such as the main memory. Such instructions may be read into the main memory from another computer readable medium, such as storage device. One or more processors in a multi-processing arrangement may also be employed to execute the sequences of instructions contained in main memory. In alternative embodiments, hard-wired circuitry may be used in place of or in combination with software instructions. Thus, embodiments are not limited to any specific combination of hardware circuitry and software.
The computer code devices of the present invention may be any interpreted or executable code mechanism, including but not limited to scripts, interpreters, dynamic link libraries, Java classes, and complete executable programs. Moreover, parts of the processing of the present invention may be distributed for better performance, reliability, and/or cost.
The computer system also includes a communication interface (520) coupled to bus. The communication interface (520) provides a two-way data communication coupling to a network link (522) that may be connected to, for example, a local network (524). For example, the communication interface (520) may be a network interface card to attach to any packet switched local area network (LAN). As another example, the communication interface (520) may be an asymmetrical digital subscriber line (ADSL) card, an integrated services digital network (ISDN) card or a modem to provide a data communication connection to a corresponding type of telephone line. Wireless links may also be implemented via the communication interface (520). In any such implementation, the communication interface (520) sends and receives electrical, electromagnetic or optical signals that carry digital data streams representing various types of information.
Network link (522) typically provides data communication through one or more networks to other data devices. For example, the network link may provide a connection to a computer (528) through local network (524) (e.g., a LAN) or through equipment operated by a service provider, which provides communication services through a communications network (526). In preferred embodiments, the local network and the communications network preferably use electrical, electromagnetic, or optical signals that carry digital data streams. The signals through the various networks and the signals on the network link and through the communication interface, which carry the digital data to and from the computer system, are exemplary forms of carrier waves transporting the information. The computer system can transmit notifications and receive data, including program code, through the network(s), the network link and the communication interface.
It should be understood, that the invention is not necessarily limited to the specific process, arrangement, materials and components shown and described above, but may be susceptible to numerous variations within the scope of the invention.
