The present disclosure relates generally to the field of data processing, and more particularly to methods and related apparatus to use unmapped cache for interprocess communication.
A process in a computer system may generate multiple threads of execution (“threads”). A thread is an execution unit that includes a set of instructions to be executed by a processing unit. The term “interprocess communication” (IPC) refers to the exchange of data between two or more threads in one or more processes. Thus, despite the name, the term IPC generally pertains to communication between threads, which may also happen to belong to different processes. Some techniques for IPC includes functions or methods for (a) message passing, (b) synchronization, (c) shared memory, and (d) remote procedure calls (RPC).
Multiprocessor systems include traditional symmetric multiprocessor (SMP) systems, as well multicore systems, in which two or more cores are packaged together on the die or in the processor package. Inside a multiprocessor system, interprocess communication usually goes through the shared memory segment or directly from one process memory to another process memory.
A shared memory segment is a portion of random access memory (RAM) that can be accessed by more than one process. In a conventional processing system, the shared memory segment is written and read from user-space, without any sort of kernel-mediated synchronization. By contrast, communication directly from one process memory to another process memory typically requires the presence of a kernel agent or another special operating system (OS) extension, and a corresponding application programming interface (API).
Conventional processing systems have RAM write-back coupling, in that data which is written to cache memory eventually gets written back to RAM.
Features and advantages of the present invention will become apparent from the appended claims, the following detailed description of one or more example embodiments, and the corresponding figures, in which:
CPU 22 may include two or more processing units, such as processing unit 21 and processing unit 23. Alternatively, a processing system may include a CPU with one processing unit, or multiple processors, each having at least one processing unit. The processing units may be implemented as processing cores, as Hyper-Threading (HT) technology, or as any other suitable technology for executing multiple threads simultaneously or substantially simultaneously.
Processor 22 may also include cache memory 46, cache write-back logic (CWL) 47, and cache unmapping logic (CUL) 48.
As used herein, the terms “processing system” and “data processing system” are intended to broadly encompass a single machine, or a system of communicatively coupled machines or devices operating together. Example processing systems include, without limitation, distributed computing systems, supercomputers, high-performance computing systems, computing clusters, mainframe computers, mini-computers, client-server systems, personal computers (PCs), workstations, servers, portable computers, laptop computers, tablet computers, personal digital assistants (PDAs), telephones, handheld devices, entertainment devices such as audio and/or video devices, and other devices for processing and/or transmitting information.
Processing system 20 may be controlled, at least in part, by input from conventional input devices, such as a keyboard, a pointing device such as a mouse, etc. Processing system 20 may also respond to directives received from other processing systems or other input sources or signals. Processing system 20 may utilize one or more connections to one or more remote data processing systems 70, for example through a network interface controller (NIC) 32, a modem, or other communication ports or couplings. Processing systems may be interconnected by way of a physical and/or logical network 72, such as a local area network (LAN), a wide area network (WAN), an intranet, the Internet, etc. Communications involving network 72 may utilize various wired and/or wireless short range or long range carriers and protocols, including radio frequency (RF), satellite, microwave, Institute of Electrical and Electronics Engineers (IEEE) 802.11, 802.16, 802.20, Bluetooth, optical, infrared, cable, laser, etc. Protocols for 802.11 may also be referred to as wireless fidelity (WiFi) protocols. Protocols for 802.16 may also be referred to as WiMAX or wireless metropolitan area network protocols. Information on WiMAX protocols is currently available at grouper.ieee.org/groups/802/16/published.html.
Within processing system 20, processor 22 may be communicatively coupled to one or more volatile data storage devices, such as random access memory (RAM) 26, and to one or more nonvolatile data storage devices. In the example embodiment, the nonvolatile data storage devices include flash memory 27 and hard disk drive 28. In alternative embodiments, multiple nonvolatile memory devices and/or multiple disk drives may be used for nonvolatile storage. Suitable nonvolatile storage devices and/or media may include, without limitation, integrated drive electronics (IDE) and small computer system interface (SCSI) hard drives, optical storage, tapes, floppy disks, read-only memory (ROM), memory sticks, digital video disks (DVDs), biological storage, polymer memory, etc.
As used herein, the term “nonvolatile storage” refers to disk drives, flash memory, and any other storage component that can retain data when the processing system is powered off. And more specifically, the term “nonvolatile memory” refers to memory devices (e.g., flash memory) that do not use rotating media but still can retain data when the processing system is powered off. The terms “flash memory” and “ROM” are used herein to refer broadly to nonvolatile memory devices such as erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash ROM, etc.
Processor 22 may also be communicatively coupled to additional components, such as NIC 32, video controllers, IDE controllers, SCSI controllers, universal serial bus (USB) controllers, input/output (I/O) ports, input devices, output devices, etc. Processing system 20 may also include a chipset 34 with one or more bridges or hubs, such as a memory controller hub, an I/O controller hub, a PCI root bridge, etc., for communicatively coupling system components.
Some components, such as NIC 32, for example, may be implemented as adapter cards with interfaces (e.g., a PCI connector) for communicating with a bus. Alternatively, NIC 32 and/or other devices may be implemented as embedded controllers, using components such as programmable or non-programmable logic devices or arrays, application-specific integrated circuits (ASICs), embedded computers, smart cards, etc.
The invention is described herein with reference to or in conjunction with data such as instructions, functions, procedures, data structures, application programs, configuration settings, etc. When the data is accessed by a machine, the machine may respond by performing tasks, defining abstract data types or low-level hardware contexts, and/or performing other operations, as described in greater detail below. The data may be stored in volatile and/or nonvolatile data storage.
As used herein, the term “program” covers a broad range of software components and constructs, including applications, modules, drivers, routines, subprograms, methods, processes, threads, and other types of software components. Also, the term “program” can be used to refer to a complete compilation unit (i.e., a set of instructions that can be compiled independently), a collection of compilation units, or a portion of a compilation unit. Thus, the term “program” may be used to refer to any collection of instructions which, when executed by a processing system, perform a desired operation or operations.
The programs in processing system 20 may be considered components of a software environment 84. For instance, data storage device 28 and/or flash memory 27 may include various sets of instructions which, when executed, perform various operations. Such sets of instructions may be referred to in general as software.
As illustrated in
As indicated above, shared memory segments may be used for interprocess communication (IPC).
In the embodiment of
In one example embodiment, to create a shared memory segment that is not mapped to RAM 26, a predetermined flag, parameter, or reserved word is passed to a memory map system call (e.g., mmap(2)), along with size information and any other necessary information. Thus, programs may easily place shared memory segments into unmapped cache. For purposes of this disclosure, the term “unmapped cache” is used to refer to a shared memory segment that can be accessed in cache memory, even though it is not mapped to RAM. Unmapped cache may also be referred to as a shared, unmapped memory segment.
The instruction or instructions that are used to create a shared, unmapped memory segment may be referred to as an unmap request. Other techniques may be used to implement unmap requests in alternative embodiments, including without limitation (a) a system call, (b) a special, dedicated, unmap instruction, (c) a new prefix or suffix for an existing instruction, (d) a control register that can be set to a particular value to cause the desired behavior when a conventional instruction (e.g., move or MOV) is executed.
In the embodiment of
In the embodiment of
If the communicating processes are assigned to different processing units, cache memory that is shared by those processing units may be used for the unmapped cache. If the communicating processes are assigned to a single processor, the unmapped cache may reside in cache memory which is not accessible to other processors.
Other processes that want to communicate with the given process through the unmapped cache need to perform similar actions, asking for an unmapped cache to be allocated. Common means of associating different memory segments, for example, the use of identical or similar names or labels for the unmapped cache segments, can be used to associate with each other the unmapped cache segments created by different processes. For instance, to enable communications between a first thread and a second thread, the first thread could allocate unmapped cache with the segment name “my_cache_segment—1”, and the second thread could allocate unmapped cache with the same segment name. OS 50 could then enable the first and second threads to share data in that segment, while CUL 48 could prevent that data from being written back to RAM 26. This name should be unique for the pair (or group) of processes that wants to communicate via this unmapped cache segment. Also, if unmapped cache is used within one address space (e.g., between two threads in the same process), only one of the threads needs to call mmap( ), and no special operations are necessary for unmapping cache by the other thread.
Once the unmapped cache memory segment has been established, the process may use that memory segment to communicate with one or more additional processes, as indicated at block 120. For instance, the first process could save data to the unmapped cache, and the second process could read data from the unmapped cache. Processes may use any suitable message passing technique or techniques to coordinate access to the unmapped cache.
As depicted at block 130 and 132, once the first process determines that no further IPC is required, the first process may free the unmapped cache, for example, through the munmap(2) system call.
In one embodiment, the unmapped cache uses a more or less conventional double buffering algorithm, which may result in bandwidth higher than that achieved through the use of the direct interprocess memory copy via a special kernel agent or another OS extension. For instance, the double buffering may asymptotically achieve full memory bandwidth. Furthermore, the absence of the RAM write-back and bus contention may improve bandwidth for medium-sized messages. In addition, the use of the unmapped cache for IPC may result in lower message latency, due to the elimination of the RAM write-back delay.
The embodiments described above may eliminate the extra latency and bus traffic required to write back into RAM data that is essentially transient in nature. The embodiments may eliminate the need for a special kernel agent or OS extension beyond, for instance, a trivial extension of the mmap(2) system call that can be standardized across different OSs.
As has been described, at least one embodiment allows processes in a processing system to conduct IPC via cache memory, while keeping the processing system from writing the associated cache data back into RAM. Accordingly, message passing transactions may be completed without causing memory bus traffic.
In light of the principles and example embodiments described and illustrated herein, it will be recognized that the described embodiments can be modified in arrangement and detail without departing from such principles. For instance, although one embodiment is described above as using a hard disk and flash memory as nonvolatile storage, alternative embodiments may use only the hard disk, only flash memory, only some other kind of nonvolatile storage, or any suitable combination of nonvolatile storage technologies.
Also, although the foregoing discussion has focused on particular embodiments, other configurations are contemplated as well. Even though expressions such as “in one embodiment,” “in another embodiment,” or the like are used herein, these phrases are meant to generally reference embodiment possibilities, and are not intended to limit the invention to particular embodiment configurations. As used herein, these terms may reference the same or different embodiments that are combinable into other embodiments.
Similarly, although example processes have been described with regard to particular operations performed in a particular sequence, numerous modifications could be applied to those processes to derive numerous alternative embodiments of the present invention. For example, alternative embodiments may include processes that use fewer than all of the disclosed operations, processes that use additional operations, processes that use the same operations in a different sequence, and processes in which the individual operations disclosed herein are combined, subdivided, or otherwise altered.
Alternative embodiments of the invention also include machine accessible media encoding instructions for performing the operations of the invention. Such embodiments may also be referred to as program products. Such machine accessible media may include, without limitation, storage media such as floppy disks, hard disks, CD-ROMs, ROM, and RAM; and other detectable arrangements of particles manufactured or formed by a machine or device. Instructions may also be used in a distributed environment, and may be stored locally and/or remotely for access by single or multi-processor machines.
It should also be understood that the hardware and software components depicted herein represent functional elements that are reasonably self-contained so that each can be designed, constructed, or updated substantially independently of the others. In alternative embodiments, many of the components may be implemented as hardware, software, or combinations of hardware and software for providing the functionality described and illustrated herein. The hardware, software, or combinations of hardware and software for performing the operations of the invention may also be referred to as logic or control logic.
In view of the wide variety of useful permutations that may be readily derived from the example embodiments described herein, this detailed description is intended to be illustrative only, and should not be taken as limiting the scope of the invention. What is claimed as the invention, therefore, is all implementations that come within the scope and spirit of the following claims and all equivalents to such implementations.