Patent Application
20120185628
Multi-processor (i.e. multiple CPUs (Central Processing Unit)) systems may operate in different modes. For example, a multi-processor system may operate in a lock-step (safety) mode or in a non-lock-step (performance) mode. Lock-step mode is used to achieve high diagnostic ability. In lock-step mode, one or more processors (CPUs) perform the same operations. For example, when two processors are operating in the lock-step mode, they are initialized to the same state during system start-up, and they receive the same inputs (Le, code, bus operations and asynchronous events). As a consequence, during lock-step mode, the state of the two processors is identical from clock to clock when no errors occur.
However, when an error occurs in either processor between the states of two processors, differences in the behavior may be detected by comparing signals at key places (e.g. data buses and address buses) in the multi-processor system. In the lockstep mode, the multi-processor system monitors signals at key places and flags an error when there is a discrepancy.
In performance mode, the processors in a multi-processor system may be used to execute a single sequence of instructions in multiple contexts (single-instruction, multiple-data (SIMD)) or multiple sequences of instructions in multiple contexts (multiple-instruction, multiple-data (MIMD)). SIMD multiprocessing is well suited to parallel or vector processing, in which a very large set of data can be divided into parts that are individually subjected to identical but independent operations. A single instruction stream directs the operation of multiple CPUs to perform the same manipulations simultaneously on potentially large amounts of data.
MIMD multiprocessing is suitable for a wide variety of tasks in which completely independent and parallel execution of instructions touching different sets of data can be put to productive use. Processing may be divided into multiple threads, each with its own hardware processor state, within a single software-defined process or within multiple processes. Insofar as a system has multiple threads awaiting dispatch (either system or user threads), this architecture makes good use of hardware resources.
A multi-processor system, such as a system-on-a-chip (SOC) or an embedded system, may contain digital, analog, mixed-signal and often radio-frequency functions, all on a single chip substrate. An SOC or embedded system is a multi-processor system often used to perform one or a few dedicated functions. Often these dedicated functions have real-time computing constraints where safety is an issue. For example, an SOC or an embedded system may be used to control the braking of an automobile.
Therefore, it is important that a multi-processor system may be switched from a safety mode to a performance or from a performance mode to a safety mode. When there is a demand for data integrity, such as in the safety mode, the multi-processor system may be switched to the safety mode. When there is a demand for performance and data integrity is less important, the multi-processor system may be switched to the performance mode. When the multi-processor system switches modes, it is important that the operating system (OS) switch cleanly between the modes with as little time delay as possible.
The drawings and description, in general, disclose a method and system of changing from a performance mode to a safety mode and from a safety mode to a performance mode in a multi-processor system while software continues to operate. In one embodiment, an external event or exception causes the multi-processor system to change from a performance mode to a safety mode. After the external event or exception occurs, the context of the processors (CPUs) in the performance mode is saved in memory and the context of the safety mode is loaded in two or more of the processors.
Next two or more processors are synchronized in order to operate in the safety (lock-step) mode. Part of the process of synchronizing two or more processors includes suspending execution of the processors, resetting parts of each processor (e.g. an PFU (prefetch unit) or an RTU (return stack unit)), and resetting a compare unit. After the processors are synchronized, the processors are released and they are now in lock-step.
Any of the processors, 104-110, may write and read data from the memories 112 and 114 and the I/O devices 116 and 118. In a multi-processor system 100 as shown in
A multi-processor system 100 may multi-task. Multi-tasking is a method by which multiple tasks, also known as processes, share common processing resources such as CPUs and memory. A process is an instance of a computer program that is being executed. It contains the program code and its current activity. Depending on the operating system (OS), a process may be made up of multiple threads of execution that execute instructions concurrently. In the case of a computer with a single CPU, only one task is said to be running at any point in time, meaning that the CPU is actively executing instructions for that task.
Multitasking schedules which task may be the one running at any given time, and when another waiting task gets a turn. Scheduling refers to the way processes are assigned to run on the available CPUs, since there are typically many more processes running than there are available CPUs. This assignment is carried out by software known as a scheduler and dispatcher. The act of reassigning a CPU from one task to another one is called a context switch.
A context switch is the process of storing and restoring the state (context) of a CPU so that execution can be resumed from the same point at a later time. Context switches are usually computationally intensive and much of the design of operating systems is to optimize the use of context switches. A context switch can mean a register context switch, a task context switch, a thread context switch, or a process context switch. What constitutes the context is determined by the processor and the operating system. Switching from one process to another requires a certain amount of time for doing the administration (i.e. saving and loading registers and memory maps, updating various tables and list etc.).
There are at least two situations where a context switch occurs. For example, a context switch may occur during multitasking as described above or during interrupt handling. Most modern computer architectures are interrupt driven. An interrupt is an asynchronous signal indicating the need for attention or a synchronous event in software indicating the need for a change in execution. A hardware interrupt causes the processor to save its state of execution and begin execution of an interrupt handler. Software interrupts are usually implemented as instructions in the instruction set, which cause a context switch to an interrupt handler similar to a hardware interrupt. An act of interrupting is referred to as an interrupt request (IRQ).
As mentioned above, the state of the process (context) may include all the registers that the process may be using, especially the program counter, plus any other operating system specific data that may be necessary. This data is usually stored in a data structure called a process control block (PCB), or a switchframe. The PCBs are sometimes stored upon a per-process stack in memory or there may be some specific operating system defined data structure for this information.
A typical stack is an area of computer memory with a fixed origin and a variable size. Initially the size of the stack is zero. A stack pointer (SP), usually in the form of a hardware register, points to the most recently referenced location on the stack; when the stack has a size of zero, the stack pointer points to the origin of the stack. A stack usually has two operations: a push operation in which a data item is placed at the location pointed to by a stack pointer, and the address in the stack pointer is adjusted by the size of the data item and a push or pop operation, in which a data item is placed at the location pointed to by the stack pointer, and the address in the stack pointer adjusted by the size of the data item.
There are many variations on the basic principle of stack operations. However, every stack usually has a fixed location in memory at which it begins. As data items are added to the stack, the stack pointer is displaced to indicate the current extent of the stack, which expands away from the origin.
Any of the processors, 304-310, may write and read data from the memories 312 and 314 and the I/O devices 316 and 318. In a multi-processor system 300 as shown in
Data from a cache in a particular CPU may be used in another CPU using cache-forwarding. For example, if CPU1 needs the data from CPU4's cache and CPU3 has a copy of that data, then CPU3 will send that data to CPU1 in response to a snoop it received and CPU4 will counter check that data in the next cycle. This results in high speed and efficient data transfer between the processors. Cache-forwarding is also useful during operation in the safety mode.
The interrupt may also be an IRQ (interrupt request), an NMI (non-maskable interrupt) or an IPI (inter-processor interrupt). An NMI is a hardware interrupt that lacks an associated bit-mask, so that it can never be ignored. NMIs are often used for timers, especially watchdog timers. An inter-processor interrupt (IPI) is a special case that is generated by one processor to interrupt another processor in a multi-processor system.
During step 404, context is switched from the performance mode to the safety mode. A context switch is the process of storing and restoring the state (context) of a CPU so that execution can be resumed from the same point at a later time. In this embodiment, the performance mode context of each CPU is stored in a memory location in the multi-processor system. The memory location may be a stack. The performance mode context also includes a stack pointer for each CPU.
Next, the safety mode context is loaded from memory in the multi-processor system. The safety mode context may be loaded from a shack. The safety mode context is loaded into at least two CPUs. The safety mode may also be run with more than two CPUs having the same context. The same software is run on all the CPUs that are running in lock-step.
During synchronization, step 406, of the CPUs running in the safety mode, the execution of each CPU is suspended while parts of each CPU is reset. For example, the PFU (pre-fetch unit) and the RTU (return stack unit) may be reset. Synchronization also includes resetting a compare unit, engaging the compare unit and a cache from a first CPU with a second CPU, and finally starting execution of each CPU used in safety mode. During the method shown in
During step 504, context is switched from the safety mode to the performance mode. In this embodiment, the safety mode context of each CPU is stored in a memory location in the multi-processor system. The memory location may be a shack. The safety mode context also includes a stack pointer for each CPU. Next, the performance mode context is loaded from memory in the multi-processor system. In one embodiment of the invention, the location of the performance mode context may be found by looking in each ID (identification) register of each CPU. After the location of each performance mode context is found, a performance mode context is loaded into each CPU. The performance mode context may be loaded from a shack.
During step 506, locked CPUs are unlocked from each other and the compare unit is notified to stop lock-step execution. After disengaging the compare unit, cache-forwarding is disengaged. At this point the multi-processor system is operating in the performance mode. During the method shown in
The foregoing description has been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form disclosed, and other modifications and variations may be possible in light of the above teachings. The embodiments were chosen and described in order to best explain the applicable principles and their practical application to thereby enable others skilled in the art to best utilize various embodiments and various modifications as are suited to the particular use contemplated. It is intended that the appended claims be construed to include other alternative embodiments except insofar as limited by the prior art.
