The present disclosure is directed to computing systems generally, and in one embodiment, a mechanism for providing enhanced per die per performance state information.
Advanced Configuration and Power Interface (ACPI) is a body of power management software, typically integrated with or integrated to work closely with, an operating system (OS) of a computer. ACPI provides for the definition of “performance states”, e.g., P0 through P5, that define performance levels of an operating (as opposed to sleeping) computer system. Each performance state typically defines a specific operating frequency of the computing system's underlying processor. As is known in the art, the performance level (and power consumption) of a processor correlates with its operating frequency. Essentially, the faster a processor operates, the more work it can do in a specific time period (higher performance level) and the more power it consumes.
Typically, a system manufacturer integrates a computer's ACPI software and processor together and defines the specific performance states for the processor through the BIOS firmware of the system. That is, definitions of the specific ACPI performance states together with the corresponding processor frequency of each performance state are stored in BIOS firmware. During boot-up of the system, the performance state information is read from BIOS firmware. During operation of the computer, the ACPI power management software uses the information to cause appropriate performance state transitions by issuing commands that change the processor's frequency.
Typically, the ACPI power management software monitors the workload of the processor. If the workload becomes extremely heavy, the ACPI power management software will issue a command that causes the processor to switch to its highest supported operating frequency/performance state (e.g., P0). If the workload becomes very light but not non-existent, the ACPI power management software will issue a command that causes the processor to switch to the lowest frequency at which it can still execute application software (e.g., P5).
The present invention is illustrated by way of example and not limitation in the figures of the accompanying drawings, in which like references indicate similar elements and in which:
The two highest ACPI performance states of a computing system, P0 and P1 (where P0 is a higher performance state than P1), are presently implemented in a manner that makes accurate and refined power consumption control difficult. Specifically, as presently implemented, the frequency of the P1 performance state is physically stamped on the processor. The P1 frequency that is stamped on the device corresponds to the frequency at which no critical power consumption or thermal limits are exceeded under most real workloads.
A problem is that the processor can support multiple different configurations, and, the P1 frequency that is stamped on the device only assumes one of these. A typical processor has interfaces not only to system memory but also to I/O. For example, a typical processor may have M system memory links and N I/O links. Each link may also have its own associated, configurable speed (e.g., as a function of the operating frequency of the processor). Processors designed to support multi-processor implementations may also have additional links to support data consistency processor to processor (chip-to-chip) interconnections. Such processors are typically multi-core processors, and, these additional links serve as off-chip core-to-core or core-to-multicore communications (e.g., for MESI protocol data consistency communications, etc.).
Moreover, certain processors may include specialized hardware, e.g., one or more “accelerators”, that perform specific, often numerically intensive functions so that these same functions need not be implemented with (e.g.,) hundreds of instructions executed on a general purpose core. The accelerators are typically coupled to one or more general purpose processing cores on the same semiconductor die as the processing cores. Depending on processor architecture, accelerators may be dedicated to a specific core, or, multiple cores may share an accelerator. The specialized functions offered by accelerators, however, are not necessarily enabled depending on the application of the system that the processor is integrated within. For example, an accelerator designed to perform specific complex financial calculations will probably not be enabled if the processor's larger system is not directed to a financial application.
To finalize the train of thought then, the actual power consumption of the processor for a given processor operating frequency can be significantly affected by the number of links that are enabled and the corresponding speed that is set for each link as well as the number of accelerators that are enabled for the processor for the specific applications that the processor is expected to process.
If the actual configuration of the processor is more power hungry than what was “assumed” for the determination of the P1 frequency, and, the system uses the P1 frequency that is stamped on the device as the processor frequency for the system's P1 performance state, the P1 frequency as implemented in all likelihood will cause the processor to exceed critical thresholds under the workloads it processes. Contra-wise, if the actual configuration of the processor is less power hungry than what was “assumed” for the determination of the P1 frequency, and, the system uses the P1 frequency that is stamped on the device as the processor frequency for the system's P1 performance state, the P1 frequency as implemented, in all likelihood, will cause the processor to operate well under a performance level it could otherwise acceptably operate at. As such, the effect that real workloads will have, whether approaching critical thresholds or even exceeding them, is not determinable pre runtime.
In the case of the P0 state, normally, the ACPI software is designed to permit the processor to exceed the P1 frequency provided that critical temperature and/or power consumption thresholds of the device are not exceeded. In this case, the ACPI decisions concerning when to bring the processor from the P1 state to the P0 state, when to bring the processor from the P0 state to the P1 state, and, what specific processor frequency to use during the P0 state are all run-time decisions made by the ACPI. The net problematic effect is similar to that discussed above for the P1 state. Namely, the true performance of the processor in the P0 performance state is indeterminable pre runtime.
Indeterminable processor performance levels can result in difficulties presented to system designers when trying to guarantee or otherwise specify the actual performance levels of the system itself.
As such, an approach is disclosed herein in which substantially more information is provided about the device concerning appropriate operating frequencies for specific configurations. Specifically, in an embodiment for an ACPI system, a P1 frequency is provided for each of a number of different configurations of the device. Said another way, rather than—as in the prior art—having a single frequency being specified as being appropriate for a particular performance state, instead, multiple frequencies are specified for the device for a same performance state, where, a particular one of the specified frequencies is selected as appropriate based on, at least in part, the processor's configuration.
As such, when a specific configuration of the processor is established by the system designer, and/or, when a specific configuration of the processor is established in the field by the user after receiving the system from the system designer, an appropriate P1 frequency for that specific configuration may be found within BIOS firmware. The ACPI power management software can then use an appropriate “configuration-specific” P1 frequency to implement its power management scheme, e.g., at least for the P1 and P0 states, that is much better tuned to the specific system than what would have otherwise been specified with the prior art approach.
Here, each entry of field 101 corresponds to a different combination of enabled/disabled accelerators. For example, if a processor has four accelerators A, B, C, D, a first entry may correspond to all four accelerators being enabled, a second entry may correspond to all accelerators except accelerator A being enabled, etc. through every other possible combination (one entry per combination) including all accelerators being disabled. A similar explanation can be provided for each of fields 102-108. In the case of the interface speeds, there may be a different speed entry for each different speed supported by the interface.
Although not depicted in
The P1 frequencies that vary as a function of temperature for a same configuration may be made available, for instance, to provide for the different kinds of cooling systems that may exist within the different kinds of systems that the processor may be designed into. For example, column 109_3 may be more appropriate for systems having high end cooling (and can therefore keep die temperatures down near T3), while, column 109_1 may be more appropriate for systems having low end cooling (which can only keep die temperatures down to T1 (where T1>T3)).
The format of
Note that in various embodiments, various entries may be excluded. Even further, whole criteria (e.g., number of I/O links, I/O link speed, etc.) may be excluded. Those of ordinary skill will understand what particular configuration and/or environmental parameters may or may not be chosen for inclusion in the provided information.
Thus, as opposed to having only a single P1 frequency associated with the processor provided to the ACPI software, as in the prior art, instead, multiple P1 frequencies are provided to the ACPI software—each P1 frequency being an appropriate P1 frequency for a particular configuration combination (e.g., of accelerators, cores, interfaces and their associated speeds). The ACPI software utilizes, as the system's P1 frequency, the P1 frequency of the entry in information 100 that corresponds to the specific processor configuration (and temperature if columns 109 are implemented) that applies.
As such, in an embodiment, the frequency values are written into on-die non-volatile storage (e.g., Read Only Memory (ROM)) 201 of the processor 200 (e.g., on die fuses are blown). Here, as each frequency is specific to the actual processor die 200, in an embodiment, the die is subjected to characterization testing by the die manufacturer. For example, the die's power consumption is measured as a function of frequency for the various possible configurations (and perhaps temperature) and an appropriate P1 frequency is determined for each such configuration (and temperature). The P1 frequency information is then written into non-volatile on die ROM 201 by the die manufacturer. The frequency information may be written into a location of the ROM that is designed to correspond to a specific configuration (and temperature), or, information identifying the specific configuration (and temperature) may also be stored in the ROM 201 and somehow correlated with the corresponding frequency information.
According to one embodiment, e.g., where P1 frequency information is stored in a location of
ROM 201 that corresponds to a specific configuration, the specific configuration that the processor is setup with when integrated finally into the system is applied as an input to the die. For example, the processor's specific configuration within the system is written into a machine specific register 202 (MSR) as an input 203. Input 203 may be specifically for the purpose of reading power state frequency information as described in more detail below, or, may be input information that the processor uses to set its internal configuration, and, the determination of the appropriate power state frequency information “taps off of” this input.
ROM read circuitry 204 within the die 200 accepts this input information 203 and uses it to formulate a read address that is applied to the ROM 201 as part of a read operation. The ROM provides the P1 frequency information that is specific to the input configuration 203, and, the P1 frequency information is subsequently written into another location of the MSR register space.
With the appropriate P1 frequency information available in model specific register (MSR) space, it can now be read by BIOS firmware and/or ACPI power management software. The process of reading the ROM may occur with each new boot up of the system, in which case the input information 203 may be stored in an external non-volatile ROM 204 (e.g., FLASH) that stores BIOS firmware that applies the input information 203 to the processor. Alternatively or in combination, the read of ROM 201 may be performed by the system manufacturer who then stores the appropriate P1 frequency information in the BIOS firmware of the system 204 which provides it directly to the ACPI software on each boot-up.
In other embodiments, the entire table of frequency information (e.g., all of the information of
If the user chooses extended P1 frequency support, the information within ROM 201 that was determined for the specific configuration of the processor may be extracted by any of the processes discussed above 302. In contrast, if the user chooses the traditional approach, the singular P1 frequency that is identified for the part regardless of its configuration is provided to the ACPI software. In this case, the singular P1 frequency may be provided directly from BIOS firmware as in prior art systems, or, may be read from on die ROM 201. If read from on-die ROM 201, the table 100 of
In response to the notification of the configuration change, the ACPI software presents 304 the new processor configuration to the processor (e.g., in MSR register space) which reads the appropriate, new P1 frequency from its internal ROM 305 and presents the new P1 frequency as a response 306 (e.g., in other MSR register space). The ACPI software reads 307 the new P1 frequency that is made available by the processor and implements the new P1 frequency going forward with the new processor configuration 308.
The process just described above can be equally applied to expected usage changes apart from or in combination with configuration changes.
Although the above discussion has been primarily directed to discussing specific ACPI related examples focused on tabulating P1 performance state frequencies, one of ordinary skill, will recognize other embodiments need not be identically directed. To name just a few possibilities, frequencies for performance states other than P1 performance state frequencies, or even ACPI performance states may be provided. Even further, the stored information need not even be specific frequencies. That is, some other parameter may be specified to communicate the appropriate performance, speed and/or power consumption of the device.
For example, coefficients of a formula may be provided, where the formula accepts configuration input information (e.g., number of links of a specific type (e.g., I/O or memory) that are enabled, number of or which specific accelerators are enabled) and provides as an output an appropriate frequency. Further still, as another possibility, the stored information may be a numeric figure of merit that, when input to a formula or set of mathematical relationships, causes the formula(relationships) to produce an appropriate operational frequency. As just one example, the stored information may correspond to a specific entry in a look-up table maintained by the ACPI software and/or BIOS firmware.
Also, although embodiments described above have focused on implementations where the frequency information is stored on the processor die, conceivably this information could be provided to the system designer separately and stored in BIOS firmware or other storage of the system external to the processor die.
A processing core having the functionality described above can be implemented into various computing systems as well.
The one or more processing cores 401 execute instructions in order to perform whatever software routines the computing system implements. The instructions frequently involve some sort of operation performed upon data. Both data and instructions are stored in system memory 403 and cache 404. Cache 404 is typically designed to have shorter latency times than system memory 403. For example, cache 404 might be integrated onto the same silicon chip(s) as the processor(s) and/or constructed with faster SRAM cells whilst system memory 403 might be constructed with slower DRAM cells. By tending to store more frequently used instructions and data in the cache 404 as opposed to the system memory 403, the overall performance efficiency of the computing system improves.
System memory 403 is deliberately made available to other components within the computing system. For example, the data received from various interfaces to the computing system (e.g., keyboard and mouse, printer port, LAN port, modem port, etc.) or retrieved from an internal storage element of the computing system (e.g., hard disk drive) are often temporarily queued into system memory 403 prior to their being operated upon by the one or more processor(s) 401 in the implementation of a software program. Similarly, data that a software program determines should be sent from the computing system to an outside entity through one of the computing system interfaces, or stored into an internal storage element, is often temporarily queued in system memory 403 prior to its being transmitted or stored.
The ICH 405 is responsible for ensuring that such data is properly passed between the system memory 403 and its appropriate corresponding computing system interface (and internal storage device if the computing system is so designed). The MCH 402 is responsible for managing the various contending requests for system memory 403 access amongst the processor(s) 401, interfaces and internal storage elements that may proximately arise in time with respect to one another.
One or more I/O devices 408 are also implemented in a typical computing system. I/O devices generally are responsible for transferring data to and/or from the computing system (e.g., a networking adapter); or, for large scale non-volatile storage within the computing system (e.g., hard disk drive). ICH 405 has bi-directional point-to-point links between itself and the observed I/O devices 408.
Processes taught by the discussion above may be performed with program code such as machine-executable instructions that cause a machine that executes these instructions to perform certain functions. In this context, a “machine” may be a machine that converts intermediate form (or “abstract”) instructions into processor specific instructions (e.g., an abstract execution environment such as a “virtual machine” (e.g., a Java Virtual Machine), an interpreter, a Common Language Runtime, a high-level language virtual machine, etc.)), and/or, electronic circuitry disposed on a semiconductor chip (e.g., “logic circuitry” implemented with transistors) designed to execute instructions such as a general-purpose processor and/or a special-purpose processor. Processes taught by the discussion above may also be performed by (in the alternative to a machine or in combination with a machine) electronic circuitry designed to perform the processes (or a portion thereof) without the execution of program code.
It is believed that processes taught by the discussion above may also be described in source level program code in various object-orientated or non-object-orientated computer programming languages (e.g., Java, C#, VB, Python, C, C++, J#, APL, Cobol, Fortran, Pascal, Perl, etc.) supported by various software development frameworks (e.g., Microsoft Corporation's .NET, Mono, Java, Oracle Corporation's Fusion, etc.). The source level program code may be converted into an intermediate form of program code (such as Java byte code, Microsoft Intermediate Language, etc.) that is understandable to an abstract execution environment (e.g., a Java Virtual Machine, a Common Language Runtime, a high-level language virtual machine, an interpreter, etc.) or may be compiled directly into object code.
According to various approaches the abstract execution environment may convert the intermediate form program code into processor specific code by, 1) compiling the intermediate form program code (e.g., at run-time (e.g., a JIT compiler)), 2) interpreting the intermediate form program code, or 3) a combination of compiling the intermediate form program code at run-time and interpreting the intermediate form program code. Abstract execution environments may run on various operating systems (such as UNIX, LINUX, Microsoft operating systems including the Windows family, Apple Computers operating systems including MacOS X, Sun/Solaris, OS/2, Novell, etc.).
An article of manufacture may be used to store program code. An article of manufacture that stores program code may be embodied as, but is not limited to, one or more memories (e.g., one or more flash memories, random access memories (static, dynamic or other)), optical disks, CD-ROMs, DVD ROMs, EPROMs, EEPROMs, magnetic or optical cards or other type of machine-readable media suitable for storing electronic instructions. Program code may also be downloaded from a remote computer (e.g., a server) to a requesting computer (e.g., a client) by way of data signals embodied in a propagation medium (e.g., via a communication link (e.g., a network connection)).
In the foregoing specification, the invention has been described with reference to specific exemplary embodiments thereof. It will, however, be evident that various modifications and changes may be made thereto without departing from the broader spirit and scope of the invention as set forth in the appended claims. The specification and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense.
The present patent application is a continuation application claiming priority from U.S. patent application Ser. No. 14/697,541, filed Apr. 27, 2015, and titled: “Mechanism to Provide Workload and Configuration-Aware Deterministic Performance for Microprocessors”, which is a continuation application of U.S. patent application Ser. No. 13/538,546, filed Jun. 29, 2012 and titled: “Mechanism to Provide Workload and Configuration-Aware Deterministic Performance for Microprocessors”, both of which are incorporated herein by reference in their entirety.
Number | Date | Country | |
---|---|---|---|
Parent | 14697541 | Apr 2015 | US |
Child | 15238717 | US | |
Parent | 13538546 | Jun 2012 | US |
Child | 14697541 | US |