The present disclosure relates to processor power management and in particular, to distributed power management for multi-core processors.
In a typical multicore processor, a power management unit (PMU) communicates with a plurality of cores and manages power consumption with respect to computing requirements. The centralized PMU face linearly scaling computing requirements as the number of cores increases. Making matters even more challenging, communication latency also increases with the number of cores. As a result, multicore processor systems that delegate substantially all power management decisions to a single, centralized PMU are likely to require power management compromises due to the sub-optimal scalability characteristics of the traditional centralized PMU paradigm. What is needed is a power management approach that scales well with the number of processors cores.
Embodiments of the invention pertain to processors that include multiple execution cores to enhance performance and improve scalability. Some embodiments, for example, encompass high-performance computing (HPC) platforms that employ an array of dozens of execution cores. Some embodiments encompass network server platforms and other throughput-intensive environments that employ multicore processor architectures.
Embodiments of power management features described herein beneficially promote efficient operation in multicore processor systems. Disclosed embodiments, for example, enable multicore processor systems to run a nominal activity load at a minimum operating voltage without requiring over-implemented power delivery and cooling systems. By being more responsive to changing conditions and requirements, embodiments of disclosed power management features are able to deliver effective power management within a tighter operating window.
Disclosed embodiments address power management issues that arise in the conventional context of a centralized, PMU-based power control architecture in which an activity level of each core may be periodically polled by the PMU before making decisions about desired present and future operating power levels. In at least some of the conventional power management approaches, each core receive operational instructions directly from the PMU. When such a centralized control loop is used in a large multicore processor system to redistribute power load to maintain a fixed power consumption budget, e.g., by shifting power to “hot” threads (e.g., streaming memory and video processing) from so-called “cool threads”, the communication latency associated with polling each core scales roughly with the square root of the number of cores and this may limit the ability to distribute power load optimally, particularly as the number of cores, n, increases.
Disclosed embodiments overcome disadvantages associated with power management strategies that assume all threads are substantially similar and should be constrained to remain at or below a defined activity level, thereby insuring that a desired power budget is maintained. Embodiments described herein recognize that such schemes generally do a poor job of accommodating workloads that vary significantly with time and further recognize that a time varying workload is characteristic in many throughput intensive environments. Embodiments of disclosed power management features are better able to tolerate bursts of high activity that produce sudden spikes in workload by being able to react to such occurrences with less latency.
In at least one embodiment, a distributed power management method disclosed herein allows a PMU to set global and/or individual parameters for each core, while a distributed control loop handles local enforcement and regulation of power activity in the individual cores. In at least one embodiment, each core is at least partially autonomous with respect to governing local processing activity in subject to global power targets (i.e., set points) for each core and for the entire processor. In some embodiments, the PMU may, for example, set power and frequency limits for each core and establish certain high priority cores. In some embodiments, each core may then attempt to drive the entire processor to a target set point and may be able to consume available power (i.e., when actual power consumption is less than the set point) with excess demand. In at least some embodiments, for example, when a core has a local set point of 50% activity but global power consumption on the entire processor is sufficiently below a global set point, the core may permit a burst of activity in excess of the local set point without abandoning global constraints. In this manner, disclosed embodiments implement an opportunistic load balancing of power consumption among cores.
In some embodiments, each core estimates the power consumption of the entire processor. Some embodiments, rather than trying to manage the long latencies and plethora of messages that result when each core communicates with all other cores, maintain a communication framework in which each core communicates nearest neighbor cores only. From its nearest neighbors, each cores is able to estimate the processor's cumulative power consumption. With each core communicating power consumption information with its nearest neighbors, the power consumption information propagates throughout the system over a number of clock cycles. Although limiting communication to certain nearest neighbors may mean that no single core knows the cumulative power consumption at any point it time, it doing so enables individual cores to make localized power management decisions based on meaningful estimates of global power conditions.
In some embodiments, a disclosed power management method for a processor system comprising an array of cores includes receiving, by a first core included in the array of cores, power consumption information from a first subset of cores in the array. The first subset may exclude the first core, while the power consumption information received at the first core may be indicative of power consumption of the array of cores. The method may also include determining, by the first core, internal power consumption of the first core, and estimating, by the first core, power consumption for the array of cores based on the power consumption information and the internal power consumption. The method may further include regulating, by the first core, power consumption of the first core to comply with global power management settings accessible to the array of cores.
In some embodiments, the first subset consists of nearest neighbor cores sharing a boundary line with the first core. The method may include outputting updated power consumption information to the first subset, while the updated power consumption information may include the internal power consumption of the first core. Each core in the array of cores may periodically perform the method. Regulating may include modifying the power consumption of the first core to: increase power consumption, decrease power consumption, zero power consumption, maximize power consumption, maintain power consumption, or a combination thereof. The global power management settings may include a first set point for the first core and/or a second set point for the array of cores in aggregate. The array of cores may be a rectangular grid of cores.
In at least one embodiment, a disclosed processor includes a power management unit and an array of cores. A core in the array may include a self-regulation unit to perform a power management cycle. The power management cycle may include receiving, at the core, power consumption information from a subset of cores in the array, the subset excluding the core. The power consumption information received may be indicative of power consumption of the array of cores. The power management cycle may also include determining internal power consumption of the core, and estimating, by the core, power consumption for the array of cores based on the power consumption information and the internal power consumption. The power management cycle may further include regulating, by the core, power consumption of the core to comply with global power management settings accessible to the array of cores, and outputting updated power consumption information to the subset. The updated power consumption information may include the internal power consumption of the core.
In particular embodiments, the self-regulation unit may periodically repeat the power management cycle. The array of cores may be a rectangular grid comprising columns and rows of cores in the array, while the subset may consist of up to four nearest neighbor cores sharing a boundary line with the core. The core may be to receive southern power control information indicative of cores in the array sharing a column with the core and situated south of the core, receive northern power control information indicative of cores in the array sharing the column with the core and situated north of the core, receive western power control information indicative of cores in the array situated west of the column, and receive eastern power control information indicative of cores in the array situated east of the column. Outputting updated power consumption information to the subset may include outputting east bound power control information to an eastern neighbor core, outputting west bound power control information to a western neighbor core, outputting north bound power control information to a northern neighbor core, and outputting south bound power control information to a southern neighbor core. The east bound power control information may include a western power control information received in a previous power management cycle; a northern power control information received in the previous power management cycle, a southern power control information received in the previous power management cycle, and the internal power consumption for a current power management cycle. The west bound power control information may include an eastern power control information received in the previous power management cycle, the northern power control information received in the previous power management cycle, the southern power control information received in the previous power management cycle, and the internal power consumption for the current power management cycle. The north bound power control information may include the southern power control information received in the previous power management cycle, and the internal power consumption for the current power management cycle. The south bound power control information may include the northern power control information received in the previous power management cycle, and the internal power consumption for the current power management cycle. The global power management settings may be received from the power management unit and may include specific instructions for the first core.
In other embodiments, a disclosed system comprises a processor comprising a plurality of cores and a power management unit, and a memory accessible to the processor. Each core in the plurality of cores, including a first core, may include a self-regulation unit to perform a power management cycle. The power management cycle may include receiving, at the first core, power consumption information from a subset of the plurality of cores, the subset excluding the first core. The power consumption information received may be indicative of power consumption of the plurality of cores. The power management cycle may also include determining internal power consumption of the first core, and estimating, by the first core, power consumption for the plurality of cores based on the power consumption information and the internal power consumption. The power management cycle may further include regulating, by the first core, power consumption of the first core to comply with global power management settings accessible to the plurality of cores, and outputting updated power consumption information to the subset. The updated power consumption information may include the internal power consumption of the first core.
In the following description, details are set forth by way of example to facilitate discussion of the disclosed subject matter. It should be apparent to a person of ordinary skill in the field, however, that the disclosed embodiments are exemplary and not exhaustive of all possible embodiments.
Throughout this disclosure, a hyphenated form of a reference numeral refers to a specific instance of an element and the un-hyphenated form of the reference numeral refers to the element generically or collectively. Thus, for example, widget 12-1 refers to an instance of a widget class, which may be referred to collectively as widgets 12 and any one of which may be referred to generically as a widget 12.
Embodiments may be implemented in many different system types. Referring now to
In the
As will be described in further detail, cores 174 may perform distributed power regulation and implement a distributed control loop for regulating power consumption of processor 170. In given embodiments, cores 174 may be physically arranged in a grid based on a rectangular geometry (see
In
Processor 170 may also communicate with other elements of processor system 100, such as I/O hub 190 and I/O controller hub 118, which are also collectively referred to as a chip set that supports processor 170. P-P interface 176 may be used by processor 170 to communicate with I/O hub 190 via interconnect link 152. In certain embodiments, P-P interfaces 176, 194 and interconnect link 152 are implemented using Intel QuickPath Interconnect architecture.
As shown in
Second bus 120 may support expanded functionality for microprocessor system 100 with I/O devices 112, and may be a PCI-type computer bus. Third bus 122 may be a peripheral bus for end-user consumer devices, represented by desktop devices 124 and communication devices 126, which may include various types of keyboards, computer mice, communication devices, data storage devices, bus expansion devices, etc. In certain embodiments, third bus 122 represents a Universal Serial Bus (USB) or similar peripheral interconnect bus. Third bus 121 may represent a computer interface bus for connecting mass storage devices, such as hard disk drives, optical drives, disk arrays, which are generically represented by data storage 128, shown including code 130 that may be executable by processor 170.
Embodiments may be implemented in code and may be stored on a storage medium having stored thereon instructions which can be used to program a system to perform the instructions. The storage medium may include, but is not limited to, any type of disk including floppy disks, optical disks, compact disk read-only memories (CD-ROMs), compact disk rewritables (CD-RWs), and magneto-optical disks, semiconductor devices such as read-only memories (ROMs), random access memories (RAMs) such as dynamic random access memories (DRAMs), static random access memories (SRAMs), erasable programmable read-only memories (EPROMs), flash memories, electrically erasable programmable read-only memories (EEPROMs), magnetic or optical cards, or any other type of media suitable for storing electronic instructions.
Turning now to
In
Turning now to
As shown in
In operation, core 202 may receive inputs describing power consumption of other cores and regions of the processor and so remain sufficiently apprised of both local and global power consumption at all times in order to perform distributed power regulation. When a plurality of cores, such as core array 200, are implemented using core 202 as shown in
Turning now to
Referring now to
Referring now to
Referring now to
In summary,
In one exemplary embodiment, the distributed control loop includes the following interface specification between a PMU (not shown in
Turning now to
Method 400 may begin by receiving (operation 402), at a first core, power consumption information from a subset of an array of cores, excluding the first core. The power consumption information may be indicative of power consumption of the array. Then, internal power consumption of the first core may be determined (operation 404). Power consumption for the array of cores may be estimated (operation 406) by the first core based on the power consumption information and the internal power consumption. The power consumption of the first core may be regulated (operation 408) by the first core to comply with global power management settings accessible to the array of cores. The regulation in operation 408 may include increasing, decreasing, maximizing, minimizing, maintaining, and/or zeroing power consumption of the first core. The regulation in operation 408 may also be based on specific instructions issued to the first core regarding internal power consumption at the first core. The global power management settings may include a first set point for the first core and/or a second set point for the array of cores in aggregate. Next, updated power consumption information is output (operation 410) to the subset. The updated power consumption information may include the internal power consumption of the first core.
To the maximum extent allowed by law, the scope of the present disclosure is to be determined by the broadest permissible interpretation of the following claims and their equivalents, and shall not be restricted or limited to the specific embodiments described in the foregoing detailed description.
This invention was made with Government support under contract number H98230-11-3-0011 awarded by the Department of Defense. The Government has certain rights in this invention.
Number | Name | Date | Kind |
---|---|---|---|
7389440 | Bailey et al. | Jun 2008 | B2 |
7392414 | Bailey et al. | Jun 2008 | B2 |
7562240 | Tsuji | Jul 2009 | B2 |
7596705 | Kim | Sep 2009 | B2 |
7664971 | Oh | Feb 2010 | B2 |
7702938 | Ha | Apr 2010 | B2 |
7721119 | Capps, Jr. et al. | May 2010 | B2 |
7788519 | Bailey et al. | Aug 2010 | B2 |
7865751 | Monferrer et al. | Jan 2011 | B2 |
8001394 | Bose et al. | Aug 2011 | B2 |
8015427 | Miller et al. | Sep 2011 | B2 |
8126058 | Tseng et al. | Feb 2012 | B2 |
8234431 | Kruglick | Jul 2012 | B2 |
8245070 | Finkelstein et al. | Aug 2012 | B2 |
8286016 | Monferrer et al. | Oct 2012 | B2 |
8316368 | Vestal et al. | Nov 2012 | B2 |
8347303 | Singh et al. | Jan 2013 | B2 |
20060279152 | Ha | Dec 2006 | A1 |
20060288243 | Kim | Dec 2006 | A1 |
20080025409 | Tseng et al. | Jan 2008 | A1 |
20090199020 | Bose et al. | Aug 2009 | A1 |
20090271646 | Talwar et al. | Oct 2009 | A1 |
20100296238 | Mowry et al. | Nov 2010 | A1 |
20110078469 | Therien | Mar 2011 | A1 |
20110169562 | Li et al. | Jul 2011 | A1 |
20120039041 | Mowry et al. | Feb 2012 | A1 |
20120072746 | Sotomayor | Mar 2012 | A1 |
20120166832 | Henry et al. | Jun 2012 | A1 |
Number | Date | Country | |
---|---|---|---|
20140189413 A1 | Jul 2014 | US |