The present disclosure generally relates to the field of electronics. More particularly, an embodiment of the invention relates to multi-level CPU (Central Processing Unit) high current protection.
Generally, the maximum current consumption of a device (such as a CPU) is determined by the worse case workload that the device may handle at any time, sometimes referred to as “power virus”. Without a protection mechanism, this maximum current may negatively impact chip, package, and system power delivery design.
For example, modern CPU and GPU (Graphics Processing Unit) architectures may implement new functional blocks such as vector operation or accelerator hardware that increase the dynamic range of the power/current and allow much higher power and current “power viruses”. This increased “power virus” current may have a severe impact on the design due to a need for higher voltage to compensate for the I*R (where “I” stands for current and “R” stands for resistance) droop which may in turn cause waste of power (i.e., power consumption increases as the voltage guard-bands increase).
There may also be a negative impact on reliability (i.e., the need for higher voltage to compensate for the I*R droop increases voltage levels and reduces device life). Lower turbo frequency may be achieved since the highest operation point (e.g., when all cores in a processor are working) may be determined by the maximum current needed for worse current “power virus”. Further, package and power delivery costs may be increased because additional capacitors and better voltage regulators may be needed to supply the higher current. Additionally, the system power delivery capabilities may need to be increased in other components such as the battery and/or PSU (Power Supply Unit).
The detailed description is provided with reference to the accompanying figures. In the figures, the left-most digit(s) of a reference number identifies the figure in which the reference number first appears. The use of the same reference numbers in different figures indicates similar or identical items.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of various embodiments. However, various embodiments of the invention may be practiced without the specific details. In other instances, well-known methods, procedures, components, and circuits have not been described in detail so as not to obscure the particular embodiments of the invention. Further, various aspects of embodiments of the invention may be performed using various means, such as integrated semiconductor circuits (“hardware”), computer-readable instructions organized into one or more programs (“software”), or some combination of hardware and software. For the purposes of this disclosure reference to “logic” shall mean either hardware, software, or some combination thereof.
Some of the embodiments discussed herein may provide efficient and/or flexible power management for computing systems and/or processors. In an embodiment, a multi-level processor high current protection is provided. For example, modern CPU and GPU (Graphics Processing Unit) architectures may implement new functional blocks such as vector operation or accelerator hardware that increase the dynamic range of the power/current and allow much higher power and current “power viruses”. More particularly, vector operations may cause a significant increase both in TDP (Thermal Design Power) and in worst case “power virus” scenarios. This causes the average TDP scenario to become further and further away from the worst case “power virus” current. One example for such high power operations is the various types of vector instructions (“AVX” in accordance with at least one instruction set architecture). As mentioned above, techniques discussed herein may also be applied to graphics GPUs which include a number of execution units and/or fixed functional logic.
Because of increased worse case current, new high power vector workloads may also carry a penalty for regular, lower power workloads because of the need to add power headroom. Some solutions may use a single event detection of any AVX operation and have no dependency on data type, e.g., when addressing the potential penalty. This coarse grain detection may use high guard bands to prevent “false positives” which in turn may limit the benefit of the feature in the newer architectures (e.g., with 256 bit wide vector operations when compared with, for example, 64 bit wide vector operations).
In one embodiment, the different workloads may be separated based on micro-architectural events (such as uop (micro-operation) types and sizes) and/or data type. This allows the distinction between multiple types of high current workloads with a lower worse case current, so as to lift or reduce the penalty discussed above and to enjoy the benefits of reduced guard-bands and higher turbo frequencies (“power viruses”).
In some embodiments, the separation may be implemented by assigning different “licenses” to workloads based on their (e.g., maximal) current draw. For example, the licenses may be referred to as: Iccp0, Iccp1, Iccp2, Iccp3, etc., e.g., where each license corresponds to a workload with increasingly higher worse case current, for example: Iccp0<Iccp1<Iccp2<Iccp3.
Moreover, some embodiments may be applied in computing systems that include one or more processors (e.g., with one or more processor cores), such as those discussed with reference to
In an embodiment, the processor 102-1 may include one or more processor cores 106-1 through 106-M (referred to herein as “cores 106,” or “core 106”), a cache 108, and/or a router 110. The processor cores 106 may be implemented on a single integrated circuit (IC) chip. Moreover, the chip may include one or more shared and/or private caches (such as cache 108), buses or interconnections (such as a bus or interconnection 112), graphics and/or memory controllers (such as those discussed with reference to
In one embodiment, the router 110 may be used to communicate between various components of the processor 102-1 and/or system 100. Moreover, the processor 102-1 may include more than one router 110. Furthermore, the multitude of routers 110 may be in communication to enable data routing between various components inside or outside of the processor 102-1.
The cache 108 may store data (e.g., including instructions) that are utilized by one or more components of the processor 102-1, such as the cores 106. For example, the cache 108 may locally cache data stored in a memory 114 for faster access by the components of the processor 102 (e.g., faster access by cores 106). As shown in
The system 100 may also include a power source 120 (e.g., a direct current (DC) power source or an alternating current (AC) power source) to provide power to one or more components of the system 100. In some embodiments, the power source 120 may include one or more battery packs and/or power supplies. The power source 120 may be coupled to components of system 100 through a voltage regulator (VR) 130. Moreover, even though
Additionally, while
As shown in
An example of information stored in the two-dimensional table 302 is shown below:
This table is flexible and may be programmed after testing on silicon. As shown, the table defines the separation between the different workloads in various embodiments. In an embodiment, a threshold is programmed into 302 per license. A weight may be assigned to every architectural event. Once the sum of those weights (e.g., per second in an embodiment) reaches a pre-defined limit, a throttle action 303 is initiated by an Iccp control unit logic 304. The throttling action may be done by changing the clock, changing the configuration of the processor such as pipe width, halting execution of instructions, etc. The throttling may be done per license in an embodiment as shown in
Referring to
At an operation 410, the detecting mechanism (e.g., logics 302/304) may compares the micro-architectural events collected and their weights to the limit of the appropriate license, e.g., as decided per the table above. If a limit is detected at operation 410, the processor will enter a safe state (with some performance hit) at operation 412, and avoids over current. At an operation 414, an appropriate license request is sent to the PMU 140. The PMU (or logic 202) decides according to the license whether to raise guard-bands, or lose some performance, and by how much. For example, by reducing frequency or increasing voltage. Voltage increase/frequency reduction is dependent on the license in some embodiments. The PMU then issues a matching license to the mechanism to indicate it to stop throttling.
The process of calculating the new voltage/frequency operation point and changing the voltage/frequency may take some time. To ensure minimal performance hit due to throttling and P-State transitions, The Iccp logic 304 may include hysteresis—that means that the Iccp would not ask for a license and will not throttle too frequently, reducing the thrashing of the system and the effect of throttling. An embodiment of a hysteresis method 450 is shown in
Accordingly, multiple licenses are used in order to deal with the greater power range of potential workloads, e.g., due newer or more extensive AVX such as AVX3. As a result, a decision is made regarding the license for every event and data width and the license is assigned based on a two dimensional table 302 of the type of event and its data width.
Some embodiments provide the following features over some existing solutions: (a) reduced guard-band on lower Cdyn (dynamic capacitance) workloads compared to a fixed guard-band; and/or (b) higher turbo frequencies for lower Cdyn workloads.
A chipset 506 may also communicate with the interconnection network 504. The chipset 506 may include a graphics and memory control hub (GMCH) 508. The GMCH 508 may include a memory controller 510 that communicates with a memory 512. The memory 512 may store data, including sequences of instructions that are executed by the processor 502, or any other device included in the computing system 500. In one embodiment of the invention, the memory 512 may include one or more volatile storage (or memory) devices such as random access memory (RAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), static RAM (SRAM), or other types of storage devices. Nonvolatile memory may also be utilized such as a hard disk. Additional devices may communicate via the interconnection network 504, such as multiple CPUs and/or multiple system memories.
The GMCH 508 may also include a graphics interface 514 that communicates with a graphics accelerator 516. In one embodiment of the invention, the graphics interface 514 may communicate with the graphics accelerator 516 via an accelerated graphics port (AGP). In an embodiment of the invention, a display (such as a flat panel display, a cathode ray tube (CRT), a projection screen, etc.) may communicate with the graphics interface 514 through, for example, a signal converter that translates a digital representation of an image stored in a storage device such as video memory or system memory into display signals that are interpreted and displayed by the display. The display signals produced by the display device may pass through various control devices before being interpreted by and subsequently displayed on the display.
A hub interface 518 may allow the GMCH 508 and an input/output control hub (ICH) 520 to communicate. The ICH 520 may provide an interface to I/O devices that communicate with the computing system 500. The ICH 520 may communicate with a bus 522 through a peripheral bridge (or controller) 524, such as a peripheral component interconnect (PCI) bridge, a universal serial bus (USB) controller, or other types of peripheral bridges or controllers. The bridge 524 may provide a data path between the processor 502 and peripheral devices. Other types of topologies may be utilized. Also, multiple buses may communicate with the ICH 520, e.g., through multiple bridges or controllers. Moreover, other peripherals in communication with the ICH 520 may include, in various embodiments of the invention, integrated drive electronics (IDE) or small computer system interface (SCSI) hard drive(s), USB port(s), a keyboard, a mouse, parallel port(s), serial port(s), floppy disk drive(s), digital output support (e.g., digital video interface (DVI)), or other devices.
The bus 522 may communicate with an audio device 526, one or more disk drive(s) 528, and one or more network interface device(s) 530 (which is in communication with the computer network 503). Other devices may communicate via the bus 522. Also, various components (such as the network interface device 530) may communicate with the GMCH 508 in some embodiments of the invention. In addition, the processor 502 and the GMCH 508 may be combined to form a single chip. Furthermore, the graphics accelerator 516 may be included within the GMCH 508 in other embodiments of the invention.
Furthermore, the computing system 500 may include volatile and/or nonvolatile memory (or storage). For example, nonvolatile memory may include one or more of the following: read-only memory (ROM), programmable ROM (PROM), erasable PROM (EPROM), electrically EPROM (EEPROM), a disk drive (e.g., 528), a floppy disk, a compact disk ROM (CD-ROM), a digital versatile disk (DVD), flash memory, a magneto-optical disk, or other types of nonvolatile machine-readable media that are capable of storing electronic data (e.g., including instructions). In an embodiment, components of the system 500 may be arranged in a point-to-point (PtP) configuration. For example, processors, memory, and/or input/output devices may be interconnected by a number of point-to-point interfaces.
As illustrated in
In an embodiment, the processors 602 and 604 may be one of the processors 502 discussed with reference to
In at least one embodiment, one or more operations discussed with reference to
Chipset 620 may communicate with the bus 640 using a PtP interface circuit 641. The bus 640 may have one or more devices that communicate with it, such as a bus bridge 642 and I/O devices 643. Via a bus 644, the bus bridge 642 may communicate with other devices such as a keyboard/mouse 645, communication devices 646 (such as modems, network interface devices, or other communication devices that may communicate with the computer network 503), audio I/O device, and/or a data storage device 648. The data storage device 648 may store code 649 that may be executed by the processors 602 and/or 604.
In various embodiments of the invention, the operations discussed herein, e.g., with reference to
Additionally, such computer-readable media may be downloaded as a computer program product, wherein the program may be transferred from a remote computer (e.g., a server) to a requesting computer (e.g., a client) by way of data signals provided in a carrier wave or other propagation medium via a communication link (e.g., a bus, a modem, or a network connection).
Reference in the specification to “one embodiment” or “an embodiment” means that a particular feature, structure, and/or characteristic described in connection with the embodiment may be included in at least an implementation. The appearances of the phrase “in one embodiment” in various places in the specification may or may not be all referring to the same embodiment.
Also, in the description and claims, the terms “coupled” and “connected,” along with their derivatives, may be used. In some embodiments of the invention, “connected” may be used to indicate that two or more elements are in direct physical or electrical contact with each other. “Coupled” may mean that two or more elements are in direct physical or electrical contact. However, “coupled” may also mean that two or more elements may not be in direct contact with each other, but may still cooperate or interact with each other.
Thus, although embodiments of the invention have been described in language specific to structural features and/or methodological acts, it is to be understood that claimed subject matter may not be limited to the specific features or acts described. Rather, the specific features and acts are disclosed as sample forms of implementing the claimed subject matter.
This application is a continuation and claims priority under 35 U.S.C. § 120 of pending U.S. patent application Ser. No. 13/997,200, filed May 16, 2014, entitled ADJUSTING POWER CONSUMPTION OF A PROCESSING ELEMENT BASED ON TYPES OF WORKLOADS TO BE EXECUTED which in turn claims priority under 35 U.S.C. § 371 to International Application No. PCT/US2011/068120 filed Dec. 30, 2011, entitled MULTI-LEVEL CPU HIGH CURRENT PROTECTION. The entire disclosure(s) of these documents are incorporated by reference herein for all purposes.
Number | Name | Date | Kind |
---|---|---|---|
5790874 | Takano et al. | Aug 1998 | A |
6472899 | Osburn | Oct 2002 | B2 |
6519707 | Clark | Feb 2003 | B2 |
6542106 | Darmawaskita et al. | Apr 2003 | B1 |
7337339 | Choquette et al. | Feb 2008 | B1 |
7376853 | Canon | May 2008 | B2 |
7598702 | Walrath | Oct 2009 | B2 |
7609040 | Jain | Oct 2009 | B1 |
7664971 | Oh | Feb 2010 | B2 |
8214663 | Floyd et al. | Jul 2012 | B2 |
8539269 | Rotem et al. | Sep 2013 | B2 |
9092218 | Wells et al. | Jul 2015 | B2 |
9724716 | Khoury | Aug 2017 | B2 |
20020138778 | Cole | Sep 2002 | A1 |
20030056125 | O'Conner | Mar 2003 | A1 |
20030126476 | Greene | Jul 2003 | A1 |
20030167460 | Desai | Sep 2003 | A1 |
20040103328 | Toru et al. | May 2004 | A1 |
20050088152 | McClure | Apr 2005 | A1 |
20050108075 | Douglis | May 2005 | A1 |
20050210304 | Hartung | Sep 2005 | A1 |
20060053323 | Kissell | Mar 2006 | A1 |
20060090086 | Rotem | Apr 2006 | A1 |
20070260895 | Aguilar et al. | Nov 2007 | A1 |
20080022140 | Yamada | Jan 2008 | A1 |
20080155281 | Savransky | Jun 2008 | A1 |
20080201548 | Przybylski et al. | Aug 2008 | A1 |
20090167092 | Ma | Jul 2009 | A1 |
20090300329 | Naffziger et al. | Dec 2009 | A1 |
20090327656 | Baum | Dec 2009 | A1 |
20100115314 | Sultenfuss | May 2010 | A1 |
20100169692 | Burton | Jul 2010 | A1 |
20110022857 | Nussbaum et al. | Jan 2011 | A1 |
20110040990 | Chan | Feb 2011 | A1 |
20110093724 | Park et al. | Apr 2011 | A1 |
20110154066 | Ravichandran et al. | Jun 2011 | A1 |
20110173462 | Wakrat | Jul 2011 | A1 |
20110173477 | Asaba | Jul 2011 | A1 |
20110178652 | Carter et al. | Jul 2011 | A1 |
20110238974 | Wells et al. | Sep 2011 | A1 |
20110302391 | Guo | Dec 2011 | A1 |
20120023345 | Naffziger | Jan 2012 | A1 |
20120144221 | Naffziger et al. | Jun 2012 | A1 |
20120159219 | Huang | Jun 2012 | A1 |
20120254641 | Rotem et al. | Oct 2012 | A1 |
20130111191 | Murray et al. | May 2013 | A1 |
Number | Date | Country |
---|---|---|
101436096 | May 2009 | CN |
2013101189 | Jul 2013 | WO |
Entry |
---|
Communication pursuant to Article 94(3) EPC received for European Patent Application No. 11878518.7, dated Sep. 14, 2017, 8 pages. |
Office Action received for European Patent Application No. 11878518.7 dated Jun. 25, 2018, 8 pages. |
Office Action received for Chinese Patent Application No. 201180075959.6, dated Oct. 17, 2016, 7 pages. |
Office Action and Search Report received for Taiwanese Patent Application No. 101150741, dated May 9, 2016, 10 pages including 1 page of English translation. |
Office Action received for Chinese Patent Application No. 201180075959.6, dated Jan. 28, 2016, 9 pages. |
Extended European Search Report received for European Patent Application No. 11878518.7, dated Jul. 28, 2015, 8 pages. |
International Preliminary Report on Patentability and Written Opinion received for PCT Patent Application No. PCT/US2011/068120, dated Jul. 10, 2014, 6 pages. |
Non-Final Office Action received for U.S. Appl. No. 13/077,618, dated Dec. 26, 2012, 7 pages. |
Notice of Allowance received for U.S. Appl. No. 13/077,618, dated May 30, 2013, 8 pages. |
International Search Report and Written Opinion received for PCT Application No. PCT/US2011/068120, dated Sep. 21, 2012, 9 pages. |
Notice of Allowance received for U.S. Appl. No. 13/997,200, dated Jan. 23, 2017, 8 pages. |
Office Action received for U.S. Appl. No. 13/997,200, dated Jun. 15, 2016, 13 pages. |
Office Action received for U.S. Appl. No. 13/997,200, dated Aug. 13, 2015, 11 pages. |
Office Action received for U.S. Appl. No. 13/997,200, dated Dec. 24, 2015, 15 pages. |
Letters of Patent received for Chinese Patent Application No. 201180075959.6, dated Dec. 26, 2017 as Chinese Patent No. 104115091, 3 pages. |
Notice of Grant received for Chinese Patent Application No. 201180075959.6 dated Sep. 4, 2017, 4 pages including 2 pages of English translation. |
Letters of Patent received for Taiwanese Patent Application No. 101150741, dated Apr. 11, 2017 as Patent No. I578234, 10 pages including 1 page of English translation. |
Extended European Search Report received for European Patent Application No. 18208100.0 dated Mar. 27, 2019, 9 pages. |
Office Action received for Chinese Patent Application No. 201180075959.6, dated May 3, 2017, 6 pages, including 3 pages of English translation. |
Office Action received for European Patent Application No. 11878518.7 dated Jan. 22, 2019, 22 pages. |
Number | Date | Country | |
---|---|---|---|
20170308146 A1 | Oct 2017 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 13997200 | US | |
Child | 15589769 | US |