Patent Grant
11323390
An arbiter is an electronic device that may be utilized to regulate access to shared resources. Arbiters may be implemented as electronic circuitry such as application-specific integrated circuits (ASICs). An arbiter may receive multiple concurrent read and/or write requests to access shared computational resources and may serially grant received requests access to the shared resources.
Various schemes may be employed for fairly granting access to requests. For example, where requests are received by the arbiter from multiple clients, the arbiter may utilize a turn-based scheme such that an equal number of requests may be granted for each client.
Certain examples are described in the following detailed description and in reference to the drawings, in which:
Requests for access to a shared pool of resources may be grouped into traffic classes. A traffic class is an isolated group of virtual channels that are categorized by any number of parameters. Dividing virtual channels into traffic classes enables performance isolation between different flows or groups of network traffic. A traffic class may be defined, for example, by any number of traffic sources, such as an address block, a number of devices and/or clients, a workspace, a combination thereof, or any other source of network traffic. Different traffic classes may concurrently request access to shared resources, and arbiters may implement various schemes to promote fairness between the different traffic classes.
A turn-based scheme, for example, may take turns granting requests to each traffic class. One such example of a turn-based scheme is round-robin arbitration. Round-robin arbitration is a scheme including logic that implements a circular counter to grant requests from traffic classes in a cyclical fashion. An arbiter implementing a round-robin scheme will serve a traffic class by granting a predetermined amount of requests from the traffic class or grant requests from the traffic class for a predetermined time, after which the traffic class will be ordered last, and a next-in-line traffic class will be served.
Another example of a turn-based scheme is Least Recently Used (LRU) arbitration. An arbiter implementing an LRU scheme may maintain an ordered list of traffic classes. To grant a request, the arbiter may scan the list by priority, and grant a request from a traffic class having both a highest priority and an active request. Once the arbiter provides the grant to the traffic class, the arbiter may lower the priority of the traffic class. The traffic class with the granted request may, for instance, be reprioritized to have a lowest priority among the listed traffic classes. Like, round-robin arbitration, LRU arbitration provides fairness such that each traffic class is given its “turn.”
In some example implementations, traffic classes may be granted weighted priority such that traffic classes having greater weight may be granted a greater number of requests than a traffic class having a lesser weight. This can be implemented a number of ways. For instance, a traffic class with a greater weight may be lowered in priority after a larger number of request grants than a traffic class with a lesser weight; a traffic class with a greater weight may not be lowered to as great a degree in priority after a request grant as would a traffic class having a lesser weight; etc.
Age-based arbitration is another example arbitration scheme. An arbiter implementing age-based arbitration provides grants to requests having a greatest age among requests to be granted by the arbiter. The age of a request may be determined by the time since the request was initiated, by the time the request existed in a queue of requests to be granted access by the arbiter, by the number of times a request was not selected among received requests to be granted access to received resources, etc.
Age-based arbitration ensures fairness among requests: requests of a greatest age will be served irrespective of the traffic class from which the request was derived. Thus, age-based arbitration alone may not facilitate traffic class isolation. When implementing a turn-based arbitration scheme for example, traffic classes may each be granted in turn. Conversely, an age-based arbitration scheme may favor a first traffic class where a larger percentage of requests are initiated from the first traffic class than from a second traffic class. In some examples, the first traffic class may clog the network with requests such that requests from other traffic classes fail to grant.
A hybrid arbitration approach is proposed that facilitates age-based arbitration by traffic class. By utilizing hybrid arbitration, fair access may be maintained across clients and/or devices via age-based arbitration while concurrently maintaining fair access across traffic classes via turn-based arbitration. Specifically, the arbitration device may include turn-based arbitration logic to receive a first set of requests derived from different traffic classes and select a traffic class from the different traffic classes according to a turn-based arbitration scheme. The hybrid arbiter may further include age-based arbitration logic to receive a second set of requests derived from the different traffic classes. In an example, the second set of requests may include any number of the first set of requests, and may include at least requests of the first set of requests of the selected traffic class. The age-based arbitration logic may select a request from each of the different traffic classes of the requests received according to an age-based arbitration scheme. A request selected by the age-based arbitration logic and of the traffic class selected by the turn-based arbitration logic may be granted access to a shared pool of resources.
Arbiter 110 may determine which requests from which traffic class are to receive a grant, the grant to be transmitted on grant lines g0-g5, 132-142 respectively. Arbiter 110 may be implemented as hardware or a combination of hardware and software/firmware. To determine which requests are to be granted, arbiter 110 may employ hybrid arbitration logic. Specifically, the requests may be received by turn-based arbitration logic 150 of arbiter 110 and age-based arbitration logic 160 of arbiter 110. Turn-based arbitration logic 150 of arbiter 110 and age-based arbitration logic 160 of arbiter 110 may be implemented as logical circuitry and may include any number of application-specific integrated circuits (ASICs). Furthermore, while example
Turn-based arbitration logic 150 may receive a first set of requests from requesters r0-r5. The received set of requests may be associated with a plurality of different traffic classes. Turn-based arbitration logic 150 may select a traffic class from among the plurality of different traffic classes, and in an example, may select the traffic class according to a turn-based arbitration scheme as detailed above.
Age-based arbitration logic 160 may receive a second set of requests from requesters r0-r5. In some example implementations, the second set of requests may be the first set of requests or the second set of requests may be a subset of the first set of requests. The second set of requests may be, for example, requests of the first set of requests associated with a particular traffic class, such as the traffic class selected by turn-based arbitration logic 150.
Age-based arbitration logic 160 may select a request from each traffic class of the requests received according to an age-based arbitration scheme as detailed above. In an example, arbiter 110 may grant a request that was selected by both turn-based arbitration logic 150 and age-based arbitration logic 160. The granted request may be granted on an associated grant line of grant lines g0-g5. Accordingly, arbiter 110 may implement a hybrid arbitration scheme in which both turn-based arbitration logic 150 and age-based arbitration logic 160 are employed.
Arbiter 202 and arbiter 204 may be implemented as hardware or a combination of hardware and software/firmware. In this example, arbiter 202 includes turn-based arbitration logic 250, and arbiter 204 includes age-based arbitration logic 260. Turn-based arbitration logic 150 of arbiter 110 and age-based arbitration logic 160 of arbiter 110 may be implemented as logical circuitry and may include any number of application-specific integrated circuits (ASICs).
Arbiter 202, upon receiving requests from any of requesters r0-r2, may, according to turn-based arbitration logic 250, select a traffic class from among a plurality of different traffic classes of the received requests, and in an example, may select a traffic class according to a turn-based arbitration scheme as detailed above. Arbiter 202 may further output a control signal value 280 indicating the selected traffic class.
While arbiter 202 may implement turn-based arbitration logic 250 to select a traffic class from among a plurality of different traffic classes, arbiter 204 may select a request from a particular traffic class with age-based arbitration logic 260. As illustrated in example
A request selected by arbiter 204 and of the traffic class selected by arbiter 202 may be granted, and in this example implementation, may be granted on any of respective grant lines 232, 234, or 236. In the example depicted in
As illustrated, Arbiter 302 may receive any number of requests from requesters r0-r5, 320-330 respectively. Each request received may be associated with any number of traffic classes. In this example, each requester may be associated with a traffic class such that requests received on a requester associated with a particular traffic class are associated with that traffic class.
For example, OR gates 342-346 may map requests to respective traffic classes before they are received by arbiter 302. In this illustrated example, r0 and r 1, 320 and 322 respectively, may be mapped to a first traffic class by OR gate 342; r2 and r3, 324 and 326 respectively, may be mapped to a second traffic class by OR gate 344; and r4 and r5, 328 and 330 respectively, may be mapped to a third traffic class by OR gate 346. By mapping requests from requesters to respective traffic classes, turn-based arbitration logic 350 may select a traffic class according to a turn-based arbitration scheme from a traffic class having an active request. While six example requesters are illustrated, any number of requesters to carry any number of requests may be implemented. Additionally, while requesters 320-330 are mapped to three example traffic classes, requesters 320-330 may be mapped to any number of traffic classes.
Arbiter 302, upon receiving requests from any of requesters r0-r5, may, according to turn-based arbitration logic 350, select a traffic class from among a plurality of different traffic classes of the received requests, and in an example, may select a traffic class according to a turn-based arbitration scheme as detailed above. Arbiter 302 may further output any number of control signal values 280 indicating the selected traffic class. The control signal value may be received by arbiter 304, and may specifically be received by selector 370 of arbiter 304. The control signal values may, for example, indicate which of AND gates 372-382 of selector 370 receives a “1” and which of AND gates 372-382 of selector 380 receives a “0”. In this example implementation, control signal 380 enables requests of the traffic class selected at arbiter 302 to pass through selector 370 to be received by age-based arbitration logic 360. In other words, a control signal value may indicate a selected traffic class by enabling requests of the selected traffic class to pass through a selector.
Age-based arbitration logic 360 may receive a second set of requests from requesters r0-r5. For example, selector 370 may pass requests of any traffic class selected by arbiter 302. In this example, the second set of requests from requesters r0-r5 may be requests of the first set of requests and associated with any traffic class selected by arbiter 302.
Age-based arbitration logic 360, upon receiving the second set of requests, may select a request from each traffic class of the requests received according to an age-based arbitration scheme as detailed above. By filtering requests through selector 370 by respective traffic class, and selecting requests from each traffic class according to age-based arbitration logic 360, arbiter 304 may select a request of a particular traffic class and according to an age-based arbitration scheme. The selected request may be granted on an associated grant line g0-g5, 332-342 respectively.
As illustrated, Arbiter 302 may receive any number of requests from requesters r0-r5, 320-330 respectively. Each request received may be associated with a traffic class. In this example, each requester may be associated with a traffic class such that requests received on a requester associated with a particular traffic class are associated with that traffic class.
For example, OR gates 342-346 may map requests to respective traffic classes before they are received by arbiter 302. In this illustrated example, r0 and r1, 320 and 322 respectively, may be mapped to a first traffic class by OR gate 342; r2 and r3, 324 and 326 respectively, may be mapped to a second traffic class by OR gate 344; and r4 and r5, 328 and 330 respectively, may be mapped to a third traffic class by OR gate 346. By mapping requests from requesters to respective traffic classes, turn-based arbitration logic 350 may select a traffic class according to a turn-based arbitration scheme from a traffic class having an active request. While six example requesters are illustrated, any number of requesters to carry any number of requests may be implemented. Additionally, while requesters 320-330 are mapped to three example traffic classes, requesters 320-330 may be mapped to any number of traffic classes.
Arbiter 302, upon receiving requests from any of requesters r0-r5, may, according to turn-based arbitration logic 350, select a traffic class from among a plurality of different traffic classes of the received requests, and in an example, may select a traffic class according to a turn-based arbitration scheme as detailed above. Arbiter 302 may further output any number of control signal values, e.g. control signal value 380a, control signal value 380b, and control signal value 380c, indicating the selected traffic class. A control signal value may be received by arbiter 304, and may specifically be received by selector 370 of arbiter 304. The control signal values may, for example, be transmitted as a “1” to AND gates 372-382 of selector 370 and may be transmitted as a “0” to AND gates 372-382 of selector 380. In this example implementation, control signal 380 enables requests of the traffic class selected at arbiter 302 to pass through selector 370 to be received by age-based arbitration logic 360. In other words, a control signal value may indicate a selected traffic class by enabling requests of the selected traffic class to pass through a selector.
Age-based arbitration logic 360 may receive a second set of requests from requesters r0-r5. For example, selector 370 may pass requests of any traffic class selected by arbiter 302. In this example, the second set of requests from requesters r0-r5 may be requests of the first set of requests and associated with any traffic class selected by arbiter 302.
Age-based arbitration logic 360, upon receiving the second set of requests, may select a request from each traffic class of the requests received according to an age-based arbitration scheme as detailed above. By filtering requests through selector 370 by respective traffic class, and selecting requests from each traffic class according to age-based arbitration logic 360, arbiter 304 may select a request of a particular traffic class and according to an age-based arbitration scheme. The selected request may be granted on an associated grant line g0-g5, 332-342 respectively.
As illustrated, arbiter 402 may receive any number of requests from requesters r0-r5, 420-430 respectively. Each request received may be associated with a traffic class. In this example, each requester may be associated with a traffic class such that requests received on a requester associated with a particular traffic class are associated with that traffic class.
For example, OR gates 442-446 may map requests to respective traffic classes before they are received by arbiter 402. In this illustrated example, r0 and r1, 420 and 422 respectively, may be mapped to a first traffic class by OR gate 442; r2 and r3, 424 and 426 respectively, may be mapped to a second traffic class by OR gate 444; and r4 and r5, 428 and 430 respectively, may be mapped to a third traffic class by OR gate 446. By mapping requests from requesters to respective traffic classes, turn-based arbitration logic 450 may select a traffic class according to a turn-based arbitration scheme from a traffic class having an active request.
Arbiter 402, upon receiving requests from any of requesters r0-r5, may, according to turn-based arbitration logic 450, select a traffic class from among a plurality of different traffic classes of the received requests, and in an example, may select a traffic class according to a turn-based arbitration scheme as detailed above. Arbiter 402 may further output any number of control signal values 480, e.g. 480a, 480b, and 480c, indicating the selected traffic class. In some example implementations, the control signal value may be received by encoder 490, to be translated and thereafter received by multiplexer 470 of arbiter 404. While encoder 490 is illustrated as a separate component in this example, encoder 490 may, in some examples, be included in arbiter 404, and may specifically be included in the logic of multiplexer 470.
Multiplexer 470 may receive the encoded signal output of arbiter 402 as well as requests 420-430, and may output a subset of requests 420-430. The subset of requests may be the full set of requests, such as requests 420-430, or the subset of requests may be requests of the set of any number of particular traffic classes, such as the selected traffic class.
The request subset may be received by age-based arbitration logic 460. Age-based arbitration logic 460, upon receiving the request subset, may select a request from each traffic class of the requests received according to an age-based arbitration scheme as detailed above. By filtering requests through multiplexer 370 by respective traffic class, and selecting requests from each traffic class according to age-based arbitration logic 360, arbiter 304 may select requests of particular traffic classes and according to an age-based arbitration scheme.
The selected request may be granted on an associated grant line. Specifically, the requests selected by age-based arbitration logic 460 may be transmitted to demultiplexer 472, which may transmit a grant on any of grant lines g0-g5, 432-440 respectively, associated with the requesters on which requests 420-430 originated. Accordingly, an age-based arbitration scheme by traffic class may be utilized to transmit grants for requests to access a shared pool of resources.
As illustrated, arbiter 502 may receive any number of requests from requesters 520-522, arbiter 504 may receive any number of requests from requesters 524-526, and arbiter 506 may receive any number of requests from requesters 528-530. Each request received may be associated with a traffic class. For instance, each requester may be associated with a traffic class such that requests received on a requester associated with a particular traffic class are associated with that traffic class.
In an example, each arbiter may receive requests from a different traffic class. Specifically, arbiter 502 may receive requests 520-522 from requesters associated with a first traffic class, arbiter 504 may receive requests 524-526 from requesters associated with a second traffic class, and arbiter 506 may receive requests 528-530 from requesters associated with a third traffic class. Although six example requesters and three example arbiters having age-based arbitration logic are illustrated, any number of requesters and arbiters may be implemented.
The requests may be received by age-based arbitration logic 562-566. Age-based arbitration logic 562-566, upon receiving the requests, may select a request from each traffic class of the requests received according to an age-based arbitration scheme as detailed above. In an example, where each arbiter receives requests from a different traffic class, the age-based arbitration logic of each arbiter may select a request from the traffic class of the requests received according to an age-based arbitration scheme. Accordingly, a request from each traffic class may be selected by arbiters 502-506.
The selected requests of each traffic class may be mapped to their respective traffic classes. In an example, OR gates 542-546 may map requests to respective traffic classes before they are received by arbiter 512. In this illustrated example, r0 and r1, 520 and 522 respectively, may be mapped to a first traffic class by OR gate 542; r2 and r3, 524 and 526 respectively, may be mapped to a second traffic class by OR gate 544; and r4 and r5, 528 and 530 respectively, may be mapped to a third traffic class by OR gate 546. By mapping requests from requesters to respective traffic classes, turn-based arbitration logic 560 may select a traffic class according to a turn-based arbitration scheme from a traffic class having an active request.
Arbiter 512, upon receiving requests from any of requesters r0-r5, may, according to turn-based arbitration logic 560, select a traffic class from among a plurality of different traffic classes of the received requests, and in an example, may select a traffic class according to a turn-based arbitration scheme as detailed above. Arbiter 512 may further output any number of control signal values 580, e.g. 580a, 580b, and 580c, indicating the selected traffic class. In some example implementations, the control signal value may be received by encoder 590, to be translated and thereafter received by multiplexer and deselector 570. While encoder 490 is illustrated as a separate component in this example, encoder 490 may, in some examples, be included in arbiter 512 or multiplexor and deselector 570.
Multiplexer and deselector 570 may receive the encoded signal output of arbiter 512 indicating a selected traffic class as well as the requests selected by arbiters 502-506, and may output any of the requests selected by arbiters 502-506 that is of the selected traffic class. The requests may specifically output on an associated grant line. For instance, a grant may be transmitted on any of grant lines g0-g5, 532-540 respectively, associated with the requesters on which requests 520-530 originate.
As illustrated, class mapper 610 may receive any number of requests from requesters r0-r5, 620-630 respectively. Each request received may be associated with a traffic class. In this example, class mapper 610 may map requesters to traffic classes such that requests received on a requester mapped to a particular traffic class are associated with that traffic class. In an example, the mapping of requesters to traffic classes may be programmable and each requester may be programmed to map to a traffic class.
A specific example implementation of a programmable class mapper is illustrated in
A traffic class may be considered active where a request is received from a requester mapped to that traffic class. Turn-based arbitration logic 150 may receive the active traffic classes from class mapper 610 and may select a traffic class according to any of the turn-based schemes described above. Age-based arbitration logic 160 may further select a request from a subset of received requests (not shown) and select a request from each traffic class of the received requests according to an age-based arbitration scheme as described above. Requests selected by the age-based arbitration logic and of the selected traffic class may be granted on any of grant lines 680-690.
At block 702, a set of requests of a plurality of traffic classes may be received, e.g. requests 220-224. In an example, the set of requests may be received at an arbiter, such as arbiter 202. Each request received may be associated with a traffic class, and each request may be associated with any number of different traffic classes. For example, request 220 may be associated with a first traffic class and request 222 may be associated with a second traffic class. At block 704, a traffic class of the set of requests may be selected by turn-based arbitration logic 704. The traffic class may be selected, for example, by turn-based arbitration logic 250 of arbiter 202. The traffic class may be selected by any of the turn-based arbitration schemes as described above.
At block 706, a request may be selected from each traffic class of a subset of received requests according to age-based arbitration logic 260. In an example, the subset of requests may be received at an arbiter, such as arbiter 204. The subset of requests may be the full set of requests, such as requests 220-224, or the subset of requests may be requests of the set of a particular traffic class, such as the selected traffic class. The request from each traffic class of the received requests may be selected according to any of the age-based arbitration schemes described above. At block 708, a request selected by the age-based arbitration logic 260 and of the selected traffic class may be granted, i.e. through any of grant lines 232-236, and specifically, may be granted access to a shared pool of resources.
At block 802, a set of requests of a plurality of traffic classes may be received, e.g. requests 320-330, at an arbiter, such as arbiter 302. Each request received may be associated with a traffic class, and each request may be associated with any number of different traffic classes. At block 804, each received request may be mapped to a traffic class. In an example, this mapping may be fixed. For example, OR gates 342-346 may map each requester to a particular traffic class such that requests from a requester mapped to a particular traffic class are associated with that particular traffic class. In another example, the mapping of requests to traffic classes may be programmable as described above with reference to
At block 806, a traffic class of the set of requests may be selected. The traffic class may be selected, for example, by turn-based arbitration logic 350 of arbiter 302. The traffic class may be selected by any of the turn-based arbitration schemes as described above. By mapping the requests to traffic classes prior to selecting a traffic class according to a turn-based arbitration scheme, a traffic class of the received requests may be selected.
At block 808, the arbiter that selected the traffic class, e.g. arbiter 302, may output a control signal value associated with the selected traffic class. Arbiter 302 may further output any number of control signal values, e.g. control signal value 380a, control signal value 380b, and control signal value 380c, indicating the selected traffic class.
At block 810, requests not associated with the selected traffic class may be filtered such that a subset of requests of the selected traffic class is generated. For example, the control signal value may be received by arbiter 304, and may specifically be received by selector 370 of arbiter 304. The control signal values may, for example, be transmitted as a “1” to AND gates 372-382 of selector 370, enabling requests of particular requesters, and thus of a particular traffic class, to pass. Conversely, control signal values may be transmitted as a “0” to AND gates 372-382 of selector 380, such that requests of particular requesters not of the selected traffic class are not passed. In this example implementation, control signal 380 enables requests of the traffic class selected at arbiter 302 to pass through selector 370 to be received by age-based arbitration logic 360. Thus, a control signal value may indicate a selected traffic class by enabling a subset of requests of the selected traffic class to pass through a selector.
At block 812, a request from each traffic class of the subset of requests received by the second arbiter, e.g. arbiter 304, may be selected according to age-based arbitration logic. The request from each traffic class of the received requests may be selected according to any of the age-based arbitration schemes described above. At block 814, a request selected by the age-based arbitration logic 360 and of the selected traffic class may be granted, i.e. through any of grant lines 332-342, and specifically, may be granted access to a shared pool of resources.
In the foregoing description, numerous details are set forth to provide an understanding of the subject disclosed herein. However, implementations may be practiced without some or all of these details. Other implementations may include modifications and variations from the details discussed above. It is intended that the appended claims cover such modifications and variations.
This application is a continuation application of and claims priority to application Ser. No. 15/883,911, filed on Jan. 30, 2018, the contents of which are hereby incorporated by reference in their entireties.
| Number | Name | Date | Kind |
|---|---|---|---|
| 7133399 | Brewer et al. | Nov 2006 | B1 |
| 7137119 | Sankaranarayan et al. | Nov 2006 | B1 |
| 7283558 | Ferolito | Oct 2007 | B2 |
| 7412551 | Bose et al. | Aug 2008 | B2 |
| 7512729 | Bose et al. | Mar 2009 | B2 |
| 7653069 | Lakshmanamurthy et al. | Jan 2010 | B2 |
| 20030165151 | Chao et al. | Sep 2003 | A1 |
| 20030223420 | Ferolito | Dec 2003 | A1 |
| 20050246463 | Barrick | Nov 2005 | A1 |
| 20060101178 | Zhong et al. | May 2006 | A1 |
| 20060101179 | Lee et al. | May 2006 | A1 |
| 20080288689 | Hoang et al. | Nov 2008 | A1 |
| 20120036412 | Sugawara | Feb 2012 | A1 |
| 20120096204 | Auerbach et al. | Apr 2012 | A1 |
| 20120226833 | Mostinski et al. | Sep 2012 | A1 |
| 20150019731 | Abts | Jan 2015 | A1 |
| 20160188529 | Nagarajan et al. | Jun 2016 | A1 |
| 20170270066 | Gopalakrishnasetty et al. | Sep 2017 | A1 |
| Entry |
|---|
| International Search Report and Written Opinion received for PCT Patent Application No. PCT/US19/015573, dated May 1, 2019, 10pages. |
| Lee, M. et al., “Approximating Age-based Arbitration in On-Chip Networks,” (Research Paper), Sep. 11-15, 2010, pp. 575-576, http://people.csail.mit.edu/leejw/pact10_age.p. |
| “The Multiplexer: Electronics Tutorials”, Online available at <http://web.archive.org/web/20160831193127/http://www.electronics-tutorials.ws:80/combination/comb_2.html> Aug. 31, 2016, 11 pages. |
| Burr et al., “Digital Signal Processing Systems: Implementation Techniques”, Demultiplexer, online available at < https://www.sciencedirect.com/topics/engineering/demultiplexer >, 1995, 17 pages. |
| Number | Date | Country | |
|---|---|---|---|
| 20200304424 A1 | Sep 2020 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 15883911 | Jan 2018 | US |
| Child | 16946162 | US |
