Integrated circuit development involves pre-manufacturing verification during which the operation of one or more portions of the integrated circuit are simulated using one of EDA simulation tools (e.g., Verilog simulations), as well as emulated, and one or more resulting outputs are compared to a set of expected results. However, verification engineers typically must wait until the designs of all the various components of the integrated circuit are complete to perform comprehensive verification, which can cause severe delays in verifying the operation of the integrated circuit and, particularly when verification fails, can severely delay production goals, result in missed deadlines and further manufacturing delays, and otherwise negatively impact the production cycle. Often, after a problem is identified in verification, multiple design teams need to be involved in identifying and remediating the problem, which increases costs and causes further delays. Additionally, even after a problem is remediated, further verification of the entire circuit must be performed to ensure that the remediation of the identified problem does not result in other problems. Accordingly, the verification process typically consumes a large amount of time and resources, especially as integrated circuit designs become more complex and involve increasing numbers of contractors, subcontractors, and suppliers.
The present disclosure may be better understood, and its numerous features and advantages made apparent to those skilled in the art by referencing the accompanying drawings. The use of the same reference symbols in different drawings indicates similar or identical items.
To illustrate, in some embodiments, circuit nodes in an emulation model are selected and smart feedback is provided to the nodes in response to signals detected at the nodes. In this way, behavior of unavailable or unverified components to be located at the nodes are simulated and smart feedback is provided to the node to enable verification of the emulation model without having to wait for the unverified or unavailable components to be provided or verified. In some embodiments, a request for manufacture is generated including aspects of the emulation model to enable verification of a fabricated circuit in a similar or identical manner to those used to verify the emulation model.
To illustrate further via an example, in some verification scenarios, it is desirable to verify the operation of an input/output (I/O) module of an integrated circuit design, and in particular the operation of an I/O module as it negotiates a communication session with an external component (that is, a component external to the integrated circuit, such as another integrated circuit). Conventionally, to verify the operation of the I/O module, a verification system emulates the operation of both the I/O module and the external component. However, this requires a complete emulation model of the external component, which increases the time and complexity associated with the verification process. Using the techniques herein, the operation of the external component is not fully emulated. Instead, the verification system employs a feedback representation to emulate the required communications from the external component to the I/O module. Because the feedback representation does not emulate all operations of the external component itself, the feedback representation is able to be developed and adjusted relatively quickly, reducing the time and complexity of the verification process.
Aspects of the present disclosure are directed to pre-manufacture verification, emulation, and on-chip post-fabrication operation and verification. In some embodiments, a smart feedback design for verification is presented and applied to inter-module, inter-core, inter-chiplet, and/or inter-chip pre-manufacture verification, emulation, or post-fabrication operation or verification. Using aspects of the present disclosure, in some embodiments, smart feedback provided to a selected node in a circuit is identical to feedback the node would receive from an unavailable or unverified component. Accordingly, in some embodiments, rather than merely redirecting data or returning identical data, the operation of an unavailable or unverified component is simulated such that verification can be performed at any point in the design process without delay.
By analyzing output data of the circuit representation 102 that is generated in response to the test signal representation 104 and often other characteristics of the performance of the circuit representation 102 the simulation provides (e.g., thermal characteristics and electromagnetic characteristics, among others), the verification system 103 determines whether the circuit representation 102 accurately performs its intended function. However, modern chip design often requires a complex orchestration of vendors, engineers, designers, and contractors in order to meet deadlines, and so verification of a final circuit design typically must wait until every single component of a design (e.g., a number of multi-chip modules or chiplets) is complete. After receiving a final circuit design, a verification engineer must then run simulations using the verification system 103 of the entire circuit in order to ensure proper operation, which often involves careful arrangement of data stored in thousands of files. Once the final circuit is ready for verification simulation, due to the complexity of modern designs, the verification engineer still often must wait up to a week for the verification system 103 to simulate a few milliseconds of simulation inputs. For this reason, verification often causes undesirable delays in production, particularly when one or more components are only available to the verification engineer at or near the end of the design phase.
In order to reduce the effects of the bottleneck created by delays in receiving final designs for various components, in accordance with aspects of the present disclosure, the verification engineer and/or verification system 103 identifies one or more nodes, such as the node 106 of the circuit representation 102, where the circuit representation 102 will interface with an external component 108, such as a multi-chip module, a communication interface, or any other aspect of a final circuit design, via an external interface 110 located at the node 106. Although the external component 108 and external interface 110 are shown in
After selecting a node such as the node 106 in the circuit representation 102 connected to an external component such as external component 108 through an interface such as external interface 110, the verification system 103 uses aspects of the present disclosure in order to simulate performance of the circuit representation 102 without needing access to, or having to rely on accuracy of, the design of the external component 108. For example, even if the final design of the external component 108 is available, the verification engineer may desire to isolate a component of a final circuit in a simulation in order to ensure it is operating properly prior to running more complex simulations with additional components. However, to thoroughly verify the circuit of circuit representation 102 without relying on the actual final design of the external component 108, the verification system 103 needs to simulate functionality of the external component 108. In order to provide smart feedback in response to outputs of the circuit of circuit representation 102 at the node 106, the present disclosure provides simulated feedback 111 to the node 106 in accordance with a feedback representation 112 configured to emulate operation of the external component 108 and/or external interface 110.
In order to enable the verification system 103 to generate the simulated feedback 111 based on the feedback representation 112, in some embodiments, the emulation model 100 includes a control interface 114 usable to control operation of the feedback representation. In some embodiments, the control interface 114 is external to the circuit representation 102, as shown in
In some embodiments, the verification system 103 configures the feedback representation 112 based on a behavioral model 115 of the external component 108. In some embodiments, the behavioral model 115 includes statistical, heuristic, mathematical, and/or logical representations of the external component 108. For example, in some embodiments, the behavioral model 115 provides the feedback representation 112 with a functional model of a communications interface, a memory such as a cache, a co-processor, a data bus, or a storage device, among others, which performs full or partial emulation of the component it models. In some embodiments, the verification system 103 selects the behavioral model 115 from a prepopulated library, and, in some embodiments, a verification engineer configures the behavioral model 115 as needed for a specific component or specific test. In some embodiments, the verification system 103 configures the feedback representation 112 based on a machine learning model 116 of the external component 108. For example, in some embodiments, the feedback representation 112 updates a machine learning support matrix using supervised or unsupervised learning in response to arbitrary outputs from the node 106. In some embodiments, the machine learning model 116 includes, or a verification engineer configures the machine learning model 116 as a function of, one or more artificial neural networks, decision trees, linear regressions, logistic regressions, and/or support vector machines, among others.
In some embodiments, the verification system 103 configures the feedback representation 112 based on a virtualized component 118 of the external component 108. In some embodiments, the virtualized component 118 includes a logical abstraction of one or more pieces of hardware or software. For example, in some embodiments, the virtualized component 118 emulates an application, an operating system, a server or other computer, or a specific environment that the verification system 103 needs to perform a complete verification. In some embodiments, the verification system 103 configures the feedback representation 112 to produce errors, distortion, and/or random data 120 as required to ensure the robustness of the circuit of circuit representation 102. Thus, in some embodiments, the verification system 103 configures the feedback representation 112 to provide parity errors, introduce data distortions in re-transmission of data, and/or simulate packet or transmission drops or errors, among others, to provide exhaustive verification and, as a result, increase the security or reliability of a circuit of the circuit representation 102.
In some embodiments, the verification system 103 configures the feedback representation 112 with a programmable delay, programmable data, programmable addressing, or other protocol-specific attributes. In some embodiments, the verification system 103 configures the feedback representation 112 to operate in a burst mode, a continuous mode, or to provide a programmable number of reflections. In some embodiments, the verification system 103 configures the feedback representation 112 to use one or more addressing modes, such as swapping a destination and source address, or to use a programmable destination for reflected packets or responses. In some embodiments, the verification system 103 configures the feedback representation 112 to use one or more data response options, such as a random response within a set range, a noise signal, or a programmable data response. In some embodiments, the verification system 103 configures the feedback representation 112 to respond to programmable triggers based on an output of the circuit in circuit representation 102 at node 106, in some embodiments such that the feedback representation 112 only responds to the triggers with simulated feedback 111 while the feedback representation 112 is otherwise bypassed or merely inactive.
Accordingly, using aspects of the present disclosure, the verification system 103 configures the feedback representation 112 as needed via the control interface 114 in order to provide simulated feedback 111 at the node 106 when required, which enables the verification system 103 to simulate operation of the circuit in circuit representation 102 without needing to rely on the accuracy of an external component 108 or without even having access to a final design for the external component 108. Thus, by using an emulation model like emulation model 100, the verification system 103 simulates operation of elements of a final circuit design as components are developed or finalized without having to wait until every component is complete, which drastically reduces the traditional bottleneck created by delays in receiving final designs for various components. After a final circuit design is complete and the verification system 103 executes all required simulations and verifies that the circuit in circuit representation 102 performs as expected, in some embodiments, at block 212, the verification engineer and/or verification system 103 then includes the feedback representation 112 in a request for manufacture 124, as described further herein in connection with
At block 206, the verification engineer causes the verification system 103 to simulate operation of the circuit in the circuit representation 102 based on the test signal representation 104. At block 208, in response to the simulated circuit in the circuit representation 102 generating an output at the node 106 associated with the feedback representation 112, the verification system 103 provides simulated feedback 111, such as one or more command responses, error messages, communication session negotiation messages, logical responses, and/or emulated circuit responses, among others, as discussed herein, to the simulated circuit in the circuit representation 102 at the node 106. In some embodiments, depending on whether and how the verification engineer and/or verification system 103 has configured the feedback representation 112, at block 210, the verification system 103 simulates operation of a virtualized component 118. After completing all required simulations and verifying that the circuit in circuit representation 102 performs as expected, in some embodiments, at block 212, the verification engineer and/or verification system 103 then includes the feedback representation 112 in a request for manufacture such as request for manufacture 124 of
In some embodiments, the control interface input/output 302 is a pin operable to control bypass switch 304, in which case the control interface 114 and control interface input/output 302 are a single component. In other embodiments, as noted above, the control interface input/output 302 is a port, a pin, or a communications module, such that the verification system 103 can provide more complex signals and/or instructions to the feedback representation 112 in addition to controlling the bypass switch 304. For example, in some embodiments, the control interface 114 is a wireless interface and the control interface input/output 302 is an antenna, enabling the verification system 103 to wirelessly interact with the control interface 114. Generally, the control interface 114 and control interface input/output 302 can take any form that enables the verification system 103 to interact with the feedback representation 112 and/or bypass switch 304 as needed.
In some embodiments, the bypass switch 304 is controllably actuated through the control interface 114 and/or the feedback representation 112 in order to provide smart feedback in the form of simulated feedback 111 in accordance with the teachings of the present disclosure. Although shown as a switch in
In order to configure the feedback representation 112 of the circuit 400, in some embodiments, a verification system programs a memory 402 connected with the feedback representation 112. In
In some embodiments, the techniques described above are implemented in a system including one or more integrated circuit (IC) devices (also referred to as integrated circuit packages or microchips), such as the smart feedback emulation model 100, the method 200 for providing smart feedback, the request for manufacture 124, and the smart feedback circuit 400 described above with reference to
A computer readable storage medium may include any non-transitory storage medium, or combination of non-transitory storage media, accessible by a computer system during use to provide instructions and/or data to the computer system. Such storage media can include, but is not limited to, optical media (e.g., compact disc (CD), digital versatile disc (DVD), Blu-Ray disc), magnetic media (e.g., floppy disc, magnetic tape, or magnetic hard drive), volatile memory (e.g., random access memory (RAM) or cache), non-volatile memory (e.g., read-only memory (ROM) or Flash memory), or microelectromechanical systems (MEMS)-based storage media. The computer readable storage medium may be embedded in the computing system (e.g., system RAM or ROM), fixedly attached to the computing system (e.g., a magnetic hard drive), removably attached to the computing system (e.g., an optical disc or Universal Serial Bus (USB)-based Flash memory), or coupled to the computer system via a wired or wireless network (e.g., network accessible storage (NAS)).
In some embodiments, certain aspects of the techniques described above may implemented by one or more processors of a processing system executing software. The software includes one or more sets of executable instructions stored or otherwise tangibly embodied on a non-transitory computer readable storage medium. The software can include the instructions and certain data that, when executed by the one or more processors, manipulate the one or more processors to perform one or more aspects of the techniques described above. The non-transitory computer readable storage medium can include, for example, a magnetic or optical disk storage device, solid state storage devices such as Flash memory, a cache, random access memory (RAM) or other non-volatile memory device or devices, and the like. The executable instructions stored on the non-transitory computer readable storage medium may be in source code, assembly language code, object code, or other instruction format that is interpreted or otherwise executable by one or more processors.
Note that not all of the activities or elements described above in the general description are required, that a portion of a specific activity or device may not be required, and that one or more further activities may be performed, or elements included, in addition to those described. Still further, the order in which activities are listed are not necessarily the order in which they are performed. Also, the concepts have been described with reference to specific embodiments. However, one of ordinary skill in the art appreciates that various modifications and changes can be made without departing from the scope of the present disclosure as set forth in the claims below. Accordingly, the specification and figures are to be regarded in an illustrative rather than a restrictive sense, and all such modifications are intended to be included within the scope of the present disclosure.
Benefits, other advantages, and solutions to problems have been described above with regard to specific embodiments. However, the benefits, advantages, solutions to problems, and any feature(s) that may cause any benefit, advantage, or solution to occur or become more pronounced are not to be construed as a critical, required, or essential feature of any or all the claims. Moreover, the particular embodiments disclosed above are illustrative only, as the disclosed subject matter may be modified and practiced in different but equivalent manners apparent to those skilled in the art having the benefit of the teachings herein. No limitations are intended to the details of construction or design herein shown, other than as described in the claims below. It is therefore evident that the particular embodiments disclosed above may be altered or modified and all such variations are considered within the scope of the disclosed subject matter. Accordingly, the protection sought herein is as set forth in the claims below.