Patent Application
20220083027
The subject matter disclosed herein relates generally to industrial automation systems, and, more specifically, to simulation and testing of industrial automation systems.
The following presents a simplified summary in order to provide a basic understanding of some aspects described herein. This summary is not an extensive overview nor is intended to identify key/critical elements or to delineate the scope of the various aspects described herein. Its sole purpose is to present some concepts in a simplified form as a prelude to the more detailed description that is presented later.
In one or more embodiments, a system for simulating industrial automation systems is provided, comprising a simulation component configured to execute a simulation of an industrial automation system under control of an industrial control program based on a virtual model of the industrial automation system and execution of the industrial control program by an industrial controller; and a controller emulation component configured to instantiate a network emulator as a device driver in a kernel space of the system, wherein the network emulator is configured to emulate a control network over which the industrial controller communicates with devices of the industrial automation system.
Also, one or more embodiments provide a method for simulating industrial automation systems, comprising executing, by the system, a simulation of an industrial automation system under control of an industrial control program based on a virtual model of the industrial automation system and execution of the industrial control program by an industrial controller, wherein the executing the simulation comprises: generating a network emulator as a device driver in a kernel space of the system, and emulating, by the network emulator, a control network over which the industrial controller communicates with devices of the industrial automation system.
Also, according to one or more embodiments, a non-transitory computer-readable medium is provided having stored thereon instructions that, in response to execution, cause a system to perform operations, the operations comprising executing a simulation of an industrial automation system under control of an industrial control program based on a virtual model of the industrial automation system and execution of the industrial control program by an industrial controller, wherein the executing the simulation comprises: generating a network emulator as a virtual machine in a kernel space of the system, and emulating, by the network emulator, a control network over which the industrial controller communicates with devices of the industrial automation system.
To the accomplishment of the foregoing and related ends, certain illustrative aspects are described herein in connection with the following description and the annexed drawings. These aspects are indicative of various ways which can be practiced, all of which are intended to be covered herein. Other advantages and novel features may become apparent from the following detailed description when considered in conjunction with the drawings.
The subject disclosure is now described with reference to the drawings, wherein like reference numerals are used to refer to like elements throughout. In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding thereof. It may be evident, however, that the subject disclosure can be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram form in order to facilitate a description thereof.
As used in this application, the terms “component,” “system,” “platform,” “layer,” “controller,” “terminal,” “station,” “node,” “interface” are intended to refer to a computer-related entity or an entity related to, or that is part of, an operational apparatus with one or more specific functionalities, wherein such entities can be either hardware, a combination of hardware and software, software, or software in execution. For example, a component can be, but is not limited to being, a process running on a processor, a processor, a hard disk drive, multiple storage drives (of optical or magnetic storage medium) including affixed (e.g., screwed or bolted) or removable affixed solid-state storage drives; an object; an executable; a thread of execution; a computer-executable program, and/or a computer. By way of illustration, both an application running on a server and the server can be a component. One or more components can reside within a process and/or thread of execution, and a component can be localized on one computer and/or distributed between two or more computers. Also, components as described herein can execute from various computer readable storage media having various data structures stored thereon. The components may communicate via local and/or remote processes such as in accordance with a signal having one or more data packets (e.g., data from one component interacting with another component in a local system, distributed system, and/or across a network such as the Internet with other systems via the signal). As another example, a component can be an apparatus with specific functionality provided by mechanical parts operated by electric or electronic circuitry which is operated by a software or a firmware application executed by a processor, wherein the processor can be internal or external to the apparatus and executes at least a part of the software or firmware application. As yet another example, a component can be an apparatus that provides specific functionality through electronic components without mechanical parts, the electronic components can include a processor therein to execute software or firmware that provides at least in part the functionality of the electronic components. As further yet another example, interface(s) can include input/output (I/O) components as well as associated processor, application, or Application Programming Interface (API) components. While the foregoing examples are directed to aspects of a component, the exemplified aspects or features also apply to a system, platform, interface, layer, controller, terminal, and the like.
As used herein, the terms “to infer” and “inference” refer generally to the process of reasoning about or inferring states of the system, environment, and/or user from a set of observations as captured via events and/or data. Inference can be employed to identify a specific context or action, or can generate a probability distribution over states, for example. The inference can be probabilistic—that is, the computation of a probability distribution over states of interest based on a consideration of data and events. Inference can also refer to techniques employed for composing higher-level events from a set of events and/or data. Such inference results in the construction of new events or actions from a set of observed events and/or stored event data, whether or not the events are correlated in close temporal proximity, and whether the events and data come from one or several event and data sources.
In addition, the term “or” is intended to mean an inclusive “or” rather than an exclusive “or.” That is, unless specified otherwise, or clear from the context, the phrase “X employs A or B” is intended to mean any of the natural inclusive permutations. That is, the phrase “X employs A or B” is satisfied by any of the following instances: X employs A; X employs B; or X employs both A and B. In addition, the articles “a” and “an” as used in this application and the appended claims should generally be construed to mean “one or more” unless specified otherwise or clear from the context to be directed to a singular form.
Furthermore, the term “set” as employed herein excludes the empty set; e.g., the set with no elements therein. Thus, a “set” in the subject disclosure includes one or more elements or entities. As an illustration, a set of controllers includes one or more controllers; a set of data resources includes one or more data resources; etc. Likewise, the term “group” as utilized herein refers to a collection of one or more entities; e.g., a group of nodes refers to one or more nodes.
Various aspects or features will be presented in terms of systems that may include a number of devices, components, modules, and the like. It is to be understood and appreciated that the various systems may include additional devices, components, modules, etc. and/or may not include all of the devices, components, modules etc. discussed in connection with the figures. A combination of these approaches also can be used.
At a high level, designing a new industrial automation system typically involves two separate but interrelated engineering efforts to develop the mechanical aspects on one hand and control aspects on the other. Mechanical engineering may involve selecting or designing the machines that will make up the new system (e.g., industrial robots, machining stations, conveyors, operator workstations, motion devices, motors, pneumatic actuators, etc.), determining suitable locations and orientations of these machines, selecting and locating sensors that will be used to feed status and operating data to the control devices, etc. Based on this mechanical design, controls engineers design the electrical system for both power and data connectivity, develop control code (e.g., ladder logic, sequential function charts, function block diagrams, structured text, etc.) to be executed by one or more industrial controllers to control the behavior of the automation system, set device configurations (e.g., motor drive parameter settings), and develop human-machine interfaces (HMIs) for visualizing machine statuses and alarms. As part of the development process, controls engineers may also execute digital simulations that test the control programming against a virtualization of the mechanical system (e.g., a digital twin).
Given these two engineering threads, conventional engineering workflow for designing, programming, and testing an industrial automation system typically requires the use of separate design tools for mechanical engineering and controls engineering.
Control design platforms 106 may also include a digital simulation platform that emulates execution of the control program against a virtual model of the automation system in order to test the control programming and the mechanical design, a process referred to as virtual commissioning. Such simulation platforms can mimic the behavior of the automation system's mechanical assets in response to execution of the control program on an emulated industrial controller so that proper operation can be verified. During commissioning of the physical system, the completed control code, device configurations, and HMI applications are downloaded to the appropriate field devices 108 of the automation system.
Since there is typically no direct link between the mechanical and control design platforms, changes made to the mechanical design on the CAD side must be communicated to the controls engineer so that the control design can be updated accordingly if necessary. Consequently, if the two engineering teams are working in parallel and revising their respective designs, maintaining synchronization between the mechanical and control designs can be difficult. Moreover, if the system design is to be tested via simulation, a virtual simulation-capable model of the automation system (e.g., a digital twin) must be developed separately from the mechanical CAD model 102 in order to test the control programming in the virtual domain prior to commissioning, since the mechanical model 102 developed on the CAD platform 104 is not simulation-capable and thus cannot be used for virtual commissioning.
To address these and other issues, one or more embodiments of the present disclosure provide an industrial CAD system, or an add-on thereto, that simplifies automation system development workflow by integrating the mechanical and control domains into the CAD platform, making CAD a common source of information for both the mechanical aspects as well as the electrical and control interface information. According to one or more embodiments, the CAD system can incorporate a set of features that allow a user to mark or label selected elements of a mechanical CAD drawing with “aspects” within the CAD environment. These aspect markups label the selected mechanical elements as being specific types of industrial assets or control elements. For example, a user may label a selected element or component of the mechanical CAD model as being a certain type of dynamic or kinematic joint (e.g., a slider joint, a robot joint, a revolute joint, a prismatic joint, a helical joint, a cylindrical joint, a planar joint, a spherical joint, etc.), a conveyor, a motor, a gripper (e.g., a mechanical gripper, a suction gripper, etc.), a mechanical load, a sensor, an actuator, or another type of industrial asset. The aspects can also define physics geometries or properties of selected elements of the mechanical design.
When selected elements of the mechanical CAD model are labeled with these aspects, the CAD platform associates simulation metadata with the selected elements based on the type of aspect with which each element is labeled. This simulation metadata defines the behavior—e.g., ranges, directions, and/or axes of motion, motion constraints, speeds, forces, etc.—of the selected element within the context of a virtual simulation, transforming the mechanical CAD model into a simulation-capable digital model (e.g., a dynamic digital twin) that can be exported to a simulation and testing platform. Within the simulation and testing platform, the resulting enhanced model can be connected to an emulated industrial controller to test control logic and to monitor simulated operation of the automation system. In this way, both mechanical and simulation markups can be added through the CAD platform to yield a usable emulation and simulation model of the automation system.
CAD system 202 can include a user interface component 204, a mechanical modeling component 206, an aspect metadata component 208, a model export component 210, a model import component 212, one or more processors 218, and memory 220. In various embodiments, one or more of the user interface component 204, mechanical modeling component 206, aspect metadata component 208, model export component 210, model import component 212, the one or more processors 318, and memory 320 can be electrically and/or communicatively coupled to one another to perform one or more of the functions of the CAD system 202. In some embodiments, components 204, 206, 208, 210, and 212 can comprise software instructions stored on memory 220 and executed by processor(s) 218. CAD system 202 may also interact with other hardware and/or software components not depicted in
User interface component 204 can be configured to receive user input and to render output to a user in any suitable format (e.g., visual, audio, tactile, etc.). In some embodiments, user interface component 204 can render interactive display screens on a display device (e.g., a display device associated with a desktop computer, a laptop computer, a tablet computer, a smart phone, etc.), where the display screens serve as the interface for a 3D mechanical design platform. The user interface component 204 can render selectable design tools and receive design input via interaction with the tools in connection with designing mechanical aspects of an industrial automation system or machine. User interface component 204 can also render a 3D graphical representation of the automation system in accordance with the design input. As will be described in more detail herein, design tools made available by the user interface component 204 include a set of automation aspects that can be selectively associated with mechanical elements or components of the automation system being designed. The aspects made available for selection are based on aspect definitions 222 maintained on the memory 220, which define the available aspects as well as associated simulation data for the respective aspects which can be used by a simulation platform to simulate operations or behaviors of the aspects within the context of an industrial simulation.
Mechanical modeling component 206 can be configured to generate a three-dimensional mechanical model of an automation system or machine based on the design input provided by a user via user interface component 204. Aspect metadata component 208 can be configured to assign aspect metadata to selected elements of the mechanical model in accordance with design input received from the user. As will be described in more detail herein, the aspect metadata labels the selected elements as being particular types of industrial components or machines (e.g., a joint of a particular type, a motor, a sensor, a conveyor, etc.), or as having a particular physics geometry or behavior. Aspect metadata assigned to a given element is drawn from one or more of the aspect definitions 222 corresponding to respective one or more aspects assigned to the element. Adding this aspect metadata to the mechanical model can yield an enhanced mechanical model (e.g., a dynamic digital twin) of the automation system that can be executed within a simulation platform to mimic the behavior of the automation system under control of an industrial control program.
The model export component 210 can be configured to export the enhanced mechanical model to an external system, such as a control design platform or a simulation platform. The model import component 212 can be configured to import the enhanced mechanical model from such external systems. In some scenarios, the enhanced mechanical model or its associated aspect metadata may have been modified by the external system. These modifications are maintained with the model and are therefore imported back into the CAD system 202 with the model, thereby maintaining synchronization between mechanical and control engineering.
The one or more processors 218 can perform one or more of the functions described herein with reference to the systems and/or methods disclosed. Memory 220 can be a computer-readable storage medium storing computer-executable instructions and/or information for performing the functions described herein with reference to the systems and/or methods disclosed.
User interface component 304 can be configured to receive user input and to render output to a user in any suitable format (e.g., visual, audio, tactile, etc.). In some embodiments, user interface component 304 can render interactive display screens on a display device (e.g., a display device associated with a desktop computer, a laptop computer, a tablet computer, a smart phone, etc.), where the display screens serve as the interface for a control design and/or simulation platform. The user interface can display virtual 3D simulations of automation systems being tested against an emulated industrial control program, render operational statistics representing expected performance of the automation system based on the simulation, and other such information. In some embodiments, the user interface component 304 can also render selectable design tools and receive design input via interaction with the tools in connection with configuring aspects for the industrial automation (e.g., I/O connectivity between devices of the virtual system and an industrial controller). Similar to the CAD system 202 described above, design tools made available by the user interface component 304 can include a set of automation aspects that can be selectively associated with mechanical elements or components of the automation system being designed. The aspects made available for selection are based on aspect definitions 322 maintained on the memory 320, which define the available aspects as well as associated simulation data for the respective aspects which can be used by a simulation platform to simulate operations or behaviors of the aspects within the context of an industrial simulation.
Simulation component 306 can be configured to simulate operation of a virtualized model of an industrial automation system under control of an industrial control program. Controller emulation component 308 can be configured to emulate execution of an industrial control program being testing on a virtualized (or emulated) industrial controller.
Aspect metadata component 310 can be configured to assign aspect metadata to selected elements of the digital model of the automation system in accordance with design input received from the user (similar to aspect metadata component 208 of CAD system 202). Model import component 212 can be configured to import a mechanical CAD model of an automation system, or another type of digital model of the system.
The one or more processors 318 can perform one or more of the functions described herein with reference to the systems and/or methods disclosed. Memory 320 can be a computer-readable storage medium storing computer-executable instructions and/or information for performing the functions described herein with reference to the systems and/or methods disclosed.
User interface component 204 can render graphical interface displays via the client device's display hardware. Through interaction with these interface displays, the user can submit mechanical design input 404 specifying mechanical aspects of the automation system being designed. For example, mechanical design input 404 can specify three-dimensional shapes representing mechanical structures or devices to be included in the mechanical design. These shapes can graphically represent such industrial assets as industrial robots, conveyors, tooling machines, motors, motor drives, sensors, piping, conduit, platforms, safety gates and fences, control cabinets, or other such assets. The mechanical design input 404 can also specify the locations and orientations of these graphical representations relative to one another, physical connections between the mechanical elements, or other such mechanical properties and relationships. Mechanical modeling component 206 generates a 3D mechanical model 402 of the automation system (e.g., a machine assembly, a production line, etc.) in accordance with the graphical representations and their relationships defined by the mechanical design input 404.
Mechanical design input 404 can be submitted via user interface component 204 in any suitable format according to various embodiments. For example, the graphical interface displays rendered by user interface component 204 can comprise a workspace or canvas on which the mechanical model 402 is rendered, as well as associated toolbars from which the user can select 2D or 3D drawing tools or pre-defined shapes or components for inclusion in the model 402. In some embodiments, shapes representing mechanical components can be dragged into the main workspace from the toolbar, or otherwise added to the workspace for placement and orientation within the model 402. Shapes or collections of shapes within the workspace can be manipulated via interaction with the graphical interface. For example, a designer can interact with selected shapes, collections of shapes, or the model 402 as a whole to rotate, link, or relocate shapes within virtual three-dimensional space. Additions or modifications to the mechanical model 402 are stored within a CAD file representing the model 402 (e.g., a part or assembly file).
The resulting mechanical model 402 encodes the mechanical layout of the automation system being designed. However, at this stage the mechanical model 402 is essentially only a three-dimensional technical drawing suitable for use as a guide for building and installing the automation system. Controls engineers responsible for designing the electrical and control system for the automation system may also reference this model 402 in connection with developing a list of controller I/O required to monitor and control the new system, designing the power distribution wiring for providing power to the system, and generating control programming Conventionally, if the controls engineer wishes to test the control programming by simulating operation of the automation system under control of the program within the context of an emulation system, a simulation-capable digital model (e.g., a digital twin) of the automation system must be separately developed and linked to an emulated controller executing the control program.
In order to simplify this workflow and generate a digital twin of the automation system more quickly, embodiments of CAD system 202 allow the user to enhance the completed mechanical model 402 with aspect metadata that transforms the mechanical model 402 to a simulation-capable digital model of the automation system that can be executed within a simulation platform to mimic operation of the system.
Each aspect definition 222 defines a set of physical, kinematic, or mechatronic properties that dictate how that aspect behaves within a simulation environment. The properties defined by an aspect definition 222 substantially mirror physical behaviors and characteristics of the corresponding physical aspect in the real world. CAD system 202 classifies the aspect definitions 222 according to the type of mechanical element, control element, or device for which the physical properties are defined. The aspect toolbar rendered by the user interface component 204 lists the available aspects according to these classifications for selection by the user. Example aspects that can be selected and applied to the mechanical model 402 include, but are not limited to, various types of dynamic or kinematic joints (e.g., slider joints, revolute joints, robot arm joints, hinges, etc.), movement surfaces such as conveyors, motors, grippers (e.g., suction grippers, mechanical grippers, etc.), sensors, pneumatic or hydraulic actuators (e.g., pusher arms, stoppers, etc.), rollers, or other such elements of the mechanical system.
The catalog of aspect definitions 222 can also include various types of robotic end effectors (e.g., mechanical grippers, suction grippers, etc.). End effector aspect definitions 222 can define physical properties (e.g., 3D physics constraints) for their corresponding gripper types, which can be used on the control simulation side to more accurately mimic operation of a robot's part handling behavior at a low level of abstraction. For example, a suction gripper aspect applied to a representation of a robot defined in the mechanical model 402 may indicate to a simulation platform that the robot's end effector is to be modeled as a suction gripper, whereby products in proximity of the suction gripper can be assumed to have been gripped by the robot (via suction), and can subsequently be moved in tandem with the robot arm to simulate movement of the part by the robot. By contrast, a mechanical gripper aspect may imply more complicated physics involved with movement of a part by the gripper. In the case of a mechanical gripper aspect, constraints of a physics engine may be used to determine whether the sides of the gripper are touching respective sides of a product at a proper location and angle before allowing the part to move in tandem with movement of the robot (due to friction between the gripper arms and the product surfaces).
Some aspect definitions 222 may also define physics geometries or properties that can be associated with selected elements of the mechanical model 402. Aspects can also designate selected machines defined within the mechanical model 402 as being load creators that introduce products having a designated shape and physical behavior (e.g., collision physics) into the automation system; e.g., via a conveyor that feeds the system.
The process of adding aspect metadata 508 to the mechanical model 402 involves labeling selected mechanical components or devices represented by the mechanical model 402 as being one of the available control aspects (represented by one of the aspect definitions 222). This aspect labeling workflow can be performed by submitting aspect specification input 504 via interaction with the graphical interface displays rendered by user interface component 204. For example, a user may select, as an aspect, a type of robot joint from the aspect toolbar and subsequently select an element of the mechanical model 402 to be labeled as this type of joint. In response to these selections, aspect metadata component 208 associates the aspect metadata 508 for the selected type of robot joint with the indicated component of the mechanical model 402, thereby transforming the static mechanical representation of the joint to an active virtual control element whose behavior can be virtually simulated within a simulation platform. The aspect metadata 508 assigned to the selected mechanical component is drawn from the aspect definition 222 corresponding to the indicated type of aspect.
Aspect metadata 508 can define substantially any type of information that can be recognized and leveraged by a simulation platform to accurately model the runtime movement or behavior of the corresponding mechanical component in response to control inputs or simulated forces. Depending on the aspect, the aspect metadata 508 may comprise default fixed values or properties that are globally applicable to all instances of that aspect, as well as user-defined metadata that can be customized by the user to conform to the specifics of the user's system.
In the example depicted in
In general, the list of available user-definable aspect metadata values rendered by the user interface component 204 is based on the particular aspect selected. In this way, when a user assigns an aspect to a component of the mechanical model 402, user interface component 204 prompts the user to enter values of any user-defined metadata fields that may be available for that selected aspect. In the illustrated example, user-definable aspect metadata 508 for a conveyor can include definitions for a leading edge 614 and a trailing edge 616 of the conveyor 612, which may be automatically identified by aspect metadata component 208 based on the shape of the mechanical conveyor representation to which the conveyor aspect is assigned, or may be explicitly identified by the user (e.g., by selecting the leading and trailing edges to indicate their locations). Additionally, the user interface component 204 may prompt the user to input such user-definable conveyor aspect metadata values as a running speed 618, an acceleration 620, or a deceleration 622 of the conveyor. The user may also be prompted to specify a material 624 of the belt used to convey products along the conveyor, which may impact the simulated traversal of products along the conveyor based on frictional coefficients or other physical properties of the material. A control mode 626 for the conveyor 612 may also be requested (e.g., on-off control, variable speed control, etc.).
Workflows and graphical interfaces similar to that illustrated
Some aspect definitions 222 (and corresponding aspect metadata 508 drawn from these definitions 222) may also define physical characteristics or constraints of selected mechanical components, and these characteristics and constraints can subsequently be referenced by a simulation platform to accurately simulate the movement and behaviors of the components. These characteristics can include, but are not limited to, gear diameters, gear ratios, coefficients of friction, inertias, motion constraints (e.g., known axes of motion of a particular type of robot and their corresponding motion constraints), or other such data. Depending on the type of aspect, some of these aspect metadata values may be user-defined, while others may be fixed global characteristics that are expected to be applicable to all instances of the aspect. Some aspect definitions 222 may also define executable scripts that can be executed by a separate simulation platform and applied to an associated element of the mechanical model 402 (e.g., an element labeled with the corresponding aspect by the user), causing the element to mimic the behavior of its corresponding physical component within the simulation environment.
Some aspect definitions 222 may also specify control I/O interfacing for their corresponding assets. For example, assigning aspect metadata 508 for a sensor (e.g., a photo-eye, a proximity switch, etc.) to a selected element of the mechanical model 402 representing a sensor can designate the selected element as a digital input device that provides a digital input value to an industrial controller in response to detection of an object within a detection range of the sensor. In this scenario, the detection range may be a user-defined aspect metadata value. In another example, aspect metadata 508 for a type of pusher arm may specify that the arm requires a digital controller output to control the advanced and retracted states of the pusher arm (e.g., ON for advanced and OFF for retracted), as well as two digital inputs to read the states of respective two proximity switches at the extreme ends of travel of the pusher arm to detect when the arm is in the fully advanced or fully retracted state. In general, aspect definitions 222 for system components having known or expected I/O interfacing to an industrial controller can define the inputs and/or outputs (analog and digital) required to monitor and/or control these system components. This I/O information can facilitate connectivity between the enhanced digital model 502 and an emulated controller when the model 502 is ready to be simulated within a simulation and testing platform.
Moreover, in some embodiments, when aspects having associated I/O definitions are added to the mechanical model 402, aspect metadata component 208 can automatically populate an aggregate list of system I/O with the I/O points defined by the corresponding aspect definitions 222.
In some embodiments, the master I/O list 702 can be integrated with or otherwise stored with the enhanced digital model 502 of the automation system, such that the I/O list 702 travels with the model 502. Thus, the enhanced digital model 502 includes not only the 3D layout of the new system but also the I/O map for the entire system. This master I/O list 702 can be generated before design of the control system begins in accordance with the designated aspect metadata 508, providing controls engineers with a useful design constraint (namely, the I/O required to operate the automation system).
Some aspect metadata 508 can also designate components of the mechanical model 402 as load sources, which introduce discrete items of product (e.g., boxes, luggage, manufactured parts, fluid material, or other such product) into the system. When a load source aspect label is applied to an element of the mechanical model 402, user interface component 204 can prompt the user to provide user-defined operating parameters for the designated load source, such as a rate at which products are introduced to the system, a shape of the products (e.g., boxes or cylinders having specified dimensions, items made of a flexible material and having random variable shapes, etc.), collision physics associated with the products, or other such characteristics. When the enhanced digital model 502 is subsequently imported into a simulation platform, the simulation platform simulates release of product items by the labeled load source in accordance with the load source aspect metadata 508.
In some embodiments, functionality for labeling a 3D mechanical model 402 with aspect metadata 508 as described above can be added to an existing CAD application as a plug-in or add-on. In such embodiments, installation of the aspect metadata add-on causes a new aspect toolbar or ribbon—e.g., aspect toolbar 604 illustrated in
Also, some embodiments can allow users (e.g., asset owners, original equipment manufacturers, system integrators, etc.) to extend the available aspects that can be applied to the CAD model with user-defined aspect definitions 222. Thus, in addition to the catalog of available aspect markups supported by the add-on (as defined by the aspect definitions 222), users can develop and add their own aspects—including associated simulation properties—and add these to the aspect toolbar, where the user-defined aspects can be selected and added to the mechanical CAD model 402 as aspect metadata 508. In this way, the CAD system 202 can support definition of control components that are company-specific in addition to those that are industry-specific.
When an element of the mechanical CAD model 402 is labeled with an aspect as described above, the aspect metadata data 406 defined by the aspect is associated with the selected element's CAD entity identifier.
When a user labels a selected component of the mechanical model 402 with an aspect as described above, the aspect metadata 508 for the selected aspect is added to the model's CAD file 802 in association with the selected component's entity ID 804. Since the aspect metadata 508 is tied to the CAD file's native entity IDs 804, the aspect metadata 508 is retained within the CAD file 802 itself rather than a separate file, and thus travels with the CAD file 802. In this way, the model's CAD file 802 can be imported into substantially any simulation platform as a simulation-capable enhanced digital model 502 of the automation system, and aspect metadata 508 for each entity ID 804 causes the corresponding element of the model 402 to be recognized by the simulation platform as a control or activation element.
Marking up the mechanical model 402 with aspect metadata 508 as described above yields an enhanced digital model 502 of the automation system being designed, which can be exported to a separate simulation platform for virtual commissioning.
In the present example, control design and testing system 302 comprises a controller emulation component 308 that emulates execution of an industrial control program being testing on a virtualized (or emulated) industrial controller, and a simulation component 306 that simulates operation of a virtualized model of an industrial automation system under control of the industrial control program. Within the control design and testing system 302, the enhanced digital model 502 of the automation system—comprising the mechanical model 402 augmented with aspect metadata 508 and master I/O list 702—can be interfaced with control programming (e.g., ladder logic) being developed for the automation system to yield a virtual testing environment that allows both the mechanical and control designs to be virtually simulated and tested before finalizing the overall design and proceeding to the building and installation phase.
Since the enhanced digital model 502 models mechanical characteristics of the automation system as well as behavioral properties of components that make up the model (by virtue of the aspect metadata 508), the enhanced digital model 502 can be used to simulate expected operation and behavior of the automation system while under control of an emulated control program 1008. This can include viewing and verifying the simulated system's responses to control inputs in terms of movement, speeds, flows, temperatures, fill levels, movement of product through the system, etc. In the example depicted in
Simulation component 306 can leverage the mechanical characteristics and associated aspect metadata 508 encoded in the enhanced digital model 502 to simulate operational aspects of the automation system to be monitored and regulated by the control program 1008. To achieve this, a user (e.g., a controls engineer) can virtually interface control program 1008 with the enhanced digital model 502 to facilitate exchange of simulated I/O data between the program 1008 and the digital model 502, thereby simulating real-world control and operation of the automation system. To this end, the developer can use the testing platform's configuration tools (e.g., a tag browser) to selectively map controller I/O defined by the control program 1008 to the I/O of the active control elements of the enhanced digital model 502 (that is, the control elements labeled with aspect metadata 508 designating these elements as having associated inputs and outputs available to be interfaced with an industrial controller's I/O, as documented by the master I/O list 702). In an example scenario, the controls engineer may define the PLC tags and I/O addresses that drive a motor, actuator, or other component defined in the mechanical model 402, and selectively link the tags and associated I/O addresses to the I/O points defined for the modeled component. This I/O mapping between the control program 1008 and the digital model 502, which is part of the overall automation system design, can be stored in an appropriately formatted file (e.g., a spreadsheet or another type of file) as PLC connectivity data 1006 and integrated with the digital model 502. Thus, the digital model 502 maintains this aspect of the control design in addition to the mechanical design aspects.
Control program 1008 can comprise any conceivable type of code used to process input signals read into a controller and to control output signals from the controller—including but not limited to ladder logic, sequential function charts, function block diagrams, or structured text—and is designed to regulate the automation system being modeled by digital model 502. During simulation, simulation component 306 generates digital and analog I/O values representing, for example, sensor outputs, metering outputs, or other plant data analogous to the data expected to be generated by the physical system based on the static and dynamic characteristics of the physical system represented by the digital model 502. This simulated output data 1004 is provided to the emulation component 308 executing control program 1008, which receives this data 1004 as one or more virtual physical inputs. Control program 1008 processes these inputs according to user-defined algorithms and generates digital and/or analog controller output data 1002 based on the processing. This output data 1002 represents the physical outputs that would be generated by a controller executing control program 1008 and transmitted to the hardwired field devices comprising the automation system (e.g., PID loop control outputs, solenoid energizing outputs, motor control outputs, actuator control outputs, robot control outputs, etc.). The controller output data 1002 is provided to the appropriate input points of the digital model 502 in accordance with the user-defined I/O mapping.
In addition to generating simulated output data 1004, simulation component 306 also generates system response data 1018 based on analysis of the simulated data exchange and expected behaviors of the modeled automation system in response to the simulated controller output data 1002. The simulation component 306 estimates and simulates the virtual automation system's responses to the emulated controller outputs (and the timings of these outputs) based on the behavioral and physical properties and constraints defined by the aspect metadata 508 associated with respective control elements of the mechanical model 402. For example, based on the mechanical and behavioral characteristics of the industrial components modeled in the by the enhanced digital model 502 (e.g., conveyors, industrial robots, machines, simulated products, etc.), as represented by the aspect metadata 508, simulation component 306 can predict expected behaviors of the modeled industrial components—as well as behaviors of products being manufactured, processed, or handled by the components—in response to the controller output data 1002, and convey this predicted behavior as system response data 1018. Example behaviors represented by system response data 1018 can include, but are not limited to, movements and trajectories of industrial robots, movement of product through the simulated automation system (including speeds, accelerations, locations, lags, collisions, gripper failures, etc.), flow rates of fluids through the system, expected energy consumption by the system, an expected rate of degradation of mechanical components of the system (based in part on coefficient of friction information defined in the enhanced digital model 502), expected forces applied to respective components of the system during operation, or other such behaviors.
In the case of industrial robots having end effectors that are used to grip and move items of product (e.g., to stack or palletize items of product, to move items from one conveyor to another, etc.), the simulated interactions between these robots and the products can depend in part on the type of gripper aspect metadata 508 associated with the robot's end effector. For example, as noted above, suction gripper aspect metadata 508 may indicate to the simulation component 306 that products in proximity of the suction gripper can be assumed to have been gripped by the robot provided the suction effector is properly aligned above the part, and can subsequently be moved with the robot arm to simulate movement of the part by the robot until the part is released. Alternatively, mechanical gripper aspect metadata 508 may define more involved physics to be considered by the simulation component 306 before it can be assumed that the part has been securely gripped by the robot. This may include determining whether the two arms of the gripper are touching respective sides of the product, and at the proper angles or orientations, when the effector is in the gripped position before allowing the product to move in tandem with the robot. Since secure gripping of the product by a mechanical gripper depends on proper alignment of the product upon entering the picking station from which the robot grips the part, as well as the relative alignment between the product and the robot's gripper at the time of pick-up, the simulation component 306 can assess these factors during the simulation to determine whether the product has been properly gripped, or alternatively whether a mis-grip is likely to occur due to misalignment. Instructions regarding how to properly assess this gripping behavior can be provided by the mechanical gripper aspect metadata 508 assigned to the robot.
As noted above, one or more components of the mechanical model 402 can be labeled with aspect metadata 508 designating those components as load sources. Based on this load source aspect metadata, the simulation component 306 can recognize these components of the model as load sources that introduce product (e.g., manufactured parts, boxes, bottles, fluid material, etc.) into the automation system under test, and animate these components to simulate the release of product in accordance with the metadata. Default and user-defined metadata parameters assigned to these components can define a frequency at which the product is released, a type of product (e.g., discrete solid items or liquid material), a shape of the product (e.g., boxes having specified dimensions, spherical objects, items having random amorphous shapes due to the flexible material of which the items are made, etc.), a speed at which the product traverses the system, etc. Movement of these products through the simulated automation system may also be a function of the conveyor aspect metadata associated with the conveyor representations across which the product moves (e.g., the speed of the conveyor, the material of the belt used to convey the product, etc.). The simulation component 306 can also simulate predicted collisions between items of products, or between products and machinery (e.g., collisions with a pusher arm or robot arm due to a mis-timed control sequence). Repercussions of these collisions can be predicted and simulated based on physics rules and geometries modeled in part by the aspect metadata 508. Simulation component 306 can also leverage physics rules defined by the aspect metadata 508 to determine whether a mechanical gripper has properly gripped an item of product, or is likely to drop some or all items of product due to improper gripping.
A user interface component 304 associated with the testing system 302 can generate a visualization 1014 that renders results of the simulation on a client device. Visualization 1014 can render a graphical representation of the automation system based on the enhanced digital model 502, and animate this graphical representation based on the system response data 1018 and/or other calculated statistics relating to the simulation session, yielding a three-dimensional visual presentation of the automation system in operation. Some of the simulation data can also be rendered as alphanumeric overlays on visualization 1014. This simulation technique can be used to test and debug control programs without putting field equipment and machinery at risk, to test modifications to machine operations and estimate how such modifications affect certain key performance indicators or financial metrics, or to perform other types of analytics.
In some embodiments, users can control a speed of the simulation at a high degree of granularity. For example, a user may select to execute the simulation in real-time, such the simulation depicts operation of the automation system as it would transpire in real-time. Alternatively, the user may selectively choose to execute some or all phases of a simulated control sequence or process faster than real-time, in accordance with a time base specified by the user. This causes the simulation and its associated analysis to transpire within a compressed time frame.
In the illustrated example, the control design and testing system 302 can allow the user to add to or modify aspects of the control design. This can include implementing and testing modifications to the control program 1008 based on observed results of the simulation. Some control design modifications submitted via the control design and testing system 302 may also be directed to the enhanced digital model 502.
In some embodiments, the control design and testing system 302 can also comprise an aspect metadata component 310 (see
To facilitate synchronization between the mechanical engineering and controls engineering efforts, some embodiments of CAD system 202 and control design and testing system 302 can support round-tripping of engineering data between the two systems. According to this round-tripping approach, mechanical design information and associated control aspects can be marked up on the CAD system 202 as discussed above, and the resulting simulation-capable model 502 can be exported to the control design and testing system 302. Within this control testing system 302, the enhanced digital model 502—the mechanical model 402 enhanced with aspect metadata 508 and further augmented with PLC connectivity data 1006 and a master I/O list 702—can be simulated using the control program 1008 being tested. During testing and debugging, the controls engineer may submit control design input 1106 that necessitates modifications 1102 to the enhanced digital model 502, its associate aspect metadata 508, the PLC connectivity data 1006, or the master I/O list 702, which had been initially developed on the CAD system 202.
After these modifications have been implemented on the control testing side, the updated model 502—including any modifications made to the aspect metadata 508, PLC connectivity data 1006, or master I/O list 702—can be imported back into the CAD system 202 by the CAD system's model import component 212, as illustrated in
In some embodiments, changes made to the model 502 can be version controlled by the CAD system 202. For example, the CAD system 202 may include a tool that documents changes that were made to the model 402 and reasons why the changes were made (as submitted by the user). Similar version control features may also be supported by the control design and testing system 302.
By integrating the ability to add aspect metadata to a mechanical model within the CAD system itself, embodiments of the present disclosure can provide engineers with tools to quickly and easily generate a dynamic digital twin of an automation system being designed without the need to separately develop a simulation-ready model from scratch. Since the aspect metadata tools can be added to existing CAD systems as a modular add-on in some embodiments, the process of labeling a mechanical model with aspect metadata to yield a digital twin can be intuitively integrated into an existing mechanical design workflow. Moreover, by supporting round-tripping of design data between the mechanical and controls engineering platforms, embodiments of this disclosure can facilitate synchronization between the two engineering threads, with the enhanced CAD model serving as a common source of up-to-date design information across both engineering disciplines.
At 1306, aspect specification input data is received by the CAD platform (via interaction with the CAD platform's graphical development interface). The aspect specification input data assigns a control aspect to a selected element of the mechanical model generated at step 1304. The control aspect can be selected from a list of available aspects rendered in a toolbar or ribbon of the CAD platform's graphical development interface. These aspect definitions can be classified according to types of mechanical elements, control elements, or industrial devices to which the aspects relate. Each aspect defines a set of simulation properties—e.g., physical or kinematic properties or behaviors, physics geometries, motion constraints, etc.—for its associated type of mechanical or control element that can be recognized and leveraged by a simulation platform to determine how that element moves or behaves within a simulation environment. Example aspects that can be selected and applied to the mechanical model include, but are not limited to, various types of dynamic or kinematic joints (e.g., slider joints, revolute joints, robot arm joints, hinges, etc.), movement surfaces such as conveyors, motors, grippers (e.g., suction grippers, mechanical grippers, etc.), sensors, pneumatic or hydraulic actuators (e.g., pusher arms, stoppers, etc.), rollers, or other such elements of the mechanical system.
At 1308, control aspect metadata corresponding to the control aspect selected at step 1306 is assigned to the selected element of the mechanical model (also selected at step 1306). At 1310, a determination is made as to whether assignment of aspects to selected elements of the mechanical model is complete. If additional aspects are to be assigned to the model (NO at step 1310), the methodology returns to step 1306, and steps 1306 and 1308 are repeated such that another element of the mechanical model is labeled with a selected aspect. Alternatively, if assignment of aspects to the mechanical model is complete (YES at step 1310), the methodology proceeds to step 1312, where a determination is made as to whether an export command is received by the CAD system. If the export command is received (YES at step 1312), the methodology proceeds to step 1314, where the mechanical model—enhanced with the aspect metadata applied by iterations of steps 1306 and 1308—is exported to a control simulation platform for simulation as a dynamic digital twin of the automation system. The aspect metadata applied by the CAD system instructs the simulation platform as to how the various components or elements of the mechanical model behave within a simulation context in response to emulated control by a control program being tested.
At 1401, a determination is made as to whether the aspect metadata assigned to the selected element of the mechanical model at step 1408 defines associated I/O for the aspect. In this regard, if the aspect assigned to the model element defines characteristics of an industrial asset that is typically interfaced with an industrial controller via one or more digital or analog inputs or outputs, these inputs or outputs may be defined by the aspect metadata. If the aspect metadata defines associated I/O (YES at step 1410), the methodology proceeds to step 1412, where the associated I/O defined by the aspect metadata is added to a cumulative master I/O list for the automation system. This master I/O list records the total I/O required to interface the automation system with an industrial controller to facilitate monitoring and control of the system. If the aspect metadata does not define associated I/O (NO at step 1410)—that is, the selected aspect corresponds to an element of the automation system that does not typically interface with an industrial controller—the methodology proceeds to step 1414 without updating the master I/O list at 1412.
At 1414, a determination is made as to whether assignment of aspects to the mechanical model is complete. If further aspects are to be assigned to the model (NO at step 1414), the methodology returns to step 1406, and steps 1406-1412 are repeated for another element of the mechanical model. Alternatively, if assignment of aspects is complete (YES at step 1414), the methodology proceeds to step 1416, where the enhanced mechanical model (with associated aspect metadata) and the master I/O list are exported to a control design platform. The master I/O list can be referenced by a controls engineer to aid in the design of the electrical and control system for the automation system.
In order to accurately simulate an industrial system under control of a physical or emulated industrial controller, as illustrated in
However, testing a control program 1008 using a separate hardware device to emulate the control network would requires the network configuration settings of control program 1008 to be configured—in terms of networking and device layout—to communicate with this external hardware device during the simulation, and to then be reconfigured to talk to a different set of devices when the control program 1008 is commissioned to the physical controller after simulation and testing has been completed. Ideally, the control system should be tested using the same network configuration that will be used during runtime.
To address this issue, rather than emulating the control network using a hardware device that is external to the hardware platform on which the control design and testing system 302 executes, a network emulator can operate on the same hardware platform on which the automation system simulation executes. This network emulator can operate as a device driver within the kernel of the operating system on which the control design and testing system 302 executes.
In one or more embodiments, when the system 302 is executing a simulation of an automation system represented by digital model 502 under control of an emulated control program 1008, as described above in connection with
In some embodiments, the network emulator 1502 can be a generic virtual machine that supports multiple network protocols, with application-specific code being downloaded to the emulator 1502.
When the controller emulation component 308 instantiates the network emulator 1502 in the kernel space, the network configuration data 1602 is extracted from the control program 1008 and used to program the network emulator 1502 in the kernel space with network logic 1504. This network logic 1504 configures the network emulator 1502 to simulate the data traffic handling and behavior of a control network having the configuration represented by network configuration data 1602. In some embodiment, the network emulator 1502 can determine the topology of the network (e.g., the set of devices that will be connected to the network when deployed) from the network configuration information extracted from the control program 1008, and this network topology information can be used to build the network emulation managed by the network emulator 1502.
The network logic 1504 also informs the network emulator 1502 which subsets of network traffic are to be intercepted and processed by the network emulator 1502 in connection simulating the digital model 502.
Only a subset of this data traffic 1702 relates to simulation of the digital model 502. Accordingly, network logic 1504 informs the network emulator 1502 which subset of the data traffic 1702 is directed to the virtual control network represented by the network emulator 1502. During simulation of the digital model 502, the network emulator 1502 monitors for data traffic that is directed to the virtual network (e.g., the controller output data 1002 generated based on emulation of the control program 1008, and the simulated output data 1004 generated by the simulation component 306), acts on this data in a manner that simulates the flow of the data through the control network, and returns the results to the controller emulation component 308 or the simulation component 306 using the operating system's TCP/IP stack. Subsets of data traffic 1702 not directed to the virtual network are processed by the kernel in the normal manner without being intercepted by the network emulator 1502, while data to be emulated is processed by the network emulator 1502 in accordance with the network logic 1504, which instructs the network emulator 1502 which subsets of data are to be processed.
The network emulator 1502 can also be used to simulate the control network in simulation architectures in which the automation system simulation executes on a first hardware machine (e.g., hardware platform 1506) and exchanges data with a physical hardware controller executing control program 1008, rather than with an emulated controller on the same hardware machine.
Similar to the scenario described above in connection with
Similar to the previous example, the network logic 1504 informs the network emulator 1502 which subsets of data traffic on network 1802 are directed to the emulated control network. Specifically, any simulation data 1804 generated by the industrial controller 1802 (e.g., controller output data 1002) and directed to the simulation of the digital model 502 will be intercepted by the network emulator 1502, processed in accordance with network logic 1504 a manner that simulates the flow of the data through the control network, and passes the processed data to the simulation component 306 to simulate receipt of control signals from the industrial controller 1802 via the control network. In the opposite direction, simulation data 1804 generated by simulation component 306 (e.g., simulated output data 1004) and directed to the industrial controller 1802 is intercepted and processed by the network emulator 1502 and placed on the network 1802 to simulate transportation of input device signaling to the controller 1802 over the control network.
In some embodiments, network logic 1504 for the network emulator 1502 can be written without the need to be digitally signed. When a control program 1008 is installed on the industrial controller 1008 for simulated testing, the design and testing system 302 configures the network emulator 1502 with rules specifying what data will be taken from the data traffic on network 1806, such that only specified subsets of the network traffic are processed by the network emulator 1502. The part of the network emulator 1502 that performs emulation chooses which part of the data traffic on network 1806 will be intercepted and emulated based on the rules specified by the network logic 1504. Since the network emulator 1502 is a virtual machine having a constrained environment, there is little or no risk that the network emulation is will crash the hardware platform on which design and testing system 302 executes.
The network emulator 1502 can be installed at a point in the kernel space where the emulator 1502 can be directly written into from the user space of the hardware platform's operating system. By executing at this low level of the hardware platform's operating system, the network emulator 1502 can pretend to be another device (e.g., a network emulation device) without a physical network.
In addition to taking the control network topology and configuration into consideration as part of the automation system simulation, the network emulator 1502 can also generate emulated network traffic statistics during the simulation, and these statistics can be rendered by the user interface component 304 as part of visualization 1014. These statistics can include, but are not limited to, data latencies, collision statistics, data bandwidth, data throughput, error rates, jitter, or other such statistics.
By emulating the control network within the kernel space of the operating system using a virtual machine (the network emulator 1502) and establishing a communication interconnection between this virtual machine and the user space on which the automation system simulation executes, the architecture described herein can accurately emulate the control network as part of an automation system simulation, and can perform this emulation with lower latency relative to architectures that emulate the control network using separate hardware devices.
Although the disclosed architecture and approach for emulating a control network has been described above in connection with automation system simulations using digital models 502 that were created using aspect metadata applied to mechanical CAD models, it is to be appreciated that this technique for emulation of control networks can be used in connection with any type of industrial automation simulation, regardless of the manner in which the industrial system model was created, without departing from the scope of this disclosure.
At 1904, a network emulator is instantiated as a virtual machine or device driver in the kernel space of the hardware platform. At 1906, network configuration information is extracted from an industrial control program that is to be executed as part of the control simulation. The control program may be installed on an industrial controller that is networked to the hardware platform on which the design and testing system executes the automation system simulation. At 1908, the network emulator is programmed with network logic inferred from the network configuration information. The network logic indicates a device topology of a control network over which the industrial controller will monitor and control the automation system when deployed on the plant floor. At 1910, operation of the industrial automation under control of the industrial control program is simulated on the design and testing system. The simulation involves exchange of simulation data, via the network, between the hardware platform on which the design and testing system executes and the industrial controller executing the control program.
The methodology continues with the second part 1900b illustrated in
Embodiments, systems, and components described herein, as well as control systems and automation environments in which various aspects set forth in the subject specification can be carried out, can include computer or network components such as servers, clients, programmable logic controllers (PLCs), automation controllers, communications modules, mobile computers, on-board computers for mobile vehicles, wireless components, control components and so forth which are capable of interacting across a network. Computers and servers include one or more processors—electronic integrated circuits that perform logic operations employing electric signals—configured to execute instructions stored in media such as random access memory (RAM), read only memory (ROM), hard drives, as well as removable memory devices, which can include memory sticks, memory cards, flash drives, external hard drives, and so on.
Similarly, the term PLC or automation controller as used herein can include functionality that can be shared across multiple components, systems, and/or networks. As an example, one or more PLCs or automation controllers can communicate and cooperate with various network devices across the network. This can include substantially any type of control, communications module, computer, Input/Output (I/O) device, sensor, actuator, and human machine interface (HMI) that communicate via the network, which includes control, automation, and/or public networks. The PLC or automation controller can also communicate to and control various other devices such as standard or safety-rated I/O modules including analog, digital, programmed/intelligent I/O modules, other programmable controllers, communications modules, sensors, actuators, output devices, and the like.
The network can include public networks such as the internet, intranets, and automation networks such as control and information protocol (CIP) networks including DeviceNet, ControlNet, safety networks, and Ethernet/IP. Other networks include Ethernet, DH/DH+, Remote I/O, Fieldbus, Modbus, Profibus, CAN, wireless networks, serial protocols, and so forth. In addition, the network devices can include various possibilities (hardware and/or software components). These include components such as switches with virtual local area network (VLAN) capability, LANs, WANs, proxies, gateways, routers, firewalls, virtual private network (VPN) devices, servers, clients, computers, configuration tools, monitoring tools, and/or other devices.
In order to provide a context for the various aspects of the disclosed subject matter,
Generally, program modules include routines, programs, components, data structures, etc., that perform particular tasks or implement particular abstract data types. Moreover, those skilled in the art will appreciate that the inventive methods can be practiced with other computer system configurations, including single-processor or multiprocessor computer systems, minicomputers, mainframe computers, Internet of Things (IoT) devices, distributed computing systems, as well as personal computers, hand-held computing devices, microprocessor-based or programmable consumer electronics, and the like, each of which can be operatively coupled to one or more associated devices.
The illustrated embodiments herein can be also practiced in distributed computing environments where certain tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules can be located in both local and remote memory storage devices.
Computing devices typically include a variety of media, which can include computer-readable storage media, machine-readable storage media, and/or communications media, which two terms are used herein differently from one another as follows. Computer-readable storage media or machine-readable storage media can be any available storage media that can be accessed by the computer and includes both volatile and nonvolatile media, removable and non-removable media. By way of example, and not limitation, computer-readable storage media or machine-readable storage media can be implemented in connection with any method or technology for storage of information such as computer-readable or machine-readable instructions, program modules, structured data or unstructured data.
Computer-readable storage media can include, but are not limited to, random access memory (RAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), flash memory or other memory technology, compact disk read only memory (CD-ROM), digital versatile disk (DVD), Blu-ray disc (BD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, solid state drives or other solid state storage devices, or other tangible and/or non-transitory media which can be used to store desired information. In this regard, the terms “tangible” or “non-transitory” herein as applied to storage, memory or computer-readable media, are to be understood to exclude only propagating transitory signals per se as modifiers and do not relinquish rights to all standard storage, memory or computer-readable media that are not only propagating transitory signals per se.
Computer-readable storage media can be accessed by one or more local or remote computing devices, e.g., via access requests, queries or other data retrieval protocols, for a variety of operations with respect to the information stored by the medium.
Communications media typically embody computer-readable instructions, data structures, program modules or other structured or unstructured data in a data signal such as a modulated data signal, e.g., a carrier wave or other transport mechanism, and includes any information delivery or transport media. The term “modulated data signal” or signals refers to a signal that has one or more of its characteristics set or changed in such a manner as to encode information in one or more signals. By way of example, and not limitation, communication media include wired media, such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media.
With reference again to
The system bus 2008 can be any of several types of bus structure that can further interconnect to a memory bus (with or without a memory controller), a peripheral bus, and a local bus using any of a variety of commercially available bus architectures. The system memory 2006 includes ROM 2010 and RAM 2012. A basic input/output system (BIOS) can be stored in a non-volatile memory such as ROM, erasable programmable read only memory (EPROM), EEPROM, which BIOS contains the basic routines that help to transfer information between elements within the computer 2002, such as during startup. The RAM 2012 can also include a high-speed RAM such as static RAM for caching data.
The computer 2002 further includes an internal hard disk drive (HDD) 2014 (e.g., EIDE, SATA), one or more external storage devices 2016 (e.g., a magnetic floppy disk drive (FDD) 2016, a memory stick or flash drive reader, a memory card reader, etc.) and an optical disk drive 2020 (e.g., which can read or write from a CD-ROM disc, a DVD, a BD, etc.). While the internal HDD 2014 is illustrated as located within the computer 2002, the internal HDD 2014 can also be configured for external use in a suitable chassis (not shown). Additionally, while not shown in environment 2000, a solid state drive (SSD) could be used in addition to, or in place of, an HDD 2014. The HDD 2014, external storage device(s) 2016 and optical disk drive 2020 can be connected to the system bus 2008 by an HDD interface 2024, an external storage interface 2026 and an optical drive interface 2028, respectively. The interface 2024 for external drive implementations can include at least one or both of Universal Serial Bus (USB) and Institute of Electrical and Electronics Engineers (IEEE) 1394 interface technologies. Other external drive connection technologies are within contemplation of the embodiments described herein.
The drives and their associated computer-readable storage media provide nonvolatile storage of data, data structures, computer-executable instructions, and so forth. For the computer 2002, the drives and storage media accommodate the storage of any data in a suitable digital format. Although the description of computer-readable storage media above refers to respective types of storage devices, it should be appreciated by those skilled in the art that other types of storage media which are readable by a computer, whether presently existing or developed in the future, could also be used in the example operating environment, and further, that any such storage media can contain computer-executable instructions for performing the methods described herein.
A number of program modules can be stored in the drives and RAM 2012, including an operating system 2030, one or more application programs 2032, other program modules 2034 and program data 2036. All or portions of the operating system, applications, modules, and/or data can also be cached in the RAM 2012. The systems and methods described herein can be implemented utilizing various commercially available operating systems or combinations of operating systems.
Computer 2002 can optionally comprise emulation technologies. For example, a hypervisor (not shown) or other intermediary can emulate a hardware environment for operating system 2030, and the emulated hardware can optionally be different from the hardware illustrated in
Further, computer 2002 can be enable with a security module, such as a trusted processing module (TPM). For instance with a TPM, boot components hash next in time boot components, and wait for a match of results to secured values, before loading a next boot component. This process can take place at any layer in the code execution stack of computer 2002, e.g., applied at the application execution level or at the operating system (OS) kernel level, thereby enabling security at any level of code execution.
A user can enter commands and information into the computer 2002 through one or more wired/wireless input devices, e.g., a keyboard 2038, a touch screen 2040, and a pointing device, such as a mouse 2042. Other input devices (not shown) can include a microphone, an infrared (IR) remote control, a radio frequency (RF) remote control, or other remote control, a joystick, a virtual reality controller and/or virtual reality headset, a game pad, a stylus pen, an image input device, e.g., camera(s), a gesture sensor input device, a vision movement sensor input device, an emotion or facial detection device, a biometric input device, e.g., fingerprint or iris scanner, or the like. These and other input devices are often connected to the processing unit 2004 through an input device interface 2044 that can be coupled to the system bus 2008, but can be connected by other interfaces, such as a parallel port, an IEEE 1394 serial port, a game port, a USB port, an IR interface, a BLUETOOTH® interface, etc.
A monitor 2044 or other type of display device can be also connected to the system bus 2008 via an interface, such as a video adapter 2048. In addition to the monitor 2044, a computer typically includes other peripheral output devices (not shown), such as speakers, printers, etc.
The computer 2002 can operate in a networked environment using logical connections via wired and/or wireless communications to one or more remote computers, such as a remote computer(s) 2048. The remote computer(s) 2048 can be a workstation, a server computer, a router, a personal computer, portable computer, microprocessor-based entertainment appliance, a peer device or other common network node, and typically includes many or all of the elements described relative to the computer 2002, although, for purposes of brevity, only a memory/storage device 2050 is illustrated. The logical connections depicted include wired/wireless connectivity to a local area network (LAN) 2052 and/or larger networks, e.g., a wide area network (WAN) 2054. Such LAN and WAN networking environments are commonplace in offices and companies, and facilitate enterprise-wide computer networks, such as intranets, all of which can connect to a global communications network, e.g., the Internet.
When used in a LAN networking environment, the computer 2002 can be connected to the local network 2052 through a wired and/or wireless communication network interface or adapter 2056. The adapter 2056 can facilitate wired or wireless communication to the LAN 2052, which can also include a wireless access point (AP) disposed thereon for communicating with the adapter 2056 in a wireless mode.
When used in a WAN networking environment, the computer 2002 can include a modem 2058 or can be connected to a communications server on the WAN 2054 via other means for establishing communications over the WAN 2054, such as by way of the Internet. The modem 2058, which can be internal or external and a wired or wireless device, can be connected to the system bus 2008 via the input device interface 2042. In a networked environment, program modules depicted relative to the computer 2002 or portions thereof, can be stored in the remote memory/storage device 2050. It will be appreciated that the network connections shown are example and other means of establishing a communications link between the computers can be used.
When used in either a LAN or WAN networking environment, the computer 2002 can access cloud storage systems or other network-based storage systems in addition to, or in place of, external storage devices 2016 as described above. Generally, a connection between the computer 2002 and a cloud storage system can be established over a LAN 2052 or WAN 2054 e.g., by the adapter 2056 or modem 2058, respectively. Upon connecting the computer 2002 to an associated cloud storage system, the external storage interface 2026 can, with the aid of the adapter 2056 and/or modem 2058, manage storage provided by the cloud storage system as it would other types of external storage. For instance, the external storage interface 2026 can be configured to provide access to cloud storage sources as if those sources were physically connected to the computer 2002.
The computer 2002 can be operable to communicate with any wireless devices or entities operatively disposed in wireless communication, e.g., a printer, scanner, desktop and/or portable computer, portable data assistant, communications satellite, any piece of equipment or location associated with a wirelessly detectable tag (e.g., a kiosk, news stand, store shelf, etc.), and telephone. This can include Wireless Fidelity (Wi-Fi) and BLUETOOTH® wireless technologies. Thus, the communication can be a predefined structure as with a conventional network or simply an ad hoc communication between at least two devices.
What has been described above includes examples of the subject innovation. It is, of course, not possible to describe every conceivable combination of components or methodologies for purposes of describing the disclosed subject matter, but one of ordinary skill in the art may recognize that many further combinations and permutations of the subject innovation are possible. Accordingly, the disclosed subject matter is intended to embrace all such alterations, modifications, and variations that fall within the spirit and scope of the appended claims.
In particular and in regard to the various functions performed by the above described components, devices, circuits, systems and the like, the terms (including a reference to a “means”) used to describe such components are intended to correspond, unless otherwise indicated, to any component which performs the specified function of the described component (e.g., a functional equivalent), even though not structurally equivalent to the disclosed structure, which performs the function in the herein illustrated exemplary aspects of the disclosed subject matter. In this regard, it will also be recognized that the disclosed subject matter includes a system as well as a computer-readable medium having computer-executable instructions for performing the acts and/or events of the various methods of the disclosed subject matter.
In addition, while a particular feature of the disclosed subject matter may have been disclosed with respect to only one of several implementations, such feature may be combined with one or more other features of the other implementations as may be desired and advantageous for any given or particular application. Furthermore, to the extent that the terms “includes,” and “including” and variants thereof are used in either the detailed description or the claims, these terms are intended to be inclusive in a manner similar to the term “comprising.”
In this application, the word “exemplary” is used to mean serving as an example, instance, or illustration. Any aspect or design described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other aspects or designs. Rather, use of the word exemplary is intended to present concepts in a concrete fashion.
Various aspects or features described herein may be implemented as a method, apparatus, or article of manufacture using standard programming and/or engineering techniques. The term “article of manufacture” as used herein is intended to encompass a computer program accessible from any computer-readable device, carrier, or media. For example, computer readable media can include but are not limited to magnetic storage devices (e.g., hard disk, floppy disk, magnetic strips . . . ), optical disks [e.g., compact disk (CD), digital versatile disk (DVD) . . . ], smart cards, and flash memory devices (e.g., card, stick, key drive . . . ).
