Patent Grant
10564633
The subject application relates generally to industrial automation, and, more particularly, to using cloud-based data for virtualization of an industrial automation environment with information overlays.
Industrial controllers and their associated input/output (I/O) devices can be useful to the operation of modern industrial automation systems. These industrial controllers can interact with field devices on the plant floor to control automated processes relating to such objectives as product manufacture, material handling, batch processing, supervisory control, and other such applications. Industrial controllers can store and execute user-defined control programs to effect decision-making in connection with the controlled process. Such programs can include, but are not limited to, ladder logic, sequential function charts, function block diagrams, structured text, or other such programming structures. In general, industrial controllers can read input data from sensors and metering devices that can provide discreet and telemetric data regarding one or more states of the controlled system, and can generate control outputs based on these inputs in accordance with the user-defined program.
In addition to industrial controllers and their associated I/O devices, some industrial automation systems also can include low-level control systems, such as vision systems, barcode marking systems, variable frequency drives, industrial robots, and the like, which can perform local control of portions of the industrial process, or which can have their own localized control systems.
During operation of a given industrial automation system, comprising a collection of industrial devices, industrial processes, other industrial assets, and network-related assets, users (e.g., operators, technicians, maintenance personnel, etc.) typically can monitor or manage operations of the industrial automation system, perform maintenance, repairs, or upgrades on the industrial automation system, or perform other tasks in connection with operation of the industrial automation system. The above-described description of today's industrial control and business systems is merely intended to provide a contextual overview of relating to conventional industrial automation systems, and is not intended to be exhaustive.
The following presents a simplified summary in order to provide a basic understanding of some aspects described herein. This summary is not an extensive overview nor is intended to identify key/critical elements or to delineate the scope of the various aspects described herein. Its sole purpose is to present some concepts in a simplified form as a prelude to the more detailed description that is presented later.
Various aspects and embodiments of the disclosed subject matter relate to the use of data analysis in a cloud platform to facilitate generating, updating, or using a virtualized industrial automation system to facilitate interacting with (e.g., facilitate remote monitoring of, tracking of, controlling of, etc.) an industrial automation system. A virtualization component can employ a collection component (e.g., a cloud-based collection component) that can collect industrial-automation-system-related data from one or more industrial automation systems of one or more industrial customers for storage (e.g., in a cloud-based data store) and analysis on a cloud platform.
A virtualization management component can analyze the data and can generate a virtualized industrial automation system of the industrial automation system based at least in part on the analysis results. The virtualized industrial automation system can be a multi-dimensional (e.g., three-dimensional (3-D) or two-dimensional (2-D)) virtualized industrial automation system that can present a multi-dimensional virtualized view (e.g., 3-D view or 2-D view) of an industrial automation system, or can be a virtualized dashboard view of the industrial automation system. The virtualization management component also can receive information relating to user interactions with the virtualized industrial automation system via a communication device of the user to facilitate remotely interacting with, monitoring, tracking, and/or controlling the industrial automation system. In some implementations, in response to information relating to user interactions with the virtualized industrial automation system in connection with remotely controlling the industrial automation system, the virtualization management component can generate a corresponding control signal(s), and can communicate (e.g., transmit) the control signal(s) to the industrial automation system to facilitate controlling (e.g., remotely controlling) operation of the industrial automation system. The virtualization management component also can update the virtualized industrial automation system based at least in part on (e.g., in response to) operation of, and user interactions with, the virtualized industrial automation system or the industrial automation system (e.g., via the virtualized industrial automation system).
In some implementations, the virtualization management component can customize a user's view of, and/or a customized data overlay associated with, the virtualized industrial automation system on the user's communication device and/or filter data associated with the virtualized industrial automation system presented on the user's communication device to the user based at least in part on the role of the user in connection with the industrial automation system, the authorization or access rights of a user to access the virtualized industrial automation system or the industrial automation system, the location of the user (e.g., the location of the user's communication device or radio-frequency identification (RFID) tag of the user) in relation to the industrial automation system (e.g., the location of the user within (or outside) the facility (e.g., plant) that comprises the industrial automation system), preferences of the user with respect to the virtualized industrial automation system, a filter(s) (e.g., a selected data filter(s)), or other defined virtualization management criteria, wherein different views of the virtualized industrial automation system, which can comprise different data overlays (e.g., role-centric data overlays), can be presented on different communication devices of different users. The virtualization management component also can facilitate enabling a user, via the user's communication device, to apply a desired filter(s) to filter data associated with the user's view (e.g., customized view) of the virtualized industrial automation system, for example, to present a subset of the data that is relevant to a work task that the user is performing at the time, present more detailed data or a drilled-down view regarding a certain portion of the virtualized industrial automation system and associated industrial automation system, or present data filtered based at least in part on other criteria.
The virtualization management component also can share a customized view (e.g., personalized view) of a virtualized industrial automation system displayed on the communication device of a user with a communication device(s) of another user(s), in accordance with the defined virtualization management criteria (e.g., when another user is authorized to access such personalized view on that other user's communication device, and/or based in part on the role of that other user in connection with the industrial automation system, etc.). The virtualization management component can facilitate enabling a user to use the communication device to generate a virtual note, comprising desired information (e.g., user-generated information relating to a portion of the industrial automation system represented by the virtualized portion of the virtualized industrial automation system, and apply or place the virtual note to the virtualized portion of the virtualized industrial automation system. The virtualization management component can facilitate enabling a user, using the communication device, to control the scope of the virtual note to control the viewability of the virtual note by another user(s), for example, on the communication device(s) of the other user(s), in accordance with the defined virtualization management criteria (e.g., when the other user is authorized to access or view the virtual note on that other user's communication device, and/or based in part on the role of that other user in connection with the industrial automation system, etc.). The virtual note can be employed, for example, to tag a problem or abnormal operating condition associated with the portion of the industrial automation system, for use as a shift report (e.g., from a user on one work shift to another user on the next work shift), to remind the user (or another user(s)) of something in connection with that portion of the industrial automation system, to notify another user(s) that some work task (e.g., maintenance, repair, or replacement task, etc.) is to be performed in connection with the industrial automation system, for another desired reason.
To the accomplishment of the foregoing and related ends, certain illustrative aspects are described herein in connection with the following description and the annexed drawings. These aspects are indicative of various ways which can be practiced, all of which are intended to be covered herein. Other advantages and novel features may become apparent from the following detailed description when considered in conjunction with the drawings.
The subject disclosure is now described with reference to the drawings, wherein like reference numerals are used to refer to like elements throughout. In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding thereof. It may be evident, however, that the subject disclosure can be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram form in order to facilitate a description thereof.
Industrial automation systems can perform various processes to produce desired products or processed materials. An industrial automation system can comprise various industrial devices, industrial processes, other industrial assets, and network-related assets (e.g., communication network devices and software). During operation of a given industrial automation system, users, such as, for example, operators, technicians, maintenance personnel, typically can monitor or manage operations of the industrial automation system, perform maintenance, repairs, or upgrades on the industrial automation system, or perform other tasks in connection with operation of the industrial automation system.
To that end, presented are various systems, methods, and techniques of the disclosed subject matter that relate to the use of data analysis (e.g., big data analysis) in a cloud platform to facilitate generating a virtualized industrial automation system of an industrial automation system that can be used to facilitate interacting with (e.g., facilitate remote monitoring operation of, tracking operation of, controlling operation of, etc., via a communication device) the industrial automation system, and providing user's with an augmented reality, unique (e.g., role-centric) information overlays, and information sharing capabilities in connection with the virtualized industrial automation system and associated industrial automation system. The various systems, methods, and techniques of the disclosed subject matter also can facilitate customizing a user's view of the virtualized industrial automation system on the user's communication device based at least in part on the user's role, level of authorization, location, or preferences, or other defined virtualization management criteria in connection with the industrial automation system or associated virtualized industrial automation system.
A cloud-based virtualization generation service (e.g., employing a collection component) can collect industrial-automation-system-related data from one or more industrial automation systems of one or more industrial customers (e.g., industrial enterprises) for storage (e.g., in a cloud-based data store) and analysis on a cloud platform. A virtualization management component can analyze the data and generate (e.g., create, build, construct, etc.) a virtualized industrial automation system that can correspond to and graphically represent the industrial automation system based at least in part on the results of the data analysis. The virtualized industrial automation system also can comprise a virtualized network component that can correspond to and graphically represent a network component (e.g., a wireline and/or wireless communication network) that can be integrated or interfaced with the other portions (e.g., industrial devices, industrial processes, industrial assets, etc.) of the industrial automation system. The virtualization management component also can facilitate interfacing the virtualized industrial automation system with the industrial automation system to facilitate using the virtualized industrial automation system to remotely interact with and/or control operation of the industrial automation system (e.g., via a communication device).
The virtualized industrial automation system can comprise a multi-dimensional virtualized industrial automation system that can provide multi-dimensional virtualized views (e.g., three-dimensional (3-D) views or two-dimensional (2-D views)) of the industrial automation system from various visual perspectives (e.g., various viewing angles). In some implementations, the virtualized industrial automation system can comprise a dashboard (e.g., a graphical representation of a dashboard) that can be a virtual view of all or a portion of the parameters, controls, alert indicators, etc., associated with the industrial automation system. The virtualized industrial automation system can be stored in the cloud-based data store. The virtualized industrial automation system, or a portion thereof, also can be provided to (e.g., communicated to) and displayed on communication devices of respective users (e.g., for remote display of the virtualized industrial automation system on such communication devices).
Using a communication device (e.g., computer, mobile phone (e.g., smart phone), electronic pad or tablet, electronic glasses (e.g., smart glasses) with communication functionality, Internet Protocol (IP) television (IPTV), etc.), a user can interact with a virtual industrial automation system associated with (e.g., interfaced with) a corresponding industrial automation system via a communication device of the user to facilitate interacting with and/or controlling (e.g., remotely interacting with and/or controlling) the industrial automation system based at least in part on the user's interactions with the virtual industrial automation system via the communication device of the user. For instance, the virtualization management component can receive input information (e.g., user input, such as gestures (e.g., gestures on a touch screen), keystrokes, mouse clicks, selections, voice commands, etc., of the user) relating to user interactions with the virtualized industrial automation system via the communication device of the user that can facilitate controlling the virtualized operation of the virtual industrial automation system to facilitate correspondingly controlling the operation of the industrial automation system. The virtualization management component can generate control signals based at least in part on the user interactions with the virtualized industrial automation system, and can transmit the control signals to the industrial automation system to facilitate controlling operation of the industrial automation system in response to, and based at least in part on (e.g., in correspondence with), the user interactions with the virtualized industrial automation system.
The virtualization management component can update (e.g., automatically, dynamically, or continuously update, in real or at least near real time) the virtualized industrial automation system based at least in part on collected data relating to the operation of the industrial automation system (e.g., in response to a user interaction with the virtualized industrial automation system) and user interactions with the industrial automation system. The virtualization management component also can update (e.g., automatically or dynamically update, in real or at least near real time) the virtualized industrial automation system, based at least in part on any modification to the industrial automation system, to generate a modified virtualized industrial automation system that can virtualize any modification made to the industrial automation system.
In some implementations, the virtualization management component can customize a user's view of the virtualized industrial automation system on the user's communication device or filter data associated with the virtualized industrial automation system presented on the user's communication device to the user based at least in part on the role of the user in connection with the industrial automation system, the authorization or access rights of a user to access the virtualized industrial automation system or the industrial automation system, the location of the user (e.g., the location of the user's communication device or radio-frequency identification (RFID) tag of the user) in relation to the industrial automation system (e.g., the location of the user within (or outside) the facility (e.g., plant) that comprises the industrial automation system), preferences of the user with respect to the virtualized industrial automation system, or other defined virtualization management criteria, wherein different views of the virtualized industrial automation system, which can comprise different data overlays (e.g., role-centric data overlays), can be presented on different communication devices of different users. The virtualization management component also can facilitate enabling a user, via the user's communication device, to apply a desired filter(s) to filter data associated with the user's view (e.g., customized view) of the virtualized industrial automation system, for example, to present a subset of the data that is relevant to a work task that the user is performing at the time, present more detailed data or a drilled-down view regarding a certain portion of the virtualized industrial automation system and associated industrial automation system.
The virtualization management component also can share a customized view (e.g., personalized view) of a virtualized industrial automation system displayed on the communication device of a user with a communication device(s) of another user(s), in accordance with the defined virtualization management criteria (e.g., when another user is authorized to access such personalized view on that other user's communication device, and/or based in part on the role of that other user in connection with the industrial automation system, etc.). The virtualization management component can facilitate enabling a user to use the communication device to generate a virtual note, comprising desired information (e.g., information relating to a portion (e.g., an industrial device, an industrial process, an industrial asset, or a network-related device, etc.) of the industrial automation system represented by the virtualized portion (e.g., a virtualized industrial device, virtualized industrial process, virtualized industrial asset, or virtualized network-related device, etc.) of the virtualized industrial automation system, and apply the virtual note to (e.g., attach, link, associate, place, etc., the virtual note to, with, or on) the virtualized portion of the virtualized industrial automation system. The virtualization management component can facilitate enabling a user, using the communication device, to control the scope of the virtual note to control the viewability of the virtual note by another user(s), e.g., on the communication device(s) of the other user(s), in accordance with the defined virtualization management criteria (e.g., when the other user is authorized to access or view the virtual note on that other user's communication device, and/or based in part on the role of that other user in connection with the industrial automation system, etc.). The virtual note can be employed, for example, to tag a problem or abnormal operating condition associated with the portion of the industrial automation system, for use as a shift report (e.g., from a user on one work shift to another user on the next work shift), to remind the user (or another user(s)) of something in connection with that portion of the industrial automation system, to notify another user(s) that some work task (e g, maintenance, repair, or replacement task, etc.) is to be performed in connection with the industrial automation system, for another desired reason.
As used in this application, the terms “component,” “system,” “platform,” “layer,” “controller,” “terminal,” “station,” “node,” “interface” are intended to refer to a computer-related entity or an entity related to, or that is part of, an operational apparatus with one or more specific functionalities, wherein such entities can be either hardware, a combination of hardware and software, software, or software in execution. For example, a component can be, but is not limited to being, a process running on a processor, a processor, a hard disk drive, multiple storage drives (of optical or magnetic storage medium) including affixed (e.g., screwed or bolted) or removably affixed solid-state storage drives; an object; an executable; a thread of execution; a computer-executable program, and/or a computer. By way of illustration, both an application running on a server and the server can be a component. One or more components can reside within a process and/or thread of execution, and a component can be localized on one computer and/or distributed between two or more computers. Also, components as described herein can execute from various computer readable storage media having various data structures stored thereon. The components may communicate via local and/or remote processes such as in accordance with a signal having one or more data packets (e.g., data from one component interacting with another component in a local system, distributed system, and/or across a network such as the Internet with other systems via the signal). As another example, a component can be an apparatus with specific functionality provided by mechanical parts operated by electric or electronic circuitry which is operated by a software or a firmware application executed by a processor, wherein the processor can be internal or external to the apparatus and executes at least a part of the software or firmware application. As yet another example, a component can be an apparatus that provides specific functionality through electronic components without mechanical parts, the electronic components can include a processor therein to execute software or firmware that provides at least in part the functionality of the electronic components. As further yet another example, interface(s) can include input/output (I/O) components as well as associated processor, application, or application programming interface (API) components. While the foregoing examples are directed to aspects of a component, the exemplified aspects or features also apply to a system, platform, interface, layer, controller, terminal, and the like.
As used herein, the terms “to infer” and “inference” refer generally to the process of reasoning about or inferring states of the system, environment, and/or user from a set of observations as captured via events and/or data. Inference can be employed to identify a specific context or action, or can generate a probability distribution over states, for example. The inference can be probabilistic—that is, the computation of a probability distribution over states of interest based on a consideration of data and events. Inference can also refer to techniques employed for composing higher-level events from a set of events and/or data. Such inference results in the construction of new events or actions from a set of observed events and/or stored event data, whether or not the events are correlated in close temporal proximity, and whether the events and data come from one or several event and data sources.
In addition, the term “or” is intended to mean an inclusive “or” rather than an exclusive “or.” That is, unless specified otherwise, or clear from the context, the phrase “X employs A or B” is intended to mean any of the natural inclusive permutations. That is, the phrase “X employs A or B” is satisfied by any of the following instances: X employs A; X employs B; or X employs both A and B. In addition, the articles “a” and “an” as used in this application and the appended claims should generally be construed to mean “one or more” unless specified otherwise or clear from the context to be directed to a singular form.
Furthermore, the term “set” as employed herein excludes the empty set; e.g., the set with no elements therein. Thus, a “set” in the subject disclosure includes one or more elements or entities. As an illustration, a set of controllers includes one or more controllers; a set of data resources includes one or more data resources; etc. Likewise, the term “group” as utilized herein refers to a collection of one or more entities; e.g., a group of nodes refers to one or more nodes.
Various aspects or features will be presented in terms of systems that may include a number of devices, components, modules, and the like. It is to be understood and appreciated that the various systems may include additional devices, components, modules, etc. and/or may not include all of the devices, components, modules etc. discussed in connection with the figures. A combination of these approaches also can be used.
The system 100 can include a virtualization component 102 that can facilitate generation and management of a virtualized industrial automation system that can correspond to an industrial automation system 104 based at least in part on data (e.g., industrial-automation-system-related data) obtained from the industrial automation system 104, another industrial automation system(s), or from other sources (e.g., extrinsic sources), in accordance with defined virtualization management criteria.
The virtualization component 102 can employ and provide a variety of services including a cloud-based virtualization generation service. As part of providing cloud-based virtualization generation service, the virtualization component 102 can perform data analysis (e.g., big data analysis) in a cloud platform to facilitate generating a virtualized industrial automation system of an industrial automation system that can be used to facilitate interacting with (e.g., remotely monitoring operation of, tracking operation of, controlling operation of, etc., via a communication device) the industrial automation system 104. As more fully disclosed herein, the virtualization component 102, as part of providing the cloud-based virtualization generation service, can employ a collection component 106 (e.g., data collection component) that can collect industrial-automation-system-related data from one or more industrial automation systems of one or more industrial customers (e.g., industrial enterprises) for storage (e.g., in a cloud-based data store) and analysis (e.g., by the virtualization component 102) on a cloud platform. The collection component 106 can be associated with (e.g., interfaced with and/or communicatively connected to) the industrial automation system 104 associated with an industrial enterprise.
The industrial automation system 104 can comprise one or more industrial devices 108, industrial processes 110, or other industrial assets 112 that can be distributed throughout an industrial facility(ies) in accordance with a desired industrial-automation-system configuration. The industrial automation system 104 can perform industrial processes or other actions to facilitate producing desired products, processed materials, etc., as an output.
The industrial automation system 104 also can include a network component 114 that can be associated with (e.g., integrated with, interfaced with, and/or communicatively connected to) the various industrial devices 108, industrial processes 110, and/or other industrial assets 112 of the industrial automation system 104 to facilitate communication of information (e.g., command or control information, status information, production information, etc.) between the various industrial devices 108, industrial processes 110, and/or other industrial assets 112 via the network component 114. The network component 114 can be associated with (e.g., interfaced with, communicatively connected to) the collection component 106 to facilitate the communication of data between the industrial automation system 104 and the collection component 106. The network component 114 can comprise network-related devices (e.g., communication devices, routers (e.g., wireline or wireless routers), switches, etc.), wherein respective network-related devices can be connected to or interfaced with certain other network-related devices to form a communication network having a desired communication network configuration. One or more network-related devices of the network component 114 can be connected to or interfaced with one or more industrial devices 108, industrial processes 110, and/or other industrial assets 112 to facilitate collecting data (e.g., industrial-automation-system-related data) from the one or more industrial devices 108, industrial processes 110, and/or other industrial assets 112 or communicating information (e.g., control signals, parameter data, configuration data, etc.) to the one or more industrial devices 108, industrial processes 110, and/or other industrial assets 112.
The virtualization component 102 can monitor or track the operation of the industrial automation system 104, including monitoring and tracking the respective operations of respective industrial devices 108, industrial processes 110, industrial assets 112, and/or network-related devices of the network component 114. The collection component 106 can receive, obtain, detect, or collect data relating to the operation of the industrial automation system 104 and the network component 114, as desired (e.g., automatically, dynamically, or continuously, in real or near real time), in accordance with the defined virtualization management criteria. For example, the collection component 106 can receive data relating to the industrial devices 108 (e.g., operation or status of the industrial devices, properties or characteristics of the industrial devices, maintenance records of the industrial devices, configurations of the industrial devices, etc.), industrial processes 110 (e.g., operation or status of the industrial processes, properties or characteristics of the industrial processes, maintenance records associated with the industrial processes, configurations of the industrial processes, etc.), and the other industrial assets 112 (e.g., operation or status of the industrial assets, properties or characteristics of the industrial assets, maintenance records associated with the industrial assets, configurations of the industrial assets, etc.). The collection component 106 also can receive or collect data relating to operation of the sub-components (e.g., network-related devices) of the network component 114 (e.g., operation or status of the network devices or assets, communication conditions associated with a communication channel, total bandwidth of a communication channel, available bandwidth of a communication channel, properties or characteristics of the network devices or assets, maintenance records associated with the network devices or assets, configurations of the network devices or assets, etc.).
The virtualization component 102 also can comprise a data store 116 that can be associated with (e.g., interfaced with, communicatively connected to) the collection component 106. The collection component 106 can provide (e.g., communicate, write, etc.) the data received or collected from the industrial automation system 104 and the network component 114 to the data store 116 for storage in the data store 116.
The virtualization component 102 further can include a virtualization management component 118 that can generate and manage a virtualized industrial automation system that can correspond to the industrial automation system 104 based at least in part on data obtained from the industrial automation system 104, another industrial automation system(s), or from other sources (e.g., extrinsic sources), in accordance with defined virtualization management criteria. The virtualization management component 118 can be associated with (e.g., interfaced with, communicatively connected to) the data store 116 to facilitate obtaining the data to facilitate generating and managing the virtualized industrial automation system of the industrial automation system 104.
In some implementations, the virtualization component 102, the collection component 106, the data store 116, and/or the virtualization management component 118, can be located in a cloud platform that can be interfaced with the industrial automation system 104. In accordance with various other implementations, one or more of the collection component 106, the data store 116, the virtualization management component 118, and/or various other portions of the virtualization component 102 can be located at the plant or original equipment manufacturer (OEM) level associated with the industrial automation system 104, or can be located in a different platform or level.
The virtualization management component 118 can analyze data stored in the data store 116 and/or other data (e.g., other industrial-automation-system-related data and/or other data, such as extrinsic data), and can generate (e.g., create, build, construct, etc.) a virtualized industrial automation system that can correspond to the industrial automation system 104 based at least in part on the results of the data analysis, in accordance with the defined virtualization management criteria. The virtualized industrial automation system also can comprise a virtualized network component that can correspond to the network component 114 (e.g., a wireline and/or wireless communication network) that can be integrated or interfaced with the other portions (e.g., industrial devices 108, industrial processes 110, industrial assets 112, etc.) of the industrial automation system 104. The virtualization management component 118 can thereby virtualize the automation or control environment as well as the network environment (e.g., an information technology (IT) view of the network environment) that can represent and be associated with (e.g., interfaced with) the industrial automation system 104. For instance, the virtualization management component 118 can generate a virtualized industrial automation system that can virtualize (e.g., comprise virtualized versions of) the industrial devices 108, industrial processes 110, industrial assets 112, and network-related devices of the network component 114, etc., including virtualizing the respective features and configurations (e.g., respective functions, controls, parameters, settings, etc.) of the industrial devices 108, industrial processes 110, industrial assets 112, and network-related devices of the network component 114, etc., and virtualizing respective connections, interactions, or interrelationships between respective industrial devices 108, industrial processes 110, industrial assets 112, and/or network-related devices of the network component 114, etc., to virtualize the configuration of the industrial automation system 104 to generate the corresponding virtualized industrial automation system. In some implementations, to facilitate analyzing the data, as desired (e.g., when appropriate), the virtualization management component 118 can normalize data to facilitate generating data with normalized values that can be used to facilitate generating the virtualized industrial automation system.
To facilitate generating a virtualized industrial automation system that can correspond to and be associated with (e.g., can interact or be interfaced with) the industrial automation system 104, the virtualization management component 118 can access the data store 116 (e.g., cloud-based data store) to obtain a set of data relating to the industrial automation system 104 and/or another industrial automation system (e.g., another system comprising an industrial device(s), process(es), and/or asset(s) that can be the same or similar to an industrial device(s) 108, process(es) 110, and/or asset(s) 112 of the industrial automation system 104). The set of data can comprise information relating to, for example, the respective properties, characteristics, functions, configurations, etc., of respective industrial devices 108, industrial processes 110, other industrial assets 112, or network-related devices of the network component 114; or the configuration of industrial devices 108, industrial processes 110, or other industrial assets 112 in relation to each other. For example, the properties or characteristics for industrial devices 108 or industrial processes 110 can comprise mechanical or process properties or characteristics associated with industrial devices or processes (e.g., mechanical latency, process cycle times, operating schedules, etc., associated with industrial devices). As another example, the properties or characteristics for network-related devices can comprise communication properties or characteristics (e.g., wireless and/or wireline communication functionality, type(s) of network or communication protocol(s), network or communication specifications, total bandwidth, etc.) of the respective network-related devices.
The set of data also can comprise information relating to, for example, the configuration of the network-related devices in relation to each other, or the configuration of network-related devices in relation to the industrial devices 108, industrial processes 110, and/or other industrial assets 112; software, firmware, and/or operating system utilized by the industrial automation system 104 (e.g., type(s), version(s), revision(s), configuration(s), etc., of the software, firmware, and/or operating system); functional and communicative relationships between industrial devices 108, industrial processes 110, industrial assets 112, network-related devices of the network component 114, etc. (e.g., communication connections or conditions between industrial devices, types of connections between industrial devices, communication connections between industrial devices and network-related devices, etc.). The set of data further can include information relating to, for example, human behavior or interaction in connection with the industrial automation system 104 (e.g., maintenance schedules, shift-specific or operator-specific behavior or interaction of operators with the industrial automation system); production or process flows of the industrial automation system 104 at particular times or in connection with particular projects; and/or other aspects or features of the industrial automation system 104.
The virtualized industrial automation system generated and managed by the virtualization management component 118 can be or can comprise a multi-dimensional virtualized industrial automation system that can provide multi-dimensional virtualized views (e.g., three-dimensional (3-D) views or two-dimensional (2-D views)) of the industrial automation system 104, or a portion thereof, from various visual perspectives. In some implementations, the virtualization management component 118 can generate and manage a virtualized industrial automation system that can comprise a dashboard (e.g., a virtualized dashboard, a graphical representation of a dashboard) that can comprise a virtual view of all or a portion of the parameters, controls, alert indicators, etc., associated with the industrial automation system 104. For instance, the virtualization management component 118 can leverage the rich set of historical and live data (e.g., industrial-automation-system-related data and other data) that can be collected in the cloud (e.g., via the collection component 106) to create interactive, multi-dimensional (e.g., 3-D, 2-D) virtualizations or other interactive virtualizations (e.g., a dashboard virtualization) of a user's plant environment (e.g., the portion of the plant relevant to the user's role or job at the plant) that can facilitate remote (virtualized) viewing, interaction with, and/or control of industrial devices 108, industrial processes 110, industrial assets 112, network-related devices, etc., on the plant floor of the industrial automation system 104 via the communication device 120 of the user.
In some implementations, a 3-D virtualized industrial automation system generated by the virtualization management component 118 can comprise parallax information (e.g., horizontal and vertical parallax information) and depth information that can recreate and/or virtualize the industrial automation system, including recreating and/or virtualizing the relationships between objects (e.g., devices, processes, assets, etc.) of the industrial automation system (e.g., recreating and/or virtualizing geo-spatial relationships of objects, relative distances of objects from a user at the user's viewpoint, providing depth perception with respect to objects, etc.). The user can use the user's communication device 120 (e.g., by interacting with controls provided by the virtualization service or application) to interact with the multi-dimensional virtualized industrial automation system. For example, using the user's communication device 120 (e.g., computer, phone, electronic pad or tablet, electronic (e.g., smart) glasses with communication capabilities and functionality, etc.), the user can be immersed (e.g., visually and/or audially) within the multi-dimensional (e.g., 3-D) virtualized industrial automation system associated with an industrial automation system such that the user can experience (e.g., visually or audially) or interact with the multi-dimensional (e.g., 3-D) virtualized industrial automation system in a manner similar to if the user was in the plant viewing the industrial automation system, wherein the user can use controls (e.g., provided by the virtualization service or application) provided on the communication device to virtually walk around through and interact with the virtualized industrial automation system to facilitate remotely interacting with the industrial automation system.
The virtualized industrial automation system generated by the virtualization management component 118 can include graphical and/or virtualized representations of the various industrial devices 108, industrial processes 110, industrial assets 112, network-related devices, etc., of the industrial automation system 104 and data (e.g., industrial-automation-system-related data or other data) that can be overlaid on and/or provided in proximity to the graphical and/or virtualized representations. The graphical and/or virtualized representations of the various industrial devices 108, industrial processes 110, industrial assets 112, network-related devices, etc., generated by the virtualization management component 118 can comprise one or more respective instances (e.g., virtualized instances) of the various industrial devices 108, industrial processes 110, industrial assets 112, network-related devices, etc. The graphical and/or virtualized representations of the various industrial devices 108, industrial processes 110, industrial assets 112, network-related devices, etc., also can comprise (e.g., as applicable) graphical and/or virtualized representations of controls (e.g., virtualized controls), switches (e.g., virtualized switches), conveyors (e.g., virtualized conveyors), or other parts (e.g., virtualized parts), that can correspond to the various controls, switches, conveyors, or other parts of or associated with the various industrial devices 108, industrial processes 110, industrial assets 112, network-related devices, etc., of the industrial automation system 104. When in accordance with the user's access rights to the virtualized industrial automation system and associated industrial automation system (e.g., via the virtualized industrial automation system), the user, using the user's communication device 120, can interact with the virtual industrial automation system to manipulate or adjust the virtualized controls, virtualized switches (e.g., switch a virtual switch on or off), etc., of the graphical and/or virtualized representations of the various industrial devices 108, industrial processes 110, industrial assets 112, network-related devices, etc., to facilitate remotely manipulating or adjusting the controls, switches, etc., of the various industrial devices 108, industrial processes 110, industrial assets 112, network-related devices, etc., of the industrial automation system 104.
In some implementations, the virtualization component 102 can facilitate capturing (e.g., via one or more capture components (e.g., one or more video cameras directed at various parts of the industrial automation system 104)) or obtaining video images of the industrial automation system 104, or a desired portion(s) thereof. The video images can be collected by the collection component 106 and stored in the data store 116. The virtualization management component 118 can overlay and/or integrate the video images (e.g., real time or near real time video images) of the industrial automation system 104 on and/or with the virtualized industrial automation system to augment the virtualized industrial automation system (e.g., to generate an augmented virtualized industrial automation system), wherein the video images of the industrial automation system 104 can provide visual data with the virtualized industrial automation system that may not be available via the virtualized industrial automation system by itself.
The virtualization management component 118 can store the virtualized industrial automation system in the data store 116 (e.g., cloud-based data store). The virtualization management component 118 also can provide (e.g., communicate) the virtualized industrial automation system, or a portion thereof, to the communication device(s) 120 of a user(s) (e.g., operator, technician, engineer, manager, maintenance or repair person, etc.) associated with the industrial automation system 104, wherein the communication device(s) 120 of the user(s) can present (e.g., display) the virtualized industrial automation system, or portion thereof, to the user(s) (e.g., for remote display of the virtualized industrial automation system on such communication device 120 for viewing by the user). For instance, the virtualization management component 118 can provide (e.g., communicate, present, etc.) one or more virtual interfaces comprising all or a portion of the virtualized industrial automation system of the industrial automation system 104 (e.g., comprising all of the virtualized industrial automation system or only the part(s) (e.g., only certain industrial device 108, processes 110, assets 112, or network-related devices) of the virtualized industrial automation system that the user desires or is permitted to access). The communication device 120 can be, for example, a computer (e.g., desktop computer, laptop computer), a mobile phone (e.g., smart phone, cellular phone), an electronic pad or tablet, electronic glasses (e.g., smart glasses) with communication functionality, an electronic watch with communication functionality, an Internet Protocol (IP) television (IPTV), or other type of suitable communication device.
The virtualization management component 118 can monitor the user's location (e.g., in relation to the industrial automation system 104), and interactions and behavior of the user in relation to the industrial automation system 104 or associated virtualized industrial automation system, to facilitate remote interaction with and/or control of (e.g., gesture-based interaction with and/or control of) the industrial devices 108, industrial processes 110, industrial assets 112, and/or network-related devices, etc., of the industrial automation system 104 via the communication device 120 of the user and the cloud platform. In some implementations, a user can interact with the virtual industrial automation system associated with (e.g., interfaced with) the corresponding industrial automation system 104 via the user's communication device 120 to facilitate interacting with and/or controlling (e.g., remotely interacting with and/or controlling) the industrial automation system 104 based at least in part on the user's interactions with the virtual industrial automation system via the communication device 120 of the user.
For instance, the user can view (e.g., monitor and/or track virtualized operation of) the virtual industrial automation system on the user's communication device 120, and can desire to adjust a control on the industrial automation system 104 to facilitate adjusting or controlling the operation of the industrial automation system 104. The virtual industrial automation system can comprise a virtualized control that can correspond to and/or be interfaced with the control of the industrial automation system 104. The user can input information (e.g., user input, such as gestures (e.g., gestures on a touch screen), keystrokes, mouse clicks, selections, voice commands, etc., of the user) to the user's communication device 120 to facilitate manipulating the virtualized control of the virtualized industrial automation system presented by (e.g., displayed on) the user's communication device 120 to facilitate adjusting the virtualized control, which can facilitate adjusting the corresponding control of the industrial automation system 104. The virtualization management component 118 can receive the input information, or corresponding control information (e.g., as generated by the communication device 120 based at least in part on the input information), relating to the user interactions with the virtualized industrial automation system via the communication device 120 of the user and communication network. The input information, or corresponding control information, can facilitate controlling the operation of the industrial automation system 104.
In response to the input information, or corresponding control information, the virtualization management component 118 can generate control signals that can be based at least in part on (e.g., that can correspond to) the user interactions with the virtualized industrial automation system. The virtualization management component 118 can transmit (e.g., in real or near real time) the control signals to the industrial automation system 104 to facilitate controlling (e.g., in real or near real time) operation of (e.g., adjusting the control of) the industrial automation system 104 in response to, and based at least in part on (e.g., in correspondence with), the user interactions with the virtualized industrial automation system.
To facilitate desirable (e.g., accurate, efficient, etc.) control of the operation of the industrial automation system 104 using the virtualized industrial automation system, the virtualization component 102 can obtain (e.g., automatically, dynamically, or continuously obtain, in real or at least near real time) data relating to the operation of the industrial automation system 104, user interactions with the industrial automation system 104 (e.g., either direct user interactions with the industrial automation system 104, or indirect or virtual user interactions with the industrial automation system 104 via user interactions with the virtual industrial automation system), and/or other data. For example, the virtualization component 102 can monitor and track the operational response of the industrial control system 104 in response to the control signals. The collection component 106 can obtain data, which can relate to the operational response of the industrial automation system 104 in response to the control signals, from the industrial control system 104.
The virtualization management component 118 can update the virtualized industrial automation system in response to the user interactions with the virtualized industrial automation system and in response to the data relating to the operational response of the industrial automation system 104 based at least in part on the user interactions with the virtualized industrial automation system. For instance, the virtualization management component 118 can update (e.g., automatically, dynamically, or continuously update, in real or at least near real time) the virtualized industrial automation system based at least in part on collected data relating to the operation of the industrial automation system, the user interactions with the industrial automation system, and/or other data. The virtualization management component 118 also can update (e.g., automatically or dynamically update, in real or at least near real time) the virtualized industrial automation system, based at least in part on any modification to the industrial automation system 104, to generate a modified virtualized industrial automation system that can virtualize any modification made to the industrial automation system 104.
As an exemplary scenario, in the industrial automation system 104, a motor short may have caused a fluid spill. The virtualization component 102 can detect the motor short and the fluid spill in the industrial automation system 104, and can collect data (e.g., via the collection component 106) relating to the motor short and fluid spill. The virtualization management component 118 can analyze the data, and can update the virtualized industrial automation system to present a graphical representation(s) and/or overlaid data associated with the industrial automation system 104 illustrating and/or relating to the motor short and fluid spill, based at least in part on the analysis results.
The virtualization management component 118 can provide (e.g., communicate, present, etc.) the updated virtualized industrial automation system, or desired portion thereof, to the communication device 120 of a user. Using the communication device 120, the user can remotely observe and interact with the virtualized industrial automation system, which can include a 3-D graphical representation of the motor, associated drive, and the portion of the industrial automation system 104 affected by the spill. The virtualization management component 118 can continue to update the virtualized industrial automation system in response to, and to reflect (e.g., to incorporate), changes to the industrial automation system 104 as they occur.
The user can interact with the updated virtualized industrial automation system presented on the communication device 120 to facilitate turning off the motor. For example, the user can make a gesture(s) (e.g., select a button, touch or swipe a control displayed on a touch screen, speak a voice command, type a command, etc.) in relation to the updated virtualized industrial automation system that indicates that the user is turning off the virtualized motor that corresponds to the motor of the industrial automation system 104 to facilitate turning off the motor. The communication device 120 can receive the gesture(s), and can communicate information (e.g., control or command related information) relating to the gesture(s) to the virtualization management component 118.
In response to the information received from the communication device 120, the virtualization management component 118 can detect that the user has performed a gesture(s) that, given the user's current view of the updated virtualized industrial automation system, indicates or corresponds to a command to turn off the motor of the industrial automation system 104. In response, the virtualization management component 118 can further update the virtualized industrial automation system to reflect (e.g., to graphically represent or display data illustrating) that the virtualized motor is being turned off. Further, in response, the virtualization management component 118 can generate and transmit a command (e.g., via the cloud platform) that can instruct a controller (e.g., of the industrial automation system 104) associated with the motor to transmit a stop or shut off command to the motor to facilitate turning off the motor and stopping or mitigating the spill. In response to the command received from the virtualization management component 118, the controller can transmit the stop or shut off command to the motor and the motor can be switched off in response to the stop or shut off command. In this way, the immediate effects of the malfunctioning motor can be curtailed before maintenance personnel are sent to the spill site.
As another example, in some implementations, the virtualization management component 118 can generate a virtualized view of the inner components, configuration of the inner components, operation of the inner components, faults of the inner components (e.g., when they occur), etc., of the industrial devices 108, industrial processes 110, industrial assets 112, and/or network-related devices of the network component 114, based at least in part on the data, in accordance with the defined virtualization management criteria. The virtualization management component 118 can provide (e.g., communicate, present) the inner virtualized view of an industrial device 108, an industrial process 110, an industrial asset 112, and/or a network-related device to the communication device 120 of a user, as desired. For example, if there is a problem with an industrial device 108 of the industrial automation system 104 detected, the user, using the communication device 120, can interact with the corresponding virtualized industrial device of the virtualized industrial automation system to access the virtualized inner components, configuration, operation, and/or fault, etc., of the virtualized industrial device. For instance, the user, using the communication device 120, can interact with the virtualized industrial device on the display screen of the communication device 120 to remove a virtualized panel of the virtualized industrial device to expose (e.g., display, present) the virtualized inner components, configuration, operation, and/or fault, etc., of the virtualized industrial device to the user via the communication device 120. In response to user interaction with the communication device 120, the user can navigate the inside of the virtualized industrial device to facilitate determining and/or rectifying the problem with the industrial device 108.
In some implementations, the virtualization management component 118 can employ or provide virtualization customization and/or data filtering services or applications. Via such virtualization customization and/or data filtering services or applications, the virtualization management component 118 can customize a user's view of the virtualized industrial automation system on the user's communication device 120 or filter data associated with the virtualized industrial automation system (and associated industrial automation system 104) presented on the user's communication device 120 to the user based at least in part on the role (e.g., operator, technician, manager, engineer, or other role) of the user in connection with the industrial automation system 104, the identity of the user or the user's communication device 120 or radio-frequency identification (RFID) tag, the authorization or access rights of a user to access the virtualized industrial automation system or the industrial automation system 104, authentication information (e.g., username, password, biometric information (e.g., voice information, fingerprint information, biometric information relating to the user's eye), etc.) presented by the user, the location of the user (e.g., the location of the user's communication device 120 or RFID tag of the user) in relation to the industrial automation system 104 (e.g., the location of the user within (or outside) the facility (e.g., plant) that comprises the industrial automation system 104), context of the data, preferences of a user (e.g., view customization preferences of the user), or other defined virtualization management criteria. For example, the virtualization management component 118 can customize the user's view of the virtualized industrial automation system on the user's communication device 120 or filter data associated with the virtualized industrial automation system presented on the user's communication device 120 to present, on the user's communication device 120, the portion of the virtualized industrial automation system and the portion of the overlaid data (e.g., industrial-automation-system-related data) desired by (e.g., of interest to) or permitted for viewing by the user. The virtualization management component 118 can generate and provide different views of the virtualized industrial automation system, which can comprise different data overlays (e.g., role-centric and/or user-preference based data overlays), for presentation on different communication devices 120 of different users, wherein the respective users can view and interact with the virtualized industrial automation system (e.g., virtualized plant) through their respective communication devices 120 to facilitate performing their respective work tasks to respectively remotely control the industrial automation system 104 via the respective customized views of the virtualized industrial automation system presented on their respective communication devices 120.
For example, the virtualization management component 118 can analyze data associated with a first user, a second user, and a third user, wherein the data can be data stored in the data store 116, data obtained from the first, second, and third users (e.g., via the users' communication devices 120), and/or data obtained from another data source(s). The data can specify or indicate the respective roles of the first, second, and third users with respect to the industrial automation system. For instance, first data associated with the first user can specify or indicate that the first user is a maintenance engineer, second data associated with the second user can specify or indicate that the second user is a shift supervisor, and third data associated with the third user can specify or indicate that the third user is a network engineer. Based at least in part on the results of the data analysis, the virtualization management component 118 can determine that the first user is a maintenance engineer, the second user is a shift supervisor, and the third user is a network engineer.
The virtualization management component 118 can generate different customized views of the virtualized industrial automation system and customized data overlays for each of the first, second, and third users based at least in part on their respective roles with respect to the industrial automation system 104. For instance, the virtualization management component 118 can determine and generate a first customized view of the virtualized industrial automation system based at least in part on the role of the first user being determined to be a maintenance engineer and/or one or more other customization factors (e.g., location of the first user with respect to the industrial automation system 104, a customization preference(s) of the first user, etc.), in accordance with the defined virtualization management criteria. The virtualization management component 118 also can determine a first subset of operational data that can be relevant to the first user in the first user's role as maintenance engineer, wherein the first subset of operational data can comprise data obtained from the data store 116 (e.g., as collected from the industrial automation system 104) and/or data being obtained from the industrial automation system 104 (e.g., automatically or dynamically, in real or near real time). The virtualization management component 118 can overlay the first subset of operational data on the first customized view of the virtualized industrial automation system. For example, the virtualization management component 118 can overlay the first subset of operational data (e.g., respective status information of respective industrial devices 108, industrial processes 110, and/or industrial assets 112) on or in proximity (e.g., near) to the corresponding virtualized industrial devices, virtualized industrial processes, and/or virtualized industrial assets presented in the first customized view of the virtualized industrial automation system.
The virtualization management component 118 also can determine and generate a second customized view of the virtualized industrial automation system based at least in part on the role of the second user being determined to be a shift supervisor and/or one or more other customization factors (e.g., location of the second user with respect to the industrial automation system 104, a customization preference(s) of the second user, etc.), in accordance with the defined virtualization management criteria. The virtualization management component 118 also can determine a second subset of operational data that can be relevant to the second user in the second user's role as shift supervisor, wherein the second subset of operational data can comprise data obtained from the data store 116 (e.g., as collected from the industrial automation system 104) and/or data being obtained from the industrial automation system 104 (e.g., automatically or dynamically, in real or near real time). The virtualization management component 118 can overlay the second subset of operational data on the second customized view of the virtualized industrial automation system. For example, the virtualization management component 118 can overlay the second subset of operational data (e.g., respective production statistics associated with respective industrial devices 108, industrial processes 110, and/or industrial assets 112) on or in proximity to the corresponding virtualized industrial devices, virtualized industrial processes, and/or virtualized industrial assets presented in the second customized view of the virtualized industrial automation system.
The virtualization management component 118 further can determine and generate a third customized view of the virtualized industrial automation system based at least in part on the role of the third user being determined to be a network engineer and/or one or more other customization factors (e.g., location of the third user with respect to the industrial automation system 104, a customization preference(s) of the third user, etc.), in accordance with the defined virtualization management criteria. The virtualization management component 118 also can determine a third subset of operational data that can be relevant to the third user in the second user's role as network engineer, wherein the third subset of operational data can comprise data obtained from the data store 116 (e.g., as collected from the industrial automation system 104) and/or data being obtained from the industrial automation system 104 (e.g., automatically or dynamically, in real or near real time). The virtualization management component 118 can overlay the third subset of operational data on the third customized view (e.g., IT view) of the virtualized industrial automation system. For example, the virtualization management component 118 can overlay the third subset of operational data (e.g., respective data usage information associated with respective network-related devices) on or in proximity to the corresponding virtualized network-related devices presented in the third customized view of the virtualized industrial automation system.
The virtualization management component 118 also can facilitate enabling a user, via the user's communication device 120, to apply a desired filter(s) to filter data associated with the user's view (e.g., customized view) of the virtualized industrial automation system, for example, to present a subset of the data that is relevant to a work task that the user is performing at the time, present more detailed data and/or a drilled-down view regarding a certain portion of the virtualized industrial automation system and associated industrial automation system 104, or for other reasons, as desired by the user. The virtualization management component 118 can provide a number of different types of filters to the communication devices 120 of users to enable the users to customize, augment, and/or filter data overlays for a user's personalized view of the virtualized industrial automation system. For example, the respective filters can be employed to facilitate filtering data to present a data overlay that can provide a summary or high-level abstract data regarding a particular portion of the industrial automation system 104; filtering data to present a data overlay relating to a particular industrial device 108, industrial process 110, industrial asset 112, or network-related device; filtering data to present a data overlay comprising more detailed information (e.g., drilled-down information) relating to a particular industrial device 108, industrial process 110, industrial asset 112, or network-related device than is presented with a current data overlay; filtering data for a data overlay based at least in part on type of data; filtering data for a data overlay based at least in part on a role of a user; filtering data based at least in part on a location of the user; filtering data based at least in part on a time associated with the data; filtering data based at least in part on a work shift (e.g., work-shift time period) associated with the data; and/or filtering data for a data overlay using another desired type of filter.
As an example of data filtering, the virtualization management component 118 can generate, and provide to the communication device 120 of a user, such as a network engineer, a customized view (e.g., an IT view) of the virtualized industrial automation system associated with the industrial automation system 104 and a data overlay associated with the customized view, based at least in part on the role (e.g., network engineer) of the user and/or preferences of the user, in accordance with the defined virtualization management criteria. For instance, the data overlay for the customized view of the virtualized industrial automation system can comprise bandwidth usage information that can be displayed over all or a desired portion of the virtualized network-related devices presented in the customized view of the virtualized industrial automation system, wherein the virtualized network-related devices can correspond to respective network-related devices of the network component 114 of the industrial automation system 104. In this example, as part of the original data overlay (e.g., original customized data overlay), the display screen of the user's communication device 120 can display an alarm (e.g., a graphical representation of an alarm) on or in proximity to a particular virtualized network-related device, wherein the alarm can indicate (e.g., can be known to indicate or can display data indicating) that bandwidth usage is reaching a slowdown level. If desired, the user (e.g., network engineer) can use the communication device 120 to select a filter (e.g., data filter) that can be placed on or used in connection with the user's customized view of the virtualized industrial automation system. The virtualized management system 118 can receive information relating to the selection of the filter from the communication device 120. In response, the virtualized management system 118 can modify (e.g., augment) the customized view of the virtualized industrial automation system (e.g., modify or augment the data overlay of the customized view of the virtualized industrial automation system) to overlay more detailed information relating to the respective bandwidth usage associated with respective network-related devices on or in proximity to respective virtualized network-related devices. For example, while the original data overlay presented an alarm indicator, on or in proximity to a particular network-related device, that indicates bandwidth usage is reaching a slowdown level, the augmented data overlay can present respective data overlay portions on or in proximity to the respective network-related devices presented on the display screen of the communication device 120, wherein the respective data overlay portions can comprise respective data that can indicate, e.g., which network-related devices are utilizing any of the bandwidth and how much bandwidth each of these network-related devices is using.
Data overlays also can be based at least in part on a current context (e.g., the user's location; a current operating condition associated with an industrial device 108, an industrial process 110, an industrial asset 112, or a network-related device; etc.). As a location-based example, the virtualization management component 118 can update, augment, filter, or customize the view (e.g., customized view), and/or data overlay, of the virtualized industrial automation system presented on the communication device 120 of a user based at least in part on the location of the user (e.g., the location of the user's communication device 120 or RFID tag of the user) with respect to the industrial automation system 104. For example, if the user is located in a first location in relation to the industrial automation system 104, the virtualization management component 118 can customize, augment, or filter a user's view of, and/or the data overlay associated with, the virtualized industrial automation system as presented on the user's communication device 120 so that the user can view a first view of, and/or a first data overlay associated with, the virtualized industrial automation system (e.g., presenting a first portion of the virtualized industrial automation system) that can correspond to the first location (e.g., wherein the first view can comprise an area of the industrial automation system 104 within a defined distance of the first location), in accordance with the access rights to the user, based at least in part on the defined virtualization management criteria. If the user is located in a second location in relation to the industrial automation system 104 (or moves from the first location to the second location), the virtualization management component 118 can update, augment, filter, or customize the user's view of the virtualized industrial automation system as presented on the user's communication device 120 so that the user can view the second view of, and/or a second data overlay associated with, the virtualized industrial automation system (e.g., presenting a second portion of the virtualized industrial automation system) that can correspond to the second location (e.g., wherein the second view can comprise an area of the industrial automation system 104 within a defined distance of the second location), in accordance with the access rights to the user, based at least in part on the defined virtualization management criteria.
The virtualization management component 118 also can share a customized view (e.g., personalized view) of, and/or customized data overlay associated with, a virtualized industrial automation system displayed on the communication device 120 of a user with a communication device(s) 120 of another user(s), in accordance with the defined virtualization management criteria (e.g., when another user is authorized to access such customized view or customized data overlay on that other user's communication device, and/or based in part on the role of that other user in connection with the industrial automation system 104, etc.). For example, a first user (e.g., first operator) can desire to share the first user's first customized view of, and/or first customized data overlay associated with, the virtualized industrial automation system with a second user (e.g., second operator, shift supervisor, maintenance engineer, etc.) via the second user's communication device 120. Alternatively, the second user can desire to view the first user's first customized view of, and/or first customized data overlay associated with, the virtualized industrial automation system. The first user, using the first user's communication device 120, can select a share control, or alternatively, the second user, using the second user's communication device 120, can select a share control (e.g., share request control), and information relating to selection of the share control can be sent from the communication device 120 to the virtualization management component 118.
In response, if the applicable virtualization management criteria have been satisfied (e.g., when it is determined that the second user is authorized to view the first user's first customized view of, and/or first customized data overlay associated with, the virtualized industrial automation system), the virtualization management component 118 can facilitate communicating the first user's first customized view of, and/or first customized data overlay associated with, the virtualized industrial automation system to the second user's communication device 120 for presentation to the second user. In some implementations, the first user's communication device 120 can directly communicate the first user's first customized view of, and/or first customized data overlay associated with, the virtualized industrial automation system to the second user's communication device 120 without the virtualization management component 118 having to be involved in the sharing process or the virtualization management component 118 can manage the authorization process to facilitate determining whether such sharing is permitted, while allowing the first user's communication device 120 to manage the communication of the first customized view and first data overlay to the second user's communication device 120, if such sharing is authorized by the virtualization management component 118.
In some implementations, in addition to or as an alternative to sharing a first user's customized view of, and/or customized data overlay associated with, the virtualized industrial automation system with another user, the virtualization management component 118 can facilitate enabling the first user, using the first user's communication device 120, to share, with another user, a filter, a set of filters, or filter settings, that the first user applied to facilitate generating the first user's customized view of, and/or customized data overlay associated with, the virtualized industrial automation system. The other user, via interacting with that other user's communication device 120, can apply the filter, the set of filters, or the filter settings obtained from the first user to the data overlay and/or the virtualized industrial automation system to facilitate generating the first user's customized view of, and/or customized data overlay associated with, the virtualized industrial automation system. In response, the virtualization management component 118 can facilitate generating and providing the first user's customized view of, and/or customized data overlay associated with, the virtualized industrial automation system to the communication device 120 of the other user for presentation to the user.
The system 100 also can facilitate enabling users to interact with the virtualized industrial automation system (e.g., to interact with the augmented reality representation of the system) to add desired information associated with and/or displayed with the virtualized industrial automation system to facilitate sharing user-generated information relating to the industrial automation system 104 or other user-generated information with other users who can view the virtualized industrial automation system via communication devices 120. For instance, the virtualization management component 118 (e.g., via provision of a virtual note generation service or application) can facilitate enabling a user to use the communication device 120 to generate a virtual note, that can comprise desired information (e.g., information relating to a portion (e.g., an industrial device, an industrial process, an industrial asset, or a network-related device, etc.) of the industrial automation system represented by the virtualized portion (e.g., a virtualized industrial device, virtualized industrial process, virtualized industrial asset, or virtualized network-related device, etc.) of the virtualized industrial automation system. A virtual note can be employed, for example, to tag a problem or abnormal operating condition associated with the portion of the industrial automation system 104, for use as a shift report (e.g., from a user on one work shift to another user on the next work shift to facilitate providing desired information to the other user on the next shift), to remind the user (or another user(s)) of something in connection with that portion of the industrial automation system 104, to notify another user(s) that some work task (e.g., maintenance, repair, or replacement task, etc.) is to be performed in connection with that portion of the industrial automation system 104 (e.g., provide a “breadcrumb” trail for maintenance personnel, e.g., by using a virtual note(s) to flag which machine requires repair, replacement, or installation of replacement part), to facilitate remote monitoring or support for an industrial automation system (e.g., by the entity operating the industrial automation system or by a 3rd-party entity providing such remote monitoring or support), or for another desired reason.
The virtualization management component 118 can facilitate enabling the user to use the communication device 120 to apply the virtual note to (e.g., attach, link, associate, place, etc., the virtual note to, with, or on) the virtualized portion of the virtualized industrial automation system. For instance, the user, using the communication device 120, can interact (e.g., via user gestures (e.g., on a touch screen), selections, keystrokes, mouse movements or commands, etc.) with the virtual note and/or the virtualized portion of the virtualized industrial automation system, wherein the interaction can indicate that the user is attempting to apply the virtual note on or in proximity to the virtualized portion of the virtualized industrial automation system. For example, the user can interact with the virtual note via the communication device 120 to drag-and-drop the virtual note on or in proximity to the virtualized portion of the virtualized industrial automation system. The virtualization management component 118 can receive information relating to the user's interactions with the virtual note and/or the virtualized portion of the virtualized industrial automation system from the communication device 120. In response, the virtualization management component 118 can facilitate applying the virtual note on or in proximity to the virtualized portion of the virtualized industrial automation system.
The virtualization management component 118 further can facilitate enabling a user, using the communication device 120, to control the scope of the virtual note to control the viewability of the virtual note on or associated with (e.g., in proximity to) the virtualized portion of the virtualized industrial automation system by another user(s), e.g., on the communication device(s) 120 of the other user(s), in accordance with the defined virtualization management criteria (e.g., when the other user is authorized to access or view the virtual note on that other user's communication device 120, and/or based in part on the role of that other user in connection with the industrial automation system 104, etc.). For instance, the user, using the communication device 120, can select a scope control associated with the virtual note, and can input information that can indicate the viewability scope of the virtual note to facilitate controlling which users can view the virtual note. Alternatively or additionally, the virtualization management component 118 can set the viewability scope or specify a minimum or maximum viewability scope for the virtual note, in accordance with the defined virtualization management criteria. The scope for a virtual note can range, for example, from allowing anyone (e.g., regardless of role) to view the virtual note on the virtualized portion of the virtualized industrial automation system, to allowing only users (e.g., regardless of role) who are logged in and authenticated with the virtualization management component 118 to view the virtual note on the virtualized portion of the virtualized industrial automation system, to allowing only users who provide authentication credentials that indicate they satisfy defined security criteria to view the virtual note on the virtualized portion of the virtualized industrial automation system, to allowing only users who have a particular role(s) to view the virtual note on the virtualized portion of the virtualized industrial automation system, to allowing only a certain user(s) specified by the user who created the virtual note to view the virtual note on the virtualized portion of the virtualized industrial automation system, to virtually any other desired viewability scope, in accordance with the defined virtualization management criteria.
As an example of using a virtual note, a user, using the user's communication device 120, can interact with the user's personalized view of the virtualized industrial automation system (e.g., the virtualized plant) to generate a virtual note and place the virtual note (e.g., a virtualized post-it note) on or near one of the virtual machine representations (e.g., on or near a virtualized industrial device) of the virtualized industrial automation system. The virtual note can comprise information from the user (e.g., a maintenance engineer) that can warn other users of an abnormal operating condition observed for a particular industrial device 108 associated with the virtualized industrial device. The user, using the communication device 120, also can interact with the scope control to set the viewability scope of the virtual note to facilitate controlling who is able to view the virtual note in connection with the virtualized industrial automation system. For instance, the user may desire that any user, who performs work tasks (e.g., as an operator, supervisor, engineer, etc.) in connection with any portion of the industrial automation system 104 that can be affected by the abnormal operating condition for the particular industrial device 108, should be able to view the virtual note. The user, using the communication device 120, can interact with the scope control and/or enter information that can indicate that such users are permitted to view the virtual note in connection with viewing the virtualized industrial automation system (e.g., viewing the virtualized industrial device). The virtualization management component 118 can receive information relating to the interaction with the scope control and/or associated information, and, in response, the virtualization management component 118 can set and enforce the viewability scope to allow such users to view the virtual note via their communication devices 120 and to not allow other users to view the virtual note via their communication devices 120.
By enabling users to generate and share user-generated information relating to the industrial automation system 104, the virtualization management component 118 can facilitate further augmenting the data-driven plant virtualizations (e.g., virtualized industrial automation system) to present users with user-provided data to facilitate the sharing of knowledge or observations relating to the industrial automation system 104 with other users. This can enable users to work more efficiently and the industrial automation system 104 to operate more efficiently.
In some implementations, the virtualization management component 118 can facilitate securing or controlling access to the virtualized industrial automation system and the industrial automation system 104, in accordance with the defined virtualization management criteria, to facilitate mitigating security risks associated with presenting the virtualized industrial automation system to communication devices of users and/or the execution of control commands via the system 100 (e.g., the cloud-based virtualized system). The virtualization management component 118 can control access to the virtualized industrial automation system and the industrial automation system 104 (e.g., via the virtualized industrial automation system), control access to a particular customized view or customized data overlay associated with the virtualized industrial automation system, and/or control access to user-generated information (e.g., contained in a virtual note), based at least in part on identity of a user, authentication information (e.g., username, password, passphrase, personal identification number (PIN), biometric information, or other unique identification information) associated with of a user, location of the user (or location of the user's communication device 120 or RFID tag) in relation to the industrial automation system 104, a viewability scope setting, preferences of a user, or other defined virtualization management criteria.
For example, if a user attempts to use the user's communication device to access the virtualized industrial automation system to facilitate controlling the associated industrial automation system 104, the virtualization management component 118 can request that the user provide valid authentication information to the virtualization management component 118 that indicates the user is authorized to gain such access to the virtualized industrial automation system and/or authorized to perform an action (e.g., adjust a virtualized control or switch) with respect to the virtualized industrial automation system or industrial automation system 104. In some implementations, the virtualization management component 118 can grant respective types of access rights to the virtualized industrial automation system and the industrial automation system 104 (e.g., via the virtualized industrial automation system) to respective users based at least in part on respective access permissions of the respective users and respective authentication information of the respective users, wherein the respective access permissions or rights can be associated with (e.g., mapped or linked to) the respective authentication information of the respective users. The access permissions or rights to the virtualized industrial automation system and the industrial automation system 104 (e.g., via the virtualized industrial automation system) can relate to the portion(s) of the virtualized industrial automation system that can be accessed by a user, the commands that can be issued by the user or the portion(s) of the virtualized industrial automation system (and corresponding portion(s) of the industrial automation system 104) that can be controlled by a user, etc. The virtualization management component 118 can grant, to respective users, respective (e.g., different) access permissions or rights the virtualized industrial automation system and the industrial automation system 104 (e.g., via the virtualized industrial automation system) based at least in part on the respective roles of the respective users in connection with the industrial automation system 104 or associated industrial enterprise, a location of a user in relation to the industrial automation system 104, or other defined virtualization management criteria.
If a user does not provide acceptable (e.g., valid) authentication information, or is not within a defined distance of a portion (e.g., an industrial device 108, industrial process 110, industrial asset 112, etc.) of the industrial automation system 104 that the user is attempting to control via a command, the virtualization management component 118 can deny the user access to the virtualized industrial automation system and the industrial automation system 104 (e.g., via the virtualized industrial automation system) or can limit the access rights of the user to the virtualized industrial automation system and the industrial automation system 104 (e.g., via the virtualized industrial automation system) to allow the user to only issue a certain limited subset of commands to facilitate controlling the virtualized industrial automation system and the industrial automation system 104 (e.g., via the virtualized industrial automation system).
In some implementations, the virtualization management component 118 can employ different levels of authentication to a user to facilitate determining access permissions or rights that are to be granted to the user to allow access to the virtualized industrial automation system and the industrial automation system 104 (e.g., via the virtualized industrial automation system) based at least in part on the location (e.g., detected location) of the user (or the user's communication device 120 or identification tag (e.g., RFID tag)) in relation to the industrial automation system 104, in accordance with the defined virtualization management criteria. For instance, if the user (or the user's communication device 120 or identification tag) is within a defined distance of the portion of the industrial automation system 104 that the user is attempting to control via the virtualized industrial automation system presented by the communication device 120 (e.g., within the facility that contains the portion of the industrial automation system 104), the virtualization management component 118 can control access to the portion of the industrial automation system 104 via the virtualized industrial automation system presented by the communication device 120 based at least in part on a first level of authentication (and a corresponding first type of authentication information (e.g., authentication credentials)) that can be lower (e.g., less stringent) than a second level of authentication (and a corresponding second type (e.g., higher or more strict type) of authentication information) associated with a second location of the user (or the user's communication device 120 or identification tag) that is not within a defined distance of the portion of the industrial automation system 104 that the user is attempting to control via the virtualized industrial automation system presented by the communication device 120. If the user (or the user's communication device 120 or identification tag) is in the second location (or is not detected as being located within the defined distance of the portion of the industrial automation system 104), the virtualization management component 118 can control access to the portion of the industrial automation system 104 via the virtualized industrial automation system presented by the communication device 120 based at least in part on the second level of authentication (and a corresponding second type of authentication information).
The virtualization management component 118 can control access to the portion of the industrial automation system 104 to grant a first (e.g., lower) level of access rights to the user in response to receiving the first type of authentication information, and can grant a second (e.g., higher) level of access rights to the user in response to receiving the second type of authentication information, wherein the second level access rights can allow the user to use the communication device 120 to have more access to the virtualized industrial automation system and the industrial automation system 104 (e.g., via the virtualized industrial automation system) or more rights to issue commands in connection with the virtualized industrial automation system and the industrial automation system 104 (e.g., via the virtualized industrial automation system) than the first level of access rights associated with the first type of authentication information. As an example, the first type of authentication information can comprise detection (e.g., by the virtualization management component 118) of a device identifier of the communication device 120 or RFID tag of the user within the defined distance of the portion of the industrial automation system 104 that the user is attempting to control via the virtualized industrial automation system presented by the communication device 120, and the second type of authentication information can comprise a valid username, password, and/or biometric information associated with the user when the user (or the user's communication device 120 or identification tag) is located in the second location (or is not detected as being located within the defined distance of the portion of the industrial automation system 104), e.g., as detected by the virtualization management component 118. It is to be appreciated and understood that, in accordance with various other implementations, additionally or alternatively, the virtualization management component 118 can implement and enforce various other authentication policies in connection with controlling access to the virtualized industrial automation system and the industrial automation system 104 (e.g., via the virtualized industrial automation system) by users, in accordance with the defined virtualization management criteria. For example, the virtualization management component 118 can implement and enforce various different authentication policies based at least in part on the role of the user with respect to the industrial automation system 104, the type of action or task the user is attempting to perform on the virtualized industrial automation system and the industrial automation system 104 (e.g., via the virtualized industrial automation system), identification of the communication device 120 (e.g., based at least in part on the device identifier associated with the device (e.g., mobile subscriber integrated services digital network-number (MSISDN), media access control (MAC) address, etc.)) associated with the user, and/or another authentication policy or criterion, in accordance with the defined virtualization management criteria.
In some implementations, to facilitate desirable (e.g., favorable, beneficial, efficient, etc.) performance of the industrial automation system 104, the virtualization component 102 (e.g., employing a simulation component) can facilitate generating simulation models of the industrial automation system 104 for a number of desired purposes. For example, prior to adjusting a virtualized control or virtualized switch associated with a virtualized industrial device of the virtualized industrial automation system in connection with a corresponding industrial device of the industrial automation system 104, the virtualization component 102 (e.g., in response to a request from a user via a communication device 120) can simulate operation of the industrial automation system 104 in response to the adjusting of the virtualized control or the virtualized switch associated with the virtualized industrial device of the virtualized industrial automation system, based at least in part on the simulation model of the industrial automation system 104, to facilitate determining whether the industrial automation system 104 will operate desirably (e.g., adequately, properly, optimally, etc.) in response to the adjusting of the virtualized control or the virtualized switch associated with the virtualized industrial device of the virtualized industrial automation system. Based at least in part on a result of the simulated operation of the industrial automation system 104, the virtualization component 102 or the user can determine whether to adjust the virtualized control or the virtualized switch associated with the virtualized industrial device of the virtualized industrial automation system to remotely control the operation of the industrial automation system 104, in accordance with the set of defined operation criteria (which can be part of the set of defined virtualization management criteria).
To facilitate generating a simulation model of the industrial automation system 104, the virtualization component 102 (e.g., employing the simulation component) can analyze the set of data relating to the industrial automation system 104 and/or the other industrial automation system to facilitate simulating or emulating the industrial automation system 104 and its constituent devices, processes, and other assets. Based at least in part on the results of the analysis of the set of data, the virtualization component 102 can simulate or emulate (e.g., determine and/or generate a simulation or an emulation for) the industrial automation system 104, including determining respectively simulating or emulating the respective industrial devices 108, industrial processes 110, other industrial assets 112, and network-related devices of the network component 114, simulating or emulating the interrelationships (e.g., system configuration, connections, etc.) between the respective industrial devices 108, industrial processes 110, other industrial assets 112, and network-related devices of the network component 114, and/or simulating or emulating the properties, characteristics, functions, etc., of the respective devices, processes, and/or assets of the industrial automation system 104, etc.
The virtualization component 102 can generate a simulation model of the industrial automation system 104 based at least in part on the simulation or emulation of the industrial automation system 104, including the respective simulations or emulations of the respective industrial devices 108, industrial processes 110, other industrial assets 112, and network-related devices of the network component 114, simulations or emulations of the interrelationships (e.g., system configuration, connections, etc.) between the respective industrial devices 108, industrial processes 110, other industrial assets 112, and network-related devices of the network component 114, etc.
When a set of operation data is applied to the simulation model, a response or behavior of the simulation model can be generated. The virtualization component 102 can utilize the response or behavior produced by the simulation model in response to the application of the set of operation data to the simulation model to facilitate determining or predicting how the industrial automation system 104 will respond (or is expected to respond) when the set of operation data is applied to the industrial automation system 104, and to facilitate determining whether an action (e.g., adjusting a virtualized control or switch associated with the virtualized industrial automation system or corresponding control or switch associated with the industrial automation system 104) is to be performed in connection with the virtualized industrial automation system or the industrial automation system 104. The virtualization component 102 can store the simulation model of the industrial automation system 104, and/or response information relating to determined or predicted responses based on the simulation model, in the data store 116.
It is to be appreciated and understood that, while the virtualization component 102 and virtualization management component 118 can generate graphical representations and/or virtualizations of the various industrial devices 108, industrial processes 110, industrial assets 112, network-related devices, etc., or one or more respective instances (e.g., virtualized instances) of the various industrial devices 108, industrial processes 110, industrial assets 112, network-related devices, etc., the disclosed subject matter is not so limited. In some implementations, another virtualization component, for example, associated with a third-party vendor, can generate all or some of the graphical representations and/or virtualizations of the various industrial devices 108, industrial processes 110, industrial assets 112, network-related devices, etc., or one or more respective instances (e.g., virtualized instances) of the various industrial devices 108, industrial processes 110, industrial assets 112, network-related devices, etc. The virtualization component 102 can receive information relating to the graphical representations and/or virtualizations of the various industrial devices 108, industrial processes 110, industrial assets 112, network-related devices, etc., or one or more respective instances (e.g., virtualized instances) of the various industrial devices 108, industrial processes 110, industrial assets 112, network-related devices, etc., generated by the other virtualization component. Regardless of the source of the graphical representations or virtualizations associated with the industrial automation system 104, the virtualization management component 118 can facilitate managing the graphical representations and/or virtualizations of the various industrial devices 108, industrial processes 110, industrial assets 112, network-related devices, etc., or one or more respective instances (e.g., virtualized instances) of the various industrial devices 108, industrial processes 110, industrial assets 112, network-related devices, etc., and can facilitate managing (e.g., controlling) the various industrial devices 108, industrial processes 110, industrial assets 112, network-related devices, etc., of the industrial automation system.
An industrial automation system 202 can be associated with (e.g., communicatively connected to or interfaced with) the virtualization component 102, as more fully disclosed herein. The industrial automation system 202 can comprise one or more industrial devices 108, industrial processes 110, industrial assets 112, network-related devices associated with a network component 114, etc., that can be configured with respect to each other to form the industrial automation system 202. The configuration of the one or more industrial devices 108, industrial processes 110, industrial assets 112, network-related devices associated with a network component 114, etc., to form the industrial automation system 202 can relate to the respective positions (e.g., locations) of these the one or more industrial devices 108, industrial processes 110, industrial assets 112, network-related devices associated with a network component 114, etc., relative to each other in the facility, respective connections (e.g., electrical connections, mechanical connections, communication connections, interfaces, etc.) between respective devices, processes, and/or assets, respective settings or configurations of respective devices, processes, and/or assets, and/or other aspects of the configuration of the industrial automation system 202.
One or more users (e.g., operator, technician, manager, engineer, maintenance or repair person, etc.) can interact with (e.g., perform work tasks in connection with) the industrial automation system 202 to facilitate desired operation of the industrial automation system 202. For example, a first user can interact with a first portion of the industrial automation system 202 to perform a first set of work tasks in connection with the industrial automation system 202, a second user can interact with a second portion of the industrial automation system 202 to perform a second set of work tasks in connection with the industrial automation system 202, and so on, wherein the first portion can comprise a first subset of the industrial devices 108, industrial processes 110, industrial assets 112, and/or network-related devices associated with a network component 114, and the second portion can comprise a second subset of the industrial devices 108, industrial processes 110, industrial assets 112, and/or network-related devices associated with a network component 114. All or some of the users can have a communication device, such as communication device 204, that can be used to communicate voice, data, audio content, video content, etc., and can be used to facilitate interacting with the industrial automation system 202 via the virtualization component 102.
The virtualization management component 118 can generate and manage a virtualized industrial automation system 206 (e.g., an interactive virtualized industrial automation system) that can represent (e.g., graphically depict) the industrial automation system 202 based at least in part on results of an analysis of data obtained from the industrial automation system 202 (e.g., by the collection component 106) and/or other data, in accordance with the defined virtualization criteria, as more fully disclosed herein. As part of generating the virtualized industrial automation system 206, the virtualization management component 118 can generate one or more virtualized industrial devices 208 (e.g., comprising one or more virtualized instances of each industrial device 108), virtualized industrial processes 210 (e.g., comprising one or more virtualized instances of each industrial process 110), virtualized industrial assets 212 (e.g., comprising one or more virtualized instances of each industrial asset 112), virtualized network-related devices associated with a virtualized network component 214 (e.g., comprising one or more virtualized instances of each network-related device), etc., that can virtualize, replicate (e.g., virtually), or correspond to the one or more industrial devices 108, industrial processes 110, industrial assets 112, network-related devices associated with a network component 114, etc., of the industrial automation system 202 and the configuration of the industrial automation system 202 (e.g., the configuration of the one or more industrial devices 108, industrial processes 110, industrial assets 112, network-related devices associated with a network component 114, etc., that form the industrial automation system 202).
The virtualization management component 118 also can update the virtualized industrial automation system 206 in response to changes in the industrial automation system 202 that are detected by the virtualization management component 118, based at least in part on data obtained from the industrial automation system 202 (e.g., by the collection component 106) and/or other data. A user can directly interact with the industrial automation system 202 to facilitate operation of the industrial automation system 202, or the user can indirectly interact with the industrial automation system 202 by interacting with the virtualized industrial automation system 206 via the communication device 204 to facilitate operation of the industrial automation system, as more fully disclosed herein. The virtualization management component 118 also can update the virtualized industrial automation system 206 in response to the direct interaction with the industrial automation system 202 by the user or in response to the indirect interaction with the industrial automation system 202 by interaction with the virtualized industrial automation system 206 via the communication device 204 by the user. The virtualization management component 118 also can operate and manage the virtualized industrial automation system 206 to facilitate interacting with and/or controlling the industrial automation system 202. For instance, in response to user interaction with the virtualized industrial automation system 206 (e.g., in response to adjusting a virtualized control associated with a virtualized industrial device 208) via the communication device 204 to facilitate performing adjusting or controlling the industrial automation system 202, the virtualization management component 118 can generate control signals that can facilitate adjusting or controlling the industrial automation system 202 (e.g., adjusting a corresponding control associated with the corresponding industrial device 108) based at least in part on (e.g., in a corresponding manner to) the adjusting or controlling of the virtualized industrial automation system 206 in response to the user interaction with the virtualized industrial automation system 206. The virtualization management component 118 can transmit the control signals to the industrial automation system 202, wherein the industrial automation system 202 can be correspondingly adjusted or controlled in response to the control signals.
Referring briefly to
For example, the virtualization management component 118 can determine that the view of the virtualized industrial automation system 206 for the user is to be customized to present a view of a first portion of the virtualized industrial automation system 206, which can correspond to a first portion of the industrial automation system 202, to the user via the communication device of the user, based at least in part on the user's role, preferences, or location, and/or other factors or criteria, in accordance with the defined virtualization management criteria. In response, the virtualization management component 118 can modify, update, or customize the view of the virtualized industrial automation system 206 that is provided to (e.g., sent to) the communication device 204 for presentation to the user to generate a first customized view 302 of the virtualized industrial automation system 206 that presents the first portion of the virtualized industrial automation system 206 that can correspond to the first portion of the industrial automation system 202. The first customized view 302 of the virtualized industrial automation system 206, which can present the first portion of the virtualized industrial automation system 206, can comprise, for example, a first subset of industrial devices 208, a first subset of industrial processes 210, a first subset of industrial assets 212, and/or a first subset of network-related devices of the network component 214. The virtualization management component 118 can communicate the first customized view 302 of the virtualized industrial automation system 206 to the communication device 204 for presentation to the user via the display screen of the communication device 204.
To continue with the example, at another time, or based in part on a change in circumstances of the user (e.g., change in the user's role, preferences, location, data filter selections, etc.), or with regard to another user, the virtualization management component 118 can determine that the view of the virtualized industrial automation system 206 for the user is to be customized to present a view of a second portion of the virtualized industrial automation system 206, which can correspond to a second portion of the industrial automation system 202, to the user via the communication device of the user, based at least in part on the user's role, preferences, or location, and/or other factors or criteria, in accordance with the defined virtualization management criteria. In response, the virtualization management component 118 can modify, update, or customize the view of the virtualized industrial automation system 206 that is provided to (e.g., sent to) the communication device 204 for presentation to the user to generate a second customized view 304 of the virtualized industrial automation system 206 that presents the second portion of the virtualized industrial automation system 206, which can correspond to the second portion of the industrial automation system 202. The second customized view 304 of the virtualized industrial automation system 206, which can present the second portion of the virtualized industrial automation system 206, can comprise, for example, a second subset of industrial devices 208, a second subset of industrial processes 210, a second subset of industrial assets 212, and/or a second subset of network-related devices of the network component 214. The virtualization management component 118 can communicate the second customized view 304 of the virtualized industrial automation system 206 to the communication device 204 for presentation to the user via the display screen of the communication device 204.
Referring briefly to
For example, the dashboard view 400 can comprise one or more system performance indicators 402, alert indicators 404, system output indicators 406, subsets of data 408, controls 410 (e.g., virtualized controls), or other desired indicators (e.g., quality indicator, materials indicator, status indicator, etc.), buttons, etc., relating to the industrial automation system 202 to provide a virtualized view (e.g., in the form of a graphical representation of a dashboard) of the industrial automation system 202. The virtualization management component 118 can customize or update the dashboard view 400 of the industrial automation system 202 based at least in part on the location of the user (or the user's communication device 204 or RFID tag), identity of the user, role of the user, information from the user indicating what data or portions of the industrial automation system 202 the user is interest in, or other factors or criteria, as more fully disclosed herein, in accordance with the defined virtualization management criteria. For example, the virtualization management component 118 can customize or update the indicators, controls, buttons, data, etc., that are presented in the dashboard view 400 of the industrial automation system 202. The virtualization management component 118 also can customize or update the size of respective virtualized items (e.g., system performance indicator 402, alert indicator 404, system output indicator 406, subsets of data 408, control 410 (e.g., virtualized control), or other desired indicator, and/or button, etc.) in the dashboard view 400, for example, in accordance with user preferences, relative importance or priority of the respective virtualized dashboard items, role of the user, etc., in accordance with the defined virtualization management criteria. An indicator (e.g., 402, 404, 406, etc.), data, or other dashboard items of information can be presented by the dashboard view 400 in the form of a chart, a graph, a meter, alphanumeric symbols, etc., wherein a chart, graph, or meter can be of desired type (e.g., bar graph, pie chart, etc.) and can have desired colors, shapes, scaling, etc.
Referring briefly to
The hybrid virtualized view 500 generated by the virtualization management component 118 can comprise multiple (e.g., 2 or more) virtualized views of the virtualized industrial automation system 206 from different perspectives. For instance, the virtualized industrial automation system 206 can generate a first virtualized view 502 (e.g., a first view or first customized view) of the virtualized industrial automation system 206 that can be displayed in a first portion of a display screen of the communication device 204, and a second virtualized view 504 (e.g., a second view or second customized view) of the virtualized industrial automation system 206 that can be displayed in a second portion of the display screen of the communication device 204. The first virtualized view 502 and the second virtualized view 504 can be generated by the virtualized industrial automation system 206 and displayed on the display screen of the communication device 204 as a picture-in-picture (PIP) hybrid view (as depicted in
The first virtualized view 502 and the second virtualized view 504 can respectively present different virtualized portions of the virtualized industrial automation system 206. For example, the first virtualized view 502 can present a virtualized view of a first virtualized portion of the virtualized industrial automation system 206 (e.g., that can be of interest to the user), and the second virtualized view 504 can present a virtualized view of a second virtualized portion of the virtualized industrial automation system 206 (e.g., the entire system 206 or a different portion of the system 206). As another example, the first virtualized view 502 can present a virtualized dashboard view of all or a portion of the virtualized industrial automation system 206, and the second virtualized view 504 can present a virtualized view that can graphically depict the physical structure and configuration of a second virtualized portion of the virtualized industrial automation system 206.
Referring briefly to
The shift supervisor may desire to drill down and obtain more detail regarding the production statistics, for example, to obtain respective production statistics relating to respective industrial devices 108 of the set of industrial devices 108. To achieve this, the shift supervisor, using the communication device 204, can interact with the first customized view 602 of the virtualized industrial automation system 206 to facilitate selecting a desired filter that can facilitate analyzing production statistics associated with the set of industrial devices 108 and filtering those production statistics to generate respective subsets of production statistics for respective industrial devices 108 of the set of industrial devices 108. The virtualization management component 118 can receive information relating to the selection of the filter from the communication device 204. The virtualization management component 118 can apply the filter to the production statistics data associated with the set of industrial devices 108 and can filter the production statistics data to generate the respective subsets of production statistics for respective industrial devices 108 of the set of industrial devices 108. The virtualization management component 118 can update or augment the first customized view 602 of the virtualized industrial automation system 206 to generate a second customized view 606 of the virtualized industrial automation system 206 that can comprise second customized data overlays 608, 610, and 612 that respectively can present the respective subsets of production statistics for the respective industrial devices 108 of the set of industrial devices 108. The virtualization management component 118 can place the respective second customized data overlays 608, 610, and 612 on or in proximity to the respective virtualized industrial devices 208 that correspond to the respective industrial devices 108. It is to be appreciated and understood that, in accordance with various implementations, the second customized view 606 (as depicted) of the virtualized industrial automation system 206 can be structured to not display the virtualized industrial process(es) 210, virtualized industrial asset(s) 212, and network component 214 of the virtualized industrial automation system 206 (as they are shown in the first customized view 602), for example, if the user interaction or preferences result in the second customized view 606 focusing on only the respective virtualized industrial devices 208 and respective second customized data overlays 608, 610, and 612, or can be structured to show the virtualized industrial process(es) 210, virtualized industrial asset(s) 212, and network component 214 of the virtualized industrial automation system 206 in addition to showing the respective virtualized industrial devices 208 and respective second customized data overlays 608, 610, and 612.
Referring briefly to
The first user may desire to share the first customized view 302 of, and/or customized data overlay associated with, the virtualized industrial automation system 206 with the second user, or the second user may desire to view the first customized view 302 of, and/or customized data overlay associated with, the virtualized industrial automation system 206 that is being displayed on the communication device 204 of the first user. To facilitate sharing the first customized view, and/or the customized data overlay, the first user, using the first user's communication device 204, can select a share control, or alternatively, the second user, using the second user's communication device 702, can select a share control (e.g., share request control), and information relating to selection of the share control can be sent from the communication device 204, or alternatively the communication device 702, to the virtualization management component 118.
In response to the selection of the share control, if the applicable virtualization management criteria have been satisfied (e.g., when it is determined that the second user is authorized to view the first user's first customized view of, and/or first customized data overlay associated with, the virtualized industrial automation system), the virtualization management component 118 can facilitate communicating the first user's first customized view 302 of, and/or customized data overlay associated with, the virtualized industrial automation system 206 to the second user's communication device 702 for presentation to the second user. In some implementations, the first user's communication device 2044 can directly communicate the first user's first customized view of, and/or customized data overlay associated with, the virtualized industrial automation system 206 to the second user's communication device 702 without the virtualization management component 118 having to be involved in the sharing process or the virtualization management component 118 can manage the authorization process to facilitate determining whether such sharing is permitted, while allowing the first user's communication device 204 to manage the communication of the first customized view 302, and/or the data overlay, to the second user's communication device 702, if such sharing is authorized by the virtualization management component 118.
Referring briefly to
The first user may desire to augment the information presented by the virtualized industrial automation system 206, and/or the associated data overlay, for example, by adding information (e.g., user-generated information) relating to the user's own observations or other desired information regarding the virtualized industrial automation system 206, and/or the associated data overlay, to the information presented by the virtualized industrial automation system 206, and/or the associated data overlay.
For instance, the virtualization management component 118 can facilitate enabling the first user to use the communication device 204 to generate a virtual note 802 (e.g., a graphical representation of a note or message), that can comprise desired information (e.g., information relating to a portion (e.g., an industrial device 108, an industrial process 110, an industrial asset 112, or a network-related device of the network component 114, etc.) of the industrial automation system represented by the virtualized portion (e.g., a virtualized industrial device 208, virtualized industrial process 210, virtualized industrial asset 212, or virtualized network-related device of the virtualized network component 214, etc.) of the virtualized industrial automation system 206. A virtual note 802 can be employed for any number of purposes, such as, for example, to tag a problem or abnormal operating condition associated with the portion of the industrial automation system 104, for use as a shift report, to remind the user (or another user(s)) of something in connection with that portion of the industrial automation system 104, to notify another user(s) that some work task (e.g., maintenance, repair, or replacement task, etc.) is to be performed in connection with that portion of the industrial automation system 104, or for another desired reason.
The virtualization management component 118 can facilitate enabling the first user to use the communication device 120 to apply the virtual note 802 to (e.g., attach, link, associate, place, etc., the virtual note to, with, or on) the virtualized portion of the virtualized industrial automation system 206 that can correspond to the portion of the industrial automation system 104. For instance, the user, using the communication device 204, can interact (e.g., via user gestures, selections, keystrokes, mouse movements or commands, etc.) with the virtual note 802 and/or the virtualized portion of the virtualized industrial automation system 206, wherein the interaction can indicate that the user is attempting to apply the virtual note 802 on or in proximity to the virtualized portion of the virtualized industrial automation system 206. For example, the user can interact with the virtual note 802 via the communication device 204 to drag-and-drop the virtual note 802 on or in proximity to the virtualized portion of the virtualized industrial automation system 206. For example, the virtualized portion of the virtualized industrial automation system 206 can be virtualized industrial device 208, for purposes of illustration. The virtualization management component 118 can receive information relating to the user's interactions with the virtual note 802 and/or the virtualized portion (e.g., virtualized industrial device 208) of the virtualized industrial automation system 206 from the communication device 204. In response, the virtualization management component 118 can facilitate applying the virtual note 802 on or in proximity to the virtualized portion (e.g., virtualized industrial device 208) of the virtualized industrial automation system 206.
The virtualization management component 118 further can facilitate enabling a user, using the communication device 204, to control the scope of the virtual note 802 to control the viewability of the virtual note 802 on or associated with (e.g., in proximity to) the virtualized portion (e.g., virtualized industrial device 208) of the virtualized industrial automation system 206 by another user(s), e.g., on the communication device(s) 804 of the other user(s), in accordance with the defined virtualization management criteria (e.g., when the other user is authorized to access or view the virtual note 802 on that other user's communication device 804, and/or based in part on the role of that other user in connection with the industrial automation system 104, etc.). For instance, the user, using the communication device 204, can select a scope control associated with the virtual note 802, and can input information (e.g., a scope parameter) that can indicate the viewability scope of the virtual note 802 to facilitate controlling which users can view the virtual note 802 in connection with the virtualized industrial automation system 206. Alternatively or additionally, the virtualization management component 118 can set the viewability scope or specify a minimum or maximum viewability scope for the virtual note 802, in accordance with the defined virtualization management criteria. The scope for a virtual note 802 can be ranged, as desired, to facilitate controlling the viewability of the virtual note 802 by another user based at least in part on a role of the other user, an identity of the other user, a location of the user with respect to the industrial automation system 104, the access rights to access the virtualized industrial automation system 206 by the other user, or another desired defined virtualization management criteria, such as disclosed herein. For example, the scope for a virtual note 802 can range from allowing any other user (e.g., regardless of role) to view the virtual note 802 on the virtualized portion of the virtualized industrial automation system 206, to allowing only users (e.g., regardless of role) who are logged in and authenticated with the virtualization management component 118 to view the virtual note 802 on the virtualized portion of the virtualized industrial automation system 206, to allowing only users who provide authentication credentials that indicate they satisfy defined security criteria (e.g., to have access rights) to view the virtual note 802 on the virtualized portion of the virtualized industrial automation system 206, to allowing only users who have a particular role(s) to view the virtual note 802 on the virtualized portion of the virtualized industrial automation system 206, to allowing only a certain user(s) specified by the user who created the virtual note 802 to view the virtual note 802 on or in proximity to the virtualized portion of the virtualized industrial automation system 206, to virtually any other desired viewability scope, in accordance with the defined virtualization management criteria.
The virtualization management component 118 can enforce the scope associated with the virtual note 802, based at least in part on the scope set for the virtual note 802, such that users permitted to view the virtual note 802 (e.g., the user associated with communication device 804) can view the virtual note 802 on or in proximity to the virtualized portion of the virtualized industrial automation system 206, and users who are not permitted to view the virtual note 802 will not be able to view the virtual note 802 that is on or in proximity to the virtualized portion of the virtualized industrial automation system 206 via their communication devices.
With further regard to
The virtualization management component 118 and/or the communication device (e.g., 120, 204) also can facilitate enabling a user to adjust the size of a virtualized view of the virtualized industrial automation system. For example, in response to user interaction (e.g., a gesture or command) with the virtualized industrial automation system via the communication device that indicates that the user is attempting to increase the size of a portion of the view of the virtualized industrial automation system, the virtualization management component 118 and/or the communication device (e.g., 120, 204) can zoom in or drill down to that portion of the view to increase or magnify the size of that portion of the view on the display screen of the communication device. If the size of the virtualized view is greater than the size of the display screen of the communication device, the virtualization management component 118 and/or the communication device (e.g., 120, 204) can facilitate providing a scroll bar or other function that can allow a user to maintain the relatively larger size of the virtualized view, while enabling the user to interact with the virtualized industrial automation system to view different areas of the virtualized industrial automation system (e.g., by moving a different area of the virtualized industrial automation system that is outside the display screen so that it is displayed on the display screen). The virtualization management component 118 and/or the communication device (e.g., 120, 204) also can facilitate presenting a keyboard (e.g., a pop-up touchscreen keyboard) and/or mouse (e.g., virtual or touchscreen mouse) on the display screen of the communication device to facilitate enabling a user to interact with the display screen to input data, select, move, or modify items, and/or interact with the virtualized industrial automation system, etc.
As disclosed herein, the virtualization system (e.g., 100, 200), or a portion thereof, can be located in a cloud platform. To provide a general context for the cloud-based virtualization system and services described herein,
Exemplary industrial automation systems can include one or more industrial controllers that can facilitate monitoring and controlling of their respective industrial processes. The industrial controllers can exchange data with the field devices using native hardwired input/output (I/O) or via a plant network, such as Ethernet/Internet Protocol (IP), Data Highway Plus, ControlNet, Devicenet, or the like. A given industrial controller typically can receive any combination of digital or analog signals from the field devices that can indicate a current state of the industrial devices and/or their associated industrial processes (e.g., temperature, position, part presence or absence, fluid level, etc.), and can execute a user-defined control program that can perform automated decision-making for the controlled industrial processes based on the received signals. The industrial controller can output appropriate digital and/or analog control signaling to the field devices in accordance with the decisions made by the control program. These outputs can include device actuation signals, temperature or position control signals, operational commands to a machining or material handling robot, mixer control signals, motion control signals, and the like. The control program can comprise any suitable type of code that can be used to process input signals read into the controller and to control output signals generated by the industrial controller, including, but not limited to, ladder logic, sequential function charts, function block diagrams, structured text, or other such platforms.
Although the exemplary overview illustrated in
According to one or more embodiments of the disclosed subject matter, industrial devices (e.g., 9081, 908N, 9101, 910N, etc.) can be coupled to a cloud platform 902 to facilitate leveraging cloud-based applications and services (e.g., data collection services, data storage services, virtualization services, etc.) associated with the cloud platform 902. That is, the industrial devices (e.g., 9081, 908N, 9101, 910N, etc.) can be configured to discover and interact with cloud-based computing services 912 that can be hosted by the cloud platform 902. The cloud platform 902 can be any infrastructure that can allow cloud services 912 (e.g., cloud-based computing services, shared computing services) to be accessed and utilized by cloud-capable devices. The cloud platform 902 can be a public cloud that can be accessible via a public network, such as the Internet, by devices having public network connectivity (e.g., Internet connectivity) and appropriate authorizations to utilize the cloud services 912. In some scenarios, the cloud platform 902 can be provided by a cloud provider as a platform-as-a-service (PaaS), and the cloud services 912 can reside and execute on the cloud platform 902 as a cloud-based service. In some such configurations, access to the cloud platform 902 and associated cloud services 912 can be provided to customers as a subscription service by an owner of the cloud services 912. Additionally and/or alternatively, the cloud platform 902 can be a private cloud that can be operated internally by the industrial enterprise 900 or an associated enterprise associated with a third-party entity. An exemplary private cloud platform can comprise a set of servers that can host the cloud services 912 and can reside on a private network (e.g., an intranet, a corporate network, etc.) that can be protected by a firewall.
The cloud services 912 can include, but are not limited to, data collection, data storage, data analysis, control applications (e.g., applications that can generate and deliver control instructions to industrial devices (e.g., 9081, 908N, 9101, 910N, etc.) based at least in part on analysis of real-time or near real-time system data or other factors), remote monitoring and support, generation and management of a virtualized industrial automation system(s) that can correspond to an industrial automation system(s), remote control of an industrial automation system(s) via a virtualized industrial automation system(s), customization of a virtualized industrial automation system and/or a data overlay on the virtualized industrial automation system, generation of virtual notes, view sharing (e.g., sharing of customized view of, customized data overlay associated with, and/or a virtual note associated with, a virtualized industrial automation system), provision of security in connection with a virtualized industrial automation system and an associated industrial automation system, or provision of other applications or services relating to industrial automation. If the cloud platform 902 is a web-based cloud, industrial devices (e.g., 9081, 908N, 9101, 910N, etc.) at the respective industrial facilities 904 can interact with cloud services 912 via the public network (e.g., the Internet). In an exemplary configuration, the industrial devices (e.g., 9081, 908N, 9101, 910N, etc.) can access the cloud services 912 through separate cloud gateways (e.g., cloud gateway 9061 up through cloud gateway 906N) at the respective industrial facilities (e.g., industrial facility1 9041 up through industrial facilityN 904N, respectively), wherein the industrial devices (e.g., 9081, 908N, 9101, 910N, etc.) can connect to the respective cloud gateways (e.g., cloud gateway 9061 up through cloud gateway 906N) through a physical (e.g., wireline) or wireless local area network or radio link. In another exemplary configuration, the industrial devices (e.g., 9081, 908N, 9101, 910N, etc.) can access the cloud platform 902 directly using an integrated cloud gateway service. Cloud gateways (e.g., cloud gateway 9061 up through cloud gateway 906N) also can comprise an integrated component of a network infrastructure device, such as a firewall box, router, or switch.
Providing industrial devices with cloud capability via the cloud gateways (e.g., cloud gateway 9061 up through cloud gateway 906N) can offer a number of advantages particular to industrial automation. For instance, cloud-based storage (e.g., cloud-based data store) offered by the cloud platform 902 can be easily scaled to accommodate the large quantities of data that can be generated daily by an industrial enterprise. Further, multiple industrial facilities (e.g., industrial facility1 9041 up through industrial facilityN 904N) at different geographical locations can migrate (e.g., communicate) their respective industrial automation data to the cloud platform 902 (e.g., via the collection component) for aggregation, collation, collective big data analysis, and enterprise-level reporting without the need to establish a private network between the respective industrial facilities. Industrial devices (e.g., 9081, 908N, 9101, 910N, etc.) and/or cloud gateways (e.g., cloud gateway 9061 up through cloud gateway 906N) having smart configuration capability can be configured to automatically detect and communicate with the cloud platform 902 upon installation at any facility, which can thereby simplify integration with existing cloud-based data storage, analysis, or reporting applications used by the industrial enterprise 900. In another exemplary application, cloud-based virtualization applications (e.g., utilized by the virtualization system comprising the virtualization component) can access the data relating to an industrial automation system(s) stored in the cloud-based data store, can generate and/or update a virtualized industrial automation system that can present a virtualized view of an industrial automation system and its operation, remotely control the industrial automation system in response to interaction with (e.g., user interaction to virtually control) a corresponding virtualized industrial automation system, customize a virtualized view of the industrial automation system(s) for a user (e.g., based at least in part on one or more customization factors associated with the user), provide security comprising controlling access to the virtualized industrial automation system and corresponding industrial automation system (e.g., based at least in part on authentication credentials of users and access rights of users), as more fully disclosed herein. These industrial cloud-computing applications are only intended to be exemplary, and the systems and methods described herein are not limited to these particular applications. As these examples demonstrate, the cloud platform 902, working with cloud gateways (e.g., cloud gateway 9061 up through cloud gateway 906N), can allow builders of industrial applications to provide scalable solutions as a service, removing the burden of maintenance, upgrading, and backup of the underlying infrastructure and framework.
The virtualization component 1000 can comprise a communication component 1002 that can be used to communicate (e.g., transmit, receive) information between the virtualization component 1000 and other components (e.g., communication devices, network-related devices, industrial devices, other types of industrial assets that have communication functionality, other devices with communication functionality that are associated with industrial enterprises, cloud gateways, etc.). The information can include, for example, data relating to industrial automation systems, data relating to specifications, properties, or characteristics of industrial devices or other industrial assets, customer-related data, work-order-related data relating to work orders that will or may be handled by an industrial automation system, etc.
The virtualization component 1000 can comprise an aggregator component 1004 that can aggregate data received (e.g., obtained, collected, detected, etc.) from various entities (e.g., communication devices, industrial devices, industrial assets, network-related devices, cloud gateways, other devices with communication functionality that are associated with industrial enterprises, processor component(s), user interface(s), data store(s), etc.). The aggregator component 1004 can correlate respective items of data based at least in part on type of data, source of the data, time or date the data was generated or received, type of device or asset associated with the data, identifier associated with a device or asset, customer associated with the data, user (e.g., operator, supervisor or manager, engineer, technician, etc.) associated with the data, industrial automation system associated with the data, industrial enterprise associated with the system, etc., to facilitate processing of the data (e.g., analyzing of the data, generating simulation models, etc.).
The virtualization component 1000 also can include a monitor component 1006 that can monitor device data, process data, asset data, system data, customer data, and/or other data in connection with the industrial automation systems. For instance, the monitor component 1006 can monitor information (e.g., signals, device or process statuses, network communication of information, process flows, updates, modifications, etc.) associated with industrial automation systems, virtualized industrial automation systems, industrial enterprises, and/or systems or devices of customers associated with the industrial enterprises to facilitate detecting information associated with industrial automation systems that can facilitate generating and updating virtualized industrial automation systems, remotely tracking operation of or controlling operation of an industrial automation system via an associated virtualized industrial automation system, customizing a view of and/or a data overlay associated with a virtualized automation system for a user, sharing a view (e.g., a customized view) of and/or a data overlay (e.g., a customized data overlay) associated with a virtualized automation system with a communication device of another user, generating virtual notes in connection with a virtual automation system, controlling and/or enforcing the viewability scope associated with a virtual note, and/or performing other virtualization-related services. The monitor component 1006 can be associated with sensors, meters, HMIs, communication monitoring components, or other components associated with industrial automation systems, industrial enterprises, and/or systems or devices of the customers to facilitate the monitoring of the industrial automation systems, industrial enterprises, and/or systems or devices of the customers.
The virtualization component 1000 can comprise a detector component 1008 that can detect desired information associated with industrial automation systems that can facilitate performing virtualization-related services in connection with an industrial automation system (e.g., generating or updating a virtualized industrial automation system, remotely interacting with (e.g., monitoring, tracking, and/or controlling, etc., operation of) an industrial automation system via interacting with a virtualized industrial automation system, etc.), in accordance with the defined virtualization management criteria. For instance, the detector component 1008 can detect desired device data, process data, asset data, system data, and/or customer data in connection with the industrial automation systems that can facilitate generating a virtualized industrial automation system that can accurately represent and interface with an industrial automation system, remotely interacting with and/or controlling an industrial automation system via an associated virtualized industrial automation system, and/or performing other virtualization-related services or functions.
The virtualization component 1000 also can include a collection component 1010 that can receive, collect, or obtain data (e.g., desired device data, process data, asset data, system data, and/or customer data) from industrial automation systems, communication devices, virtualized industrial automation systems, extrinsic sources, etc., to facilitate performing virtualization-related services, as more fully disclosed herein. The data collected by the collection component 1010 can be stored in the data store 1040, and/or can be made available to other components (e.g., analyzer component 1016, virtualization management component 1018, etc.) to facilitate generating and updating virtualized industrial automation systems, remotely interacting with (e.g., monitoring, tracking, and/or controlling, etc.) an industrial automation system via an associated virtualized industrial automation system, and/or performing other virtualization-related services or functions.
The virtualization component 1000 can comprise an interface component 1012 that can be employed to facilitate interfacing the virtualization component 1000, including a virtualized industrial automation system generated by the virtualization component 1000, with industrial automation systems and their constituent components (e.g., industrial devices or assets, network-related devices or assets, etc.) or processes, systems or devices associated with customers, systems or devices associated with device manufacturers, etc. For instance, the interface component 1012 can be configured to receive industrial data (e.g., device data, process data, asset data, system data, configuration data, status data, process variable data, etc.) sent by one or more cloud-capable industrial devices, cloud gateways, or other sources of industrial data. The interface component 1012 also can be configured to receive network-related data (e.g., data relating to communication conditions, network-status data, data identifying network-related devices, etc.) communicated by one or more network-related devices of the network component of an industrial automation system. The interface component 1012 also can be configured to interface a virtualized industrial automation system with a corresponding industrial automation system to facilitate remotely interacting with (e.g., monitoring, tracking, and/or controlling, etc., operation of) the industrial automation system via interactions (e.g., user interactions) with the virtualized industrial automation system (e.g., via virtualized control of the virtualized operation of the virtualized industrial automation system). The interface component 1012 further can be configured to exchange data with one or more client or customer devices via an Internet connection. For example, the interface component 1012 can receive customer profile data, requests for firmware upgrades, customer service selections, information relating to work orders for products, customer preferences or requirements with regard to a work order, or other such information from a client device (e.g., an Internet-capable client device, such as a phone, a computer, an electronic tablet or pad, or other suitable Internet-capable device). The interface component 1012 also can deliver upgrade notifications, firmware upgrades, reports or notifications regarding the evaluation of and determinations regarding proposed modifications to an industrial automation system, notifications of impending device failures, identification of asset or system inefficiencies, configuration recommendations, or other such data to the client device.
The system also can contain a controller component 1014 that can control operations relating to processing data, generate or update a virtualized industrial automation system that can represent an industrial automation system, remotely control an industrial automation system using an associated virtualized industrial automation system, customize a view of a virtualized industrial automation system for a user, generate a simulation model of an industrial automation system, perform simulation operations using simulation models, and/or perform other operations in connection with the industrial automation system. The controller component 1014 can facilitate controlling operations being performed by various components of the virtualization component 1000, controlling data flow between various components of the virtualization component 1000, controlling data flow between the virtualization component 1000 and other components or systems associated with the virtualization component 1000, etc.
The analyzer component 1016 can analyze data (e.g., device data, process data, asset data, system data, customer data, user-generated or user-provided data, and/or other data) to facilitate generating a virtualized industrial automation system of an industrial automation system, customizing a view of and/or a data overlay associated with a virtualized industrial automation system, sharing a customized view of and/or a customized data overlay associated with a virtualized industrial automation system, processing virtual notes, etc. The analyzer component 1016 can parse data to facilitate identifying data that is relevant to performing an operation (e.g., generating a virtualized industrial automation system, customizing a view of and/or a data overlay associated with a virtualized industrial automation system, etc.) by the virtualization component 1000. Based at least in part on the analysis of the data, the analyzer component 1016 can generate analysis results that can be provided to another component (e.g., virtualization management component 1018, processor component 1038, etc.) to facilitate the performance of various operations by the virtualization component 1000.
The virtualization component 1000 also can comprise a virtualization management component 1018 that can generate and/or update a virtualized industrial automation system that can represent an industrial automation system, remotely interact with and/or control an industrial automation system using an associated virtualized industrial automation system, customize a view of and/or a data overlay associated with a virtualized industrial automation system for a user, share a customized view of and/or a customized data overlay associated with a virtualized industrial automation system, process virtual notes, generate a simulation model of an industrial automation system, perform simulation operations using simulation models, and/or performing other operations. For instance, the virtualization management component 1018 can include a virtualization generator component 1020 that can generate and/or update a virtualized industrial automation system that can represent an industrial automation system, including generating and/or updating virtualized versions or instances of the constituent components (e.g., industrial devices, industrial processes, industrial assets, network-related devices or assets, etc.) of the industrial control system, the interrelationships between respective constituent components, configurations of respective constituent components, etc., in accordance with the set of defined virtualization management criteria, as more fully disclosed herein.
The virtualization management component 1018 can comprise a virtualized controller component 1022 that can facilitate remotely interacting and/or controlling an industrial automation system using an associated virtualized industrial automation system. For instance, the virtualized controller component 1022 can receive information relating to user interactions with the virtualized industrial automation system from a communication device of the user, and can facilitate remotely interacting with and/or controlling the industrial automation system in response to the information relating to the user interactions with the virtualized industrial automation system, as more fully disclosed herein.
The virtualization management component 1018 can include a customizer component 1024 that can customize a view of, and/or a data overlay associated with, a virtualized industrial automation system that can correspond to and be interfaced with an industrial automation system, for example, based at least in part on one or more customization factors (e.g., associated with a user). The virtualization management component 1018 can facilitate providing (e.g., communicating, presenting, etc.) data relating to the customized view of, and/or a customized data overlay associated with, the virtualized industrial automation system to a communication device of a user to facilitate displaying the customized view of and/or a customized data overlay associated with, the virtualized industrial automation system to the user via the communication device.
The virtualization management component 1018 also can comprise a data overlay component 1026 that can facilitate overlaying a set of data on a virtualized industrial automation system, wherein the set of data can relate to operation of the industrial automation system associated with the virtualized industrial automation system. The data overlay component 1026 can facilitate overlaying a summary or synthesis of data associated with the industrial automation system, or a portion thereof, on the virtualized industrial automation system, or a portion thereof. The data overlay component 1026 can facilitate overlaying respective subsets of data on or in proximity to respective virtualized objects (e.g., virtualized industrial device(s), virtualized industrial process(es), virtualized industrial asset(s), virtualized network-related device(s), etc.) presented in the virtualized industrial automation system, wherein the respective virtualized objects (e.g., industrial device(s), industrial process(es), industrial asset(s), network-related device(s), etc.) can correspond to respective objects of the industrial automation system. In some implementations, the data overlay component 1026 can facilitate overlaying a customized set of data on a virtualized industrial automation system, or customized subsets of data on or in proximity to respective virtualized objects presented in the virtualized industrial automation system, based at least in part on the role of a user, location of the user in relation to the industrial automation system, preferences of the user, and/or other factors, in accordance with the virtualization management criteria.
The virtualization management component 1018 also can include a filter component 1028 that can facilitate filtering data overlaid on the virtualization industrial automation system, wherein the data can relate to the operation of the industrial automation system and/or a user associated therewith. The filter component 1028 can facilitate providing one or more filters to a communication device of a user to enable the user to filter the data, or the view of the data, overlaid on the virtualized industrial automation system (e.g., the user's customized view of the virtualized industrial automation system). The user, via the communication device, can manipulate or select a filter control and/or input filter-related information to facilitate setting or selecting a desired filter(s) that can be used to filter the data associated with the industrial automation system. The virtualization management component 1018 can receive the information relating to setting or selection of the filter(s) and/or other filter-related information from the communication device for processing. The filter component 1029 can facilitate setting or implementing the filter(s) based at least in part on the information relating to setting or selection of the filter(s) and/or other filter-related information. The filter component 1028 (and/or the analyzer component 1016) can analyze data relating to the industrial automation system, and can filter such data to generate a set of filtered data relating to the industrial automation system. The data overlay component 1026 can facilitate overlaying the set of filtered data on the virtualized industrial automation system, or a portion thereof (e.g., facilitate overlaying the set of filtered data on or in proximity to a virtualized object(s) of the virtualized industrial automation system).
For instance, the filter component 1028 can facilitate enabling a user, via the user's communication device, to select and apply a desired filter(s) to filter data associated with the user's view (e.g., customized view) of the virtualized industrial automation system, for example, to present (on the virtualized industrial automation system) a subset of the data that is relevant to a work task that the user is performing at the time, present (on the virtualized industrial automation system) more detailed data and/or a drilled-down view regarding a certain portion of the virtualized industrial automation system and associated industrial automation system 104, as desired by the user. The filter component 1028 can facilitate providing a number of different types of filters to the communication devices of users to enable the users to customize, augment, and/or filter data overlays for a user's personalized view of the virtualized industrial automation system, as more fully disclosed herein.
The virtualization management component 1018 also can include a share component 1030 that can facilitate sharing a customized view of, and/or a customized data overlay associated with, a virtualized industrial automation system with a communication device of another user. The share component 1030 can facilitate presenting a share control or another control(s) to a user via the user's communication device. If the user desires to share the user's customized view of, and/or customized data overlay associated with, the virtualized industrial automation system with a communication device of another user, the user can manipulate or select the share control and/or another control(s). In response, the share component 1030 can facilitate determining whether the other user is authorized to access and view the user's customized view of, and/or customized data overlay associated with, the virtualized industrial automation system, based at least in part on the role of the other user, location of the other user in relation to the industrial automation system, access rights of the other user to access information associated with the virtualized industrial automation system, and/or other factors, in accordance with the defined virtualization management criteria. If the share component 1030 determines that the other user is permitted to access and view the user's customized view of, and/or customized data overlay associated with, the virtualized industrial automation system, the share component 1030 can facilitate communicating the user's customized view of, and/or customized data overlay associated with, the virtualized industrial automation system to the communication device of the other user for presentation to the other user. If the share component 1030 determines that the other user is not permitted to access and view the user's customized view of, and/or customized data overlay associated with, the virtualized industrial automation system, the share component 1030 can deny the request to share and/or can communicate a denial message to the communication device of the user and/or to the communication device of the other user.
The virtualization management component 1018 further can comprise a note component 1032 that can facilitate generating and posting virtual notes to a virtual industrial automation system. A virtual note can be a graphical representation of a note and can comprise information (e.g., user-generated information) relating to the industrial automation system or other desired information presented by a user. In some implementations, the note component 1032 can present (e.g., communicate) a note generation control or another control, which can facilitate creating virtual notes, to a communication device of a user. If the user desires to create a virtual note, the user can manipulate or select the note generation control or other control presented on the communication device to facilitate generating and sending a request to create a virtual note to the virtualization management component 1018. The note component 1032 can receive the request to create the virtual note from the communication device of the user. In response, the note component 1032 can facilitate generating the virtual note. The user can enter desired information (e.g., user-generated information) for inclusion in the virtual note via the communication device, and the communication device can communicate the desired information to the virtualization management component 1018. The note component 1032 can insert the desired information in the virtual note. The user, via the communication device, also can manipulate or select a control (e.g., note placement control) to facilitate placing, applying, or inserting the virtual note in a desired location of the virtualized industrial automation system. The manipulation or selection of the control and/or other gestures or input information (e.g., touch screen gesture, mouse click, mouse movement, keystroke, etc.) of the user can facilitate generating note placement information, which can facilitate placing, applying, or inserting the virtual note in the desired location of the virtualized industrial automation system, and can be sent to the virtualization management component 1018 for processing. The note component 1032 can facilitate placing, applying, or inserting the virtual note, with the desired information, in the desired location of the virtualized industrial automation system, based at least in part on the note placement information.
In some implementations, the note component 1032 can facilitate setting and enforcing a viewability scope for a virtual note, and can control which entities (and associated communication devices) can view (or present) the virtual note posted (e.g., placed) on the virtualized industrial automation system. For instance, the user may desire that only a certain user(s) be able to view the virtual note based at least in part on the role of another user with respect to the industrial automation system, an identity of the other user, a location of the other user in relation to the industrial automation system, and/or another factor(s), in accordance with the defined virtualization management criteria. The user, using the user's communication device, can manipulate or select the scope control and/or can input scope-related information to the communication device to facilitate setting the viewability scope for the virtual note. The communication device can send the information relating to the scope control and/or the other scope-related information to the virtualization management component 1018 for processing. The note component 1032 can set and enforce the viewability scope for the virtual note based at least in part on the information relating to the scope control and/or the other scope-related information, as more fully disclosed herein. The note component 1032 can facilitate controlling which entities (e.g., users) can view the virtual note posted (e.g., placed) on the virtualized industrial automation system using their respective communication devices, based at least in part on the viewability scope associated with the virtual note, as more fully disclosed herein.
The virtualization management component 1018 also can contain a security component 1034 that can facilitate securing a virtualized industrial automation system and associated industrial automation system. The security component 1034 can facilitate controlling access to a virtualized industrial automation system (or a particular (e.g., customized) view of a virtualized industrial automation system) and/or an associated industrial automation system (e.g., via the virtualized industrial automation system), based at least in part on respective authentication credentials of user, respective access rights of users, respective locations of users, etc., as more fully disclosed herein.
The virtualization management component 1018 also can comprise a simulation component 1036 that can generate a simulation model of the industrial automation system based at least in part on the simulation or emulation of the industrial control system, in accordance with the set of defined virtualized management criteria. The simulation component 1036 can integrate the respective simulations or emulations of the constituent components of the industrial automation system, the interrelationships between respective constituent components, configurations of respective constituent components, etc., to facilitate generating the simulation model that can simulate or emulate the industrial automation system. The simulation component 1036 also can use the simulation model to facilitate simulating operation of the industrial automation system under (e.g., in response to) a given set of conditions (e.g., under a set of conditions associated with a modification (e.g., adjustment to a virtualized control, virtualized switch, etc.) to the virtualized industrial control system that is under consideration). The virtualization management component 1018 or a user can analyze the results of the simulated operation of the industrial automation system, and can determine whether the modification to the virtualized industrial control system that is under consideration is to be performed based at least in part on the analysis results.
The virtualization component 1000 also can comprise a processor component 1038 that can operate in conjunction with the other components (e.g., communication component 1002, aggregator component 1004, monitor component 1006, etc.) to facilitate performing the various functions and operations of the virtualization component 1000. The processor component 1038 can employ one or more processors (e.g., central processing units (CPUs), graphical processing units (GPUs), field-programmable gate arrays (FPGAs), etc.), microprocessors, or controllers that can process data, such as industrial data (e.g., device data, process data, asset data, system data, etc.) associated with industrial control systems, customer or client related data, data relating to parameters associated with the virtualization component 1000 and associated components, etc., to facilitate generating or updating a virtualized industrial automation system that can represent an industrial automation system, remotely interacting with and/or controlling an industrial automation system using an associated virtualized industrial automation system, customizing a view of and/or a data overly associated with a virtualized industrial automation system for a user, filter data relating to the industrial automation system in connection with a data overlay, share a customized view and/or a customized data overlay associated with a user with a communication device of another user, generate or post a virtual note, generating a simulation model of an industrial automation system, performing simulation operations using simulation models to facilitate determining whether to perform a particular action in connection with a virtualized industrial automation system or associated industrial automation system, performing other virtualization-related operations, etc.; and can control data flow between the virtualization component 1000 and other components associated with the virtualization component 1000.
In yet another aspect, the virtualization component 1000 can contain a data store 1040 that can store data structures (e.g., user data, metadata); code structure(s) (e.g., modules, objects, classes, procedures), commands, or instructions; industrial data or other data associated with industrial automation systems or industrial enterprises; customer or client related information; data relating to virtualization-related services in connection with industrial automation systems; parameter data; algorithms (e.g., algorithm(s) relating to generating or updating a virtualized industrial automation system that can represent an industrial automation system, including its industrial devices, industrial processes, industrial assets, network-related devices, interrelationships between such devices, processes, or assets, etc.); algorithm(s) relating to remotely interacting with (e.g., monitoring, tracking, controlling, etc.) an industrial automation system using an associated virtualized industrial automation system, algorithm(s) relating to customizing a view of and/or a data overlay associated with a virtualized industrial automation system, filtering data, sharing a customized view of and/or a customized data overlay associated with a virtualized industrial automation system, generating or posting a virtual note, etc.); a set of defined virtualization management criteria; and so on. In an aspect, the processor component 1038 can be functionally coupled (e.g., through a memory bus) to the data store 1040 in order to store and retrieve data desired to operate and/or confer functionality, at least in part, to the communication component 1002, aggregator component 1004, monitor component 1006, etc., of the virtualization component 1000 and/or substantially any other operational aspects of the virtualization component 1000. It is to be appreciated and understood that the various components of the virtualization component 1000 can communicate data, instructions, or signals between each other and/or between other components associated with the virtualization component 1000 as desired to carry out operations of the virtualization component 700. It is to be further appreciated and understood that respective components (e.g., communication component 1002, aggregator component 1004, monitor component 1006, etc.) of the virtualization component 1000 each can be a stand-alone unit, can be included within the virtualization component 1000 (as depicted), can be incorporated within another component of the virtualization component 1000 (e.g., within the virtualization management component 1018) or a component separate from the virtualization component 1000, and/or virtually any suitable combination thereof, as desired.
In accordance with various embodiments, one or more of the various components of the virtualization component 1000 (e.g., communication component 1002, aggregator component 1004, monitor component 1006, etc.) can be electrically and/or communicatively coupled to one another to perform one or more of the functions of the virtualization component 1000. In some implementations, one or more components of the virtualization component 1000 (e.g., communication component 1002, aggregator component 1004, monitor component 1006, . . . , virtualization management component 1018) can comprise software instructions that can be stored in the data store 1040 and executed by the processor component 1038. The virtualization component 1000 also can interact with other hardware and/or software components not depicted in
The virtualization system 1102 can organize manufacturing data collected from the industrial automation systems (e.g., 11041, 11042, 1104N) according to various classes. In the illustrated example, manufacturing data can be classified according to device data 1108, process data 1110, asset data 1112, and system data 1114.
Referring briefly to
Returning again to
The process data 1110 can comprise information relating to one or more processes or other automation operations carried out by the devices; e.g., device-level and process-level faults and alarms, process variable values (speeds, temperatures, pressures, etc.), and the like.
The asset data 1112 can comprise information generated, collected, determined, or inferred based on data that can be aggregated from various (e.g., multiple) industrial devices over time, which can yield higher asset-level views of the industrial automation systems (e.g., 11041, 11042, 1104N). Example asset data 1112 can include performance indicators (KPIs) for the respective assets, asset-level process variables, faults, alarms, etc. Since the asset data 1112 can yield a relatively longer term view of asset characteristics relative to the device and process data, the virtualization system 1102 can leverage the asset data 1112 to facilitate identifying operational patterns and correlations unique to each asset, among other types of analysis, and this can facilitate generating respective virtualization assets that can correspond to the respective assets, and generating, updating, using, customizing, etc., of a virtualized industrial automation system of an industrial control system based at least in part on the respective virtualizations of the respective assets associated with the industrial control system.
The system data 1114 can comprise collected, determined, or inferred information that can be generated based on data that can be aggregated from various (e.g., multiple) assets over time. The system data 1114 can characterize system behavior within a large system of assets, yielding a system-level view of each of the industrial automation systems (e.g., 11041, 11042, 1104N). The system data 1114 also can document the particular system configurations in use and industrial operations performed at each of the industrial automation systems (e.g., 11041, 11042, 1104N). For example, the system data 1114 can document the arrangement of assets, interconnections between devices, the product being manufactured at a given facility, an industrial process performed by the assets, a category of industry of each industrial system (e.g., automotive, oil and gas, food and drug, marine, textiles, etc.), or other relevant information. Among other functions, this data can be accessed by technical support personnel during a support session so that particulars of the customer's unique system and device configurations can be obtained without reliance on the customer to possess complete knowledge of their assets.
As an example, a given industrial facility can include a packaging line (e.g., the system), which in turn can comprise a number of individual assets (e.g., a filler, a labeler, a capper, a palletizer, etc.). Each asset can comprise a number of devices (e.g., controllers, variable frequency drives, HMIs, etc.). Using an architecture similar to that depicted in
In addition to maintaining the data classes (e.g., 1108, 1110, 1112, 1114), each customer data store also can maintain a customer model 1116 that can contain data specific to a given industrial entity or customer. The customer model 1116 can contain customer-specific information and preferences, which can be leveraged by (e.g., used by) the virtualization system 1102 to facilitate generating or updating a virtualized industrial automation system that can represent an industrial automation system, remotely interacting with (e.g., monitoring, tracking, controlling, etc.) an industrial automation system using an associated virtualized industrial automation system, customizing a view of and/or a data overlay associated with a virtualized industrial automation system for a user, sharing a customized view of and/or a customized data overlay associated with a virtualized industrial automation system for a user, processing virtual notes, generating a simulation model of an industrial automation system, performing simulation operations using simulation models, and/or performing other operations in connection with the industrial automation system, etc. Example information that can be maintained in the customer model 1116 can include a client identifier, client preferences or requirements with regard to production or work orders associated with an industrial automation system, client contact information specifying which plant personnel are to be notified in response to results of a response of the industrial automation system to a user interaction with an associated virtualized industrial automation system, notification preferences that can specify how plant personnel are to be notified (e.g., email, mobile phone, text message, etc.), service contracts that are active between the customer and the technical support entity, and other such information. The virtualization system 1102 can marry (e.g., associate, link, unite, map, etc.) data collected for each customer with the corresponding customer model 1116 for identification and event handling purposes.
As noted above, industrial data can be migrated (e.g., communicated) from industrial devices to the cloud platform (e.g., comprising the virtualization system 1102) using cloud gateways. To this end, some devices can include integrated cloud gateways that can directly interface each device to the cloud platform. Additionally or alternatively, some configurations can utilize a cloud proxy device that can collect industrial data from multiple devices associated with the industrial automation systems (e.g., 11041, 11042, 1104N) and can send (e.g., transmit) the data to the cloud platform. Such a cloud proxy can comprise a dedicated data collection device, such as a proxy server that can share a network (e.g., communication network) with the industrial devices. Additionally or alternatively, the cloud proxy can be a peer industrial device that can collect data from other industrial devices.
In the configuration depicted in
While the proxy device illustrated in
In some embodiments, the cloud gateway 1308 of
In some embodiments, the cloud gateway 1308 of
To ensure a rich and descriptive set of data for analysis purposes, the cloud-based virtualization system can collect device data in accordance with one or more standardized device models. To this end, a standardized device model can be developed for each industrial device. Device models can profile the device data that is available to be collected and maintained by the virtualization system.
The device model 1506 can comprise such information as a device identifier (e.g., model and serial number) associated with the industrial device 1502, status information for the industrial device 1502, a currently installed firmware version associated with the industrial device 1502, device setup data associated with the industrial device 1502, warranty specifications associated with the industrial device 1502, calculated and/or anticipated KPIs associated with the industrial device 1502 (e.g., mean time between failures), health and diagnostic information associated with the industrial device 1502, device documentation, or other such parameters.
In addition to maintaining individual customer-specific data stores for each industrial enterprise, the virtualization system (e.g., cloud-based virtualization system) also can feed (e.g., transmit) sets of customer data to a global data storage (referred to herein as cloud-based data store or Big Data for Manufacturing (BDFM) data store) for collective big data analysis in the cloud platform (e.g., by the virtualization system).
For example, it can be known that a given industrial asset (e.g., a device, a configuration of device, a machine, etc.) can be used across different industries for different types of industrial applications. Accordingly, the virtualization management component 1018 can identify a subset of the global data stored in BDFM data store 1602 relating to the asset or asset type, and perform analysis on this subset of data to determine how the asset or asset type performs over time and under various types of operating conditions for each of multiple different industries or types of industrial applications. The virtualization management component 1018 also can determine the operational behavior of the asset or asset type over time and under various types of operating conditions for each of different sets of operating constraints or parameters (e.g. different ranges of operating temperatures or pressures, different recipe ingredients or ingredient types, etc.). The virtualization management component 1018 can leverage (e.g., use) a large amount of historical data relating to the asset or asset type that has been gathered (e.g., collected and/or aggregated) from many different industrial automation systems to facilitate learning or determining common operating characteristics of many diverse configurations of industrial assets or asset types at a relatively high degree of granularity and under many different operating contexts. The virtualization management component 1018 can use the learned or determined operating characteristics relating to the industrial assets or asset types to facilitate generating, updating, and/or using virtualized versions of the industrial assets or asset types when employed in an industrial automation system to facilitate generating, updating, and/or using a virtualized industrial automation system that can be based at least in part on the virtualized versions of the industrial assets or asset types.
The virtualization system 1702 also can collect product resource information and maintain (e.g., store) the product resource information in the cloud-based product resource data store 1708. In general, the product resource data store 1708 can maintain up-to-date information relating to specific industrial devices or other vendor products in connection with industrial automation systems. Product data stored in the product resource data store 1708 can be administered by the virtualization system 1702 and/or one or more product vendors or OEMs. Exemplary device-specific data maintained by the product resource data store 1708 can include product serial numbers, most recent firmware revisions, preferred device configuration settings and/or software for a given type of industrial application, or other such vendor-provided information.
The system depicted in
In accordance with various aspects, the customer-specific data can include device and/or asset level faults and alarms, process variable values (e.g., temperatures, pressures, product counts, cycle times, etc.), calculated or anticipated key performance indicators for the customer's various assets, indicators of system behavior over time, and other such information. The customer-specific data also can include documentation of firmware versions, configuration settings, and software in use on respective devices of the customer's industrial assets. Moreover, the virtualization system 1702 can take into consideration customer information encoded in customer model 1116, which can have a bearing on inferences made by the virtualization system 1702 based at least in part on the analysis (e.g., big data analysis) stored in the BDFM data store 1706. For example, customer model 1116 may indicate a type of industry that is the focus of the customer's business (e.g., automotive, food and drug, oil and gas, fibers and textiles, power generation, marine, etc.). Knowledge of the customer's industry can facilitate enabling the virtualization system 1702 to correlate the customer-specific data with data relating to similar systems and applications in the same industry, as documented by the data stored in the BDFM data store 1706.
Taken together, customer-specific data and a customer model (e.g., 1116) can facilitate accurately modeling the customer's industrial enterprise at a highly granular level, from high-level system behavior over time down to the device and software level. The analyzing (e.g., by the virtualization system 1702) of this customer-specific data in view of global industry-specific and application-specific trends learned via analysis of data stored in the BDFM data store 1706, as well as vendor-provided device information maintained in the product resource data store 1708, can facilitate real-time or near real-time generation, updating, and/or use of a virtualized industrial automation system associated with an industrial automation system to facilitate real-time or near real-time remote interaction with (e.g., monitoring, tracking, controlling, etc., of) the industrial automation system using the virtualized industrial automation system (e.g., based at least in part on user interactions of the virtualized industrial automation system by a user via a communication device).
In some implementations, the system 1700 (e.g., via the collection component or virtualization system 1702) also can receive, collect, or capture extrinsic data 1710 from one or more sources (e.g., external data sources). The virtualization system 1702 can use or leverage the extrinsic data 1710 received, collected, or captured from sources external to a customer's industrial enterprise, wherein the extrinsic data 1710 can have relevance to operation of the customer's industrial automation system(s). Example extrinsic data 1710 can include, for example, energy cost data, material cost and availability data, transportation schedule information from companies that provide product transportation services for the customer, market indicator data, web site traffic statistics, information relating to known information security breaches or threats, or other information relevant to the operation of the customer's industrial automation system(s). The virtualization system 1702 can retrieve extrinsic data 1710 from substantially any data source, such as, e.g., servers or other data storage devices linked to the Internet, cloud-based storage that maintains extrinsic data of interest, or other sources. The virtualization system 1702 can analyze the extrinsic data 1710 and/or other data (e.g., user-related data associated with users (e.g., operators, managers, technicians, other workers) associated with the industrial automation system(s), device data 1108, process data 1110, asset data 1112, system data 1114, etc.) to facilitate performing virtualization-related or other services in connection with the industrial automation system(s).
The aforementioned systems and/or devices have been described with respect to interaction between several components. It should be appreciated that such systems and components can include those components or sub-components specified therein, some of the specified components or sub-components, and/or additional components. Sub-components could also be implemented as components communicatively coupled to other components rather than included within parent components. Further yet, one or more components and/or sub-components may be combined into a single component providing aggregate functionality. The components may also interact with one or more other components not specifically described herein for the sake of brevity, but known by those of skill in the art.
At 1802, a customized view of a virtualized industrial automation system, which can correspond to an industrial automation system, can be generated based at least in part on a set of industrial-automation-system-related data and/or other data stored in a cloud-based data store and information associated with a user in connection with the industrial automation system, wherein a first subset of the set of industrial-automation-system-related data can be received (e.g., collected, obtained, detected, etc.) from the industrial automation system and stored in the cloud-based data store. The set of industrial-automation-system-related data can comprise, for example, device-related data (e.g., industrial device-related data, network device-related data), asset-related data, process-related data (e.g., industrial-automation-process-related data), data relating to users associated with the industrial automation system (e.g., role information, user preferences, etc.), and/or other industrial-automation-system-related data associated with an industrial enterprise. The industrial-automation-system-related data can be migrated (e.g., communicated) to the cloud platform using one or more cloud gateways (e.g., communication gateway components) that can serve as uni-directional or bi-directional communication interfaces between industrial devices of the industrial automation system and the cloud platform. The device-related data, asset-related data, process-related data, and/or other industrial-automation-system-related data can be stored in the cloud-based data store in association with identification information, such as, for example, a customer identifier and other customer-specific information.
The collection component can facilitate collecting or obtaining the industrial-automation-system-related data, and can store the industrial-automation-system-related data in the cloud-based data store. The virtualization management component can access the cloud-based data store and can receive (e.g., collect, obtain, etc.) the set of industrial-automation-system-related data from the cloud-based data store. The virtualization management component can analyze the set of industrial-automation-system-related data to generate analysis results. The virtualization management component can generate, manage, modify, and/or update the customized view of the virtualized industrial automation system associated with the industrial automation system based at least in part on the results of the analysis of the set of industrial-automation-system-related data. For example, using the analysis results, the virtualization management component can facilitate generating, managing, modifying, and/or updating the customized view of the virtualized industrial automation system, based at least in part on virtualization of industrial devices, software and/or firmware configurations (including software or firmware revisions or updates) associated with industrial devices and/or other components of the industrial automation system, network-related devices (e.g., communication devices, computers, routers, etc.) associated with the industrial automation system, functional and communicative relationships between industrial devices, industrial processes, network-related devices, etc. (e.g., communication connections or conditions between industrial devices, types of connections between industrial devices, communication connections between industrial devices and network-related devices, etc.), mechanical or process properties or characteristics associated with industrial devices (e.g., mechanical latency, process cycle times, operating schedules, etc., associated with industrial devices), user behavior or interaction in connection with the industrial automation system (e.g., maintenance schedules, shift-specific or operator-specific behavior or interaction of operators with the industrial automation system), user behavior or interaction in connection with the virtualized industrial automation system (e.g., via a communication device of a user), production or process flows of the industrial automation system at particular times or in connection with particular projects, and/or other aspects or features of the industrial automation system.
To facilitate customizing the view of the virtualized industrial automation system for a user, the virtualization management component can analyze the information associated with the user, and can determine the role of the user with respect to the industrial automation system, preferences of the user with regard to customization of the user's view of the virtualized industrial automation system, and/or other customization factors (e.g., whether or what type of a data filter was selected, the viewability scope associated with data, etc.) associated with the user, based at least in part on the results of the data analysis. The virtualization management component can generate, manage, modify, and/or update the customized view of the virtualized industrial automation system associated with the industrial automation system based at least in part on the role of the user in connection with the industrial automation system.
At 1804, the industrial automation system can be interacted with and/or controlled in response to received information relating to user interaction with the customized view of the virtualized industrial automation system. Using a communication device (e.g., computer, smart phone, electronic pad or tablet, electronic glasses, etc.), a user can perceive (e.g., look at) the customized view of the virtualized industrial automation system. The user, using the communication device, can interact (e.g., monitor or track operation of, adjust a control, modify a parameter, perform another type of work task, etc.) with the virtualized industrial automation system, or portion thereof (e.g., customized portion), displayed on the display screen of the communication device. The virtualization management component can receive information relating to the interaction of the user with the customized view of the virtualized industrial automation system from the communication device in connection with the user desiring to facilitate interacting with or controlling the operation of the industrial automation system associated with the customized view of the virtualized industrial automation system. In some implementations, in response to the interaction-related information received from the communication device in connection with controlling the industrial automation system, the virtualization management component can generate one or more control signals that can correspond to the controlling of the industrial automation system that the user desired based at least in part on the information relating to the interaction of the user with the customized view of the virtualized industrial automation system.
The industrial automation system can receive the one or more control signals from the virtualization management component. In response to the one or more control signals, operation of the industrial automation system can be controlled in accordance with the information relating to the interaction of the user with the customized view of the virtualized industrial automation system, and in accordance with the defined virtualization management criteria. The virtualization component can monitor the operational response of the industrial automation system to the one or more control signals. The collection component can receive or collect data relating to the operational response of the industrial automation system to the one or more control signals. The virtualization management component also can facilitate updating the virtualized industrial automation system, or portion (e.g., customized portion) thereof, to control the virtual operation of the virtualized industrial automation system, in response to the interaction of the user with the customized view of the virtualized industrial automation system and in response to the operational response of the industrial automation system to the one or more control signals.
At 1902, a set of data relating to a set of industrial automation systems comprising one or more industrial automation systems can be collected. The virtualization system can comprise a collection component that can collect the set of data relating to the set of industrial automation systems. The set of data can comprise data relating to industrial devices, industrial processes, other industrial assets, and/or network-related devices, etc., associated with the one or more industrial automation systems of the set of industrial automation systems. The set of industrial automation systems can be associated with one or more industrial enterprises.
In some implementations, all or part of the virtualization system can be located in a cloud platform. For example, virtualization component, the collection component, the data store (e.g., cloud-based data store), the virtualization management component, and/or another component(s) of the virtualization system can be located in the cloud platform. In other implementations, certain components (e.g., virtualization management component or collection component) can be located outside of the cloud platform and can access the cloud platform (e.g., the data store in the cloud platform) to facilitate analyzing the data in the data store to facilitate generating, managing, and/or updating a virtualized industrial automation system that can correspond to, and interface or interact with, an industrial automation system of the set of industrial automation systems.
At 1904, the set of data can be stored in a data store. The collection component can facilitate storing the set of data in the data store, wherein the data store can be a cloud-based data store located in the cloud platform.
At 1906, the set of data can be analyzed. The virtualization management component can access the cloud-based data store and can retrieve, obtain, read the set of data from the cloud-based data store. The virtualization management component can analyze the set of data (e.g., perform big data analysis on the set of data) to facilitate generating, managing, and/or updating a virtualized industrial automation system that can correspond to, and interface or interact with, an industrial automation system. The virtualization management component can analyze the set of data to facilitate identifying or determining industrial devices, industrial processes, operating systems, software (e.g., software type, software version, software functions, software manufacturer, etc.), firmware (e.g., firmware type, firmware version, firmware functions, firmware manufacturer, etc.), network-related devices, etc., associated with the industrial automation system; identifying or determining configuration of the industrial devices, industrial processes, operating systems, software, firmware, and network-related devices, including the functional relationships or connections between respective industrial devices, industrial processes, operating systems, software, firmware, and network-related devices; respective properties or characteristics associated with the respective industrial devices, industrial processes, operating systems, software, firmware, and network-related devices; etc.
At 1908, a virtualized industrial automation system that can correspond to (e.g., be a virtual replication of) the industrial automation system, comprising the industrial devices, industrial processes, operating systems, software, firmware, network-related devices, etc., can be generated based at least in part on the results of the analysis of the set of data. The virtualization management component can generate the virtualized industrial automation system associated with the industrial automation system, including generating virtualized industrial devices, virtualized software and/or firmware configurations (including virtualized software or firmware revisions or updates) associated with the industrial devices and/or other components of the industrial automation system, virtualized network-related devices (e.g., virtualized communication devices, computers, routers, etc.) associated with the industrial automation system, virtualized functional and communicative relationships between industrial devices, industrial processes, network-related devices, etc. (e.g., virtualized communication connections or conditions between industrial devices, types of connections between industrial devices, virtualized communication connections between industrial devices and network-related devices, etc.), virtualized mechanical or process properties or characteristics associated with industrial devices (e.g., virtualized mechanical latency, process cycle times, operating schedules, etc., associated with industrial devices), virtualized properties or characteristics associated with the network-related devices (e.g., virtualized communication conditions, virtualized total bandwidth, virtualized available bandwidth, virtualized wireless communications, virtualized wireline communications, etc., associated with the network-related devices), and/or other aspects or features of the industrial automation system.
At 1910, the virtualized industrial automation system can be provided (e.g., communicated, presented), for example, to a communication device of a user. The virtualization management component can provide the virtualized industrial automation system to the communication device of the user via a communication network (e.g., a communication network comprising an IP-based network (e.g., Internet, intranet), a mobile core network, and/or a local area network (LAN)). The user can use the communication device to access the virtualized industrial automation system to facilitate remotely controlling the associated industrial automation system, as more fully disclosed herein.
At this point, the method 1900 can proceed to reference point A, wherein, for example, from reference point A, as disclosed with regard to method 2000, the generated virtualized industrial automation system can be used to facilitate controlling operation of the industrial automation system, and/or as disclosed with regard to method 2100, the generated virtualized industrial automation system can be customized to provide a user a customized view of, and/or customized overlay of data associated with, the virtualized industrial automation system via the user's communication device.
Information relating to the virtualized industrial automation system can be stored in the cloud-based data store or another desired data store, wherein the virtualization management component can access data relating to the virtualized industrial automation system from the cloud-based data store or other data store, and can use the data relating to the virtualized industrial automation system to facilitate updating the virtualized industrial automation system, controlling operation of the industrial automation system associated with the virtualized industrial automation system, customizing a view of the virtualized industrial automation system for a user, and/or performing other operations on the virtualized industrial automation system or associated industrial automation system, as more fully disclosed herein.
At 2002, information relating to an interaction with the virtualized industrial automation system by a user can be received. The user can use the user's communication device to interact with (e.g., monitor operation of, track operation of, adjust a control of, modify a system parameter of, and/or perform another work task in connection with, etc.) the virtualized industrial automation system, or portion thereof (e.g., a customized view or version of), to facilitate interaction with and/or controlling operation of the industrial automation system associated with (e.g., interfaced with or communicatively connected to) the virtualized industrial automation system. The communication device can communicate the information relating to the interaction with the virtualized industrial automation system by the user to the virtualization management component via a communication network (e.g., a communication network comprising an IP-based network (e.g., Internet, intranet), a mobile core network, and/or a LAN). The virtualization management component can receive the information relating to the interaction with the virtualized industrial automation system by the user.
At 2004, data relating to the virtualized industrial automation system and the information relating to the interaction with the virtualized industrial automation system by the user can be analyzed. The virtualization management component can analyze the data relating to the virtualized industrial automation system and the information relating to the interaction with the virtualized industrial automation system, or portion thereof (e.g., the customized view or version of), by the user to facilitate interacting with and/or controlling the virtual operation of the virtualized industrial automation system and determining the interaction with the industrial automation system that is desired or initiated by the user to facilitate controlling the operation of the industrial automation system, in accordance with the interaction of the user with the virtualized industrial automation system.
At 2006, one or more control signals can be determined based at least in part on the data analysis results at 2004. The virtualization management component can determine one or more control signals that can be used to facilitate interacting with and/or controlling the operation of the industrial automation system, in accordance with the interaction with the virtualized industrial automation system, or portion thereof (e.g., the customized view or version of), by the user, based at least in part on the data analysis results at 2004.
At 2008, the one or more control signals can be communicated to the industrial automation system. The virtualization management component can communicate the one or more control signals to the industrial automation system via the communication network to facilitate interacting with and/or controlling the operation of the industrial automation system, in accordance with the interaction with the virtualized industrial automation system, or portion thereof (e.g., the customized view or version of), by the user. For example, the industrial automation system can receive the one or more control signals. In response to the one or more control signals, the operation of the industrial automation system can be controlled, in accordance with the interaction with the virtualized industrial automation system by the user.
At 2010, data relating to the operation of the industrial automation system in response to the one or more control signals can be received. The collection component can receive or collect the data relating to the operation (e.g., the change in operation) of the industrial automation system in response to the one or more control signals.
At 2012, the data relating to the operation of the industrial automation system in response to the one or more control signals, the data relating to the virtualized industrial automation system, and the information relating to the interaction with the virtualized industrial automation system by the user can be analyzed. The virtualization management component can analyze the data relating to the operation of the industrial automation system in response to the one or more control signals, the data relating to the virtualized industrial automation system, and the information relating to the interaction with the virtualized industrial automation system by the user to facilitate updating the virtualized industrial automation system (or updating the customized view of, and/or customized data overlay associated with, the virtualized industrial automation system).
At 2014, the virtualized industrial automation system (and/or customized view of, and/or customized data overlay associated with, the virtualized industrial automation system) can be updated based at least in part on the results of the data analysis at 2012. The virtualization management component can control the virtual operation of the virtualized industrial automation system based at least in part on the data analysis results obtained at 2012. For instance, in response to the information relating to the interaction with the virtualized industrial automation system by the user and in response to the operational response of the industrial automation system to the one or more control signals, the virtualization management component can update the virtualized industrial automation system (and/or the customized view of, and/or customized data overlay associated with, the virtualized industrial automation system), which can facilitate interacting with, and/or controlling the virtual operation of, the virtualized industrial automation system.
At 2102, data relating to a user associated with the industrial automation system can be received. The virtualization component can monitor operations of the industrial automation system and monitor movements, behavior, interactions, etc., of the user with respect to the industrial automation system. The collection component can receive, collect, and/or obtain the data relating to the user, wherein the data relating to the user can comprise data relating to the operations of the industrial automation system and the movements, behavior, interactions, etc., of the user with respect to the industrial automation system and/or other data (e.g., data identifying the user, identifying the role of the user with respect to the industrial automation system, identifying preferences of the user with regard to customizing the view of, and/or customizing the data overlay associated with) the virtualized industrial automation system to be provided to the user, etc.). The data relating to the user can be stored in the data store.
At 2104, the data relating to the user and data relating to the virtualized industrial automation system can be analyzed. The virtualization management component can analyze the data relating to the user and data relating to the virtualized industrial automation system to facilitate determining one or more customization factors that can be employed to facilitate determining how the view of, and/how the data overlay associated with, the virtual industrial automation system is to be customized for the user.
At 2106, one or more customization factors associated with the user can be determined based at least in part on the results of the data analysis of 2104. The virtualization management component can determine the one or more customization factors associated with the user based at least in part on the results of the data analysis of 2104. The one or more customization factors can comprise or relate to, for example, the role of the user in connection with the industrial automation system, the identity of the user, the device identifier associated with the communication device, the RFID tag associated with the user, the set of access rights of the user to access the virtualized industrial automation system or the industrial automation system, authentication information associated with the user, the location of the user in relation to the industrial automation system, the location of the communication device in relation to the industrial automation system, the location of the radio-frequency identification tag associated with the user in relation to the industrial automation system, the preference(s) of the user with regard to customizing the view of, and/or customizing the data overlay associated with, the virtualized industrial automation system, a data filter(s) selected by the user to facilitate filtering the overlay data, and/or the context of a set of data associated with the virtualized industrial automation system or the user.
At 2108, a customized view of, and/or a customized data overlay associated with, the virtualized industrial automation system can be determined based at least in part on the one or more customization factors associated with the user. The virtualization management component can determine a customized view of, and/or a customized data overlay associated with, the virtualized industrial automation system based at least in part on the one or more customization factors associated with the user. For example, the results of the data analysis can indicate that the role of the user in connection with the industrial automation system is a customization factor. The virtualization management component also can identify the role of the user in connection with the industrial automation system. In such instance, the virtualization management component can determine the customized view of the virtualized industrial automation system based at least in part on the role of the user in connection with the industrial automation system. For instance, if the virtualization management component determines that the user has a first role (e.g., operator) in connection with the industrial automation system, the virtualization management component can determine a first customized view of, and/or a first customized data overlay associated with, the virtualized industrial automation system based at least in part on the first role of the user; or, alternatively, if the virtualization management component determines that the user has a second role (e.g., maintenance engineer) in connection with the industrial automation system, the virtualization management component can determine a second customized view of, and/or a second customized data overlay associated with, the virtualized industrial automation system based at least in part on the second role of the user. The first customized view, and/or the first customized data overlay associated with, can facilitate presenting a first portion of the virtualized industrial automation system on a communication device associated with the first user, wherein a first subset of data can be overlaid on the first portion of the virtualized industrial automation system. The second customized view, and/or the second customized data overlay associated with, can facilitate presenting a second portion of the virtualized industrial automation system on a communication device associated with the second user, wherein a second subset of data can be overlaid on the second portion of the virtualized industrial automation system. As part of customizing the view of the virtualized industrial automation system, the virtualization management component also can filter the data (e.g., overlaid data) presented via the virtualized industrial automation system to generate an augmented and/or further customized subset of the data for presenting via (e.g., for overlaying on) the customized view of the virtualized industrial automation system.
At 2110, the customized view of, and/or a customized data overlay associated with, the virtualized industrial automation system can be generated based at least in part on the determination of the customized view of, and/or a customized data overlay associated with, the virtualized industrial automation system. The virtualization management component can generate the customized view of, and/or a customized data overlay associated with, the virtualized industrial automation system in response to determining the customized view of, and/or a customized data overlay associated with, the virtualized industrial automation system.
At 2112, information relating to the customized view of, and/or a customized data overlay associated with, the virtualized industrial automation system can be provided (e.g., communicated, presented), for example, to a communication device associated with the user. The virtualization management component can provide the customized view of, and/or a customized data overlay associated with, the virtualized industrial automation system to the communication device associated with the user, wherein the customized view of, and/or a customized data overlay associated with, the virtualized industrial automation system can be displayed on the display screen of the communication device. Via the communication device, the user can interact with the customized view of, and/or a customized data overlay associated with, the virtualized industrial automation system to facilitate remotely interacting with and/or controlling the virtualized industrial automation system. In some implementations, the virtualization management component and/or the communication device can facilitate providing (e.g., communicating, presenting, sharing) the customized view of, and/or a customized data overlay associated with, the virtualized industrial automation system with one or more other communication devices of one or more other users associated with the industrial automation system, in accordance with the defined virtualization management criteria (e.g., when the criteria indicates that the sharing of the customized view of the virtualized industrial automation system with one or more other communication devices is permitted).
In some implementations, the method 2100 can proceed to reference point B, wherein, for example, from reference point B, as disclosed with regard to method 2100, the subset of data associated with a customized view of, and/or a customized data overlay associated with, the virtualized industrial automation system can be filtered using a desired filter.
At 2202, information indicating selection of a filter in connection with a portion of the customized view of the virtualized industrial automation system can be received. The user can use the user's communication device to input information (e.g., selection information) that can indicate a filter that the user desires to use to filter a subset of operational data associated with a customized view of, and/or a customized data overlay associated with, a virtualized industrial automation system. The subset of operational data can be part of the customized data overlay and/or can be associated with the portion of the customized view of the virtualized industrial automation system, for example. The virtualization management component can receive the information indicating selection of the filter from the user's communication device, for example, via a communication network.
At 2204, the filter to be applied to the subset of operational data associated with the customized data overlay and/or the portion of the customized view of the virtualized industrial automation system can be determined based at least in part on the received information indicating selection of the filter. The virtualization management component can analyze the received information indicating selection of the filter, and can determine the filter that is to be applied to the subset of operational data based at least in part on the analysis results. The filter can be one of the types of data filters disclosed herein, for example.
At 2206, the subset of operational data can be filtered to generate filtered operational data based at least in part on the filter. The virtualization management component can apply the filter to the subset of operational data to filter the subset of operational data to generate the filtered operational data. Based at least in part on the type of filter, the filtered operational data can comprise a portion of the subset of operational data and/or can comprise other data (e.g., more detailed operational data obtained from applying the filter to a set of operational data)
At 2208, the filtered operational data can be overlaid on or in proximity to the portion of the customized view of the virtualized industrial automation system. The virtualization management component can augment the original portion of the customized view and original data overlay associated with the virtualized industrial automation system to, for example, replace at least a portion of the original data overlay with the filtered operational data, which can be overlaid on or in proximity to the portion of the customized view of the virtualized industrial automation system. For example, the virtualization management component can remove (e.g., filter out) all or a portion of the original data overlay associated with the original portion of the customized view of the virtualized industrial automation system, and can overlay the filtered operational data on or in proximity to the portion of the customized view of the virtualized industrial automation system.
At 2210, the augmented customized view of the virtualized industrial automation system, with the filtered operational data overlaid on or in proximity to the portion of the customized view of the virtualized industrial automation system, can be provided (e.g., for display). The virtualization management component can provide the augmented customized view of the virtualized industrial automation system, which can have the filtered operational data overlaid on or in proximity to the portion of the customized view of the virtualized industrial automation system, to the communication device of the user. The communication device can display the augmented customized view of the virtualized industrial automation system to the user to facilitate providing desired information (e.g., the filtered operational data) to the user. Using the user's communication device (e.g., computer, phone, electronic pad or tablet, electronic glasses (e.g., smart glasses) with communication functionality, etc.), the user can monitor, track, and/or interact with the information relating to the industrial automation system via the augmented customized view of the virtualized industrial automation system to facilitate performing work tasks in connection with the industrial automation system.
At 2302, a customized view of, and/or a customized data overlay associated with, a virtualized industrial automation system associated with an industrial automation system for a first user can be generated. In connection with a first user, the virtualization management component can generate the customized view of, and/or the customized data overlay associated with, the virtualized industrial automation system, based at least in part on a set of customization factors associated with the first user and the defined virtualization management criteria, in accordance with the disclosed subject matter.
At 2304, the customized view of, and/or the customized data overlay associated with, the virtualized industrial automation system can be provided (e.g., communicated) to a first communication device associated with the first user. The virtualization management component can communicate the customized view of, and/or the customized data overlay associated with, the virtualized industrial automation system to the first communication device for display on the first communication device for viewing by the first user.
At 2306, a request to share the customized view of, and/or the customized data overlay associated with, the virtualized industrial automation system can be received. For instance, the first user can input information to the first communication device that indicates that the first user requests to share the customized view of, and/or the customized data overlay associated with, the virtualized industrial automation system with a second communication device associated with a second user. The first user can use the first communication device to communicate the request to share to the virtualization management component, which can receive the request to share.
At 2308, a determination can be made regarding whether the customized view of, and/or the customized data overlay associated with, the virtualized industrial automation system can be shared with the second communication device. The virtualization management component can analyze information associated with the request to share, and information associated with the second user, to generate analysis results that can facilitate determining whether whether the customized view of, and/or the customized data overlay associated with, the virtualized industrial automation system can be shared with the second communication device associated with the second user. For instance, the virtualization management component can determine the identity or role of the second user, determine what information associated with the virtualized industrial automation system will be made available to the second user if the request to share is granted, determine access rights of the second user in connection with viewing the customized view of, and/or the customized data overlay associated with, the virtualized industrial automation system, determine the location of the second user or the second communication device with respect to the industrial automation system, etc., based at least in part on the analysis results.
At 2310, the customized view of, and/or the customized data overlay associated with, the virtualized industrial automation system can be communicated to (e.g., shared with) the second communication device in response to determining that the second communication device is permitted to receive the customized view of, and/or the customized data overlay associated with, the virtualized industrial automation system. For example, the virtualization management component can determine that the second user and associated second communication device are permitted to receive the customized view of, and/or the customized data overlay associated with, the virtualized industrial automation system associated with the first user, based at least in part on the data analysis results and the defined virtualized management criteria. For instance, the data analysis results can indicate the second user has a role with respect to the industrial automation system that is associated with a set of access rights with respect to information associated with the industrial automation system that allow the second user to access the customized view of, and/or the customized data overlay associated with, the virtualized industrial automation system. Based at least in part on such data analysis results, the virtualization management component can determine that the second user and associated second communication device are permitted to receive the customized view of, and/or the customized data overlay associated with, the virtualized industrial automation system associated with the first user, in accordance with the defined virtualization management criteria. The virtualization management component can facilitate communicating the customized view of, and/or the customized data overlay associated with, the virtualized industrial automation system to the second communication device for presentation on the display screen of the second communication device to the second user. In this way, the first user can share the customized view of, and/or the customized data overlay associated with, the virtualized industrial automation system with the second user.
If the virtualization management component had determined that the second user or second communication device were not authorized to receive or access the customized view of, and/or the customized data overlay associated with, the virtualized industrial automation system, the virtualization management component can deny the request to share and can deny the second user and second communication device the ability to receive or access the customized view of, and/or the customized data overlay associated with, the virtualized industrial automation system. The virtualization management component also can communicate a denial message to the first communication device and/or second communication device to notify the first user and/or second user that the request to share was denied.
At 2402, a virtual note can be generated. A user can use a communication device to interact with the application or service associated with the virtualized industrial automation system to, for example, select a note generation control to facilitate generating a virtual note. The virtualization management component can receive information relating to the selection of the note generation control from the communication device. The virtualization management component can generate the virtual note in response to the selection of the note generation control.
At 2404, information for inclusion in the virtual note can be received. The user can use the communication device to input (e.g., enter) information that the user desires to include in the virtual note. The communication device can communicate such information for the virtual note to the virtualization management component. The virtualization management component can receive the information that is to be included in the virtual note and can insert such information in the virtual note.
At 2406, note placement information can be received. The user can use the communication device to input (e.g., enter) note placement information that can facilitate placing the virtual note in a desired location of the virtualized industrial automation system. The note placement information can comprise keystrokes, user gestures (e.g., touch screen gestures), mouse movement and/or clicks, and/or drag-and-drop information, for example. For instance, the user can drag (e.g., via touch screen gesture, or mouse movement and/or click) the virtual note across the virtualized industrial automation system to a desired location of the virtualized industrial automation system where the user desires to place the virtual note on the virtualized industrial automation system. Such actions by the user can facilitate generating the note placement information. The communication device can communicate the note placement information to the virtualization management component.
At 2408, the virtual note can be moved to a desired location of the virtualized industrial automation system in response to the note placement information. At 2410, the virtual note can be placed in the desired location of the virtualized industrial automation system in response of the note placement information. In response to the note placement information, the virtualization management component can move the virtual note to the desired location of the virtualized industrial automation system and can place the virtual note in the desired location of the virtualized industrial automation system. For example, as the note placement information is being generated by the communication device, the generated note placement information can be communicated to the virtualization management component. In response to the generated note placement information, the virtualization management component can move the virtual note in relation to the virtualized industrial automation system, and can communicate information relating to such movement to the communication to facilitate showing, on the display screen of the communication device, the virtual note being moved in relation to the virtualized industrial automation system. This can continue until the virtual note is placed in the desired location of the virtualized industrial automation system, in accordance with the note placement information.
Embodiments, systems, and components described herein, as well as industrial automation or control systems and industrial automation environments in which various aspects set forth in the subject specification can be carried out, can include computer or network components such as servers, clients, programmable logic controllers (PLCs), automation controllers, communications modules, mobile computers, wireless components, control components and so forth which are capable of interacting across a network. Computers and servers include one or more processors—electronic integrated circuits that perform logic operations employing electric signals—configured to execute instructions stored in media such as random access memory (RAM), read only memory (ROM), a hard drives, as well as removable memory devices, which can include memory sticks, memory cards, flash drives, external hard drives, and so on.
Similarly, the term PLC or automation controller as used herein can include functionality that can be shared across multiple components, systems, and/or networks. As an example, one or more PLCs or automation controllers can communicate and cooperate with various network devices across the network. This can include substantially any type of control, communications module, computer, Input/Output (I/O) device, sensor, actuator, and human machine interface (HMI) that communicate via the network, which includes control, automation, and/or public networks. The PLC or automation controller can also communicate to and control various other devices such as I/O modules including analog, digital, programmed/intelligent I/O modules, other programmable controllers, communications modules, sensors, actuators, output devices, and the like.
The network can include public networks such as the internet, intranets, and automation networks such as control and information protocol (CIP) networks including DeviceNet, ControlNet, and Ethernet/IP. Other networks include Ethernet, DH/DH+, Remote I/O, Fieldbus, Modbus, Profibus, CAN, wireless networks, serial protocols, and so forth. In addition, the network devices can include various possibilities (hardware and/or software components). These include components such as switches with virtual local area network (VLAN) capability, LANs, WANs, proxies, gateways, routers, firewalls, virtual private network (VPN) devices, servers, clients, computers, configuration tools, monitoring tools, and/or other devices.
In order to provide a context for the various aspects of the disclosed subject matter,
With reference to
The system bus 2518 can be any of several types of bus structure(s) including the memory bus or memory controller, a peripheral bus or external bus, and/or a local bus using any variety of available bus architectures including, but not limited to, 8-bit bus, Industrial Standard Architecture (ISA), Micro-Channel Architecture (MSA), Extended ISA (EISA), Intelligent Drive Electronics (IDE), VESA Local Bus (VLB), Peripheral Component Interconnect (PCI), Universal Serial Bus (USB), Advanced Graphics Port (AGP), Personal Computer Memory Card International Association bus (PCMCIA), and Small Computer Systems Interface (SCSI).
The system memory 2516 includes volatile memory 2520 and nonvolatile memory 2522. The basic input/output system (BIOS), containing the basic routines to transfer information between elements within the computer 2512, such as during start-up, is stored in nonvolatile memory 2522. By way of illustration, and not limitation, nonvolatile memory 2522 can include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable PROM (EEPROM), or flash memory. Volatile memory 2520 includes random access memory (RAM), which acts as external cache memory. By way of illustration and not limitation, RAM is available in many forms such as synchronous RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), Synchlink DRAM (SLDRAM), and direct Rambus RAM (DRRAM).
Computer 2512 also includes removable/non-removable, volatile/nonvolatile computer storage media.
It is to be appreciated that
A user enters commands or information into the computer 2512 through input device(s) 2536. Input devices 2536 include, but are not limited to, a pointing device such as a mouse, trackball, stylus, touch pad, keyboard, microphone, joystick, game pad, satellite dish, scanner, TV tuner card, digital camera, digital video camera, web camera, and the like. These and other input devices connect to the processing unit 2514 through the system bus 2518 via interface port(s) 2538. Interface port(s) 2538 include, for example, a serial port, a parallel port, a game port, and a universal serial bus (USB). Output device(s) 2540 use some of the same type of ports as input device(s) 2536. Thus, for example, a USB port may be used to provide input to computer 2512, and to output information from computer 2512 to an output device 2540. Output adapters 2542 are provided to illustrate that there are some output devices 2540 like monitors, speakers, and printers, among other output devices 2540, which require special adapters. The output adapters 2542 include, by way of illustration and not limitation, video and sound cards that provide a means of connection between the output device 2540 and the system bus 2518. It should be noted that other devices and/or systems of devices provide both input and output capabilities such as remote computer(s) 2544.
Computer 2512 can operate in a networked environment using logical connections to one or more remote computers, such as remote computer(s) 2544. The remote computer(s) 2544 can be a personal computer, a server, a router, a network PC, a workstation, a microprocessor based appliance, a peer device or other common network node and the like, and typically includes many or all of the elements described relative to computer 2512. For purposes of brevity, only a memory storage device 2546 is illustrated with remote computer(s) 2544. Remote computer(s) 2544 is logically connected to computer 2512 through a network interface 2548 and then physically connected via communication connection 2550. Network interface 2548 encompasses communication networks such as local-area networks (LAN) and wide-area networks (WAN). LAN technologies include Fiber Distributed Data Interface (I-DDI), Copper Distributed Data Interface (CDDI), Ethernet/IEEE 802.3, Token Ring/IEEE 802.5 and the like. WAN technologies include, but are not limited to, point-to-point links, circuit switching networks like Integrated Services Digital Networks (ISDN) and variations thereon, packet switching networks, and Digital Subscriber Lines (DSL).
Communication connection(s) 2550 refers to the hardware/software employed to connect the network interface 2548 to the system bus 2518. While communication connection 2550 is shown for illustrative clarity inside computer 2512, it can also be external to computer 2512. The hardware/software necessary for connection to the network interface 2548 includes, for exemplary purposes only, internal and external technologies such as, modems including regular telephone grade modems, cable modems and DSL modems, ISDN adapters, and Ethernet cards.
What has been described above includes examples of the disclosed subject matter. It is, of course, not possible to describe every conceivable combination of components or methods for purposes of describing the disclosed subject matter, but one of ordinary skill in the art may recognize that many further combinations and permutations of the disclosed subject matter are possible. Accordingly, the disclosed subject matter is intended to embrace all such alterations, modifications, and variations that fall within the spirit and scope of the appended claims.
In particular and in regard to the various functions performed by the above described components, devices, circuits, systems and the like, the terms (including a reference to a “means”) used to describe such components are intended to correspond, unless otherwise indicated, to any component which performs the specified function of the described component (e.g., a functional equivalent), even though not structurally equivalent to the disclosed structure, which performs the function in the herein illustrated exemplary aspects of the disclosed subject matter. In this regard, it will also be recognized that the disclosed subject matter includes a system as well as a computer-readable medium having computer-executable instructions for performing the acts and/or events of the various methods of the disclosed subject matter.
In addition, while a particular feature of the disclosed subject matter may have been disclosed with respect to only one of several implementations, such feature may be combined with one or more other features of the other implementations as may be desired and advantageous for any given or particular application. Furthermore, to the extent that the terms “includes,” and “including” and variants thereof are used in either the detailed description or the claims, these terms are intended to be inclusive in a manner similar to the term “comprising.”
It is to be appreciated and understood that components (e.g., virtualization component, collection component, virtualization management component, processor component, data store, etc.), as described with regard to a particular system or method, can include the same or similar functionality as respective components (e.g., respectively named components or similarly named components) as described with regard to other systems or methods disclosed herein.
In this application, the word “exemplary” is used to mean serving as an example, instance, or illustration. Any aspect or design described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other aspects or designs. Rather, use of the word exemplary is intended to present concepts in a concrete fashion.
Various aspects or features described herein may be implemented as a method, apparatus, or article of manufacture using standard programming and/or engineering techniques. The term “article of manufacture” as used herein is intended to encompass a computer program accessible from any computer-readable device, carrier, or media. For example, computer readable media can include but are not limited to magnetic storage devices (e.g., hard disk, floppy disk, magnetic strips . . . ), optical disks [e.g., compact disk (CD), digital versatile disk (DVD) . . . ], smart cards, and flash memory devices (e.g., card, stick, key drive . . . ).
This application is a continuation of pending U.S. patent application Ser. No. 14/088,014, filed on Nov. 22, 2013, entitled “USING CLOUD-BASED DATA FOR VIRTUALIZATION OF AN INDUSTRIAL AUTOMATION ENVIRONMENT WITH INFORMATION OVERLAYS”, which claims the benefit of U.S. Provisional Patent Application Ser. No. 61/821,639, filed on May 9, 2013, and entitled “REMOTE SERVICES AND ASSET MANAGEMENT SYSTEMS AND METHODS.” The entireties of the aforementioned applications are hereby incorporated herein by reference.
| Number | Name | Date | Kind |
|---|---|---|---|
| 5014317 | Kita et al. | May 1991 | A |
| 5122948 | Zapolin | Jun 1992 | A |
| 5199009 | Svast | Mar 1993 | A |
| 5598572 | Tanikoshi | Jan 1997 | A |
| 5611059 | Benton et al. | Mar 1997 | A |
| 5612869 | Letzt et al. | Mar 1997 | A |
| 5682460 | Hyziak et al. | Oct 1997 | A |
| 5710885 | Bondi | Jan 1998 | A |
| 5844794 | Keeley | Dec 1998 | A |
| 5845149 | Husted et al. | Dec 1998 | A |
| 5856931 | McCasland | Jan 1999 | A |
| 5957985 | Wong et al. | Sep 1999 | A |
| 5966301 | Cook et al. | Oct 1999 | A |
| 5970430 | Burns et al. | Oct 1999 | A |
| 5978568 | Abraham et al. | Nov 1999 | A |
| 6167337 | Haack et al. | Dec 2000 | A |
| 6175770 | Bladow | Jan 2001 | B1 |
| 6175801 | Millington | Jan 2001 | B1 |
| 6199068 | Carpenter | Mar 2001 | B1 |
| 6279113 | Vaidya | Aug 2001 | B1 |
| 6282455 | Engdahl | Aug 2001 | B1 |
| 6324607 | Korowitz et al. | Nov 2001 | B1 |
| 6381502 | Rudder et al. | Apr 2002 | B1 |
| 6400996 | Hoffberg et al. | Jun 2002 | B1 |
| 6412032 | Neet et al. | Jun 2002 | B1 |
| 6437692 | Petite et al. | Aug 2002 | B1 |
| 6457024 | Felsentein et al. | Sep 2002 | B1 |
| 6463338 | Neet | Oct 2002 | B1 |
| 6466972 | Paul et al. | Oct 2002 | B1 |
| 6535926 | Esker | Mar 2003 | B1 |
| 6578005 | Lesaint et al. | Jun 2003 | B1 |
| 6624388 | Blankenship et al. | Sep 2003 | B1 |
| 6640145 | Hoffberg et al. | Oct 2003 | B2 |
| 6651062 | Ghannam et al. | Nov 2003 | B2 |
| 6675226 | Nair et al. | Jan 2004 | B1 |
| 6686838 | Rezvani et al. | Feb 2004 | B1 |
| 6691159 | Grewal et al. | Feb 2004 | B1 |
| 6705229 | Frankenberger | Mar 2004 | B2 |
| 6708074 | Chi et al. | Mar 2004 | B1 |
| 6708385 | Lemelson | Mar 2004 | B1 |
| 6714974 | Machida | Mar 2004 | B1 |
| 6728262 | Woram | Apr 2004 | B1 |
| 6732165 | Jennings, III | May 2004 | B1 |
| 6732191 | Baker et al. | May 2004 | B1 |
| 6774598 | Kohler et al. | Aug 2004 | B1 |
| 6801920 | Wischinski | Oct 2004 | B1 |
| 6819960 | McKelvey et al. | Nov 2004 | B1 |
| 6891850 | Vandesteeg et al. | May 2005 | B1 |
| 6895532 | Raynham | May 2005 | B2 |
| 6904600 | James et al. | Jun 2005 | B1 |
| 6907302 | Karbassi | Jun 2005 | B2 |
| 6920502 | Araujo et al. | Jul 2005 | B2 |
| 6952680 | Melby et al. | Oct 2005 | B1 |
| 6965802 | Sexton | Nov 2005 | B2 |
| 6968242 | Hwu et al. | Nov 2005 | B1 |
| 6970913 | Albert et al. | Nov 2005 | B1 |
| 6982953 | Swales | Jan 2006 | B1 |
| 7032045 | Kostadinov | Apr 2006 | B2 |
| 7085814 | Gandhi et al. | Aug 2006 | B1 |
| 7103428 | Varone et al. | Sep 2006 | B2 |
| 7133900 | Szeto | Nov 2006 | B1 |
| 7149792 | Hansen et al. | Dec 2006 | B1 |
| 7151966 | Baier et al. | Dec 2006 | B1 |
| 7203560 | Wylie et al. | Apr 2007 | B1 |
| 7210095 | Mor | Apr 2007 | B1 |
| 7233830 | Callaghan et al. | Jun 2007 | B1 |
| 7242009 | Wilson et al. | Jul 2007 | B1 |
| 7275037 | Lauer | Sep 2007 | B2 |
| 7277865 | Silverstone et al. | Oct 2007 | B1 |
| 7289994 | Nixon et al. | Oct 2007 | B2 |
| 7298275 | Brandt | Nov 2007 | B2 |
| 7310344 | Sue | Dec 2007 | B1 |
| 7383155 | Rosam et al. | Jun 2008 | B2 |
| 7412548 | Sichner | Aug 2008 | B2 |
| 7428495 | Dhar et al. | Sep 2008 | B2 |
| 7478010 | Hashemian | Jan 2009 | B2 |
| 7480728 | Evans | Jan 2009 | B2 |
| 7539724 | Callaghan | May 2009 | B1 |
| 7734590 | Chand | Jun 2010 | B2 |
| 7827122 | Campbell, Jr. et al. | Nov 2010 | B1 |
| 7831317 | McGreevy et al. | Nov 2010 | B2 |
| 8150959 | Bezdicek | Apr 2012 | B1 |
| 8266066 | Wezter et al. | Sep 2012 | B1 |
| 8353012 | Del Real | Jan 2013 | B2 |
| 8392845 | Cahill | Mar 2013 | B2 |
| 8451753 | Vanga et al. | May 2013 | B2 |
| 8468272 | Giroti | Jun 2013 | B2 |
| 8686871 | Jensen | Apr 2014 | B2 |
| 8924328 | Kozlovsky et al. | Dec 2014 | B1 |
| 9024955 | Ramarao | May 2015 | B2 |
| 9117076 | Devost | Aug 2015 | B2 |
| 9438648 | Asenjo et al. | Sep 2016 | B2 |
| 9507807 | Florissi et al. | Nov 2016 | B1 |
| 9685053 | Palmeri | Jun 2017 | B2 |
| 9690669 | Bernal et al. | Jun 2017 | B2 |
| 10026049 | Asenjo et al. | Jul 2018 | B2 |
| 10054914 | Vartiainen | Aug 2018 | B2 |
| 20010035729 | Graiger | Nov 2001 | A1 |
| 20020004798 | Babula et al. | Jan 2002 | A1 |
| 20020016839 | Smith | Feb 2002 | A1 |
| 20020042756 | Kumar et al. | Apr 2002 | A1 |
| 20020046239 | Stawikowski et al. | Apr 2002 | A1 |
| 20020049833 | Kikinis | Apr 2002 | A1 |
| 20020065898 | Leontiev et al. | May 2002 | A1 |
| 20020068983 | Sexton | Jun 2002 | A1 |
| 20020068984 | Alexander et al. | Jun 2002 | A1 |
| 20020073236 | Helgeson et al. | Jun 2002 | A1 |
| 20020077711 | Nixon et al. | Jun 2002 | A1 |
| 20020082966 | O'Brien et al. | Jun 2002 | A1 |
| 20020094588 | Fan et al. | Jul 2002 | A1 |
| 20020096077 | Frankenberger | Jul 2002 | A1 |
| 20020107904 | Talluri et al. | Aug 2002 | A1 |
| 20020138378 | Leskuski | Sep 2002 | A1 |
| 20020156872 | Brown | Oct 2002 | A1 |
| 20020156926 | Batke et al. | Oct 2002 | A1 |
| 20020161745 | Call | Oct 2002 | A1 |
| 20020169993 | Woods et al. | Nov 2002 | A1 |
| 20030004937 | Salmenkaita et al. | Jan 2003 | A1 |
| 20030009253 | McIntyre et al. | Jan 2003 | A1 |
| 20030009572 | Thurner | Jan 2003 | A1 |
| 20030011467 | Suomela | Jan 2003 | A1 |
| 20030014149 | Kreidler et al. | Jan 2003 | A1 |
| 20030023336 | Kreidler et al. | Jan 2003 | A1 |
| 20030041089 | Mauro | Feb 2003 | A1 |
| 20030051074 | Edwards | Mar 2003 | A1 |
| 20030056224 | Stone | Mar 2003 | A1 |
| 20030105535 | Rammler | Jun 2003 | A1 |
| 20030105585 | Ukita | Jun 2003 | A1 |
| 20030109942 | Yeh et al. | Jun 2003 | A1 |
| 20030120817 | Ott et al. | Jun 2003 | A1 |
| 20030156639 | Liang | Aug 2003 | A1 |
| 20030167238 | Zeif | Sep 2003 | A1 |
| 20030167449 | Warren et al. | Sep 2003 | A1 |
| 20030177169 | Nutt et al. | Sep 2003 | A1 |
| 20030177201 | Shen | Sep 2003 | A1 |
| 20030198188 | Castlebury et al. | Oct 2003 | A1 |
| 20030208545 | Eaton et al. | Nov 2003 | A1 |
| 20030217100 | Kronk | Nov 2003 | A1 |
| 20030224769 | Solve et al. | Dec 2003 | A1 |
| 20030236576 | Resnick | Dec 2003 | A1 |
| 20040024572 | Pagnano et al. | Feb 2004 | A1 |
| 20040083165 | Lawrence | Apr 2004 | A1 |
| 20040111512 | Barth | Jun 2004 | A1 |
| 20040148039 | Farchmin | Jul 2004 | A1 |
| 20040148187 | Boettcher et al. | Jul 2004 | A1 |
| 20040148383 | Gonsalves | Jul 2004 | A1 |
| 20040159113 | Singh et al. | Aug 2004 | A1 |
| 20040199573 | Schwartz et al. | Oct 2004 | A1 |
| 20040203895 | Balasuriya | Oct 2004 | A1 |
| 20040214566 | Suzuki et al. | Oct 2004 | A1 |
| 20040215551 | Eder | Oct 2004 | A1 |
| 20040225629 | Eder | Nov 2004 | A1 |
| 20040267729 | Swaminathan et al. | Dec 2004 | A1 |
| 20050021158 | De Meyer | Jan 2005 | A1 |
| 20050038528 | McKelvey et al. | Feb 2005 | A1 |
| 20050055429 | Abele et al. | Mar 2005 | A1 |
| 20050080799 | Hamden et al. | Apr 2005 | A1 |
| 20050091410 | Gibart et al. | Apr 2005 | A1 |
| 20050120112 | Wing et al. | Jun 2005 | A1 |
| 20050125441 | Clemens et al. | Jun 2005 | A1 |
| 20050137735 | Loy et al. | Jun 2005 | A1 |
| 20050149922 | Vincent | Jul 2005 | A1 |
| 20050203869 | Minamino et al. | Sep 2005 | A1 |
| 20050209902 | Iwasaki et al. | Sep 2005 | A1 |
| 20050257204 | Bryant et al. | Nov 2005 | A1 |
| 20050278441 | Bond et al. | Dec 2005 | A1 |
| 20060022048 | Johnson | Feb 2006 | A1 |
| 20060046712 | Shamp | Mar 2006 | A1 |
| 20060077095 | Tucker et al. | Apr 2006 | A1 |
| 20060078859 | Mullin | Apr 2006 | A1 |
| 20060149813 | Janik | Jul 2006 | A1 |
| 20060153089 | Silverman | Jul 2006 | A1 |
| 20060173873 | Prompt et al. | Aug 2006 | A1 |
| 20060190106 | Kay et al. | Aug 2006 | A1 |
| 20060236374 | Hartman | Oct 2006 | A1 |
| 20060253205 | Gardiner | Nov 2006 | A1 |
| 20060259472 | MacClellan | Nov 2006 | A1 |
| 20060282432 | Cassidy et al. | Dec 2006 | A1 |
| 20070008129 | Soliman | Jan 2007 | A1 |
| 20070019641 | Pai et al. | Jan 2007 | A1 |
| 20070021968 | Amir et al. | Jan 2007 | A1 |
| 20070050206 | Whikehart et al. | Mar 2007 | A1 |
| 20070061018 | Callaghan et al. | Mar 2007 | A1 |
| 20070073850 | Callaghan et al. | Mar 2007 | A1 |
| 20070078525 | Chand | Apr 2007 | A1 |
| 20070078536 | Gordon et al. | Apr 2007 | A1 |
| 20070078862 | Chand | Apr 2007 | A1 |
| 20070095907 | Robinson et al. | May 2007 | A1 |
| 20070112801 | McGreevy et al. | May 2007 | A1 |
| 20070118560 | Bornhoevd et al. | May 2007 | A1 |
| 20070130112 | Lin | Jun 2007 | A1 |
| 20070192213 | Wu et al. | Aug 2007 | A1 |
| 20070194097 | Jones | Aug 2007 | A1 |
| 20070244892 | Narancic | Oct 2007 | A1 |
| 20070245169 | Farchmin et al. | Oct 2007 | A1 |
| 20070247789 | Benson et al. | Oct 2007 | A1 |
| 20070255431 | Kinsey | Nov 2007 | A1 |
| 20080027704 | Kephart et al. | Jan 2008 | A1 |
| 20080049013 | Nasle | Feb 2008 | A1 |
| 20080065243 | Fallman et al. | Mar 2008 | A1 |
| 20080077512 | Grewal | Mar 2008 | A1 |
| 20080082186 | Hood et al. | Apr 2008 | A1 |
| 20080109099 | Moshier | May 2008 | A1 |
| 20080125887 | Case | May 2008 | A1 |
| 20080155064 | Kosuge et al. | Jun 2008 | A1 |
| 20080162688 | Reumann et al. | Jul 2008 | A1 |
| 20080189637 | Krajewski | Aug 2008 | A1 |
| 20080208365 | Grgic et al. | Aug 2008 | A1 |
| 20080209211 | Grgic et al. | Aug 2008 | A1 |
| 20080214104 | Baumert et al. | Sep 2008 | A1 |
| 20080263514 | DeMesa et al. | Oct 2008 | A1 |
| 20080303472 | John et al. | Dec 2008 | A1 |
| 20090037872 | Schnabele et al. | Feb 2009 | A1 |
| 20090063258 | Mueller et al. | Mar 2009 | A1 |
| 20090065578 | Peterson | Mar 2009 | A1 |
| 20090083204 | Baier et al. | Mar 2009 | A1 |
| 20090086692 | Chen | Apr 2009 | A1 |
| 20090088875 | Baier | Apr 2009 | A1 |
| 20090089032 | Sturrock et al. | Apr 2009 | A1 |
| 20090089233 | Gach et al. | Apr 2009 | A1 |
| 20090089359 | Siorek | Apr 2009 | A1 |
| 20090089682 | Baier et al. | Apr 2009 | A1 |
| 20090109889 | Budampati et al. | Apr 2009 | A1 |
| 20090125460 | Hewison et al. | May 2009 | A1 |
| 20090127325 | Macurek et al. | May 2009 | A1 |
| 20090204234 | Sustaeta et al. | Aug 2009 | A1 |
| 20090210071 | Agrusa | Aug 2009 | A1 |
| 20090210814 | Agrusa | Aug 2009 | A1 |
| 20090216341 | Enkerud et al. | Aug 2009 | A1 |
| 20090300151 | Friedman et al. | Dec 2009 | A1 |
| 20100023562 | Kreuch et al. | Jan 2010 | A1 |
| 20100057660 | Kato | Mar 2010 | A1 |
| 20100076575 | Vasko et al. | Mar 2010 | A1 |
| 20100082127 | Plache et al. | Apr 2010 | A1 |
| 20100082129 | McGreevy | Apr 2010 | A1 |
| 20100082453 | Speers et al. | Apr 2010 | A1 |
| 20100082669 | Obitko et al. | Apr 2010 | A1 |
| 20100083232 | Chouinard et al. | Apr 2010 | A1 |
| 20100118895 | Radulescu | May 2010 | A1 |
| 20100146014 | Ionescu et al. | Jun 2010 | A1 |
| 20100153487 | Greven et al. | Jun 2010 | A1 |
| 20100192144 | Schmit | Jul 2010 | A1 |
| 20100211509 | Jacobs | Aug 2010 | A1 |
| 20100241260 | Kilibarda | Sep 2010 | A1 |
| 20100256795 | McLaughlin et al. | Oct 2010 | A1 |
| 20100257227 | McLaughlin et al. | Oct 2010 | A1 |
| 20100257228 | Staggs | Oct 2010 | A1 |
| 20100306377 | DeHaan et al. | Dec 2010 | A1 |
| 20100318837 | Murphy et al. | Dec 2010 | A1 |
| 20100324855 | Parker | Dec 2010 | A1 |
| 20100332008 | Knipfer et al. | Dec 2010 | A1 |
| 20110016058 | Pinchuk | Jan 2011 | A1 |
| 20110047230 | McGee | Feb 2011 | A1 |
| 20110078300 | Grelewicz et al. | Mar 2011 | A9 |
| 20110161378 | Williamson | Jun 2011 | A1 |
| 20110173127 | Ho et al. | Jul 2011 | A1 |
| 20110257766 | Sundaram et al. | Oct 2011 | A1 |
| 20110276498 | Madhok | Nov 2011 | A1 |
| 20120005242 | Feng et al. | Jan 2012 | A1 |
| 20120054246 | Fischer | Mar 2012 | A1 |
| 20120072597 | Teather et al. | Mar 2012 | A1 |
| 20120079461 | Copass et al. | Mar 2012 | A1 |
| 20120083906 | Weatherhead | Apr 2012 | A1 |
| 20120084400 | Almadi et al. | Apr 2012 | A1 |
| 20120089920 | Eick | Apr 2012 | A1 |
| 20120095808 | Kattapuram et al. | Apr 2012 | A1 |
| 20120101801 | Van Dorsselaer | Apr 2012 | A1 |
| 20120147894 | Mulligan et al. | Jun 2012 | A1 |
| 20120232876 | Misra | Sep 2012 | A1 |
| 20120257544 | Schein et al. | Oct 2012 | A1 |
| 20120262069 | Reed | Oct 2012 | A1 |
| 20120290104 | Holt et al. | Nov 2012 | A1 |
| 20120297249 | Yang et al. | Nov 2012 | A1 |
| 20120304007 | Hanks et al. | Nov 2012 | A1 |
| 20120306620 | Karaffa | Dec 2012 | A1 |
| 20130004281 | Anders et al. | Jan 2013 | A1 |
| 20130012220 | Waris et al. | Jan 2013 | A1 |
| 20130018696 | Meldrum | Jan 2013 | A1 |
| 20130024542 | Keller et al. | Jan 2013 | A1 |
| 20130031158 | Salsburg | Jan 2013 | A1 |
| 20130036198 | Galm | Feb 2013 | A1 |
| 20130041705 | Hampapur et al. | Feb 2013 | A1 |
| 20130097563 | Pacheco Rodrigues Velho et al. | Apr 2013 | A1 |
| 20130097710 | Basavapatna et al. | Apr 2013 | A1 |
| 20130104236 | Ray et al. | Apr 2013 | A1 |
| 20130107772 | Splitz et al. | May 2013 | A1 |
| 20130111034 | Upadhya | May 2013 | A1 |
| 20130117064 | Sadeghi et al. | May 2013 | A1 |
| 20130117806 | Parthasarathy | May 2013 | A1 |
| 20130125233 | Bush et al. | May 2013 | A1 |
| 20130138812 | Assuncao et al. | May 2013 | A1 |
| 20130138818 | Wolf | May 2013 | A1 |
| 20130145033 | Polla et al. | Jun 2013 | A1 |
| 20130159500 | Reus et al. | Jun 2013 | A1 |
| 20130182107 | Anderson | Jul 2013 | A1 |
| 20130191106 | Kephart | Jul 2013 | A1 |
| 20130204982 | Kim et al. | Aug 2013 | A1 |
| 20130211546 | Lawson et al. | Aug 2013 | A1 |
| 20130211547 | Buchdunger | Aug 2013 | A1 |
| 20130211559 | Lawson et al. | Aug 2013 | A1 |
| 20130211870 | Lawson et al. | Aug 2013 | A1 |
| 20130212420 | Lawson et al. | Aug 2013 | A1 |
| 20130218971 | Sasaki et al. | Aug 2013 | A1 |
| 20130237204 | Buck et al. | Sep 2013 | A1 |
| 20130257627 | Rafael | Oct 2013 | A1 |
| 20130262654 | Masli et al. | Oct 2013 | A1 |
| 20130283265 | Acharya et al. | Oct 2013 | A1 |
| 20130304237 | Schroeder et al. | Nov 2013 | A1 |
| 20130325545 | Mordvinova et al. | Dec 2013 | A1 |
| 20130347003 | Whitmore | Dec 2013 | A1 |
| 20140013100 | Menzel et al. | Jan 2014 | A1 |
| 20140046618 | Arunachalam et al. | Feb 2014 | A1 |
| 20140046977 | Gopalakrishnan et al. | Feb 2014 | A1 |
| 20140047107 | Maturana et al. | Feb 2014 | A1 |
| 20140052499 | Wagner et al. | Feb 2014 | A1 |
| 20140059056 | Chaney et al. | Feb 2014 | A1 |
| 20140095231 | Cherusseri et al. | Apr 2014 | A1 |
| 20140095654 | Finnerty et al. | Apr 2014 | A1 |
| 20140121789 | Brandes et al. | May 2014 | A1 |
| 20140137257 | Martinez et al. | May 2014 | A1 |
| 20140156032 | Jenkins et al. | Jun 2014 | A1 |
| 20140156584 | Motukuri et al. | Jun 2014 | A1 |
| 20140250153 | Nixon et al. | Sep 2014 | A1 |
| 20140250337 | Yamaji et al. | Sep 2014 | A1 |
| 20140279641 | Singh et al. | Sep 2014 | A1 |
| 20140279948 | Mahate et al. | Sep 2014 | A1 |
| 20140282257 | Nixon et al. | Sep 2014 | A1 |
| 20140306533 | Paquin et al. | Oct 2014 | A1 |
| 20140335480 | Asenjo et al. | Nov 2014 | A1 |
| 20140336785 | Asenjo et al. | Nov 2014 | A1 |
| 20140336786 | Asenjo et al. | Nov 2014 | A1 |
| 20140336791 | Asenjo et al. | Nov 2014 | A1 |
| 20140336795 | Asenjo et al. | Nov 2014 | A1 |
| 20140337000 | Asenjo et al. | Nov 2014 | A1 |
| 20140358606 | Hull | Dec 2014 | A1 |
| 20140372347 | Cohen | Dec 2014 | A1 |
| 20150012763 | Cohen et al. | Jan 2015 | A1 |
| 20150019191 | Maturana et al. | Jan 2015 | A1 |
| 20150032886 | Wang | Jan 2015 | A1 |
| 20150048952 | Murphy | Feb 2015 | A1 |
| 20150235161 | Azar et al. | Aug 2015 | A1 |
| 20150278407 | Vennelakanti et al. | Oct 2015 | A1 |
| 20150304193 | Ishii | Oct 2015 | A1 |
| 20150378356 | Hefeeda | Dec 2015 | A1 |
| 20160154693 | Uhde et al. | Jun 2016 | A1 |
| 20160217378 | Bellala et al. | Jul 2016 | A1 |
| 20160217410 | Santos et al. | Jul 2016 | A1 |
| 20170019483 | Maturana et al. | Jan 2017 | A1 |
| 20170236391 | Palmeri | Aug 2017 | A1 |
| 20180157995 | O'Malley | Jun 2018 | A1 |
| 20180205803 | Asenjo et al. | Jul 2018 | A1 |
| Number | Date | Country |
|---|---|---|
| 1232553 | Oct 1999 | CN |
| 1529837 | Sep 2004 | CN |
| 1690685 | Nov 2005 | CN |
| 100362442 | Jan 2008 | CN |
| 101114160 | Jan 2008 | CN |
| 101326471 | Dec 2008 | CN |
| 101536002 | Sep 2009 | CN |
| 101739007 | Jun 2010 | CN |
| 101776862 | Jul 2010 | CN |
| 102435870 | May 2012 | CN |
| 102449567 | May 2012 | CN |
| 102830666 | Dec 2012 | CN |
| 102927937 | Feb 2013 | CN |
| 103019102 | Apr 2013 | CN |
| 103403753 | Nov 2013 | CN |
| 104142629 | Nov 2014 | CN |
| 104142630 | Nov 2014 | CN |
| 104142662 | Nov 2014 | CN |
| 104142664 | Nov 2014 | CN |
| 104142679 | Nov 2014 | CN |
| 198 34 456 | Feb 2000 | DE |
| 10 2014 102 844 | Sep 2014 | DE |
| 1 209 558 | May 2002 | EP |
| 1 531 373 | May 2005 | EP |
| 1 686 442 | Aug 2006 | EP |
| 1 933 214 | Jun 2008 | EP |
| 2 189 900 | May 2010 | EP |
| 2 293 164 | Mar 2011 | EP |
| 2 453 326 | May 2012 | EP |
| 2 469 466 | Jun 2012 | EP |
| 2 660 667 | Nov 2013 | EP |
| 2 704 401 | Mar 2014 | EP |
| 2 778 816 | Sep 2014 | EP |
| 2 790 101 | Oct 2014 | EP |
| 2 801 935 | Nov 2014 | EP |
| 2 801 936 | Nov 2014 | EP |
| 2 801 938 | Nov 2014 | EP |
| 2 801 940 | Nov 2014 | EP |
| 2 801 941 | Nov 2014 | EP |
| 3 037 901 | Jun 2016 | EP |
| 3 070 550 | Jul 2018 | EP |
| 0111586 | Feb 2001 | WO |
| 0169329 | Sep 2001 | WO |
| 0217131 | Feb 2002 | WO |
| 03007097 | Jan 2003 | WO |
| 03058506 | Jul 2003 | WO |
| 2008133715 | Nov 2008 | WO |
| 2009046095 | Apr 2009 | WO |
| 2011050482 | May 2011 | WO |
| 2013007866 | Jan 2013 | WO |
| 2014090310 | Jun 2014 | WO |
| 2016001718 | Jan 2016 | WO |
| Entry |
|---|
| Office Action for European Patent Application Serial No. 16160604.1-1802, dated May 17, 2017, 6 pages. |
| Office Action for U.S. Appl. No. 15/143,733 dated Mar. 8, 2018, 141 pages. |
| Office Action for U.S. Appl. No. 15/490,076 dated Apr. 2, 2018, 23 pages. |
| Office Action for U.S. Appl. No. 14/658,327 dated Apr. 10, 2018, 43 pages. |
| Office Action for U.S. Appl. No. 14/658,345 dated Mar. 14, 2018, 56 pages. |
| Office Action for U.S. Appl. No. 14/658,365, dated Apr. 5, 2018, 64 pages. |
| Office Action for U.S. Appl. No. 14/658,394, dated Apr. 6, 2018, 40 pages. |
| Final Office Action received for U.S. Appl. No. 14/658,365, dated Oct. 16, 2018, 42 pages. |
| Notice of Allowance received for U.S. Appl. No. 15/923,127 dated Nov. 21, 2018, 85 pages. |
| Non-Final Office Action received for U.S. Appl. No. 14/658,327 dated Nov. 1, 2018, 58 pages. |
| Final Office Action received for U.S. Appl. No. 14/658,394 dated Nov. 1, 2018, 51 pages. |
| Second Office Action received for Chinese Patent Application Serial No. 201610149668.1 dated Oct. 24, 2018, 18 pages (including English Translation). |
| Second Office Action received for Chinese Patent Application Serial No. 201610149635.7 dated Oct. 24, 2018, 24 pages (including English Translation). |
| First Office Action received for Chinese Patent Application Serial No. 201610151417.7 dated Sep. 18, 2018, 28 pages (including English Translation). |
| Non-Final Office Action for U.S. Appl. No. 14/088,014 dated Mar. 22, 2016, 98 pages. |
| Final Office Action for U.S. Appl. No. 14/088,014, dated Jul. 15, 2016, 65 pages. |
| Office Action for U.S. Appl. No. 14/088,014, dated Nov. 17, 2016, 61 pages. |
| Final Office Action for U.S. Appl. No. 14/658,365 dated Sep. 8, 2017, 59 pages. |
| Office Action for U.S. Appl. No. 14/087,821 dated Sep. 7, 2017, 63 pages. |
| Final Office Action for U.S. Appl. No. 14/087,730 dated Aug. 18, 2017, 72 pages. |
| Office Action for U.S. Appl. No. 15/214,583 dated Aug. 28, 2017, 80 pages. |
| Final Office Action for U.S. Appl. No. 14/658,345 dated Sep. 25, 2017, 52 pages. |
| Final Office Action for U.S. Appl. No. 15/388,260 dated Oct. 18, 2017, 76 pages. |
| Office Action for U.S. Appl. No. 15/206,744 dated Nov. 6, 2017, 48 pages. |
| Office Action for U.S. Appl. No. 14/658,327 dated Oct. 30, 2017, 48 pages. |
| Final Office Action for U.S. Appl. No. 14/658,394 dated Nov. 16, 2017, 49 pages. |
| Chinese First Office Action for Chinese Application No. 20170339669.7 dated Dec. 11, 2018, 25 pages (Including English Translation). |
| Office Action for U.S. Appl. No. 15/143,733, dated Jun. 18, 2018, 76 pages. |
| Office Action for U.S. Appl. No. 15/599,921, dated Jun. 29, 2018, 75 pages. |
| Office Action for U.S. Appl. No. 14/087,970, dated Aug. 1, 2018, 68 pages. |
| Wikipedia; “PID Controller”; Jul. 20, 2018; https://en.wikipedia.org/wiki/PID_controller (Year: 2018). |
| Communication pursuant to Article 94(3) EPC for EP Application Serial No. 14167714.6 dated Aug. 3, 2018, 5 pages. |
| Communication pursuant to Article 94(3) EPC for EP Application Serial No. 14167708.8 dated Aug. 3, 2018, 5 pages. |
| Communication pursuant to Article 94(3) EPC for EP Application Serial No. 14167712.0 dated Aug. 3, 2018, 5 pages. |
| Search Report received for Chinese Application Serial No. 201610149668.1 dated Apr. 2, 2018, 1 page. |
| Search Report received for Chinese Application Serial No. 201610149635.7 dated Apr. 2, 2018, 1 page. |
| First Office Action received for Chinese Patent Application Serial No. 201610151380.8 dated Jul. 17, 2018, 65 pages. |
| Office Action for U.S. Appl. No. 14/658,345, dated Sep. 13, 2018, 79 pages. |
| Office Action for U.S. Appl. No. 15/490,076 dated Dec. 20, 2017, 37 pages. |
| Office Action for U.S. Appl. No. 15/278,139 dated Jan. 11, 2018, 103 pages. |
| Final Office Action for U.S. Appl. No. 14/087,821 dated Dec. 14, 2017, 37 pages. |
| Final Office Action for U.S. Appl. No. 14/088,011 dated Nov. 22, 2017, 77 pages. |
| Office Action for U.S. Appl. No. 14/087,970 dated Feb. 12, 2018, 69 pages. |
| Chinese Office Action for CN Application Serial No. 201410196114.8, dated Dec. 13, 2017, 26 pages. |
| Non-Final Office Action received for U.S. Appl. No. 10/234,504 dated Oct. 18, 2006, 15 pages. |
| Final Office Action received for U.S. Appl. No. 10/234,504 dated Feb. 7, 2007, 12 pages. |
| Final Office Action received for U.S. Appl. No. 10/234,504 dated May 1, 2007, 12 pages. |
| Non-Final Office Action received for U.S. Appl. No. 10/162,314 dated Dec. 15, 2005, 17 pages. |
| Final Office Action received for U.S. Appl. No. 10/162,314 dated Jun. 5, 2006, 23 pages. |
| Non-Final Office Action received for U.S. Appl. No. 10/162,314 dated Nov. 16, 2006, 20 pages. |
| Final Office Action received for U.S. Appl. No. 10/162,314 dated Apr. 30, 2007, 35 pages. |
| Non-Final Office Action received for U.S. Appl. No. 10/162,314 dated Oct. 25, 2007, 28 pages. |
| Final Office Action received for U.S. Appl. No. 10/162,314 dated May 5, 2008, 31 pages. |
| Non-Final Office Action received for U.S. Appl. No. 10/161,848 dated Nov. 15, 2005, 15 pages. |
| Final Office Action received for U.S. Appl. No. 10/161,848 dated Mar. 27, 2006, 13 pages. |
| Non-Final Office Action received for U.S. Appl. No. 10/161,848 dated Sep. 5, 2006, 15 pages. |
| Final Office Action received for U.S. Appl. No. 10/161,848 dated Feb. 23, 2007, 17 pages. |
| Non-Final Office Action received for U.S. Appl. No. 10/161,848 dated May 7, 2007, 14 pages. |
| Final Office Action received for U.S. Appl. No. 10/161,848 dated Oct. 17, 2007, 15 pages. |
| Non-Final Office Action received for U.S. Appl. No. 10/161,848 dated Feb. 7, 2008, 14 pages. |
| Final Office Action received for U.S. Appl. No. 10/161,848 dated Sep. 9, 2008, 17 pages. |
| Non-Final Office Action received for U.S. Appl. No. 12/410,632 dated Feb. 1, 2011, 56 pages. |
| Final Office Action received for U.S. Appl. No. 12/410,632 dated May 17, 2011, 17 pages. |
| Non-Final Office Action received for U.S. Appl. No. 12/410,632 dated Sep. 2, 2011, 11 pages. |
| Non-Final Office Action received for U.S. Appl. No. 10/298,366 dated Apr. 20, 2006, 13 pages. |
| Final Office Action received for U.S. Appl. No. 10/298,366 dated Sep. 29, 2006, 16 pages. |
| Non-Final Office Action received for U.S. Appl. No. 10/298,366 dated Jan. 31, 2007, 12 pages. |
| Final Office Action received for U.S. Appl. No. 10/298,366 dated Jul. 18, 2007, 14 pages. |
| Non-Final Office Action received for U.S. Appl. No. 10/298,366 dated Dec. 17, 2007, 10 pages. |
| Non-Final Office Action received for U.S. Appl. No. 10/298,366 dated Jun. 11, 2008, 24 pages. |
| Final Office Action received for U.S. Appl. No. 10/298,366 dated Nov. 18, 2008, 20 pages. |
| Notice of Allowance received for U.S. Appl. No. 10/298,366 dated Feb. 2, 2009, 23 pages. |
| Non-Final Office Action received for U.S. Appl. No. 13/615,195, dated Aug. 19, 2014, 24 pages. |
| Communication pursuant to Article 96(2) EPC for EP Application Serial No. 03026339.6 dated Apr. 6, 2006, 6 pages. |
| Communication pursuant to Article 96(2) EPC for EP Application Serial No. 13166670.3 dated Dec. 14, 2018, 4 pages. |
| Chinese Third Office Action for Chinese Application No. 201410196114.8 dated Apr. 12, 2017, 25 pages (Including English Translation). |
| Chinese Fourth Office Action for Chinese Application No. 201410196114.8 dated Aug. 15, 2017, 24 pages (Including English Translation). |
| Chinese Second Office Action for Chinese Application No. 201410196198.5 dated Dec. 21, 2016, 10 pages (Including English Translation). |
| Chinese Third Office Action for Chinese Application No. 201410196198.5 dated Mar. 28, 2017, 10 pages (Including English Translation). |
| Chinese Second Office Action for Chinese Application No. 201410196525.7 dated Dec. 21, 2016, 8 pages (Including English Translation). |
| Chinese Second Office Action for Chinese Application No. 201410196775.0 dated Dec. 7, 2016, 8 pages (Including English Translation). |
| Chinese Third Office Action for CN Application Serial No. 201410196150.4, dated Nov. 29, 2017, 10 pages (Including English Translation). |
| Communication pursuant to Article 94(3) EPC for EP Application Serial No. 14167511.6 dated Jan. 23, 2019, 7 pages. |
| Communication pursuant to Article 94(3) EPC for EP Application Serial No. 14167703.9 dated Jan. 23, 2019, 6 pages. |
| Anonymous: “Hash function—Wikipedia”, Wikipedia, Apr. 19, 2009, URL:https://en.wikipedia.org/w/index.php?title=Hash_function&oldid=284890279, 9 pages. |
| Communication pursuant to Article 94(3) EPC for EP Application Serial No. 16160611.6 dated Apr. 5, 2017, 5 pages. |
| Communication pursuant to Article 94(3) EPC for EP Application Serial No. 16160611.6 dated May 10, 2017, 5 pages. |
| Second Office Action received for Chinese Patent Application Serial No. 201610151417.7 dated Jan. 22, 2019, 7 pages (Including English Translation). |
| Communication pursuant to Article 94(3) EPC for EP Application Serial No. 16160604.1 dated Jun. 13, 2017, 6 pages. |
| Summons to attend oral proceedings pursuant to Rule 115(1) EPC received for EP Patent Application Serial No. 14167706.2 dated Dec. 13, 2018, 65 pages. |
| Second Office Action received for Chinese Patent Application Serial No. 201410196150.4 dated Aug. 3, 2017, 10 pages (Including English Translation). |
| Extended European Search Report received for EP Patent Application Serial No. 16160610.8 dated Sep. 8, 2016, 9 pages. |
| Office Action for U.S. Appl. No. 14/658,345 dated May 13, 2019, 78 pages. |
| Office Action for U.S. Appl. No. 14/658,365 dated Jun. 3, 2019, 70 pages. |
| Non-Final Office Action received for U.S. Appl. No. 14/658,365 dated Mar. 23, 2017, 100 pages. |
| First Office Action received for Chinese Patent Application Serial No. 201410196150.4 dated Mar. 2, 2017, 22 pages (Including English Translation). |
| Final Office Action received for U.S. Appl. No. 14/087,970 dated Apr. 12, 2017, 59 pages. |
| Non-Final Office Action received for U.S. Appl. No. 14/658,394 dated Apr. 21, 2017, 97 pages. |
| Non-Final Office Action received for U.S. Appl. No. 15/388,260 dated Apr. 24, 2017, 101 pages. |
| Non-Final Office Action received for U.S. Appl. No. 14/658,345 dated Mar. 17, 2017, 95 pages. |
| Non-Final Office Action received for U.S. Appl. No. 14/658,327 dated May 1, 2017, 99 pages. |
| Examiner Answer to Appeal Brief received for U.S. Appl. No. 14/087,977, dated Feb. 1, 2017, 12 pages. |
| Givehchi et al., “Control-as-a-Service from the Cloud: A Case Study for using Virtualized PLCs,” 2014 10th IEEE Workshop on Factory Communication Systems (WFCS 2014), May 5, 2014 IEEE, 4 pages. |
| Non-Final Office Action received for U.S. Appl. No. 14/088,011 dated May 17, 2017, 57 pages. |
| Rouse et al., “Definition Industrial Control System (ICS)”, URL : http://whatis.techtarget.com/definition/industrial-control-system-ICS, whatis.techtarget.com, Jan. 11, 2017, 4 Pages. |
| Non-Final Office Action received for U.S. Appl. No. 14/087,730, dated Feb. 9, 2017, 78 pages. |
| Second Office Action received for Chinese Patent Application Serial No. 201410198289.2 dated Dec. 15, 2016, 37 pages (Including English Translation). |
| Second Office Action received for Chinese Patent Application Serial No. 201410196127.5 dated Nov. 30, 2016, 24 pages (Including English Translation). |
| Second Office Action received for Chinese Patent Application Serial No. 201410195780.X dated Feb. 3, 2017, 27 pages (Including English Translation). |
| Non-Final Office Action received for U.S. Appl. No. 14/087,821, dated Mar. 2, 2016, 86 pages. |
| Non-Final Office Action received for U.S. Appl. No. 14/087,977 dated Mar. 17, 2016, 93 pages. |
| Recursion Software, Inc., “SCADA-Aware Mobile”, URL: http://www.emsenergyautomation.com/brochures/scada.pdf, Aug. 29, 2012, 5 pages. |
| Ars Technica., “Windows 7 themes: how to unlock them or create your own”, URL : http://arstechnica.com/information-technology/2009/11/unlock-hidden-windows-7-themesl, Nov. 12, 2009, 7 pages. |
| Microsoft., “Sharing Outlook 2010 Contact\Notes/Field?”, microsoft.com, URL : http://answers.microsoft.com/en-us/office/forum/office 2010—outlook/sharing—outlook-2010-contactnotes-field/c7e74273-ff60-4da3-a3aa-ccb6cadcd25e?auth= 1, Jun. 23, 2011, 2 pages. |
| Notice of Allowance received for U.S. Appl. No. 13/608,850 dated Apr. 12, 2016, 37 pages. |
| Notice of Allowance received for U.S. Appl. No. 14/087,873 dated Apr. 18, 2016, 26 pages. |
| First Office Action received for Chinese Patent Application Serial No. 201410196198.5 dated Mar. 29, 2016, 28 pages (Including English Translation). |
| Non-Final Office Action received for U.S. Appl. No. 14/088,011 dated May 12, 2016, 96 pages. |
| First Office Action received for Chinese Patent Application Serial No. 201410198289.2 dated Apr. 5, 2016, 27 pages (Including English Translation). |
| First Office Action received for Chinese Patent Application Serial No. 201410196905.0 dated Apr. 5, 2016, 30 pages (Including English Translation). |
| First Office Action received for Chinese Patent Application Serial No. 201410196127.5 dated Apr. 7, 2016, 23 pages (Including English Translation). |
| First Office Action received for Chinese Patent Application Serial No. 201410196775.0 dated May 5, 2016, 19 pages (Including English Translation). |
| First Office Action received for Chinese Patent Application Serial No. 201410196525.7 dated May 5, 2016, 14 pages (Including English Translation). |
| Non-Final Office Action received for U.S. Appl. No. 13/615,195 dated Jun. 21, 2016, 27 pages. |
| Final Office Action received for U.S. Appl. No. 13/725,543 dated Jun. 17, 2016, 19 pages. |
| Non-Final Office Action received for U.S. Appl. No. 14/087,970 dated Jun. 17, 2016, 76 pages. |
| First Office Action received for Chinese Patent Application Serial No. 201410196114.8 dated Apr. 25, 2016, 30 pages (Including English Translation). |
| Communication pursuant to Article 94(3) EPC received for European Patent Application Serial No. 14167707.0 dated Sep. 22, 2015, 9 pages. |
| First Office Action received for Chinese Patent Application Serial No. 201410195780.X dated May 26, 2016, 19 pages (Including English Translation). |
| Final Office Action received for U.S. Appl. No. 14/087,977, dated Jul. 13, 2016, 59 pages. |
| Non-Final Office Action received for U.S. Appl. No. 14/087,922, dated Jul. 19, 2016, 120 pages. |
| Extended European Search Report for European Patent Application Serial No. 16160604.1, dated Aug. 17, 2016, 8 pages. |
| Extended European Search Report received for European Patent Application Serial No. 16160611.6 dated Aug. 24, 2016, 9 pages. |
| Final Office Action received for U.S. Appl. No. 14/087,730, dated Aug. 24, 2016, 113 pages. |
| Extended European Search Report received for European Patent Application Serial No. 16160602.5 dated Sep. 2, 2016, 9 pages. |
| “Cloud Computing”, Whatis.com, http://searchcloudcomputing.techtarget.com/sDefinition/O, Sid201_gci1287881,00.html, Oct. 27, 2009, 2 pages. |
| Mell et al., “The NIST Definition of Cloud Computing”, http://csrc.nist.gov/groups/SNS/cloud/Computing/index.html, Oct. 7, 2009, 2 pages. |
| Communication pursuant to Rule 69 EPC received for EP Patent Application Serial No. 16160611.6 dated Sep. 26, 2016, 2 pages. |
| Communication pursuant to Rule 69 EPC received for EP Patent Application Serial No. 13166670.3 dated Jul. 18, 2016, 2 pages. |
| Communication pursuant to Rule 69 EPC received for EP Patent Application Serial No. 16160604.1 dated Sep. 26, 2016, 2 pages. |
| Final Office Action received for U.S. Appl. No. 13/615,195 dated Oct. 21, 2016, 44 pages. |
| Final Office Action received for U.S. Appl. No. 14/088,011 dated Nov. 1, 2016, 79 pages. |
| Communication pursuant to Rule 69 EPC received for EP Patent Application Serial No. 16160610.8 dated Oct. 17, 2016, 2 pages. |
| Communication pursuant to Rule 69 EPC received for EP Patent Application Serial No. 16160602.5 dated Oct. 10, 2016, 2 pages. |
| Third Office Action received for Chinese Patent Application Serial No. 201610149635.7 dated Apr. 26, 2019, 23 pages (including English Translation). |
| Notice of Opposition received for EP Patent Application Serial No. 16160611.6 dated Apr. 11, 2019, 789 pages. |
| Wen et al., “Current Trends and Perspectives in Wireless Virtualization”, 2013 International Conference on Selected Topics in Mobile and Wireless Networking (MoWNeT), 2013, 6 pages. |
| Wang et al., “The Research of Chemical Plant Monitoring Base on the Internet of Things and 3D Visualization Technology”, Proceeding of the IEEE International Conference on Information and Automation, Aug. 2013, 5 pages. |
| Second Office Action received for Chinese Patent Application Serial No. 201410196114.8 dated Nov. 9, 2016, 35 pages (Including English Translation). |
| Second Office Action received for Chinese Patent Application Serial No. 201410196905.0 dated Nov. 18, 2016, 8 pages (Including English Translation). |
| Final Office Action received for U.S. Appl. No. 14/087,922 dated Nov. 25, 2016, 65 pages. |
| Extended European Search Report received for European Patent Application Serial No. 14167714.6 dated Aug. 11, 2014, 5 pages. |
| Extended European Search Report received for European Patent Application Serial No. 14167706.2 dated Aug. 11, 2014, 7 pages. |
| Extended European Search Report received for European Patent Application Serial No. 14167626.2 dated Aug. 11, 2014, 9 pages. |
| Extended European Search Report received for European Patent Application Serial No. 14167627.0 dated Aug. 11, 2014, 6 pages. |
| Extended European Search Report received for European Patent Application Serial No. 14167703.9 dated Aug. 11, 2014, 7 pages. |
| Extended European Search Report received for European Patent Application Serial No. 14167707.0 dated Aug. 11, 2014, 7 pages. |
| Extended European Search Report received for European Patent Application Serial No. 14167708.8 dated Aug. 11, 2014, 5 pages. |
| Extended European Search Report received for European Patent Application Serial No. 14167712.0 dated Aug. 11, 2014, 5 pages. |
| Extended European Search Report received for European Patent Application Serial No. 14167511.6 dated Aug. 11, 2014, 6 pages. |
| Non-Final Office Action received for U.S. Appl. No. 10/162,315 dated Dec. 27, 2004, 10 pages. |
| Final Office Action received for U.S. Appl. No. 10/162,315 dated Jun. 15, 2005, 11 pages. |
| Non-Final Office Action received for U.S. Appl. No. 10/162,315 dated Sep. 9, 2005, 22 pages. |
| Vasudevan, Venu, “A Web Services Primer”, URL: http://webservices.xml.com/pub/a/ws/2001/04/04/vebservices/index.html, XML.com, Apr. 4, 2001, 10 pages. |
| Non-Final Office Action received for U.S. Appl. No. 10/162,315 dated Mar. 6, 2006, 10 pages. |
| W3C, “Web Services Description Language (WSDL) 1.1”, URL: http://www.w3.org!TR/wsd1, W3C Note, Mar. 15, 2001, 36 pages. |
| European Search Report received for European Patent Application Serial No. 03026339.6 dated Apr. 6, 2004, 4 pages. |
| Compuquest Inc., “SPM-IM—Instant Messaging Client for SpreadMsg Wireless Messaging Software”, URL: http://www.Compuqueslinc.com/spmim.html, Aug. 13, 2002, 4 pages. |
| Compuquest Inc., “SpreadMsg Lite—Data Capture, Scanning, Extraction, & Rule Based Instant Messaging Software”, URL: http://web.archive.org/web/20020813080848/ http://www.compuqueslinc.com/spmsgl.html, retrieved on Jul. 21, 2006, 6 pages. |
| International Business Machines Corporation, “Cross platform instant messaging using web services”, Research Disclosure, Kenneth Mason Publications, vol. 458, No. 156, Jun. 2002, 3 pages. |
| Non-Final Office Action received for U.S. Appl. No. 13/725,578 dated Jun. 18, 2014, 13 pages. |
| Non-Final Office Action received for U.S. Appl. No. 13/615,195 dated Aug. 19, 2014, 22 pages. |
| Non-Final Office Action received for U.S. Appl. No. 13/725,543 dated Oct. 9, 2014, 10 pages. |
| Final Office Action received for U.S. Appl. No. 13/725,578 dated Dec. 12, 2014, 24 pages. |
| Final Office Action received for U.S. Appl. No. 13/615,195 dated Jan. 20, 2015, 22 pages. |
| Third Party Submission received for U.S. Appl. No. 14/087,873 dated Nov. 21, 2014, 26 pages. |
| Final Office Action received for U.S. Appl. No. 13/725,543 dated May 20, 2015, 15 pages. |
| Non-Final Office Action received for U.S. Appl. No. 13/608,821 dated Jun. 1, 2015, 44 pages. |
| Non-Final Office Action received for U.S. Appl. No. 13/608,850 dated Jun. 1, 2015, 38 pages. |
| Non-Final Office Action received for U.S. Appl. No. 13/677,060 dated Apr. 24, 2015, 54 pages. |
| Non-Final Office Action received for U.S. Appl. No. 13/725,619 dated Jul. 17, 2015, 45 pages. |
| Non-Final Office Action received for U.S. Appl. No. 13/725,660 dated Aug. 18, 2015, 131 pages. |
| Colombo et al., “Factory of the Future: A Service-oriented System of Modular, Dynamic Reconfigurable and Collaborative Systems”, Artificial Intelligence Techniques for Networked Manufacturing Enterprises Management, Springer Series in Advanced Manufacuring, 2010, pp. 459-481. |
| Colombo et al., “Towards the Factory of the Future: A Service-Oriented Cross-layer Infrastructure”, ICT Shaping the World: A Scientific View, 2009, pp. 65-81. |
| Notice of Allowance received for U.S. Appl. No. 13/725,578 dated Apr. 24, 2015, 23 pages. |
| Final Office Action received for U.S. Appl. No. 13/677,060 dated Oct. 20, 2015, 48 pages. |
| Non-Final Office Action received for U.S. Appl. No. 13/615,195 dated Sep. 21, 2015, 19 pages. |
| Final Office Action received for U.S. Appl. No. 13/725,660 dated Oct. 26, 2015, 79 pages. |
| Non-Final Office Action received for U.S. Appl. No. 14/087,873 dated Nov. 25, 2015, 59 pages. |
| Final Office Action received for U.S. Appl. No. 13/725,619 dated Dec. 4, 2015, 21 pages. |
| Final Office Action received for U.S. Appl. No. 13/608,821 dated Dec. 7, 2015, 39 pages. |
| Final Office Action received for U.S. Appl. No. 13/615,195 dated Feb. 11, 2016, 19 pages. |
| Non-Final Office Action received for U.S. Appl. No. 13/725,543 dated Feb. 2, 2016, 15 pages. |
| Non-Final Office Action received for U.S. Appl. No. 13/725,660 dated Jan. 21, 2016, 72 pages. |
| Final Office Action received for U.S. Appl. No. 13/608,850 dated Dec. 9, 2015, 25 pages. |
| Communication pursuant to Article 94(3) EPC received for European Patent Application Serial No. 14167706.2 dated Nov. 24, 2015, 8 pages. |
| Communication pursuant to Article 94(3) EPC received for European Patent Application Serial No. 14167626.2 dated Nov. 24, 2015, 8 pages. |
| Notice of Allowance received for U.S. Appl. No. 13/725,619 dated Mar. 31, 2016, 26 pages. |
| Non-Final Office Action received for U.S. Appl. No. 13/677,060 dated Mar. 10, 2016, 66 pages. |
| Notice of Allowance received for U.S. Appl. No. 13/725,660 dated Feb. 3, 2016, 47 pages. |
| Non-Final Office Action received for U.S. Appl. No. 14/087,730 dated Mar. 11, 2016, 81 pages. |
| Non-Final Office Action received for U.S. Appl. No. 15/714,333 dated Jul. 17, 2019, 113 pages. |
| Non-Final Office Action received for U.S. Appl. No. 14/658,394 dated Aug. 19, 2019, 70 pages. |
| First Office Action received for Chinese Patent Application Serial No. 201710778822.6 dated Jun. 24, 2019, 29 pages (Including English Translation). |
| Second Office Action received for Chinese Patent Application Serial No. 201710339669.7 dated Jul. 2, 2019, 20 pages (Including English Translation). |
| Final Office Action received for U.S. Appl. No. 15/714,333 dated Oct. 25, 2019, 35 pages. |
| Non-Final Office Action received for U.S. Appl. No. 15/970,932 dated Nov. 14, 2019, 122 pages. |
| Second Office Action received for Chinese Patent Application Serial No. 201710778822.6 dated Sep. 20, 2019, 5 pages. |
| Number | Date | Country | |
|---|---|---|---|
| 20170277171 A1 | Sep 2017 | US |
| Number | Date | Country | |
|---|---|---|---|
| 61821639 | May 2013 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 14088014 | Nov 2013 | US |
| Child | 15621206 | US |
