Patent Grant
11237549
This application claims the benefit of and priority to U.S. Provisional Patent Application No. 62/729,272, filed Sep. 10, 2018, entitled “UTILIZATION EDGE MODULE SYSTEM AND METHOD” the entire contents of which are incorporated herein by reference.
The “Internet of Things” provides many advantages for many applications including process control. Industry increasingly depends upon highly automated data acquisition and control systems to ensure that industrial processes are run efficiently, safely and reliably while lowering their overall production costs. Data acquisition begins when sensors measure aspects of an industrial process and periodically report their measurements back to a data collection and control system. Such measurements come in a wide variety of forms. By way of example, the measurements produced by a sensor and/or recorder include: temperature, pressure, pH, mass and/or volume flow of material, a tallied inventory of packages waiting in a shipping line, and/or a photograph of a room in a factory. Sophisticated process management and control software examines the incoming data, produces status reports, and, in many cases, responds by sending commands to actuators and/or controllers that adjust the operation of at least a portion of the industrial process. The data produced by the sensors can also allow an operator to perform several supervisory tasks including: tailoring the process (e.g., specify new set points) in response to varying external conditions (including costs of raw materials), detecting an inefficient and/or non-optimal operating condition and/or impending equipment failure, and/or taking remedial actions, such as by moving equipment into and out of service as required.
Typical industrial processes are extremely complex and receive substantially greater volumes of information than any human could possibly digest in its raw form. By way of example, it is not unheard of to have thousands of sensors and control elements (e.g., valve actuators) monitoring and/or controlling aspects of a multi-stage process within an industrial plant. These sensors are of varied type and report on varied characteristics of the process. Their outputs are similarly varied in the meaning of their measurements, in the amount of data sent for each measurement, and in the frequency of their measurements. Regarding the latter, for accuracy and to enable quick response, some of these sensors and/or control elements take one or more measurements every second. Multiplying a single sensor and/or control element by thousands of sensors and/or control elements (a typical industrial control environment) results in an overwhelming volume of data flowing into the manufacturing information and process control system. Sophisticated data management and process visualization techniques have been developed to handle the large volumes of data generated by such systems.
Highly advanced human-machine interface and/or process visualization systems exist today that are linked to data sources such as the above-described sensors and controllers. Such systems acquire and digest (e.g., filter) the process data described above. The digested process data in-turn drives a graphical display rendered by a human machine interface. Examples of such systems are the well-known Wonderware INTOUCH® human-machine interface software system for visualizing and controlling a wide variety of industrial processes. The INTOUCH® HMI software empowers users to quickly and easily develop custom graphical views of their processes. Animated graphical images driven by constantly changing process data values within data streams are considerably easier for a human observer to comprehend than a stream of numbers. For this reason, process visualization systems, such as INTOUCH® software, have become key components of supervisory process control and manufacturing information systems.
However, conventional automated data acquisition and control systems are heavily dependent on cloud-based servers and databases that can cause latency delays, slow, intermittent, and/or disrupted connections. Hence, new systems could benefit from performing some equipment utilization analytics and other functions locally before sending data to a cloud platform using an “edge” computing architecture.
Some embodiments include a server system comprising a program logic tangibly stored on at least one non-transitory computer-readable storage medium that includes logic of at least one edge computing device configured to be coupled to a network. The network includes a cloud platform configured to receive utilization change events from a utilization module of the program logic. Some embodiments include at least one processor coupled to the non-transitory computer-readable storage medium, where upon execution of at least a portion of the program logic by the at least one processor, the at least one processor is configured to process steps of a method. In some embodiments, the steps include i). transmitting a plurality of attributes from the cloud platform to the at least one edge computing device, where the plurality of attributes can be associated with at least one device of a distributed environment coupled to the network. In some embodiments, the steps include ii). receiving from the utilization module, by the edge computing device, one or more current utilization data of the at least one device. In some further embodiments, the steps include iii). preparing and analyzing a comparison based on a set of rules or mappings of the plurality of attributes, by the at least one edge computing device, of the one or more current utilization data of the at least one device. In some other embodiments, the steps include iv). based on the comparison, sending, by the edge computing device, an update to a human-machine-interface module for display to at least one user.
In some embodiments, the at least one edge computing device includes software executable by a processor of the at least one edge computing device enabling the at least one edge computing device to perform operations locally when connected or disconnected from one or more portions of the network. In some embodiments, the operations include analyzing at least one operational characteristic of the at least one device of the distributed environment from data received into an edge cache of the at least one edge computing device, from the at least one device of the distributed environment.
In some embodiments, an edge logic of the at least one edge computing device includes human-machine-interface logic configured to generate a visual representation in a graphical user interface, where the visual representation includes a display of the one or more current utilization data.
In some embodiments, the network includes a historian module supporting data retrieval operations from the distributed environment including time-series data from the at least one device, where the time-series data comprises the one or more current utilization data.
In some embodiments, the one or more current utilization data comprises an operational characteristic of the at least one device of the distributed environment, and the at least one edge computing device includes logic configured to use at least a portion of the plurality of attributes determine a change in operational characteristic including a state and/or a reason code displayed by the human-machine-interface logic.
Some embodiments include a computer-implemented method comprising the steps of i). receiving, by at least one edge computing device, from a server processor of a cloud platform coupled to a network, a plurality of attributes associated with at least one device of a distributed environment coupled to the network. In some embodiments, the steps of the method include ii). receiving, by the edge computing device, one or more current utilization data of the at least one device. In some further embodiments, the steps of the method include iii). preparing and analyzing a comparison based on a set of rules or mappings of the plurality of attributes, by the at least one edge computing device, of the one or more current utilization data of the at least one device. In some other embodiments, the steps of the method include iv). based on the comparison, sending, by the edge computing device, an update to a human-machine-interface module for display to at least one user.
In some embodiments of the computer-implemented method, the one or more current utilization data are generated by one or more sensor devices measuring the one or more current utilization data from the at least one device of the distributed environment. In some further embodiments of the computer-implemented method, the plurality of attributes includes assigned behaviors including associated data values of the at least one device.
In some embodiments of the computer-implemented method, at least one of steps (ii), (iii), and (iv) operate at least once without an operable data connection between the at least one edge computing device and the cloud platform. In some further embodiments of the computer-implemented method, step (ii) is repeated following step (iv).
In some embodiments of the computer-implemented method, based on at least one identified operational aspect of at least one connection in the network, the plurality of attributes from the cloud platform are downloaded to the at least one edge computing device, and the one or more current utilization data of at least one device of the distributed environment are monitored by the at least one edge computing device regardless of the identified operational aspects of the at least one connection in the network.
In some embodiments of the computer-implemented method, the at least one edge computing device includes software executable by a processor of the at least one edge computing device enabling the at least one edge computing device to operate locally when connected or disconnected from one or more portions of the network.
In some embodiments of the computer-implemented method, the one or more current utilization data comprises an operational characteristic of the at least one device of the distributed environment, and the update comprises or is based on a state and/or a reason code.
In some embodiments of the computer-implemented method, the one or more current utilization data comprises a current operation or non-operation status or condition of the at least one device of the distributed environment.
In some embodiments of the computer-implemented method, the network includes a supervisory control and data acquisition (SCADA) system operationally coupled to the cloud platform and the distributed environment. In some embodiments of the computer-implemented method, the supervisory control and data acquisition (SCADA) system comprises a human-machine-interface logic generating a visual representation in a graphical user interface, the visual representation including a display of the one or more current utilization data. In some embodiments of the computer-implemented method, the at least one edge computing device includes the human-machine-interface logic.
In some embodiments of the computer-implemented method, the network includes a historian module supporting data retrieval operations from the distributed environment including time-series data from the at least one device, where the time-series data comprises the one or more current utilization data.
In some embodiments of the computer-implemented method, the at least one device of the distributed environment includes pressure sensors, temperature sensors, motion sensors, density sensors, weight sensors, viscosity sensors, accelerometers, servos, contactors, switches, limit switches, solenoids, motors, valves, heaters, heat exchangers, pumps, fans, boilers, turbines, generators, conveyors, augers, elevators, mills, drills, presses, and/or manufacturing equipment.
Before any embodiments of the invention are explained in detail, it is to be understood that the invention is not limited in its application to the details of construction and the arrangement of components set forth in the following description or illustrated in the following drawings. The invention is capable of other embodiments and of being practiced or of being carried out in various ways. Also, it is to be understood that the phraseology and terminology used herein is for the purpose of description and should not be regarded as limiting. The use of “including,” “comprising,” or “having” and variations thereof herein is meant to encompass the items listed thereafter and equivalents thereof as well as additional items. Unless specified or limited otherwise, the terms “mounted,” “connected,” “supported,” and “coupled” and variations thereof are used broadly and encompass both direct and indirect mountings, connections, supports, and couplings. Further, “connected” and “coupled” are not restricted to physical or mechanical connections or couplings.
The following discussion is presented to enable a person skilled in the art to make and use embodiments of the invention. Various modifications to the illustrated embodiments will be readily apparent to those skilled in the art, and the generic principles herein can be applied to other embodiments and applications without departing from embodiments of the invention. Thus, embodiments of the invention are not intended to be limited to embodiments shown, but are to be accorded the widest scope consistent with the principles and features disclosed herein. The following detailed description is to be read with reference to the figures, in which like elements in different figures have like reference numerals. The figures, which are not necessarily to scale, depict selected embodiments and are not intended to limit the scope of embodiments of the invention. Skilled artisans will recognize the examples provided herein have many useful alternatives and fall within the scope of embodiments of the invention.
Embodiments of the invention herein generally describe non-conventional approaches to systems and methods to data processing and management that are not well-known, and further, are not taught or suggested by any known conventional methods or systems. Moreover, the specific functional features are a significant technological improvement over conventional methods and systems, including at least the operation and functioning of a computing system that are technological improvements. These technological improvements include one or more aspects of the systems and methods described herein that describe the specifics of how a machine operates, which the Federal Circuit makes clear is the essence of statutory subject matter.
One or more of the embodiments described herein include functional limitations that cooperate in an ordered combination to transform the operation of a data repository in a way that improves the problem of data storage and updating of databases that previously existed. In particular, some embodiments described herein include system and methods for managing single or multiple content data items across disparate sources or applications that create a problem for users of such systems and services, and where maintaining reliable control over distributed information is difficult or impossible.
The description herein further describes some embodiments that provide novel features that improve the performance of communication and software, systems and servers by providing automated functionality that effectively and more efficiently manages resources and asset data for a user in a way that cannot effectively be done manually. Therefore, the person of ordinary skill can easily recognize that these functions provide the automated functionality, as described herein, in a manner that is not well-known, and certainly not conventional. As such, the embodiments of the invention described herein are not directed to an abstract idea and further provide significantly more tangible innovation. Moreover, the functionalities described herein were not imaginable in previously-existing computing systems, and did not exist until some embodiments of the invention solved the technical problem described earlier.
Some embodiments relate to improved processing and display of data in electronic devices including, for example, a computer or computer server (e.g., such as a computer system or server functioning as a manufacturing execution system) that provides a technological solution where users can more efficiently monitor processes, retrieve, process, and view useful data. Some embodiments include a system and methods for arranging, structuring, and transmitting data or datasets in a computer or computer server using one or more data or data streams. In some embodiments, the data or datasets can comprise one or more alarms, alerts, status update, and/or utilization data related to at least one asset.
Some embodiments include one or more methods operated by program logic executed by at least one processor of a computer system that can provide an environment that allows users to utilize a graphical user interface (GUI) to visualize data or blocks of data, monitor data and alarms, status updates, and utilization including one or more transitions to or from an alarm or alert state, and/or status change, and utilization update or change (e.g., such as those that may be received from the industrial process system comprising a distributed environment). In some embodiments, this information may be conveyed to a user in the form of text and/or graphics in the GUI. In some embodiments, the GUI may have a variety of icons indicating different event data, storage blocks, or snapshots, alarms status updates, and utilization.
Referring to
In some embodiments, an application interface of the network architecture 100 can be accessed by executing program logic to initialize an application object. For example, in some embodiments, a logic engine of the program logic can startup or shutdown an application object, and/or initiate a scheduled execution of a corresponding application code. In some embodiments, at least a portion of edge logic 150 can include the program logic that initializes an application, starts or shuts-down an application, and/or schedules an application, and/or attempts to initiate a data transfer protocol with at least one remote network (e.g., such as the cloud platform 120 and/or the distributed environment 110.
In some embodiments, an application interface of the network architecture 100 can be accessed by executing a bootstrap logic to initialize an application object. In some embodiments, an engine of the bootstrap logic can startup an application object, and/or initiate a scheduled execution of a corresponding application code. In some embodiments, at least a portion of edge logic 150 can include the bootstrap logic that initializes or starts an application, and/or schedules an application.
In some embodiments, the SCADA system 105 can present information to an operator or user about the utilization of a process such as one or more distributed assets including one or more distributed components of a process control and/or manufacturing information system of the aforementioned distributed environment 110. In some embodiments, the SCADA system 105 can manage and/or function as a human-machine interface (“HMI”) enabling intake and processing of an operators control instructions. In some embodiments, software instructions stored on a tangible, non-transitory media and executable by a processor can receive data indicative of a manufacturing/process control system being monitored, and display a user interface indicative of a status of the manufacturing/process control system being monitored where the status is based on the received data. In addition, some logic instructions can manage a display of graphic elements as part of the user interface, where one or more of the elements is associated with and indicative of a utilization and/or status (e.g., such as an alarm status, or a specific utilization, or fault) of one or more aspects of the manufacturing/process control system being monitored.
In some embodiments, program logic of the HMI can provide a graphical view/window representing a status or utilization of a process/plant, and/or a specific piece of equipment, and/or component, or portion thereof based upon information obtained via device integration and application objects from devices/controllers residing in the network. In some embodiments, a view engine can host individual or multiple HMI object instances corresponding to various configured process/facility views driven by information provided by, for example a connected device in the distributed environment 110.
Some embodiments include a historian module or modules 135 supporting an extensible set of advanced data retrieval operations. An example of such system is a Wonderware® historian that can collect time-series data values for observed parameters from a variety of data sources (e.g., from the distributed environment 110). The collected time-series data is thereafter deposited with the historian module or modules 135 to achieve data access efficiency and querying benefits/capabilities of the historian's database. Through its database, the historian module or modules 135 integrates plant data with event, summary, production and configuration information. A non-limiting example embodiment of the operational functions and characteristics of the historian module or modules 135 is described in more detail below.
In some embodiments, assets 121 are defined in the cloud platform 120 and are assigned behaviors which include the associated data value references, and the mappings to calculate the state and/or a reason code. In some embodiments, edge computing can be utilized to download asset, behaviors, rules and/or mappings from the configuration stored in the cloud platform, and continue to process data independently of the cloud platform. For example, in some embodiments, the cloud platform 120 can comprise a plurality of assets, such as assets 122, 124, and 126. For example, some embodiments include an “Internet of Things” (hereinafter “IoT”) equipment utilization capability within the distributed environment 110.
In some embodiments, the utilization module of the SCADA system 105 can monitor multiple sensor values from one or more devices 115 of the distributed environment 110, and using information stored in a cloud-based common intelligent model, the values can be used to determine either or both of an equipment state of one or more devices 115 of the distributed environment 110 (e.g., running or stopped), and the reason code (e.g., a reason code associated with a jam, film break, etc.). Some embodiments enable a transmission of a utilization event to the cloud platform 120 for further processing.
Some embodiments of the invention enable a local low or reduced latency generation of state events with reduced traffic to and/or from a cloud-based computing system such as the cloud platform 120. Further, some embodiments of the invention can operate and process data without internet connectivity. Some embodiments can enable continued use when connectivity fails, a cloud platform outage occurs, or as desired. For example, in some embodiments, at least a portion of the network architecture 100 can continue to function with a local low or reduced latency generation or without internet connectivity. In some embodiments, the system performance advantages can be enabled by a scalable edge computing capability within a distributed control environment.
Some embodiments include one or more edge computing devices 140, each of which can comprise an edge module. For example, some embodiments comprise at least one edge module 145 for local data processing. Further, some embodiments comprise at least one edge cache module 155 for local storage. In some embodiments, the at least one edge module 145 can comprise program logic tangibly stored on at least one non-transitory computer-readable storage medium. In some embodiments, at least one processor of the network architecture 100 can be coupled to the non-transitory computer-readable storage medium for execution of at least a portion of the program logic to operate a process, function, or method of the network architecture 100.
In some embodiments, an application interface of the network architecture 100 can be accessed by executing program logic to initialize an application object. For example, in some embodiments, a logic engine of the program logic can startup or shutdown an application object, and/or initiate a scheduled execution of a corresponding application code. In some embodiments, at least a portion of edge logic 150 can include the program logic that initializes an application, starts or shuts-down an application, and/or schedules an application, and/or attempts to initiate a data transfer protocol with at least one remote network (e.g., such as the cloud platform 120 and/or the distributed environment 110.
In some embodiments, an application interface of the network architecture 100 can be accessed by executing a bootstrap logic to initialize an application object. In some embodiments, an engine of the bootstrap logic can startup an application object, and/or initiate a scheduled execution of a corresponding application code. In some embodiments, at least a portion of edge logic 150 can include the bootstrap logic that initializes or starts an application, and/or schedules an application.
In some embodiments, the edge module 145 can download asset data from one or more of the assets 121, including, but not limited to tag data 122a, behavior data 122b, and rules or mappings data 122c. In some embodiments, the edge module 145 can download asset data from a plurality of assets, such as assets 122, 124, and 126 comprising the behavior and mappings from the configuration stored in the cloud platform 120. In some embodiments, once downloaded, the module can operate independently of the cloud platform 120 (e.g., disconnected) with only occasional connections needed to transmit the state changes.
Some embodiments of the invention comprise a common intelligent model, and/or a Wonderware® online component, for persistent configuration storage. For example, in some embodiments, the historian module or modules 135 support data retrieval operations and data sharing at least one of the edge modules 145. Some embodiments include AVEVA™ Insight software for visualization and manipulation of transmitted state changes. For example, some embodiments include integration with one or more modules of Wonderware® INTOUCH® software.
In some embodiments, at least a portion of the logic executable by a processor of the network architecture 100 includes a historian 135 communicatively coupled to the at least one distributed environment 110, where the historian 135 is configured to enable the user to receive, store, and transmit the data or data streams. In general, the historian can store (i.e., “historize”) various types of data related to at least one device or component of an industrial process. Some example data can include, but is not limited to, time-series data, metadata, event data, configuration data, raw time-series binary data, tag metadata, diagnostic log data, and the like. In some embodiments, the historian 135 can also be adapted to record trends and historical information about the industrial process for future reference. In some embodiments, the historian 135 can analyze process related data stored in an operational historian database and transform that data into timely reports that are communicated to one or more user devices. In this manner, an operational historian can filter (i.e., curate) data to raise the visibility of the data to users (e.g., via user devices). In some embodiments, the user devices can be embodied as mobile devices with a mobile application utilizing aspects of a browser-based display that can render data components including charts, trends, grids, etc.
In some embodiments, at least some program logic of the network architecture 100 can include a reporting service can be adapted to retrieve data from historian 135, detect patterns in the retrieved data, generate reports that include information about the detected patterns, and store the generated reports in the report repository, such as a database. In some embodiments, the reporting service may be provided as processor-executable instructions that comprise a procedure, a function, a routine, a method, and/or a subprogram utilized independently or in conjunction with additional aspects of network architecture 100 by computing device of the SCADA 105. In some embodiments, application specific reporting services can be based on a client application configuration, and/or the HMI of the SCADA 105 and/or the at least one edge computing device 140. In some further embodiments, the application specific reporting services can analyze incoming data using algorithms and to detect certain patterns (e.g., “pattern of interest”) and/or non-conformities in the data for reporting and/or for triggering an alarm and/or reporting a specific utilization. For example, some algorithms include statistical algorithms, machine learning algorithms, rules-based algorithms, mapping algorithm or rules, and the like, capable of detecting certain patterns.
In an example embodiment, a report or update, including any report or update processed by at least one edge computing device 140 can include text, graphics (e.g., graphs, images, etc.), and/or metadata, and/or one or more alarms or alarm data, and/or one or more utilization characteristics. In some embodiments, the reports may include the information about the detected patterns in a format that is amenable to the curating service and/or a format that is human-understandable when displayed via a display device and/or an HMI.
In some embodiments, a software module of the edge module 145 can download needed configuration data 190 from a cloud-based computer server or system, such as the cloud platform 120. In some embodiments, the software module can be assigned to one or more edge computing devices 140 even when those devices are offline. Some embodiments include a software module of the edge module 145 that can self-configure, and/or download itself to applicable one or more edge computing devices 140. Further, some embodiments include a software module of the edge module 145 that can operate locally and continue to function even if disconnected from one or more portions of the network architecture 100, including, but not limited to, the cloud platform 120. Some embodiments include a local low latency generation of utilization events with reduced traffic to the cloud platform 120.
In some embodiments, one or more edge computing devices 140 can couple to a network of the network architecture 100 using any fixed or mobile computing device that can be wired and/or wirelessly coupled to the Internet or through an Intranet and/or Ethernet, including, but not limited to, personal digital assistants, and/or cellular phones, mobile phones, or smart phones, and/or pagers, and/or digital tablets, and/or fixed or mobile internet appliances. In some embodiments, one or more components of the network architecture 100 can include numerous user devices which can be personal computers including for example desktop computers, laptop computers, digital assistants, personal digital assistants, cellular phones, mobile phones, smart phones, pagers, digital tablets, internet appliances, vehicular displays, wearable displays, virtual reality viewing devices such as virtual reality headsets, virtual reality glasses, and the like and other processor-based devices.
In some embodiments, data connections or transfers within the network architecture 100 can include one or more gateways, servers, and/or firewalls. For example, in some embodiments, a connection between one or more of edge modules 145 can include a gateway 175 and/or server 177. In some embodiments, any one or more of the connections and/or data transfers of the network architecture 100 can include a gateway 175 and/or server 177, and/or at least one firewall.
Referring to
With the above embodiments in mind, it should be understood that the invention can employ various computer-implemented operations involving data stored in computer systems. Moreover, the above-described databases and models described throughout can store analytical models and other data on computer-readable storage media within the system 210 and on computer-readable storage media coupled to the system 210. In addition, the above-described applications of the system can be stored on computer-readable storage media within the system 210 and on computer-readable storage media coupled to the system 210. These operations are those requiring physical manipulation of physical quantities. Usually, though not necessarily, these quantities take the form of electrical, electromagnetic, or magnetic signals, optical or magneto-optical form capable of being stored, transferred, combined, compared and otherwise manipulated. In some embodiments of the invention, the system 210 can comprise at least one computer readable medium 236 coupled to at least one data source 237a, and/or at least one data storage device 237b, and/or at least one input/output device 237c. In some embodiments, the invention can be embodied as computer readable code on a computer readable medium 236. In some embodiments, the computer readable medium 236 can be any data storage device that can store data, which can thereafter be read by a computer system (such as the system 210). In some embodiments, the computer readable medium 236 can be any physical or material medium that can be used to tangibly store the desired information or data or instructions and which can be accessed by a computer or processor 232. In some embodiments, the computer readable medium 236 can include hard drives, network attached storage (NAS), read-only memory, random-access memory, FLASH based memory, CD-ROMs, CD-Rs, CD-RWs, DVDs, magnetic tapes, other optical and non-optical data storage devices. In some embodiments, various other forms of computer-readable media 236 can transmit or carry instructions to a computer 240 and/or at least one user 231, including a router, private or public network, or other transmission device or channel, both wired and wireless. In some embodiments, the software modules 238 can be configured to send and receive data from a database (e.g., from a computer readable medium 236 including data sources 237a and data storage 237b that can comprise a database), and data can be received by the software modules 238 from at least one other source. In some embodiments, at least one of the software modules 238 can be configured within the system to output data to at least one user 231 via at least one graphical user interface rendered on at least one digital display.
In some embodiments of the invention, the computer readable medium 236 can be distributed over a conventional computer network via the network interface 235a where the system embodied by the computer readable code can be stored and executed in a distributed fashion. For example, in some embodiments, one or more components of the system 210 can be coupled to send and/or receive data through a local area network (“LAN”) 239a and/or an internet coupled network 239b (e.g., such as a wireless internet). In some further embodiments, the networks 239a, 239b can include wide area networks (“WAN”), direct connections (e.g., through a universal serial bus port), or other forms of computer-readable media 236, or any combination thereof.
In some embodiments, components of the networks 239a, 239b can include any number of user devices such as personal computers including for example desktop computers, and/or laptop computers, or any fixed, generally non-mobile internet appliances coupled through the LAN 239a. For example, some embodiments include at least one computer 240 coupled through the LAN 239a that can be configured for any type of user including an administrator. Other embodiments can include personal computers coupled through network 239b. In some further embodiments, one or more components of the system 210 can be coupled to send or receive data through an internet network (e.g., such as network 239b). For example, some embodiments include at least one user 231 coupled wirelessly and accessing one or more software modules of the system including at least one enterprise application 238 via an input and output (“I/O”) device 237c. In some other embodiments, the system 210 can enable at least one user 231 to be coupled to access enterprise applications 238 via an I/O device 237c through LAN 239a. In some embodiments, the user 231 can comprise a user 231a coupled to the system 210 using a desktop computer, and/or laptop computers, or any fixed, generally non-mobile internet appliances coupled through the internet 239b. In some further embodiments, the user 231 can comprise a mobile user 231b coupled to the system 210. In some embodiments, the user 231b can use any mobile computing device 231c to wireless coupled to the system 210, including, but not limited to, personal digital assistants, and/or cellular phones, mobile phones, or smart phones, and/or pagers, and/or digital tablets, and/or fixed or mobile internet appliances.
Any of the operations described herein that form part of the invention are useful machine operations. The invention also relates to a device or an apparatus for performing these operations. The apparatus can be specially constructed for the required purpose, such as a special purpose computer. When defined as a special purpose computer, the computer can also perform other processing, program execution or routines that are not part of the special purpose, while still being capable of operating for the special purpose. Alternatively, the operations can be processed by a general-purpose computer selectively activated or configured by one or more computer programs stored in the computer memory, cache, or obtained over a network. When data is obtained over a network the data can be processed by other computers on the network, e.g. a cloud of computing resources.
The embodiments of the invention can also be defined as a machine that transforms data from one state to another state. The data can represent an article, that can be represented as an electronic signal and electronically manipulate data. The transformed data can, in some cases, be visually depicted on a display, representing the physical object that results from the transformation of data. The transformed data can be saved to storage generally, or in particular formats that enable the construction or depiction of a physical and tangible object. In some embodiments, the manipulation can be performed by a processor. In such an example, the processor thus transforms the data from one thing to another. Still further, some embodiments include methods can be processed by one or more machines or processors that can be connected over a network. Each machine can transform data from one state or thing to another, and can also process data, save data to storage, transmit data over a network, display the result, or communicate the result to another machine. Computer-readable storage media, as used herein, refers to physical or tangible storage (as opposed to signals) and includes without limitation volatile and non-volatile, removable and non-removable storage media implemented in any method or technology for the tangible storage of information such as computer-readable instructions, data structures, program modules or other data.
For the purposes of this disclosure the term “server” should be understood to refer to a service point which provides processing, database, and communication facilities. A computing device may be capable of sending or receiving signals, such as via a wired or wireless network, or may be capable of processing or storing signals, such as in memory as physical memory states, and may, therefore, operate as a server. Thus, devices capable of operating as a server may include, as examples, dedicated rack-mounted servers, desktop computers, laptop computers, set top boxes, integrated devices combining various features, such as two or more features of the foregoing devices, or the like. By way of example, and not limitation, the term “server” can refer to a single, physical processor with associated communications and data storage and database facilities, or it can refer to a networked or clustered complex of processors and associated network and storage devices, as well as operating software and one or more database systems and application software that support the services provided by the server. Servers may vary widely in configuration or capabilities, but generally a server may include one or more central processing units and memory. A server may also include one or more mass storage devices, one or more power supplies, one or more wired or wireless network interfaces, one or more input/output interfaces, or one or more operating systems, such as a Microsoft® Windows® Server, Mac OS X, Unix, Linux, and/or any other conventional operating system.
For the purposes of this disclosure a “network” should be understood to refer to a network that may couple devices so that communications may be exchanged, such as between a server and a client device, peer to peer communications, or other types of devices, including between wireless devices coupled via a wireless network, for example. A network may also include mass storage, such as network attached storage (NAS), a storage area network (SAN), or other forms of computer or machine-readable media, for example. A network may include the Internet, one or more local area networks (LANs), one or more wide area networks (WANs), wire-line type connections, wireless type connections, cellular or any combination thereof. Likewise, sub-networks, which may employ differing architectures or may be compliant or compatible with differing protocols, may interoperate within a larger network. Various types of devices may, for example, be made available to provide an interoperable capability for differing architectures or protocols. As one illustrative example, a router may provide a link between otherwise separate and independent LANs. A communication link or channel may include, for example, analog telephone lines, such as a twisted wire pair, a coaxial cable, full or fractional digital lines including T1, T2, T3, or T4 type lines, “Integrated Services Digital Networks” (ISDNs), “Digital Subscriber Lines” (DSLs), wireless links including satellite links, or other communication links or channels, such as may be known to those skilled in the art. Furthermore, a computing device or other related electronic devices may be remotely coupled to a network, such as via a telephone line or link, for example.
For purposes of this disclosure, a “wireless network” should be understood to couple user or client devices with a network. A wireless network may employ stand-alone ad-hoc networks, mesh networks, wireless LAN (WLAN) networks, cellular networks, or the like. A wireless network may further include a system of terminals, gateways, routers, or the like coupled by wireless radio links, or the like, which may move freely, randomly or organize themselves arbitrarily, such that network topology may change, at times even rapidly. A wireless network may further employ a plurality of network access technologies, including “Long Term Evolution” (LTE), WLAN, wireless router (WR) mesh, or 2nd, 3rd, 4th, or 5th generation (2G, 3G, 4G, or 5G) cellular technology, or the like. Network access technologies may enable wide area coverage for devices, such as client devices with varying degrees of mobility, for example. For example, a network may enable RF or wireless type communication via one or more network access technologies, such as “Global System for Mobile communication” (GSM), “Universal Mobile Telecommunications System” (UMTS), “General Packet Radio Services” (GPRS), “Enhanced Data GSM Environment” (EDGE), 3GPP LTE, LTE Advanced, “Wideband Code Division Multiple Access” (WCDMA), Bluetooth®, 802.11b/g/n, or the like. A wireless network may include virtually any type of wireless communication mechanism by which signals may be communicated between devices, such as a client device or a computing device, between or within a network, or the like.
For purposes of this disclosure, a client (or consumer or user) device may include a computing device capable of sending or receiving signals, such as via a wired or a wireless network. A client device may, for example, include a desktop computer or a portable device, such as a cellular telephone, a smart phone, a display pager, a radio frequency (RF) device, an infrared (IR) device, a near field communication (NFC) device, a personal digital assistant (PDA), a handheld computer, a tablet computer, a phablet, a laptop computer, a set top box, a wearable computer, an integrated device combining various features, such as features of the forgoing devices, or the like.
A client device may vary in terms of capabilities or features, and claimed subject matter is intended to cover a wide range of potential variations. A web-enabled fixed or mobile device may include a browser application that is configured to receive and to send web pages, web-based messages, and the like. The browser application may be configured to receive and display graphics, text, multimedia, and the like, employing virtually any conventional web-based language. In some embodiments, one or more services of any of the systems described herein can be hosted/consumed in an HTML5 compatible browser. However, other embodiments can include wrapping the service up in a C #component that embeds the NVDEC decoder i.e. not use a browser control. In some embodiments, the service presents an API supporting zoom to/highlighting, and/or picking return of a selected tag identifier/name.
It is noted that the network architecture 100 depicted in
Although method operations can be described in a specific order, it should be understood that other housekeeping operations can be performed in between operations, or operations can be adjusted so that they occur at slightly different times, or can be distributed in a system which allows the occurrence of the processing operations at various intervals associated with the processing, as long as the processing of the overlay operations are performed in the desired way.
It will be appreciated by those skilled in the art that while the invention has been described above in connection with particular embodiments and examples, the invention is not necessarily so limited, and that numerous other embodiments, examples, uses, modifications and departures from the embodiments, examples and uses are intended to be encompassed by the description and claims herein.
| Number | Name | Date | Kind |
|---|---|---|---|
| 20090089231 | Baier et al. | Apr 2009 | A1 |
| 20090210814 | Agrusa et al. | Aug 2009 | A1 |
| 20140047107 | Maturana et al. | Feb 2014 | A1 |
| Number | Date | Country |
|---|---|---|
| 10-2017-0094232 | Aug 2017 | KR |
| 2017035536 | Mar 2017 | WO |
| Entry |
|---|
| International Search Report and Written Opinion for International Application No. PCT/US2019/050442, dated Dec. 27, 2019, 11 pages. |
| Number | Date | Country | |
|---|---|---|---|
| 20200081426 A1 | Mar 2020 | US |
| Number | Date | Country | |
|---|---|---|---|
| 62729272 | Sep 2018 | US |
