Patent Application
20200011696
The present disclosure relates generally to indoor wayfinding to equipment and infrastructure at a facility.
The equipment and infrastructure of a facility, such as that of a building, industrial space, manufacturing plant, warehouse, air liner, or cruise ship, can, in many cases, be purposefully hidden from view from occupants of the facility. This can be done for a variety of reasons. For example, components can be hidden to improve the aesthetics of the facility, to keep such components from being tampered with, and/or to minimize sounds from such components in spaces where occupants are present.
However, with these components hidden, it can be difficult for them to be located. For example, an HVAC service technician that is coming to the facility to perform service or diagnose a problem may need to access one or more boilers, heat pumps, vents, fans, duct work, etc. without being able to see the equipment or infrastructure because it is hidden behind a wall, hidden behind a false ceiling, or in a specialized space dedicated to such equipment or infrastructure.
Additionally, in some facilities there many be many of the same type of devices in close proximity (e.g., smoke detectors in a cafeteria. In such instances, it may be difficult to determine which detector was tripped based on an audible signal. Or, if providing service on the devices, it may be difficult to track which devices have been serviced and which have not. These issues can make service work or emergency response inefficient as the correct devices cannot be easily located.
Methods, systems, and devices for indoor wayfinding to equipment and infrastructure at a facility are described herein. For example, one method includes receiving an identifier associated with a piece of equipment or infrastructure within a facility, receiving location information associated with the location of the piece of equipment or infrastructure within the facility, receiving visual view data to produce a visual view of an area of the facility, and merging the identifier, the location information, and the visual view data to produce a visual view on a user interface of a computing device to communicate the location of the piece of equipment or infrastructure to a user of the computing device.
Accordingly, embodiments of the present disclosure can use sensor or stored data and/or a map database to determine the location of a device and direct a user to the location. For instance, embodiments of the present disclosure can be used in firefighting and facility equipment and infrastructure service, among other applications.
For example, the scope should include any building system functionality, that uses a device which is connected to a network associated with the facility. Systems can, for example, include: HVAC, fire detection, fire control, security sensing (including motion, sound, vibration, cameras, etc.), access control, and asset tracking, among others. Types of devices can include: HVAC, access control modules, fire alerting devices, fire detection devices, mass notification devices, elevators, lighting, conference room equipment, computing devices, advertising boards, ticketing machines, escalators, or other fixed or moving devices within a facility. Some examples of how such systems and devices can operate are discussed in more detail below.
In the following detailed description, reference is made to the accompanying drawings that form a part hereof. The drawings show by way of illustration how one or more embodiments of the disclosure may be practiced.
These embodiments are described in sufficient detail to enable those of ordinary skill in the art to practice one or more embodiments of this disclosure. It is to be understood that other embodiments may be utilized and that mechanical, electrical, and/or process changes may be made without departing from the scope of the present disclosure.
As will be appreciated, elements shown in the various embodiments herein can be added, exchanged, combined, and/or eliminated so as to provide a number of additional embodiments of the present disclosure. The proportion and the relative scale of the elements provided in the figures are intended to illustrate the embodiments of the present disclosure and should not be taken in a limiting sense.
The figures herein follow a numbering convention in which the first digit or digits correspond to the drawing figure number and the remaining digits identify an element or component in the drawing. Similar elements or components between different figures may be identified by the use of similar digits. For example, 102 may reference element “02” in
As used herein, “a” or “a number of” something can refer to one or more such things, while “a plurality of” something can refer to more than one such things. For example, “a number of sensor devices” can refer to one or more sensor devices, while “a plurality of sensor devices” can refer to more than one sensor device.
In some embodiments, an identifier can be associated with a piece of equipment or infrastructure. This can be accomplished by placing the sensor tag on or near the equipment or infrastructure component to be identified. This can be beneficial in already installed systems within a facility as the sensor tags can be installed after the system is in place. An identifier can also be associated by having identifier information integrated in the component, for example, at the time the component is manufactured.
As used herein, equipment is any device within that provides a function to the facility that may need to be located or serviced. For example, this may be needed by emergency response personnel or in requiring service from technicians. Infrastructure is other components that allow the equipment to function properly, such as valves, ducts, control panels, etc.
In the embodiment of
Sensor device 102 can be part of the existing infrastructure (e.g., the existing lighting, fire, security, and/or HVAC infrastructure) of the facility. For example, sensor device 102 may be installed (e.g., deployed) in the existing infrastructure of the facility in accordance with the applicable safety (e.g., UL) codes, and may be line powered from a loop circuit.
Although one (e.g., a single) sensor device 102 is illustrated in
For example, as shown in
Sensor device 102 can obtain (e.g., receive) an identifier and/or location data from equipment tags 104 and/or 106. The location data received from equipment tags 104 and/or 106 can indicate the current location of the item of equipment or infrastructure in the facility, respectively.
Sensor device 102 can receive the location data from equipment tags 104 and/or 106 via a first type of wireless communication. For example, sensor device 102 can receive the location data from equipment tag 104 via sub gigahertz (e.g., 900 megahertz) signals transmitted from equipment tag 104. These signals could also come via Bluetooth (e.g., BLE) or Wi-Fi signals, among other suitable communication formats.
Sensor device 102 can receive the location data from a number of locations including from a computing device in communication with the sensor device via the network connection or via equipment tags 104 and/or 106 using a communication module (e.g., a radio communication module), for example. For instance, the communication module can include a signal receiver that can receive the location data from equipment tags 104 and/or 106.
Sensor device 102 may obtain the sensed data by, for example, directly sensing the data using the sensing module or mechanism integrated in sensor device 102. As an additional example, sensor device 102 may receive the sensed data from sensor tags 108 and 110 illustrated in
Sensor tags 108 and 110 can be, for instance, an ultrasound sensor tag and an infrared sensor tag, respectively, located in the facility. Sensor device 102 can receive the sensed data from sensor tags 108 and 110 via wireless communication (e.g., via sub gigahertz signals transmitted by sensor tags 108 and 110) using the communication module (e.g., the signal receiver of the communication module).
Location data, and other equipment and infrastructure information, can be stored in one or more computing devices (e.g., devices 112 and 116). For example, this information can be stored in one or more data stores in memory on the computing device or a building information model can be stored on the device and the information can be contained in data stores related to that model.
In such embodiments, it may be necessary to convert the location data from the format in which it is stored for purposes of the building information model to its use in the visual view of embodiments of the present disclosure. For example, the location information maybe be presented in different coordinate systems, different Cartesian coordinate systems, have different offsets of origin, and/or different XY axis scaling.
For instance, the information may need to be converted from a building information model geometric object format to a vector format. Accordingly, one or more conversion algorithms may be needed to convert the location information from the building information model or other format that it has been stored in into an acceptable format for the embodiments of the present disclosure.
Upon receiving the information obtained from sensor device 102, computing device 112 can send (e.g., transmit) the information to computing device 116 via network 114 illustrated in
Network 114 can be a wired or wireless network. For example, network 114 can be a network relationship through which computing devices 112 and 116 can communicate. Examples of such a network relationship can include a distributed computing environment (e.g., a cloud computing environment), a wide area network (WAN) such as the Internet, a local area network (LAN), a personal area network (PAN), a campus area network (CAN), or metropolitan area network (MAN), among other types of network relationships. For instance, the network can include a number of servers that receive the information from computing device 112 and transmit the anomalous audio portion to computing device 116 via a wired or wireless network.
As used herein, a “network” can provide a communication system that directly or indirectly links two or more computers and/or peripheral devices and allows users to access resources on other computing devices and exchange messages with other users. A network can allow users to share resources on their own systems with other network users and to access information on centrally located systems or on systems that are located at remote locations. For example, a network can tie a number of computing devices together to form a distributed control network (e.g., cloud).
A network may provide connections to the Internet and/or to the networks of other entities (e.g., organizations, institutions, etc.). Users may interact with network-enabled software applications to make a network request, such as to get a file or print on a network printer. Applications may also communicate with network management software, which can interact with network hardware to transmit information between devices on the network.
Computing device 116 can use the information received from computing device 112 (e.g., the information obtained by sensor device 102) to provide software-based services for the facility. For example, computing device can use the information to run (e.g., address, enable, and/or operate) multiple facility management apps, such as, for instance, communication, sensing (e.g., space, environment, air quality, and/or noise sensing), location (e.g., real time location service and/or wayfinding), occupancy, equipment (e.g., asset) tracking, comfort control, energy management, fire and safety, fire system, security management, HVAC control, space utilization, labor productivity, and/or environmental monitoring applications.
In various embodiments, computing device 116 can use the information to run such applications as mobile apps on mobile device 118 via network 114 illustrated in
As an example, a location services application can use the information obtained by sensor device 102 to locate equipment (e.g., assets) in a facility, control HVAC equipment and lighting to achieve energy efficiency, and/or provide automatic navigation inside the facility for humans and/or machines such as wheel chair navigation to a destination or robots for building automation activities such as cleaning or delivery, among other uses.
As shown in
As shown in
The data communicated from mobile device 206 and sensor tags 208 and 210 to the sensor device can then be communicated from the sensor device to a computing device via wireless communication 228 illustrated in
The data can then be communicated from the computing device to an additional computing device via network 214 illustrated in
As shown in
Sensing module 332 may be used by sensor device 302 to sense data, as previously described in connection with
Computing device 412 can be, for example, a laptop computer, a desktop computer, or a mobile device. However, embodiments of the present disclosure are not limited to a particular type of computing device.
As shown in
For example, memory 444 can be a non-transitory computer readable medium having computer readable instructions (e.g., computer program instructions) stored thereon that are executable by processor 442 to perform various examples of the present disclosure. That is, processor 442 can execute the executable instructions stored in memory 444 to perform various examples of the present disclosure.
Memory 444 can be volatile or nonvolatile memory. Memory 444 can also be removable (e.g., portable) memory, or non-removable (e.g., internal) memory. For example, memory 444 can be random access memory (RAM) (e.g., dynamic random access memory (DRAM), resistive random access memory (RRAM), and/or phase change random access memory (PCRAM)), read-only memory (ROM) (e.g., electrically erasable programmable read-only memory (EEPROM) and/or compact-disk read-only memory (CD-ROM)), flash memory, a laser disk, a digital versatile disk (DVD) or other optical disk storage, and/or a magnetic medium such as magnetic cassettes, tapes, or disks, among other types of memory.
Further, although memory 444 is illustrated as being located in computing device 412, embodiments of the present disclosure are not so limited. For example, memory 444 can also be located internal to another computing resource (e.g., enabling computer readable instructions to be downloaded over the Internet or another wired or wireless connection).
Further, a communication module 446 may be used by computing device 412 to receive and send information, as previously discussed in connection with
In the implementation shown in
In
The user has also defined the area to be viewed by scaling the map shown at 556. In some embodiments, the user interface can suggest a viewing area for the user to view, for example, based on the selection made in 552.
In this example, the selection made in the choice area 552 of the fire system to view in the user interface results in the identification of a device 554 listed by its unique identifier in a system component list area 554. The identifier can be any suitable identifier and can be assigned by the user interface or can be an identifier that is already associated with the system component. As used herein, a system component is a piece of equipment or infrastructure of the facility that is part of a system of pieces of equipment or infrastructure that interact as a system to provide a particular functionality within the facility).
On the map, the location of the system component is shown at 560 and is identified by its identifier 558 which corresponds to the identifier in the list 554. The providing of the identifier can aid the user in finding the correct component, among other benefits.
The area shown in the map can be configured by the user, can be preset by the executable instructions that provide the user interface, or can be defined by executable instructions based on an analysis of the sensor data provided by the system components to identify where an issue (e.g., fire condition) may be present within the facility.
Information about the fire condition is shown at 662. This can contain any information that would be useful to the user in determining what to do with respect to this condition (e.g., send someone to investigate, check sensor status, reset the sensor or system, contact emergency response personnel).
Area 654 provides information about component 664-1, so that the user can better understand what fire condition information is being provided. The information can be anything that would be helpful to the user to understand the fire condition information better (e.g., component identifier, group identifier that this component belongs to, a location identifier, component type (e.g., smoke sensor, heat sensor, audible alarm, visual alarm), installation date, last test date, technician identifier (name, badge number), technician notes, component history, etc.).
In the embodiment of
Since the nearby components selection was made, the executable instructions define a viewing area to display around the location of the user at 770 and display the components (e.g., 768 shows one such component) within that area. The list area on the bottom of the left side lists all of the components in the area shown on the map. In some embodiments, the components shown may be from more than one system (e.g., all pieces of equipment and infrastructure that have identifiers).
In the embodiment of
The information provided in this example includes the component identifier, a sensor reading that may indicate the status of the component and/or location of the component (e.g., Temperature sensor reading of 225 degrees may indicate a faulty sensor or that a fire is present. Corroboration with other nearby sensors can confirm a fire condition.). The information box 778 also includes a button for the user to select to see more details about the component at 774 (which will be discussed in more detail below) and a button at 776 to initiate and determine a route and to see a route from the user's location to the location of the component.
The route can be calculated, for example, by determining the location of the user and the component and also the structures of the facility (e.g., walls) that may be in the way of a straight line route can be considered and the route can be adjusted accordingly. For example, the route can follow hallways within the facility that may not take the user in a straight line to the component.
In some implementations, the user's position with the facility can be updated, for example, based on sensor location data from the user's device. This updated information can then be used to update the location of the user on the map view. In some embodiments the updating can be done such that the location of the user on the map is current or nearly current with the actual location of the user device.
In the embodiment of
Such an embodiment can be helpful, for example, for use by technicians when entering an area and looking for components that may need service or diagnosis of an issue. It can also identify components of other systems that may be causing the issue but may not be included in the component list for the system the technician is working on.
The embodiment also includes a map view at 888. This may help the user identify where in the facility the area in the image is located. In some embodiments, the map view can include the user's location.
The information box can provide any suitable information that may be of benefit to the user when viewing the image. In the embodiment shown in
Although a VAV device is shown, it can be understood by the reader that the information provided in this illustration would be helpful to an operator of an HVAC system and the information provided is specialized to the needs of that functionality. Likewise, for components of other systems having other functionalities, the information provided on this type of visual view will be tailored to the needs of the operator of such a system and will be within the scope of the embodiments of this disclosure.
In
For the visual view, an image of the VAV device is provided. Such an image can be an image stored in memory and could be an illustration or an actual picture of the device taken by a technician and stored in memory.
In the example shown in
Additionally, the stage 1 status is shown at 1063 and indicates an ON condition and the stage 2 status is shown at 1059 and indicate an OFF condition. The supply temperature is also shown at 1061 and includes a sensor temperature value, a setpoint value, and a difference value.
Such information can be beneficial, for example, to a technician who is not familiar with the device or in keeping notes about the device so that when the technician returns to the device at a later date, they can refresh their recollection of the status of the device quickly.
Connected devices 1167 and 1169 are shown with details of their status and data that may be helpful to diagnose an issue being indicated by device 1171. With respect to component 1167, the information provided includes the component identifier, discharge temperature value, set point value, difference value between the discharge temperature value and the set point value, return temperature value, and location of the component. The information also includes buttons to access details about this component and a button to calculate a route to the component.
With respect to component 1169 the information provided includes the component identifier, fan status, supply temperature value, return temperature value, and location. The information also includes buttons to access details about this component and a button to calculate a route to the component.
The embodiments of the present disclosure can be used in many fields of technology. For example, some fields in which this concept would be suitable include:
For building maintenance:
For general office maintenance:
For commercial buildings
For Workshops
Provided below are several example embodiments that illustrate various aspects of the concepts of the present disclosure. A computing device embodiment can, for example, include a memory and a processor. The processor can be configured to execute executable instructions stored in the memory to: receive an identifier associated with a piece of equipment or infrastructure (e.g., identifier 558 from
The instructions can receive location information associated with the location of the piece of equipment or infrastructure within the facility. The location information can be GPS coordinates, can be based on triangulation with other devices within the facility, can be provided from a database of locations, or other suitable information to determine the location of the component.
The instructions can also receive visual view data to produce a visual view of an area of the facility. As discussed above, the visual view information can be map images stored in memory, map images created from map data stored in memory, images of areas stored in memory, images of areas taken by the user device and/or by imaging sensors, such as cameras located in the facility.
The instructions can merge the identifier, the location information, and the visual view data to produce a visual view (e.g., the right side views shown in
Further, in some embodiments, the instructions include instructions to receive status information about the piece of equipment or infrastructure and merge the status information with the identifier, the location information, and the visual view data to provide the status information to a user to enable the user to see the status of the piece of equipment or infrastructure. As used herein, status information can be any information that allows the user to determine the status of the piece of equipment or infrastructure or the status of the location at which the piece of equipment or infrastructure is located.
Examples include, an indication that the component of the system is operational, that the component is on, that a valve is open, a temperature reading from a sensor, or an alarm condition, among other data from which a status can be determined. An example of status indicators that could be used with a component providing fire detection functionality include: an alarm status, a warning status, a failure status, a replacement status, a service request status, for the piece of equipment or infrastructure provides a fire detection functionality.
In some embodiments, the instructions include instructions to receive user device location information that indicates the location of a user device within the facility. This information can be merged with the identifier, the location information, and the visual view data to provide the user device location information to a user to enable the user to see their location relative to the piece of equipment or infrastructure. For example, this merged information can be used to form a visual view as described in the figures.
As described with respect to the figures herein, in some embodiments, the instructions include instructions to calculate a route from the user device location to the location of the piece of equipment or infrastructure. This route information can then be analyzed with respect to the visual view data and the visual view of the route can be provided to a user. In some cases this can be in the form of a map with the route drawn on the map, text directions provided on the visual view or elsewhere on the user interface, a distance from the component, and/or a direction to the component, for example.
The computing device can also receive functionality information about the piece of equipment or infrastructure and merge the functionality information with the identifier, the location information, and the visual view data to provide the functionality information to a user to enable the user to see what one or more functions the piece of equipment or infrastructure provides to the facility. For example, functionality information can indicate the piece of equipment or infrastructure provides an HVAC functionality or a fire detection functionality.
Further, the computing device can also receive model information about the piece of equipment or infrastructure. The model information can then be merged with the identifier, the location information, and the visual view data to provide the model information to a user. The model information can, for example, include: model brand, model type, model identification number, number of connections to other pieces of equipment and infrastructure, type of connections to other pieces of equipment and infrastructure, for the piece of equipment or infrastructure provides a fire detection functionality, among other helpful information about the model of the component that would be useful to the user.
In some embodiments, the computing device can receive connection information about the piece of equipment or infrastructure. The connection information can be merged with the identifier, the location information, and the visual view data to provide the connection information to a user to enable the user to see how the piece of equipment or infrastructure is connected to other pieces of equipment or infrastructure within the facility.
An example of such a visual view is provided in
An example of a system embodiment includes: a piece of equipment or infrastructure within a facility and a user device carried by a user within the facility. At least one of the piece of equipment or infrastructure or the user device includes at least one of: a first data store having an identifier associated with the piece of equipment or infrastructure, a second data store having location information associated with the location of the piece of equipment or infrastructure within the facility, a third data store having visual view data to produce a visual view of an area of the facility on a user device, and a processor to execute instructions stored in memory to: merge the identifier, the location information, and the visual view data to produce a visual view on a user interface of the computing device to communicate the location of the piece of equipment or infrastructure to a user of the computing device.
In some embodiments, the system further includes a gateway device that communicates information from the piece of equipment or infrastructure within the facility to the user device. For example, computing device 112 of
In some embodiments, the gateway device communicates the information indirectly to the user device via a network connection (e.g., network 114 of
As discussed herein, the embodiments of the present disclosure can provide assistance in locating equipment and infrastructure within a facility. This can provide significant benefits to users of these embodiments as described herein.
Although specific embodiments have been illustrated and described herein, those of ordinary skill in the art will appreciate that any arrangement calculated to achieve the same techniques can be substituted for the specific embodiments shown. This disclosure is intended to cover any and all adaptations or variations of various embodiments of the disclosure.
It is to be understood that the above description has been made in an illustrative fashion, and not a restrictive one. Combination of the above embodiments, and other embodiments not specifically described herein will be apparent to those of skill in the art upon reviewing the above description.
The scope of the various embodiments of the disclosure includes any other applications in which the above structures and methods are used. Therefore, the scope of various embodiments of the disclosure should be determined with reference to the appended claims, along with the full range of equivalents to which such claims are entitled.
In the foregoing Detailed Description, various features are grouped together in example embodiments illustrated in the figures for the purpose of streamlining the disclosure. This method of disclosure is not to be interpreted as reflecting an intention that the embodiments of the disclosure require more features than are expressly recited in each claim.
Rather, as the following claims reflect, inventive subject matter lies in less than all features of a single disclosed embodiment. Thus, the following claims are hereby incorporated into the Detailed Description, with each claim standing on its own as a separate embodiment.
