Patent Application
20210116141
The invention relates to a method and a mobile communication device for generating for a user augmented reality information related to an HVAC component.
HVAC systems often involve a plurality of HVAC components installed at different sites of a facility or a building. Typically, the HVAC components, such as valves and actuators, sensors, thermostats etc. are each controllable and exhibit varying states depending on operation of the HVAC component. For monitoring, controlling and maintenance purposes, it is therefore desired to obtain fast and efficient information on the status of each HVAC component in an HVAC system.
For regulating the operation of HVAC systems, remotely located central control systems, such as Building Automation Systems are typically used. However, on-site maintenance is regularly required, where field workers often face uncertainty about the identification of the respective HVAC component among the plurality of HVAC components in the HVAC system. HVAC components being installed in places with limited or barred accessibility may further impede fast identification and status verification. For example, an HVAC component may be installed within a duct or behind a wall and thus not be easy accessible or at least not visible to a field worker. Additionally, the HVAC component may be placed in an orientation where control elements on the HVAC components are difficult to activate manually. Therefore, ease of access for controlling operation of the HVAC components is likewise desired.
Recently, augmented reality technology has been considered as a versatile solution for enhanced interaction with real-world entities, such as electronic devices. Augmented reality is a term for the real-time use of computer-generated information in the form of text, graphics, audio and other virtual enhancements integrated with real-world objects. In particular, augmented reality can be used to add an interactive dimension to the real world by overlaying the computer-generated information together with accessible user interface elements to the real-world object.
It is an object of the invention to provide a method and a mobile communication device for generating for a user augmented reality information related to an HVAC component, which at least partially improves the prior art of controlling HVAC components of an HVAC system.
According to the present invention, these objects are achieved by the features of the independent claims. In addition, further advantageous embodiments follow from the dependent claims and the description.
According to an aspect of the invention, the object is particularly achieved by a method of generating for a user augmented reality information related to an HVAC component, the method comprising a circuit of a mobile communication device executing the following steps: obtaining a component identification of the HVAC component; generating the augmented reality information related to the HVAC component using the component identification, the augmented reality information including a displayable user interface element for initiating an operation of the HVAC component; displaying the augmented reality information on a display unit connected to the mobile communication device; and generating, responsive to activation of the user interface element, a control command for the operation of the HVAC component and transmitting the control command via a cloud-based computer system to the HVAC component, commanding the HVAC component to perform the operation and enabling the user to visually verify execution of the operation by the HVAC component.
The cloud-based computer system makes it possible that each HVAC component can be remotely monitored and controlled independently from the location of the user. Further, data and support regarding the HVAC system can be readily provided anywhere and at any time. However, for large HVAC systems including a plurality of HVAC components, it often occurs that a specific HVAC component is not actually installed as indicated and recorded in the cloud-based computer system, for example at the specific registered position, which hampers on-site inspection, as described above. The inventive method provides the advantage that the HVAC components connected to the cloud-based computer system can be inspected on-site by visually verifying the execution of an operation by the HVAC component initiated by a control command which is transmitted from the mobile communication device via the cloud-based computer system to the HVAC component. Generating the control command responsive to activation of the user interface element which is displayed within the augmented reality information, provides the advantage of ease of access for controlling operation of the HVAC component, independent of the actual physical accessibility of the HVAC component.
In particular, the inventive method allows to perform target/current-status comparison using verification of the execution of an operation due to a command transmitted via the cloud-based computer system and receiving direct feedback from the HVAC component.
Obtaining the component identification may be achieved visually, for example by way of a bar code, a QR code, LED data transfer or visible fiducial markers, wherein the bar code, QR code, the LED or the visible fiducial markers are arranged at the HVAC component.
In some embodiments, the component identification may be obtained non-visually, for example by using RFID technology, in particular NFC, Bluetooth or Li-Fi using an LED. Non-visual transmission of the component identification in case of Li-Fi using an LED is understood as the switching rate of the LED being too high for the human eye to be recognized.
In some embodiments, the component identification comprises login credentials for the user of the mobile communication device. Using the login credentials, the user of the mobile communication device may access the cloud-based computer system, for example for transmitting a control command via the cloud-based computer system to the HVAC component. The login credentials may be temporarily active such that access to the cloud-based computer system may be possible only during a limited time period.
In an embodiment, the method further comprises the circuit of the mobile communication device receiving current status information from the HVAC component, and generating augmented reality information which visualizes execution of the operation by the HVAC component, using the current status information, enabling visual verification of the operation of the HVAC component by the user when the HVAC component is not visible to the user.
For example, the HVAC component may be installed in a duct or behind wall. Further, the control command may be directed to an operation of the HVAC component for which the execution may not be externally visible, such as activating a sensor or interrupting a communication channel etc.
In an embodiment, the method further comprises the circuit of the mobile communication device locally generating and displaying additional HVAC component information within the augmented reality information. The additional HVAC component information may include information about specific properties of the HVAC component which may help for installing the HVAC component. The additional HVAC component information may be recorded in a storage of the mobile communication device after being received from the cloud-based computer system.
In an embodiment, the method further comprises the circuit of the mobile communication device receiving from the cloud-based computer system target status information of the HVAC component related to the control command, and generating augmented reality information using a comparison of current status information, received from the HVAC component, with the target status information of the HVAC component, received from the cloud-based computer system.
In particular, this enables a target/current-status comparison where the operation of the HVAC component is initiated by a user interface element which includes a degree of abstraction of the operation. For example, the user interface element may display an element “verify the connection of the HVAC component to the power supply”. For the activation of said user interface element, a variety of control commands may be generated in order to verify the supply of power to the HVAC component. For example, a control command to change the angle of the damper blade by a certain amount may be generated and transmitted via the cloud-based computer system to the HVAC component for verifying the supply of power to the HVAC component. Upon transmitting said control command, the mobile communication device may receive from the cloud-based computer system the target status information that the angle of the damper blade should be changed by the specific amount as defined by the control command. By comparing current status information about the current angle change of the damper blade with said target status information, augmented reality information may be generated allowing to verify the element “verify the connection of the HVAC component to the power supply”, as initiated by the user interface element.
In an embodiment, the method further comprises the circuit of the mobile communication device displaying within the augmented reality information a confirmation notification for a correspondence of the current status information and the target status information, and an error notification for a deviation of the current status information from the target status information.
In an embodiment, the method further comprises the circuit of the mobile communication device receiving from the cloud-based computer system lifetime information related to the HVAC component, and displaying the lifetime information within the augmented reality information.
The lifetime information may be used to display and indicate within the augmented reality information that the HVAC component has reached its end-of-life.
In an embodiment, the method further comprises the circuit of the mobile communication device generating an identification command, and transmitting the identification command to the HVAC component, the identification command commanding the HVAC component to generate the component identification.
This provides the advantage that the HVAC component is not required to generate the component identification continuously, but only upon transmission of the identification command to the HVAC component. For example, a Bluetooth module of the HVAC component may be activated only upon transmission of the identification command for generating the component identification.
In an embodiment, the method further comprises the circuit of the mobile communication device transmitting the identification command via the cloud-based computer system to the HVAC component.
In an embodiment, the method further comprises the circuit of the mobile communication device displaying within the augmented reality information a drilling template for drilling holes.
After installation of an HVAC component, it may be desirable to mount additional components in addition to the installed HVAC component. For this purpose, holes may be drilled, for example into a wall or a duct where the HVAC component is installed, in order to mount the additional component. Using the drilling template displayed within the augmented reality information provides the advantage that the field worker does not have to carry the drilling templates for the various HVAC components and additional components during on-site inspection.
According to a further aspect, the present invention is also directed to a mobile communication device for generating for a user augmented reality information related to an HVAC component, the mobile communication device comprising a circuit configured to obtain a component identification of the HVAC component; to generate the augmented reality information related to the HVAC component using the component identification, the augmented reality information including a displayable user interface element for initiating an operation of the HVAC component; to display the augmented reality information on a display unit connected to the mobile communication device; to generate, responsive to activation of the user interface element, a control command for the operation of the HVAC component, and to transmit the control command via a cloud-based computer system to the HVAC component to command the HVAC component to perform the operation; and to enable the user to visually verify execution of the operation by the HVAC component.
The mobile communication device may be for example a smartphone, a smart glass, a tablet PC etc.
In an embodiment, the circuit is further configured to receive current status information from the HVAC component, and to generate augmented reality information which visualizes execution of the operation by the HVAC component, and using the current status information, to enable visual verification of the operation of the HVAC component by the user when the HVAC component is not visible to the user.
In an embodiment, the circuit is further configured to receive from the cloud-based computer system target status information of the HVAC component related to the control command, and to generate augmented reality information using a comparison of current status information received from the HVAC component with the target status information of the HVAC component received from the cloud-based computer system.
In an embodiment, the circuit is further configured to display within the augmented reality information a confirmation notification for a correspondence of the current status information and the target status information, and an error notification for a deviation of the current status information form the target status information.
In an embodiment, the circuit is further configured to receive from the cloud-based computer system lifetime information related to the HVAC component and to display the lifetime information within the augmented reality information.
In an embodiment, the circuit is further configured to generate an identification command and to transmit the identification command to the HVAC component, the identification command commanding the HVAC component to generate the component identification.
In an embodiment, the circuit is further configured to transmit the identification command via the cloud-based computer system to the HVAC component.
In an embodiment, the circuit is further configured to display within the augmented reality information a drilling template for drilling holes.
According to a further aspect, the present invention is also directed to a computer program product comprising a non-transient computer readable medium having stored thereon computer program code configured to control a circuit of a mobile communication device such that the circuit executes the steps of: obtaining a component identification of an HVAC component; generating for a user augmented reality information related to the HVAC component using the component identification, the augmented reality information including a displayable user interface element for initiating an operation of the HVAC component; displaying the augmented reality information on a display unit connected to the mobile communication device; and generating, responsive to activation of the user interface element, a control command for the operation of the HVAC component, and transmitting the control command via a cloud-based computer system to the HVAC component, commanding the HVAC component to perform the operation and enabling the user to visually verify execution of the operation by the HVAC component.
The present invention will be explained in more detail, by way of example, with reference to the drawings, in which:
Upon obtaining the component identification of the HVAC component 2, the circuit of the mobile communication device 1 generates augmented reality information 12 using the component identification and displays the augmented reality information 12 on the display 11 of the mobile communication device 1. In the example as shown in
If the HVAC component 2 is installed as specified in the cloud-based computer system 3, the user may visually recognize execution of the operation by the HVAC component 2 in front of which he is standing. If the HVAC component 2 is not installed as specified in the cloud-based computer system 3, for example due to wrong wiring or broken cabling, the HVAC component 2 will not execute the operation as commanded via the cloud-based computer system 3 and this will be recognized visually by the user. If the HVAC component 2 is installed in a visible position and the operation commanded is directed to an operation which can be externally recognized, the user may verify the execution of the operation by eye.
Alternatively or additionally, the execution of the operation may be displayed within the augmented reality information 12, for example by a color code. For this purpose, the circuit of the mobile communication device 1 receives current status information from the HVAC component 2 in which execution of the operation may be encoded. The current status information is transmitted using the LED 21 in the shown example. In other embodiments, the current status information may be transmitted using a communication module of the HVAC component 2, for example a Bluetooth module. In the shown example, the image of the HVAC component 2, as shown within the augmented reality information 21, will be displayed in a specific first color, e.g. in green, if the mobile communication device 1 receives current status information from the HVAC component 2 which indicates that the commanded operation has successfully been executed. On the other hand, the image of the HVAC component 2, as shown within the augmented reality information 21, will be displayed in a specific second color, e.g. in red, if the current status information, received from the HVAC component 2, does not indicate successful execution of the commanded operation.
For example, the user interface element 121′ initiates a sensing of the flow in the duct 5′ over a time interval Δt. Using the Bluetooth module 21′, current status information of the HVAC component 2′, e.g. the sensed flow values in the duct 5′ during the time interval Δt can be directly received by the circuit of the mobile communication device 11′ allowing to verify correct installation or functioning of the HVAC component 2′ by the circuit of the mobile communication device 1′. The circuit of the mobile communication device 1′ receives from the cloud-based computer system a target status information of the HVAC component 2′ including an expected average flow for the duct 5′ and compares said expected average flow with a sensed average flow calculated from the sensed flow values, allowing to verify and visualize correct or erroneous functioning of the HVAC component 2′ within the augmented reality information 12′.
For not actually externally visible HVAC components, in particular, as shown in the example of
For the example as shown in
In some embodiments, however, the control command A is more general. For example, the control command A could be “check whether the power supply of the HVAC component 2″ is working”. In this case, the cloud-based computer system 3″ could translate the control command A into a control command B: “check whether the power supply of the HVAC component 2″ is working by turning the damper blade 23″ by an angle α”. The target status information as received from the cloud-based computer system 3″ is then “damper blade is rotated by the angle α” and the user can verify that the HVAC component 2″ is supplied with power by comparing the target status information with current status information from the HVAC component 2″ indicating whether the damper blade 23″ has in fact been rotated by α”. The confirmation notification could for example be “the HVAC component 2″ is correctly supplied with power”. Optionally, the confirmation notification within the augmented reality information could include the information: “This has been verified by rotating the damper blade 23″ by α”.
| Number | Date | Country | Kind |
|---|---|---|---|
| 00683/18 | May 2018 | CH | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/EP2019/062978 | 5/20/2019 | WO | 00 |
