Patent Application
20210231788
The embodiments herein relate to the field of presence detection, and specifically to a method and apparatus for detecting presence of objects using radar
Conventional human presence sensing have difficulty detecting humans when humans are not in motion but are indeed present in the scene as these sensors detect large motions to infer indirectly whether an area is occupied or not.
According to an embodiment, a method of detecting a presence of an object is provided. The method including: transmitting commissioning frequency-modulated continuous wave (FMCW) radar signals throughout an area using a FMCW radar system; mapping a commissioning image of the area using the commissioning FMCW radar signals; transmitting current FMCW radar signals throughout an area using the FMCW radar system; mapping a current image of the area using the current FMCW radar signals; detecting a difference between the current image and the commissioning image; identifying an object as the difference between the current image and the commissioning image; and determining an identity of the object.
In addition to one or more of the features described herein, or as an alternative, further embodiments may include that determining an identity of the object further include: identifying whether the object is an animate object or an inanimate object.
In addition to one or more of the features described herein, or as an alternative, further embodiments may include that identifying whether the object is an animate object or an inanimate object further include: determining whether the object is breathing.
In addition to one or more of the features described herein, or as an alternative, further embodiments may include that determining whether the object is breathing further include: detecting movements of the object using the current FMCW radar signals; determining the movements are periodic having a first frequency; and determining the first frequency is within the range of within range of respiratory rates.
In addition to one or more of the features described herein, or as an alternative, further embodiments may include that determining an identity of the object further include: determining the first frequency is within the range of human respiratory rates; and identifying the object as a human when the first frequency is within the range of human respiratory rates.
In addition to one or more of the features described herein, or as an alternative, further embodiments may include that determining an identity of the object further include: determining the first frequency is within the range of animal respiratory rates; and identifying the object as an animal when the first frequency is within the range of animal respiratory rates.
In addition to one or more of the features described herein, or as an alternative, further embodiments may include that identifying whether the object is an animate object or an inanimate object further includes: detecting movements of the object using the current FMCW radar signals; and identifying a gait of the object; and determining the object is animate in response to the gait.
In addition to one or more of the features described herein, or as an alternative, further embodiments may include determining a number of legs of the object using the current FMCW radar signals.
In addition to one or more of the features described herein, or as an alternative, further embodiments may include identifying the object as a human when the number of legs is two.
In addition to one or more of the features described herein, or as an alternative, further embodiments may include identifying the object as an animal when the number of legs is four.
According to another embodiment, a frequency-modulated continuous wave (FMCW) radar system is provided. The FMCW radar system including: a transceiver configure to transmit and receive frequency-modulated continuous wave (FMCW) radar signals; a processor; a memory including computer-executable instructions that, when executed by the processor, cause the processor to perform operations, the operations including: transmitting commissioning FMCW radar signals throughout an area; mapping a commissioning image of the area using the commissioning FMCW radar signals; transmitting current FMCW radar signals throughout an area using the FMCW radar system; mapping a current image of the area using the current FMCW radar signals; detecting a difference between the current image and the commissioning image; identifying an object as the difference between the current image and the commissioning image; and determining an identity of the object.
In addition to one or more of the features described herein, or as an alternative, further embodiments may include that determining an identity of the object further includes: identifying whether the object is an animate object or an inanimate object.
In addition to one or more of the features described herein, or as an alternative, further embodiments may include that identifying whether the object is an animate object or an inanimate object further includes: determining whether the object is breathing.
In addition to one or more of the features described herein, or as an alternative, further embodiments may include that determining whether the object is breathing further includes: detecting movements of the object using the current FMCW radar signals; determining the movements are periodic having a first frequency; and determining the first frequency is within the range of within range of respiratory rates.
In addition to one or more of the features described herein, or as an alternative, further embodiments may include that determining an identity of the object further include: determining the first frequency is within the range of human respiratory rates; and identifying the object as a human when the first frequency is within the range of human respiratory rates.
In addition to one or more of the features described herein, or as an alternative, further embodiments may include that determining an identity of the object further include: determining the first frequency is within the range of animal respiratory rates; and identifying the object as an animal when the first frequency is within the range of animal respiratory rates.
In addition to one or more of the features described herein, or as an alternative, further embodiments may include that identifying whether the object is an animate object or an inanimate object further includes: detecting movements of the object using the current FMCW radar signals; and identifying a gait of the object; and determining the object is animate in response to the gait.
In addition to one or more of the features described herein, or as an alternative, further embodiments may include that the operations further include: determining a number of legs of the object using the current FMCW radar signals.
In addition to one or more of the features described herein, or as an alternative, further embodiments may include that the operations further include: identifying the object as a human when the number of legs is two.
In addition to one or more of the features described herein, or as an alternative, further embodiments may include that the operations further include: identifying the object as an animal when the number of legs is four.
Technical effects of embodiments of the present disclosure include utilizing a frequency-modulated continuous wave (FMCW) radar system to detect changes between objects in the room in order to determine human presence.
The foregoing features and elements may be combined in various combinations without exclusivity, unless expressly indicated otherwise. These features and elements as well as the operation thereof will become more apparent in light of the following description and the accompanying drawings. It should be understood, however, that the following description and drawings are intended to be illustrative and explanatory in nature and non-limiting.
The present disclosure is illustrated by way of example and not limited in the accompanying figures in which like reference numerals indicate similar elements.
As shown in
The power supply 64 of the FMCW radar system 60 is configured to store and/or supply electrical power to the FMCW radar system 60. In one embodiment, the power supply 64 may be an electrical outlet that FMCW radar system 60 plugs into. In another embodiment, the power supply 64 may be a self-contained unit within the FMCW radar system 60 configured to store and/or generate electricity to power the FMCW radar system 60. The power supply 64 may include an energy storage system, such as, for example, a battery system, capacitor, or other energy storage system known to one of skill in the art. The power supply 64 may also generate electrical power for the FMCW radar system 60 using an energy harvesting system from power sources including but not limited to solar power, thermal energy, wind energy, kinetic energy, and salinity gradients. The power supply 64 may also include an energy generation or electricity harvesting system, such as, for example synchronous generator, induction generator, or other type of electrical generator known to one of skill in the art.
The FMCW radar system 60 includes a communication module 68 configured to allow the controller 62 of the FMCW radar system 60 to communicate with a remote system 82 through at least one of short-range wireless protocols 42 and long-range wireless protocols 44. Short-range wireless protocols 42 may include but are not limited to Bluetooth, Wi-Fi, HaLow (801.11ah), Wireless M-Bus, zWave, Zigbee. Long-range wireless protocol 44 may include but are not limited to cellular, LTE (NB-IoT, CAT M1), LoRa, Ingenu, SigFox, and Satellite.
The communication module 68 may be configured to communicate directly with the remote system 82 using short-range wireless protocols 42. Using short-range wireless protocols 42, the communication module 68 may be configured to transmit the data 48 to a local gateway device 94 (e.g., Wire-less Access Protocol (WAP) device) and the local gateway device 94 is configured to transmit the data 48 to a remote system 82 through a network 86 via either short-range wireless protocols 42 or long-range wireless protocol 44. The communication module 68 may be configured to communicate directly with the remote system 82 using long-range wireless protocols 44. The data 48 being transferred to the remote system 82 may include a command configured to control operation or suggest an adjustment to operation of the remote system 82.
The remote system 82 may be a building system, such as, for example, an HVAC system, an elevator system, fire alarm system, a security system, a video camera system, a light, lock, a door lock or any other building system known to one of skill in the art. In an embodiment, the remote system 82 is a lock and a locking mechanism of the lock is adjusted in response to the data 48. In another embodiment, the remote system 82 is an HVAC system and a compressor, fan, or furnace of the HVAC system is adjusted in response to the data 48. The remote system 82 generally includes a processor that controls the operation of the remote system 82 and an associated memory comprising computer-executable instructions that, when executed by the processor, cause the processor to perform various operations. The processor may be but is not limited to a single-processor or multi-processor system of any of a wide array of possible architectures, including field programmable gate array (FPGA), central processing unit (CPU), application specific integrated circuits (ASIC), digital signal processor (DSP) or graphics processing unit (GPU) hardware arranged homogenously or heterogeneously. The memory may be a storage device, such as, for example, a random access memory (RAM), read only memory (ROM), or other electronic, optical, magnetic or any other computer readable medium.
Referring now to
At block 208, current FMCW radar signals 90 are transmitted throughout an area using the FMCW radar system 60. At block 210, a current image of the area 18 is mapped using the current FMCW radar signals 90. The FMCW radar system 60 may use a fast Fourier transform to analyze the FMCW radar signals 90 and determine the distance between all the objects 10 located in the area 18 to generate the current image of the area 18. At block 212, a difference between the current image and the commissioning image may be detected by comparing the current image and the commissioning image. Advantageously, the difference between the current image and the commissioning image allows detecting a change in the area 18, such as the introduction of an object 10 into the area 18, without detecting motion directly. At block 214, an object 10 is identified as the difference between the current image and the commissioning image.
At block 216, an identity of the object 10 is determined. In a few examples, the identity of the object 10 may be an animate object 11, inanimate object 12, a human 20, or an animal 32. The method 200 may determine the object 10 to be an animate object 11 or an inanimate object 12 by determining whether the object 10 is breathing. If the object 10 is breathing, the object 10 is an animate object 11 whereas if the object 10 is not breathing the object 10 is an inanimate object 12. The method 200 may determine that the object 10 is breathing by detecting movements of the object 10 that are higher than a signal threshold under which the scene is regarded as static using the current FMCW radar signals 90; determining the movements are periodic having a first frequency; and determining the first frequency is within the range of respiratory rates. For example, the current FMCW radar signals 90 may detect that a chest 22 of a human 20 is moving in and out by showing a period change in the location of the chest 22 of the human 20. In another example, the current FMCW radar signals 90 may detect that a chest 36 of an animal 32 is moving in and out by showing a period change in the location of the chest 36 of the animal 32. Further, the animate object 11 may be identified to be a human 20 if the first frequency of the breathing is is within the range of human respiratory rates. Alternatively, the animate object 11 may be identified to be an animal 32 if the first frequency of the breathing is within the range of animal respiratory rates.
In another embodiment, the method 200 may determine that the object 10 to be an animate object 11 or an inanimate object 12 by determining whether the object 10 is moving. The FMCW system 60 can determine whether the object 10 is moving and animate by detecting movements of the object 10 using the current FMCW radar signals 90 and identifying a gait of the object 10. The FMCW system 60 can identify the animate object by determining a number of legs of the animate object 10 using the current FMCW radar signals 90. For example, an animate object 11 will show a change in position of the legs of the animate object 11 when the animate object 11 is walking. For example, the current FMCW radar signals 90 may detect that legs 24 of a human 20 moving by showing a change in the location of the legs 24 of the human 20. In another example, the current FMCW radar signals 90 may detect that legs 34 of an animal 32 moving by showing a change in the location of the legs 34 of the animal 32. The animate object 11 may be determined to be a human 20 when the number of legs detected is two. The animate object 11 may be determined to be an animal 32 when the number of legs is four.
The legs 24, 34 may be detected as follows: when an FMCW radar system 60 operates using a high sweeping bandwidth (e.g., >1 GHz), the range resolution of the FMCW radar system 60 allows for limbs of humans 20 or animals 32 to be separated in the FMCW signal's frequency domain. These limbs appear as motion tracks with associated periodicity. The motion tracks are detected and tracked by a multi-object tracking algorithm to decide the number of legs 24, 34 and their respective periodicity.
The method 200 may further include transmitting data 48 to the remote system 82 in response to an object 10 detected. For example, if a human 20 is detected in the area 18, the HVAC system may be adjusted accordingly. In another example, if a human 20 is detected in a restricted access high-security area (e.g., banks, prisons, nuclear sites, military bases, research facilities, etc.) then an alarm may be activated indicating that a human is present in the restricted access high-security area.
While the above description has described the flow process of
The term “about” is intended to include the degree of error associated with measurement of the particular quantity and/or manufacturing tolerances based upon the equipment available at the time of filing the application.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the present disclosure. As used herein, the singular forms “a”, “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprises” and/or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, element components, and/or groups thereof.
Those of skill in the art will appreciate that various example embodiments are shown and described herein, each having certain features in the particular embodiments, but the present disclosure is not thus limited. Rather, the present disclosure can be modified to incorporate any number of variations, alterations, substitutions, combinations, sub-combinations, or equivalent arrangements not heretofore described, but which are commensurate with the scope of the present disclosure. Additionally, while various embodiments of the present disclosure have been described, it is to be understood that aspects of the present disclosure may include only some of the described embodiments. Accordingly, the present disclosure is not to be seen as limited by the foregoing description, but is only limited by the scope of the appended claims.
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/US2019/040768 | 7/8/2019 | WO | 00 |
| Number | Date | Country | |
|---|---|---|---|
| 62697503 | Jul 2018 | US |
