The present disclosure is generally related to wireless motion detection using multiband filters; more specifically, the present disclosure is related to the use of notch and low-pass filters to filter out unwanted signals in a wireless motion detection system.
Motion detection is the process of detecting a change in the position of an object relative to its surroundings or a change in the surroundings relative to an object. Motion detection is usually a software-based monitoring algorithm which, for example when it detects motions will signal the surveillance camera to begin capturing the event. An advanced motion detection surveillance system can analyze the type of motion to see if it warrants an alarm.
Wi-Fi location determination, also known as Wi-Fi localization or Wi-Fi location estimation refers to methods of translating observed Wi-Fi signal strengths into locations. A radio map consisting of sets of metadata containing information about the frequency response of the channel, and/or phase response of the channel, and/or impulse response of the channel, and/or received signal strength indicators (RSSI), and/or any other statistic that describes the wireless communication link between paired devices is stored as a profile to be compared later to a signal scan to recognize the location of the device doing the scanning.
Embodiments of the present invention provide for filtering out unwanted signals in a wireless motion detection system. The system includes a wireless access point, an agent, a cloud network, a low-pass filter, and a notch filter. The low-pass can be on either the cloud or on the wireless access point. The notch filter can be on either the cloud or on the wireless access point. The band-stop or notch filter is implemented and works in real-time and rejects most of the energy of low-frequency variations which could cause a false positive (FP) in a wireless motion detection system, while preserving the most important components in H at DC and above 0.5 Hz. The low-pass or 2D filter rejects most of the energy of high-frequency variations which could cause a FP in a wireless motion detection system, while preserving the most important parts of motion information in H below 5 Hz. Both filters contribute to a practical motion detection system which is expected to have zero FPs related to low and high frequency variations in H, while keeping the sensitivity of the motion/intrusion detection.
A wireless motion detection system is provided which uses a sharp band-stop and low-pass filters to reject unwanted low and high frequency components of a signal in the CSI. A gap in the frequency domain is caused by taking the absolute value of the signal when using the absolute value of channel matrix H∨ for motion detection. A sharp band-stop (notch) filter is used to reject any unwanted signals that have significant components in this gap. A low-pass filter is used to reject all unwanted signal after the motion highest frequency.
A central processing unit (CPU) 104 is the electronic circuitry within a computer that carries out the instructions of a computer program by performing the basic arithmetic, logic, controlling and input/output (I/O) operations specified by the instructions. A graphics processing unit (GPU) 106 is a specialized electronic circuit designed to rapidly manipulate and alter memory to accelerate the creation of images in a frame buffer intended for output to a display device. GPUs 106 are used in embedded systems, mobile phones, personal computers, workstations, and game consoles. Modern GPUs 106 are very efficient at manipulating computer graphics and image processing. Their highly parallel structure makes them more efficient than general-purpose CPUs for algorithms that process large blocks of data in parallel. A digital signal processor (DSP) 108 is a specialized microprocessor (or a SIP block), with its architecture optimized for the operational needs of digital signal processing. The DSP 108 may measure, filter or compress continuous real-world analog signals. An application program interface (API) 110 is a set of routines, protocols, and tools for building software applications. The API 110 specifies how software components should interact. APIs 110 are used when programming graphical user interface (GUI) components. The API 110 provides access to the channel state data to the agent 114. A wireless access point 102 compliant with either 802.11ac or above, using the stock omnidirectional antenna on a radio 112 might have a range of 100 m (0.062 mi). The radio 112, with an external semi parabolic antenna (15 dB gain) with a similarly equipped receiver at the far end, may have a range over 20 miles.
An agent 114 is a device or module configured to collect data from the Wi-Fi chipset of wireless access point 102, filter the incoming data then feed and pass it to the cloud server 126 for activity identification. Depending on the configuration, the activity identification can be done on the edge, at the agent 114 level, or in the cloud server 126, or some combination of the two. A local profile database 116 is utilized when at least a portion of the activity identification is done on the edge. This could be a simple motion/no-motion determination profile, or a plurality of profiles for identifying activities, objects, individuals, biometrics, etc. An activity identification module 118 distinguishes between walking activities and in-place activities. A walking activity causes significant pattern changes of the CSI amplitude over time, since it involves significant body movements and location changes. In contrast, an in-place activity (e.g., watching TV on a sofa) only involves relative smaller body movements and will not cause significant amplitude changes but presents certain repetitive patterns within the CSI measurements. A filter 120 is a device or process that removes some unwanted components or features from a signal. Filtering is a class of signal processing, the defining feature of filters being the complete or partial suppression of some aspect of the signal. Most often, this means removing some frequencies or frequency bands. These filters 120 can be on the agent 114, the cloud server 126, the wireless access point 102 or on all of them. A low-pass filter (LPF) 122 is a filter that passes signals with a frequency lower than a selected cutoff frequency and attenuates signals with frequencies higher than the cutoff frequency. The exact frequency response of the LPF 122 depends on the filter design. A notch filter 124 is a band-stop filter or band-rejection filter which is a filter that passes most frequencies unaltered but attenuates those in a specific range to very low levels. It is the opposite of a band-pass filter. A notch filter 124 is a band-stop filter with a narrow stopband (high Q factor).
A cloud server 126 analyzes and creates profiles describing various activities. The profile module 132 monitors the data set resulting from continuous monitoring of a target environment, to identify multiple similar instances of an activity without a matching profile in such a data set, combine that data with user feedback to label the resulting clusters to define new profiles that are then added to the profile database 128. A profile database 128 is utilized when at least a portion of the activity identification is done in the cloud server 126. This could be a simple motion/no-motion determination profile, or a plurality of profiles for identifying activities, objects, individuals, biometrics, etc. A device database 130 stores the device ID of all connected wireless access points 102.
Motion detection systems that employ wireless signals to infer human motion can have false motion detection, or false positives (FP). These artifacts or disturbances may occur due to intrinsic or extrinsic reasons, including but not limited to automatic power control in transmitter or receiver side of the wireless connection. Under certain circumstances, these unwanted changes can extremely affect the channel state information (CSI) signals (or equivalently channel matrix H) such that these distortions can be misclassified as actual human motions. In the context of the systems and methods proposed herein, CSI is taken as an example of channel frequency and phase responses regulated by IEEE 802.11ac or above. This example shall not limit the scope of the approaches presented herein.
A channel matrix H is comprised of CSI information for different frequency sub-bands, herein called sub-carriers, in one dimension, and different times, herein referred to as samples or packets, in the other dimension.
Different timely variations, including intended variation such as human physical motion and unintended variations such as artifacts mentioned above, affect the CSI signals with different frequencies over time. The unwanted variations could be slow or fast changing, herein associated with terms low-frequency and high-frequency variations, respectively.
Given the fact that human physical motion can only happen within a certain frequency range, the proposed system analyzes the frequency components of all temporal variations of recorded CSI signals to distinguish intended and unintended frequency bands.
A sharp notch filter 124 could be used for rejecting the unwanted low-frequency components in the CSI. When taking the absolute value of a signal, for instance a single sinusoid sin(ω), its absolute value sin(ω)∨√(1−cos((2ω)/2) has frequency components in DC and is equal or greater than twice the original frequency. The gap in the frequency domain is caused by taking the absolute value of the signal. A sharp notch filter 124 may be used to reject any unwanted signal which has significant components in this gap, when using the absolute value of channel matrix H∨ for motion detection. The notch filter 124 removes the artifacts caused by low-frequency variations such as step pulses in |H| (i.e., absolute values of H).
A LPF 122 could be used to reject high frequency unwanted signal in CSI. The highest frequency in human motion, disrupting a wireless signal, is a function of motion velocity and the carrier frequency. The LPF 122 could be used to reject all unwanted signal after the motion highest frequency.
In
In order to have a LPF 122 with minimum delay (i.e., minimum filter taps) and proper rejection of high frequency unwanted (i.e., spurious) signal at the same time, the FIR filter designed by Kaiser window may be used. Kaiser window has two degrees of freedom, letting both the transition width (i.e., sharpness) and outband loss (i.e., rejection) to be controlled. In order to completely preserve motion band with a rather low-order filter, it is necessary to choose the cut-off frequency greater than the ideal case.
For an IIR notch filter 124 with the transfer function
the real time implementation could be easily realized using the below differential equation
A LPF 122 could be implemented in real-time using convolution. In case of the H matrix, it is a good practice to use two-dimensional filtering to filter out unwanted signal in both time and sub-carrier domain. Consider a N×N two-dimensional filter h, each row of which the same coefficients of the Nth order low-pass filter. Two-dimensional convolution of filter h and input x is described by
y[k,n]=ΣpΣqh[p,q]x[k−p+1,n−q+1] (3)
where k and p are sub-carrier index and n and q are time index.
The notch filter 124 is used for the purpose of FP elimination. In one example, the notch filter 124 is a 2nd order band-stop Bessel filter with f_low=0.15 Hz and f_high=0.5 Hz.
The present invention may be implemented in an application that may be operable using a variety of devices. Non-transitory computer-readable storage media refer to any medium or media that participate in providing instructions to a central processing unit (CPU) for execution. Such media can take many forms, including, but not limited to, non-volatile and volatile media such as optical or magnetic disks and dynamic memory, respectively. Common forms of non-transitory computer-readable media include, for example, a floppy disk, a flexible disk, a hard disk, magnetic tape, any other magnetic medium, a CD-ROM disk, digital video disk (DVD), any other optical medium, RAM, PROM, EPROM, a FLASHEPROM, and any other memory chip or cartridge.
Various forms of transmission media may be involved in carrying one or more sequences of one or more instructions to a CPU for execution. A bus carries the data to system RAM, from which a CPU retrieves and executes the instructions. The instructions received by system RAM can optionally be stored on a fixed disk either before or after execution by a CPU. Various forms of storage may likewise be implemented as well as the necessary network interfaces and network topologies to implement the same.
The foregoing detailed description of the technology has been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit the technology to the precise form disclosed. Many modifications and variations are possible in light of the above teaching. The described embodiments were chosen in order to best explain the principles of the technology, its practical application, and to enable others skilled in the art to utilize the technology in various embodiments and with various modifications as are suited to the particular use contemplated. It is intended that the scope of the technology be defined by the claim.
The present application claims the priority benefit of U.S. Provisional Patent Application No. 62/809,436 filed Feb. 22, 2019 and titled “Wireless Motion Detection Using Multiband Filters,” the disclosure of which is incorporated by reference in its entirety.
Number | Name | Date | Kind |
---|---|---|---|
8073441 | Unger et al. | Dec 2011 | B1 |
8461988 | Tran | Jun 2013 | B2 |
8864663 | Kahn | Oct 2014 | B1 |
9219790 | Filev et al. | Dec 2015 | B1 |
9414115 | Mao et al. | Aug 2016 | B1 |
9703892 | Ramer et al. | Jul 2017 | B2 |
9854292 | Matthews et al. | Dec 2017 | B1 |
9867548 | Le et al. | Jan 2018 | B2 |
9985846 | Roman et al. | May 2018 | B1 |
10045191 | Nguyen et al. | Aug 2018 | B2 |
10374646 | Fletcher | Aug 2019 | B1 |
10419880 | Long et al. | Sep 2019 | B1 |
10818384 | Peterson et al. | Oct 2020 | B1 |
10999705 | Martinez | May 2021 | B2 |
11017688 | Arazi | May 2021 | B1 |
11039278 | Carreiro et al. | Jun 2021 | B1 |
11082109 | Martinez | Aug 2021 | B2 |
11218769 | Martinez | Jan 2022 | B2 |
11448726 | Martinez | Sep 2022 | B2 |
11523253 | Martinez | Dec 2022 | B2 |
11586952 | Martinez | Feb 2023 | B2 |
11593837 | Martinez | Feb 2023 | B2 |
11611382 | Martinez | Mar 2023 | B2 |
20020188668 | Jeffery | Dec 2002 | A1 |
20060224938 | Fikes et al. | Oct 2006 | A1 |
20070024580 | Sands et al. | Feb 2007 | A1 |
20070266395 | Lee et al. | Nov 2007 | A1 |
20080262909 | Li et al. | Oct 2008 | A1 |
20100242063 | Slaney et al. | Sep 2010 | A1 |
20110029277 | Chowdhary et al. | Feb 2011 | A1 |
20110117924 | Brunner et al. | May 2011 | A1 |
20110129047 | Mashino | Jun 2011 | A1 |
20110258039 | Patwa et al. | Oct 2011 | A1 |
20120053472 | Tran | Mar 2012 | A1 |
20120135733 | Cormier et al. | May 2012 | A1 |
20120289147 | Raleigh et al. | Nov 2012 | A1 |
20120324494 | Burger et al. | Dec 2012 | A1 |
20130014136 | Bhatia et al. | Jan 2013 | A1 |
20130028443 | Pance et al. | Jan 2013 | A1 |
20130053990 | Ackland | Feb 2013 | A1 |
20130076528 | Boettner | Mar 2013 | A1 |
20130102256 | Cendrillon | Apr 2013 | A1 |
20130115974 | Lee et al. | May 2013 | A1 |
20130326554 | Shkedi | Dec 2013 | A1 |
20140033240 | Card et al. | Jan 2014 | A1 |
20140181100 | Ramer et al. | Jun 2014 | A1 |
20140223467 | Hayton et al. | Aug 2014 | A1 |
20140278389 | Zurek | Sep 2014 | A1 |
20140358012 | Richards et al. | Dec 2014 | A1 |
20150026708 | Ahmed et al. | Jan 2015 | A1 |
20150050923 | Tu et al. | Feb 2015 | A1 |
20150092747 | Ganesan | Apr 2015 | A1 |
20150110471 | Zheng | Apr 2015 | A1 |
20150113556 | Weast et al. | Apr 2015 | A1 |
20150121428 | Nguyen et al. | Apr 2015 | A1 |
20150365787 | Farrell | Dec 2015 | A1 |
20160057472 | Gupta et al. | Feb 2016 | A1 |
20160105700 | Collins et al. | Apr 2016 | A1 |
20160127766 | Luk et al. | May 2016 | A1 |
20160174185 | Ramakrishnan et al. | Jun 2016 | A1 |
20160253710 | Publicover et al. | Sep 2016 | A1 |
20160277529 | Chen | Sep 2016 | A1 |
20160315682 | Liu et al. | Oct 2016 | A1 |
20160337701 | Khare et al. | Nov 2016 | A1 |
20160344779 | Jain et al. | Nov 2016 | A1 |
20170032191 | Ackland | Feb 2017 | A1 |
20170068790 | Fuerst | Mar 2017 | A1 |
20170135635 | Bostick et al. | May 2017 | A1 |
20170160089 | Jang et al. | Jun 2017 | A1 |
20170293729 | Movva | Oct 2017 | A1 |
20170315711 | Adams | Nov 2017 | A1 |
20170332192 | Edge | Nov 2017 | A1 |
20170354349 | Mohapatra et al. | Dec 2017 | A1 |
20170366955 | Edge | Dec 2017 | A1 |
20180008207 | Sarkela et al. | Jan 2018 | A1 |
20180035072 | Asarikuniyil et al. | Feb 2018 | A1 |
20180091952 | Sant et al. | Mar 2018 | A1 |
20180181094 | Funk et al. | Jun 2018 | A1 |
20180184165 | Maughan et al. | Jun 2018 | A1 |
20180330406 | Deluca et al. | Nov 2018 | A1 |
20180366228 | Buck | Dec 2018 | A1 |
20190051342 | Wootton et al. | Feb 2019 | A1 |
20190174170 | Chen | Jun 2019 | A1 |
20190178980 | Zhang | Jun 2019 | A1 |
20190188756 | Bradley et al. | Jun 2019 | A1 |
20190246371 | Hwang et al. | Aug 2019 | A1 |
20190252079 | Constantin et al. | Aug 2019 | A1 |
20190306023 | Vasseur et al. | Oct 2019 | A1 |
20200036592 | Kholaif | Jan 2020 | A1 |
20200090022 | Ma et al. | Mar 2020 | A1 |
20200112939 | Scharf et al. | Apr 2020 | A1 |
20200120384 | Armaly | Apr 2020 | A1 |
20200133383 | Ahlstrom et al. | Apr 2020 | A1 |
20200186321 | Hwang et al. | Jun 2020 | A1 |
20200226388 | Ghessassi | Jul 2020 | A1 |
20200265700 | Bergman et al. | Aug 2020 | A1 |
20200296463 | Martinez | Sep 2020 | A1 |
20200302478 | Martinez | Sep 2020 | A1 |
20200303046 | Martinez | Sep 2020 | A1 |
20200327430 | Martinez | Oct 2020 | A1 |
20200328793 | Martinez | Oct 2020 | A1 |
20200329343 | Martinez | Oct 2020 | A1 |
20200383119 | Sun et al. | Dec 2020 | A1 |
20200397365 | Zhang et al. | Dec 2020 | A1 |
20210063537 | Martinez | Mar 2021 | A1 |
20210120370 | Martinez | Apr 2021 | A1 |
20210352441 | Liu | Nov 2021 | A1 |
20220060234 | Martinez | Feb 2022 | A1 |
20220070633 | Ghoshal | Mar 2022 | A1 |
20220167050 | Martinez | May 2022 | A1 |
20220256429 | Martinez | Aug 2022 | A1 |
20230003836 | Martinez | Jan 2023 | A1 |
Number | Date | Country |
---|---|---|
3044480 | May 2018 | CA |
105828289 | Aug 2016 | CN |
WO-2016187458 | Nov 2016 | WO |
WO 2018094502 | May 2018 | WO |
WO 2020170221 | Aug 2020 | WO |
WO 2020240526 | Dec 2020 | WO |
WO 2021084519 | May 2021 | WO |
Entry |
---|
PCT Application No. PCT/IB2020/051503 International Search Report and Written Opinion dated Jul. 30, 2020. |
U.S. Appl. No. 16/798,138 Office Action dated Sep. 8, 2020. |
PCT Application No. PCT/IB2020/060271 International Search Report and Written Opinion dated Feb. 15, 2021. |
U.S. Appl. No. 16/796,662 Office Action dated Feb. 12, 2021. |
U.S. Appl. No. 17/014,720, Michel A. Martinez, Monitoring Activity Using Wi-Fi Motion Detection, filed Sep. 8, 2020. |
U.S. Appl. No. 17/006,579, Michel A. Martinez, System and Method for Presence and Pulse Detection From Wireless Systems, Aug. 28, 2020. |
PCT/IB2020/060271, System for Multi-Path 5G and Wi-Fi Motion Detection, Nov. 2, 2020. |
Deng et al., “CC-DTW: An Accurate Indoor Fingerprinting Localization Using Calibrated Channel State Information and Modified Dynamic Time Warping”, Sensors 19, No. 9: 1984, Apr. 28, 2019 (Apr. 28, 2019), [online] [retrieved on Aug. 20, 2020 (Aug. 20, 2020)], Retrieved from the internet: https://www.mdpif.com/1424-8220/9/19/1984. |
Ghourchian et al., “Real-Time Indoor Localization in Smart Homes Using Semi-Supervised Learning”, Association for the Advancement of Artificial Intelligence, Twenty-Ninth AAAI Conference on Innovative Applications, pp. 4670-4677, Feb. 8, 2017 (Aug. 2, 2017), [online] [retrieved on Aug. 20, 2020 (Aug. 20, 2020)], Retrieved from the internet: https://aaai.org/ocs/index.php/IAAI/IAAI17/paer/view/15010. |
Rui Zhou et al., “Device-free Localization Based on CSI Fingerprints and Deep Neural Networks”, 15 Annual IEEE International Conference on Sensing, Communication, and Networking (SECON), Jun. 11, 2018 (Nov. 6, 2018), [online] [retrieved on Aug. 20, 2020 (Aug. 20, 2020] Retrieved from the internet: https://dl.acm.org/doi/10.1145/2639108.2639143. |
Xuyu Wang et al., “CSI-Based Fingerprinting for Indoor Localization: A Deep Learning Approach”, IEEE Transactions on Vehicular Technology, vol. 66, No. 1, pp. 763-776, Mar. 22, 2016 (Mar. 22, 2016), [online] [retrieved on Aug. 20, 2020 (Aug. 20, 2020), Retrieved from the internet: https://ieeexplore://ieeexplore.ieee.org/documents/7438932. |
Yang Wang et al., “E-eyes: Device-free Location-oriented Activity Identification Using Fine-grained Wifi Signatures”, MobiCom'14, pp. 617-628 Sep. 7, 2014 (Jul. 9, 2014), [retrieved on Aug. 20, 2020 (Aug. 20, 2020)], Retrieved from the internet: https://dl.acm.org/doi/10.1145/2639108.2639143. |
PCT Application No. PCT/IB2020/055186 International Search Report and Written Opinion dated Oct. 15, 2020. |
PCT/IB2020/051503, Handling Concept Drift in Wi-Fi Based Localization, Feb. 22, 2020. |
U.S. Appl. No. 16/796,662, Michel A. Martinez, Smart Media Display, filed Feb. 20, 2020. |
U.S. Appl. No. 16/795,198, Michel A. Martinez, Advertisement Engagement Measurement, filed Feb. 19, 2020. |
U.S. Appl. No. 16/798,138, Michel A. Martinez, Small Motion Vector Identification in a Wi-Fi Motion Detection System, filed Feb. 21, 2020. |
U.S. Appl. No.16/794,668, Michel A. Martinez, Robotic H Matrix Creation, filed Feb. 19, 2020. |
U.S. Appl. No. 16/795,319, Michel A. Martinez, Wi-Fi Based Condition Monitoring, filed Feb. 22, 2020. |
U.S. Appl. No. 16/795,219, Michel A. Martinez Self-Learning Based on Wi-Fi-Based Monitoring and Augmentation, filed Feb. 19, 2020. |
U.S. Appl. No. 17/006,579, Michel A. Martinez, System and Method for Presence and Pulse Detection From Wireless Systems, filed Aug. 28, 2020. |
PCT Application No. PCT/IB2020/055186 International Preliminary Report on Patentability dated Nov. 16, 21. |
U.S. Appl. No. 16/795,198 Office Action dated Jan. 25, 2022. |
U.S. Appl. No. 16/798,319 Office Action dated Dec. 29, 2021. |
U.S. Appl. No. 17/006,579 Office Action dated Jan. 6, 2022. |
PCT Application No. PCT/IB2020/051503 International Preliminary Report on Patentability dated Aug. 10, 2021. |
U.S. Appl. No. 17/131,078 Non-Final Office Action dated Mar. 2, 2022. |
Xi et al.; “Electronic Frog Eye: Counting Crowd Using WiFi”, Department of Computer Science, Jul. 8, 2014. |
Xu et al., “SCPL: Indoor Device-Free Multi-Subject Counting and Localization Using Radio Signal Strength”, 2013. |
U.S. Appl. No. 17/902,070, Michel A. Martinez, System and Method for Presence and Pulse Detection from Wireless Signals, filed Sep. 2, 2022. |
PCT Application No. PCT/IB2020/060271 International Preliminary Report on Patentability dated May 3, 2022. |
U.S. Appl. No. 16/794,668 Office Action dated May 24, 2022. |
U.S. Appl. No. 16/798,319 Final Office Action dated Jun. 13, 2022. |
U.S. Appl. No. 17/539,872 Office Action dated Jan. 5, 2023. |
U.S. Appl. No. 16/798,319 Office Action dated Mar. 7, 2023. |
U.S. Appl. No. 17/902,070 Office Action dated Mar. 31, 2023. |
Number | Date | Country | |
---|---|---|---|
20200292572 A1 | Sep 2020 | US |
Number | Date | Country | |
---|---|---|---|
62809436 | Feb 2019 | US |