This application claims priority from Japanese Patent Application No. 2021-188191 filed in Japan on Nov. 18, 2021, the entire disclosure of which is incorporated herein by reference.
The present disclosure relates to an electronic device, a method for controlling an electronic device, and a program.
For example, in fields of automobile-related industries and the like, a technology for measuring a distance between a vehicle of interest and a predetermined object, and the like, is regarded as important. More particularly, various studies have recently been conducted on a radar (Radio Detecting and Ranging) technology for measuring a distance, etc. to an object such as an obstacle by transmitting a radio wave such as a millimeter wave and then receiving a wave reflected off the object. The importance of such a technology for measuring a distance, etc. is expected to grow more and more in the future with progresses of technologies for assisting drivers in driving and autonomous-driving-related technologies for partially or entirely automating driving.
Various suggestions have been made regarding a technology for detecting the presence, etc. of a predetermined object by receiving a reflected wave coming back from the object due to reflection of a transmitted radio wave. For example, Patent Literature 1 proposes a microwave imaging system configured to image a status of a detection target to enable evaluation thereof. As another example, Patent Literature 2 proposes a method of performing medical image processing by using a radar signal.
In one embodiment, an electronic device includes a transmission antenna, a plurality of reception antenna arrays, and a signal processor.
The transmission antenna transmits a transmission wave.
Each of the plurality of reception antenna arrays includes a plurality of reception antennas each configured to receive a reflected wave. The reflected wave is the transmission wave having been reflected.
The signal processor detects, based on a transmission signal transmitted as the transmission wave and a reception signal received as the reflected wave, displacement of a subject reflecting the transmission wave.
The plurality of reception antenna arrays is arranged in different orientations from one another.
The signal processor synthesizes the displacement of the subject detected by each of the plurality of reception antenna arrays.
In one embodiment, a method for controlling an electronic device includes transmission, reception, detection, and synthesis.
The transmission transmits a transmission wave from a transmission antenna.
The reception receives a reflected wave, the reflected wave being the transmission wave having been reflected, via a plurality of reception antenna arrays each including a plurality of reception antennas, the plurality of reception antenna arrays being arranged in different orientations from one another.
The detection detects, based on a transmission signal transmitted as the transmission wave and a reception signal received as the reflected wave, displacement of a subject reflecting the transmission wave.
The synthesis synthesizes the displacement of the subject detected by each of the plurality of reception antenna arrays.
In one embodiment, a program causes an electronic device to execute transmission, reception, detection, and synthesis.
The transmission transmits a transmission wave from a transmission antenna.
The reception receives a reflected wave, the reflected wave being the transmission wave having been reflected, via a plurality of reception antenna arrays each including a plurality of reception antennas, the plurality of reception antenna arrays being arranged in different orientations from one another.
The detection detects, based on a transmission signal transmitted as the transmission wave and a reception signal received as the reflected wave, displacement of a subject reflecting the transmission wave.
The synthesis synthesizes the displacement of the subject detected by each of the plurality of reception antenna arrays.
Usefulness in various fields can be expected if oscillations such as vibrations of an apparatus or a heartbeat in a human body or the like can be detected with good accuracy through transmission and reception of a radio wave or the like such as, for example, a millimeter wave. The present disclosure provides an electronic device capable of detecting the displacement of a subject with good accuracy through transmission and reception of a radio wave or the like, a method for controlling an electronic device, and a program. One embodiment makes it possible to provide an electronic device capable of detecting the displacement of a subject with good accuracy through transmission and reception of a radio wave or the like, a method for controlling an electronic device, and a program. One embodiment will now be described in detail with reference to the drawings.
In the present disclosure, the term “electronic device” may refer to a device driven by electric power. The term “user” may refer to an entity (typically, a human) using, or an animal using, a system and/or an electronic device according to one embodiment. The user may include an entity who monitors a subject such as a human by using the electronic device according to one embodiment. The term “subject” may refer to an object or a living entity (for example, a human or an animal) to be monitored with the electronic device according to one embodiment. The user may be included in the subject. The object may be an engine, a machine tool, a lathe machine, a processing machine, conveyance such as an automobile, etc., but is not limited to them. The object may be any other kind of apparatus.
The electronic device according to one embodiment may detect the displacement of an apparatus as the target of detection. The displacement may include, for example, vibrations of an apparatus. The displacement may include displacement of any combination of periodic motion, non-periodic motion, and/or random motion, etc. Accordingly, expected scenes where the electronic device according to one embodiment will be used are, for example, a factory, a work site, a parking lot, or the like. The electronic device according to one embodiment may detect a vibration velocity of an apparatus as the target of detection, where the vibration velocity is calculated from the displacement of the apparatus per predetermined time. In this case, the electronic device according to one embodiment may detect the vibration velocity in place of the displacement or in addition to the displacement.
The electronic device according to one embodiment is capable of detecting a heartbeat of a subject such as a human located in the neighborhood of the electronic device. Accordingly, expected scenes where the electronic device according to one embodiment will be used may be specific facilities used by entities who perform social activities, such as, for example, a company, a hospital, a nursing home, a school, a gym, and a care facility. For example, in the case of a company, grasping and/or managing health conditions of employees and the like are very important. Likewise, in the case of a hospital, grasping and/or managing health conditions of patients, healthcare workers, and the like are very important. In the case of a nursing home, grasping and/or managing health conditions of residents, staff members, and the like are very important. The scenes where the electronic device according to one embodiment will be used are not limited to the above-mentioned facilities such as a company, a hospital, and a nursing home, but may be any facility where grasping and/or managing health conditions of a subject are demanded. “Any facility” may include non-commercial facilities such as a house of a user. The scenes where the electronic device according to one embodiment is used are not limited to indoor places, but may be outdoor places. For example, the scenes where the electronic device according to one embodiment will be used may be the inside of mobility means such as a train, a bus, and an airplane, a station, a landing, and the like. The electronic device according to one embodiment may be used aboard mobility means such as an automobile, an aircraft, or a vessel, at a hotel, at a house of a user, in a living room of the user's house, a bathroom thereof, a lavatory thereof, a bedroom thereof, or the like.
For example, the electronic device according to one embodiment may be used for the purpose of detecting or monitoring a heartbeat of a subject such as a person requiring medical care or a person requiring nursing care at a care facility or the like. Upon finding something abnormal in the heartbeat of the subject such as a person requiring medical care or a person requiring nursing care, for example, the electronic device according to one embodiment may issue a predetermined warning to, for example, the subject himself/herself and/or another person. Thus, the electronic device according to one embodiment enables the subject such as, for example, a person requiring medical care or a person requiring nursing care, and/or a staff member at a care facility or the like, to grasp the abnormality in the pulse of the subject. Upon finding nothing abnormal in the heartbeat of the subject such as a person requiring medical care or a person requiring nursing care, for example, the electronic device according to one embodiment may inform, for example, the subject himself/herself and/or another person that no abnormality is found in the heartbeat. Thus, the electronic device according to one embodiment enables the subject such as, for example, a person requiring medical care or a person requiring nursing care, and/or a staff member at a care facility or the like, to grasp that the pulse of the subject is normal (or not abnormal).
The electronic device according to one embodiment may detect the pulse of a subject other than a human, such as an animal. The description will be given below on an assumption that the electronic device according to one embodiment detects the pulse of a human by means of a sensor based on a technology such as a millimeter-wave radar, for example. The target of detection by the electronic device according to one embodiment may include biological information about cardiac motion such as a heartbeat, throbbing, pulsation, pulsing motion, and the like of a human and a living entity other than a human such as an animal. The target of detection by the electronic device according to one embodiment may include a bodily movement of a human and a living entity other than a human such as an animal.
The electronic device according to one embodiment may be installed in or on any stationary object or may be installed in or on any mobility device. The electronic device according to one embodiment is capable of transmitting a transmission wave to an area around the electronic device from a transmission antenna. The electronic device according to one embodiment is capable of receiving, by means of a reception antenna, a reflected wave that is the transmission wave having been reflected. The electronic device may include at least one of the transmission antenna or the reception antenna. Alternatively, for example, a radar sensor or the like may include at least one of the transmission antenna or the reception antenna.
In the description given below, as a typical example, the electronic device according to one embodiment is assumed to be stationary. On the other hand, a subject (a human) whose pulse is to be detected by the electronic device according to one embodiment may be stationary, may be moving, or may be moving his/her body while being stationary. As is the case with an ordinary radar sensor, the electronic device according to one embodiment is capable of measuring a distance, etc. between the electronic device and an object located in the neighborhood of the electronic device when the object is movable. The electronic device according to one embodiment is capable of measuring a distance, etc. between the electronic device and the object even if both the electronic device and the object are stationary.
As will be described later, an electronic device 1 according to one embodiment includes at least one transmission antenna array and a plurality of reception antenna arrays. First, as a preamble before giving an explanation of an operation principle of the electronic device 1 according to one embodiment, an electronic device 100 that can be configured as a part of the electronic device 1 according to one embodiment will now be described while referring to the drawings. The electronic device 100 disclosing a partial configuration of the electronic device 1 according to one embodiment will be simply referred to as “electronic device 100”. That is, the electronic device 100 described below may have a configuration obtained by deleting or omitting some functional units and/or parts from a configuration of the electronic device 1 according to one embodiment.
First, an example of detecting vibrations of an object by the electronic device 100 according to one embodiment will now be described. Described below is a case where the electronic device 100 according to one embodiment detects vibrations of an engine, a machine tool, a lathe machine, a processing machine or any other kind of apparatus, or conveyance such as an automobile, etc.
As illustrated in
The example illustrated in
As will be described later, the electronic device 100 transmits an electromagnetic wave as a transmission wave from the transmission antenna array 24. For example, when a predetermined object entity (for example, a target device 200 illustrated in
The electronic device 100 including the transmission antenna array 24 may be typically a radar (Radio Detecting and Ranging) sensor configured to transmit and receive a radio wave. However, the electronic device 100 is not limited to a radar sensor. The electronic device 100 according to one embodiment may be, for example, a sensor based on the LIDAR (Light Detection and Ranging, Laser Imaging Detection and Ranging) technology that uses an optical wave. These sensors can include, for example, patch antennas, etc. Since the RADAR and the LIDAR are known technologies, detailed description thereof will be sometimes omitted, or the description thereof will be sometimes simplified, where appropriate. The electronic device 100 according to one embodiment may be a sensor that is based on a technology of detecting an object entity by transmitting and receiving a sound wave or an ultrasound wave, for example.
The electronic device 100 illustrated in
In
The target device 200 may be, for example, an apparatus or the like located in the neighborhood of the electronic device 100. As described above, the target device 200 may be moving, stopped, or stationary. The target device 200 may include an engine, a machine tool, a lathe machine, a processing machine or any other kind of apparatus, conveyance such as an automobile, etc. The electronic device 100 according to the present embodiment may detect vibrations of any kind of apparatus such as an engine, a machine tool, a lathe machine, and/or a processing machine. The target device 200 may be installed at a factory, production facilities, a laboratory, or the like.
In the present disclosure, an object entity to be detected by the electronic device 100 includes living things such as a person, a dog, a cat, a horse, and other kinds of animal in addition to non-living things such as any object. The object entity to be detected by the electronic device 100 in the present disclosure may include a radar target including a person, an object, and an animal, etc. to be detected using the radar technology. In the description given below, an object entity such as the target device 200 located in the neighborhood of the electronic device 100 is assumed to be an apparatus.
In
In the description given below, as a typical example, the transmission antenna of the electronic device 100 is assumed to transmit a radio wave in a frequency band, such as a millimeter wave (equal to or higher than 30 GHZ) or a quasi-millimeter wave (for example, around 20 GHz to 30 GHZ). On the other hand, the transmission antenna of the electronic device 100 may transmit a radio wave having a frequency bandwidth of 4 GHz such as, for example, from 77 GHz to 81 GHZ.
When a distance or the like is measured by using a millimeter-wave radar, a frequency modulated continuous wave radar (hereinafter abbreviated as “FM-CW radar”) is often used. The FM-CW radar sweeps a frequency of a to-be-transmitted radio wave to generate a transmission signal. Therefore, the frequency of a radio wave used by, for example, a 79-GHz millimeter-wave FM-CW radar has a frequency bandwidth of 4 GHz such as from, for example, 77 GHz to 81 GHz. The radar in the frequency band of 79 GHz has a feature of a wider usable frequency bandwidth, as compared with other millimeter-wave/quasi-millimeter-wave radars in frequency bands of, for example, 24 GHZ, 60 GHz, 76 GHZ, and the like. Such an embodiment will be described below as an example.
The FM-CW radar scheme used in the present disclosure may include an FCM (Fast-Chirp Modulation) scheme, in which chirp signals are transmitted in a shorter cycle than usual. The signal generated by the electronic device 100 is not limited to a signal of the FM-CW scheme. The signal generated by the electronic device 100 may be a signal of various schemes other than the FM-CW scheme. A transmission signal sequence stored in any storage unit may differ from one to another of these various schemes. For example, in the case of a radar signal of the FM-CW scheme described above, a signal whose frequency increases/decreases for each time sample may be used. A more detailed description of the various schemes described above is omitted because known techniques can be employed as appropriate.
As illustrated in
The reception signal processing unit 12 and/or the vibration displacement extraction processing unit 14 may perform processing of, for example, extracting micro-Doppler components. The reception signal processing unit 12 and/or the vibration displacement extraction processing unit 14 may perform processing of extracting an envelope of vibrations of the target device 200. Based on a frequency analysis of time-series data of vibrations, the reception signal processing unit 12 and/or the vibration displacement extraction processing unit 14 may perform processing of calculating changes in vibrations of the target device 200.
When the target of detection by the electronic device in the present disclosure is a living entity, the reception signal processing unit 12 and/or the vibration displacement extraction processing unit 14 may perform processing of, for example, extracting micro-Doppler components. When the target of detection by the electronic device in the present disclosure is a living entity, the reception signal processing unit 12 and/or the vibration displacement extraction processing unit 14 may perform processing of extracting an envelope of cardiac sound of the subject. When the target of detection by the electronic device in the present disclosure is a living entity, the reception signal processing unit 12 and/or the vibration displacement extraction processing unit 14 may perform processing of, for example, extracting a heart rate interval (RRI) of the subject. When the target of detection by the electronic device in the present disclosure is a living entity, the reception signal processing unit 12 and/or the vibration displacement extraction processing unit 14 may perform processing for frequency analysis of time-series data of the extracted heart rate interval of the subject. When the target of detection by the electronic device in the present disclosure is a living entity, the reception signal processing unit 12 and/or the vibration displacement extraction processing unit 14 may perform processing of calculating a heart rate variability of the subject on the basis of the frequency analysis of the time-series data of the heart rate interval.
As illustrated in
The signal processing unit 10 of the electronic device 100 according to one embodiment is capable of performing control on the overall operation of the electronic device 100, besides control on each functional unit of the electronic device 100. Among them, the signal processing unit 10 performs various kinds of processing on signals dealt with by the electronic device 100. To provide control and processing capabilities for executing various functions, the signal processing unit 10 may include at least one processor such as, for example, a CPU (Central Processing Unit) or a DSP (Digital Signal Processor). The signal processing unit 10 may be collectively embodied by one processor, may be embodied by some processors, or may be embodied by discrete individual processors. The processor may be embodied as a single integrated circuit. The integrated circuit is also referred to as “IC”. The processor may be embodied as a plurality of integrated circuits and discrete circuits connected communicably. The processor may be embodied based on various other known technologies. In one embodiment, the signal processing unit 10 may be configured as, for example, a CPU(s) (hardware) and a program(s) (software) run by the CPU. The signal processing unit 10 may include, as appropriate, a storage unit (memory) necessary for operation of the signal processing unit 10.
The signal generation processing unit 11 of the signal processing unit 10 generates a signal to be transmitted from the electronic device 100. In the electronic device 100 according to one embodiment, the signal generation processing unit 11 may generate a transmission signal such as, for example, a chirp signal (transmission chirp signal). In particular, the signal generation processing unit 11 may generate a signal (linear chirp signal) whose frequency changes linearly in a periodic manner. For example, the signal generation processing unit 11 may generate a chirp signal whose frequency increases linearly in a periodic manner from 77 GHz to 81 GHz as time elapses. For example, the signal generation processing unit 11 may generate a signal whose frequency repeats a linear increase (up-chirp) from 77 GHz to 81 GHz and a decrease (down-chirp) in a periodic manner as time elapses. For example, the signal generated by the signal generation processing unit 11 may be preset at the signal processing unit 10. For example, the signal generated by the signal generation processing unit 11 may be pre-stored in any storage unit or the like of the signal processing unit 10. Since a chirp signal used in a technical field of a radar and the like is known, detailed description thereof will be omitted, or the description thereof will be simplified, where appropriate. The signal generated by the signal generation processing unit 11 is supplied to the transmission DAC 21. Therefore, the signal generation processing unit 11 may be connected to the transmission DAC 21.
The transmission DAC (digital-to-analog converter) 21 has a function of converting a digital signal supplied from the signal generation processing unit 11 into an analog signal. The transmission DAC 21 may include an ordinary digital-to-analog converter. The signal having been converted into an analog format by the transmission DAC 21 is supplied to the transmission circuit 22. Therefore, the transmission DAC 21 may be connected to the transmission circuit 22.
The transmission circuit 22 has a function of converting the signal having been converted into the analog format by the transmission DAC 21 into a signal of an intermediate frequency (IF) band. The transmission circuit 22 may include an ordinary IF-band transmission circuit. The signal having been processed by the transmission circuit 22 is supplied to the millimeter-wave transmission circuit 23. Therefore, the transmission circuit 22 may be connected to the millimeter-wave transmission circuit 23.
The millimeter-wave transmission circuit 23 has a function of transmitting, as a millimeter wave (RF wave), the signal having been processed by the transmission circuit 22. The millimeter-wave transmission circuit 23 may include an ordinary millimeter-wave transmission circuit. The signal having been processed by the millimeter-wave transmission circuit 23 is supplied to the transmission antenna array 24. Therefore, the millimeter-wave transmission circuit 23 may be connected to the transmission antenna array 24. The signal having been processed by the millimeter-wave transmission circuit 23 is supplied to the mixer 32, too. Therefore, the millimeter-wave transmission circuit 23 may be connected to the mixer 32, too.
The transmission antenna array 24 is an array of the plurality of transmission antennas. In
As described above, the electronic device 100 according to one embodiment includes a transmission antenna (the transmission antenna array 24) and is capable of transmitting a transmission signal (for example, a transmission chirp signal) as a transmission wave from the transmission antenna array 24.
Suppose that, for example, as illustrated in
The reception antenna array 31 receives the reflected wave. The reflected wave mentioned here may be at least a part of a reflection, of the transmission wave transmitted from the transmission antenna array 24, reflected off the object entity such as the target device 200.
The reception antenna array 31 is an array of the plurality of reception antennas. In
The mixer 32 performs conversion, into an intermediate frequency (IF) band, of the signal (transmission signal) having been processed by the millimeter-wave transmission circuit 23 and the reception signal having been received by the reception antenna array 31. The mixer 32 may include a mixer used in an ordinary millimeter-wave radar. The mixer 32 supplies a signal generated as a result of mixing to the reception circuit 33. Therefore, the mixer 32 may be connected to the reception circuit 33.
The reception circuit 33 has a function of performing analog processing on the signal having been converted into the IF band by the mixer 32. The reception circuit 33 may include a reception circuit compliant with ordinary IF-band conversion. The signal having been processed by the reception circuit 33 is supplied to the reception ADC 34. Therefore, the reception circuit 33 may be connected to the reception ADC 34.
The reception ADC (analog-to-digital converter) 34 has a function of converting an analog signal supplied from the reception circuit 33 into a digital signal. The reception ADC 34 may include an ordinary analog-to-digital converter. The signal having been digitized by the reception ADC 34 is supplied to the reception signal processing unit 12 of the signal processing unit 10. Therefore, the reception ADC 34 may be connected to the signal processing unit 10.
The reception signal processing unit 12 of the signal processing unit 10 has a function of performing various kinds of processing on the digital signal supplied from the reception DAC 34. For example, based on the digital signal supplied from the reception DAC 34, the reception signal processing unit 12 calculates the distance from the electronic device 100 to the object entity such as the target device 200 (range measurement). Based on the digital signal supplied from the reception DAC 34, the reception signal processing unit 12 calculates the relative velocity of the object entity such as the target device 200 in relation to the electronic device 100 (velocity measurement). Based on the digital signal supplied from the reception DAC 34, the reception signal processing unit 12 calculates the angle of azimuth, as viewed from the electronic device 100, of the object entity such as the target device 200 (angle measurement). Specifically, the reception signal processing unit 12 may receive an input of I/Q-converted data. Upon receiving an input of this kind of data, the reception signal processing unit 12 performs fast Fourier transform in each of a distance (range) direction and a speed (velocity) direction (2D-FFT). After that, the reception signal processing unit 12 may perform processing of, for example, CFAR (Constant False Alarm Rate) to remove noise points, thereby suppressing false alarms and making probabilities constant. Then, the reception signal processing unit 12 may perform angle-of-arrival estimation on points satisfying the CFAR criterion to obtain the position of the object entity such as the target device 200. Information generated as the results of range measurement, velocity measurement, and angle measurement performed by the reception signal processing unit 12 may be supplied to the vibration displacement extraction processing unit 14.
The vibration displacement extraction processing unit 14 extracts displacement of vibration as information regarding a heartbeat from the information having been generated by the reception signal processing unit 12. A more detailed description will be given later about operation of extracting the information regarding a heartbeat by the vibration displacement extraction processing unit 14. The information regarding a heartbeat having been extracted by the vibration displacement extraction processing unit 14 may be supplied to a communication interface 50. Therefore, the vibration displacement extraction processing unit 14 and/or the signal processing unit 10 may be connected to the communication interface 50. Various kinds of information having been processed by the vibration displacement extraction processing unit 14 may be supplied to any functional unit other than the communication interface 50.
The communication interface 50 may include an electric interface configured to output, for example, to an external device 60 or the like, the information supplied from the signal processing unit 10. The communication interface 50 may output, to the external device 60 or the like, information on at least any of the position, velocity, and angle of the object entity such as the target device 200 as, for example, a signal of CAN (Controller Area Network), UART (Universal Asynchronous Receiver Transmitter), or the like. For example, the information on at least any of the position, velocity, and angle of the object entity such as the target device 200 may be supplied via the communication interface 50 to the external device 60 or the like. Therefore, the communication interface 50 may be connected to the external device 60 or the like.
As illustrated in
In
In the example illustrated in
In the electronic device 100 according to one embodiment, the signal generation processing unit 11 may generate a transmission signal as any number of frames. In
As described above, the electronic device 100 according to one embodiment may transmit a transmission signal constituted by sub-frames each including a plurality of chirp signals. The electronic device 100 according to one embodiment may transmit a transmission signal constituted by frames each including a predetermined number of sub-frames.
In the description given below, the electronic device 100 is assumed to transmit a transmission signal having a frame structure illustrated in
As illustrated in
In
Based on at least one of the result of 2D-FFT estimation or the result of angle estimation, the reception signal processing unit 12 detects an object entity located in a range in which a transmission wave T is transmitted. The reception signal processing unit 12 may perform object detection by performing, for example, clustering processing on the basis of each estimated distance information, velocity information, and angle information. A known example of algorithms used for data clustering is DBSCAN (density-based spatial clustering of applications with noise). This is an algorithm for performing density-based clustering. In the clustering processing, for example, average power of points constituting the object entity to be detected may be calculated. The distance information, the velocity information, the angle information, and the power information regarding the object entity detected by the reception signal processing unit 12 may be supplied to, for example, the external device 60, etc. via the communication interface 50.
As described above, the electronic device 100 may include transmission antennas (the transmission antenna array 24), reception antennas (the reception antenna array 31), and the signal processing unit 10. The transmission antenna array 24 transmits a transmission wave T. The reception antenna array 31 receives a reflected wave R that is the transmission wave T having been reflected. Then, based on a transmission signal transmitted as the transmission wave T and a reception signal received as the reflected wave R, the signal processing unit 10 detects an object entity (for example, an object such as the target device 200) that reflects the transmission wave T.
A further explanation will now be given of estimating the direction of an arrival wave by the antenna array of the electronic device 100 according to one embodiment.
As illustrated in
In the electronic device 100 according to one embodiment, at least one of the transmission antenna array 24 or the reception antenna array 31 may be a linear array of a plurality of antennas. This enables directivity to be narrowed appropriately when transmitting/receiving a radio wave at, for example, a millimeter-wave radar. To transmit a transmission wave, a beam former is often used for controlling the direction of a transmission beam. On the other hand, to receive a reflected wave, a subspace method (the above-mentioned MUSIC, ESPRIT, etc.) is often used, rather than a beam former, for estimating the direction of arrival of the reflected wave. In beamforming and sub-spacing, with regard to electromagnetic waves coming from various directions, a phase difference arises between measured values of the sensors of the ULA illustrated in
A further explanation will now be given of angle estimation in two directions of an arrival wave by the antenna array of the electronic device 100 according to one embodiment.
As illustrated in
In the transmission antenna array 24 illustrated in
As illustrated in
As illustrated in
As illustrated in
All of the elements included in the transmission antenna array 24 and the reception antenna array 31 may be disposed on the same plane (for example, on a surface layer of the same substrate). The transmission antenna array 24 and the reception antenna array 31 may be disposed in proximity to each other (monostatic). The first direction and the second direction illustrated in
The transmission antenna array 24 and the reception antenna array 31 illustrated in
A method of detecting vibrations of the target device 200 by the electronic device 100 according to one embodiment will now be described.
The electronic device 100 according to one embodiment detects vibrations of the target device 200 on the basis of the result of transmitting a transmission wave of millimeter-wave radar or the like to the target device 200 and then receiving a reflected wave reflected off the target device 200. As described earlier, the target device 200 may be an engine, a machine tool, a lathe machine, a processing machine, or conveyance such as an automobile, etc., but is not limited to them, and thus may be any other kind of apparatus. Studied below is a method of estimating the heart rate interval of the target device 200 on the basis of the results of performing 2D-FFT, CFAR processing, and direction-of-arrival estimation described above, etc. First, how vibrations are expressed as the result of 2D-FFT performed in
Note that, in a case where the electronic device 100 according to one embodiment detects biological information, the electronic device 100 detects a heartbeat of the subject on the basis of the result of transmitting a transmission wave of millimeter-wave radar or the like to the target device 200 and then receiving a reflected wave reflected off the chest where the heart of the subject exists. As described earlier, the subject may be a human or an animal.
The peak Hm illustrated in
The vibration displacement dv mentioned above cannot be detected except for components in a moving-radius direction from the vibrating body toward the radar. Though the vibrating body is supposed to have a three-axis vibration displacement under ordinary circumstances, if the method described above is used, only a projection in the moving-radius direction is obtained as dy. Therefore, there is a possibility that sufficient information cannot be restored when restoration of vibrations of the object that are otherwise restorable is attempted using the radar.
As described above, the reception antenna array 31 illustrated in
As described above, when vibrations such as, for example, a body motion of a human are detected using a Doppler radar, range measurement of a particular portion of the subject that vibrates, angle measurement (direction estimation) thereof, and vibration velocity extraction thereof can be performed by using a pair of transmission and reception antenna arrays. However, if the method described above is used, the only thing that can measured in a Doppler shift of the radar is a velocity in a moving-radius direction from the subject toward the radar.
For a solution, the electronic device 1 according to one embodiment to be described below enables measurement inclusive of a velocity in a normal-line direction normal to a moving-radius direction toward the radar when extracting a vibration velocity of the subject that vibrates. That is, the electronic device 1 according to one embodiment, just with a single device configuration, enables measurement of, for example, vibrations in two dimensions or in higher-order dimensions by combining a plurality of Doppler radars using a quasi-millimeter-wave frequency or higher (for example, 20 GHz or higher). The electronic device 1 according to one embodiment enables detection of micro-vibrations of an object as micro-Doppler by using Doppler radars configured to perform distance measurement (range measurement) using an electromagnetic wave or a sound wave, for example, angle estimation (angle measurement), and Doppler velocity detection (velocity measurement).
The electronic device 1 according to one embodiment described above will now be described.
The electronic device 1 according to one embodiment may mainly include feature(s) of the following aspect(s). Specifically, the electronic device 1 according to one embodiment may include (A) a feature about antenna arrangement and antenna configuration and (B) a feature about system design. These features will now be further described.
(A) Feature about Antenna Arrangement and Antenna Configuration
The electronic device 1 according to one embodiment may include at least two, for example, three, reception antennas (reception antenna arrays). The plurality of reception antennas in the electronic device 1 according to one embodiment may be arranged such that they are not in the same orientation as one another. For example, the plurality of reception antennas in the electronic device 1 according to one embodiment may be arranged in different orientations from one another. In the electronic device 1 according to one embodiment, the respective antennas may be arranged such that the distance between the center of one antenna and the center of another antenna is not greater than a predetermined distance. The predetermined distance may be a distance set such that the distance from the center of each antenna to the vibrating body is not greater than the range (distance) resolution of the radar. The distance to the vibrating body may be determined on the basis of the minimum installation distance set as radar-module specifications. The feature of the above-described aspect of the electronic device 1 according to one embodiment will be simply referred to also as “feature A”. A more detailed description of the feature A will be given later.
(B) Feature about System Design
The electronic device 1 according to one embodiment may be configured such that an antenna set described about the feature A above is housed in one radar module. The electronic device 1 according to one embodiment may include a plurality of reception systems integrated together. The electronic device 1 according to one embodiment may achieve angular concordance by correcting an angle detected by each antenna into an angle on a global coordinate system. By using the integrated reception system, for example, the electronic device 1 according to one embodiment enables three-dimensional detection of the displacement (or a velocity or an acceleration, etc.) of the subject that vibrates. The feature of the above-described aspect of the electronic device 1 according to one embodiment will be simply referred to also as “feature B”. A more detailed description of the feature B will be given later.
Each of the feature A and the feature B described above will now be described in more details.
The transmission antenna array 24 described here may have the same configuration as that of the transmission antenna array 24 of the electronic device 100 described earlier with reference to
As illustrated in
Disposing the transmission antenna as described above makes it possible to bring the center line of the radar module into alignment with a normal line n passing through the center of the transmission antenna. The radar module mentioned here may be a module that includes the transmission antenna and/or the reception antennas. Disposing the transmission antenna as described above makes it possible to equally distribute the energy of an electromagnetic wave to the x-axis direction, the y-axis direction, and the z-axis direction.
The reception antenna array 31 may have the same configuration as that of the reception antenna array 31 of the electronic device 100 described earlier with reference to
As illustrated in
In one embodiment, the antenna “orientation” may be a direction perpendicular to a receiving surface of a receiving antenna. In one embodiment, the antenna “orientation” may be, for example, a direction perpendicular to a radiating surface of a plane-type antenna.
The reception antenna array 31A illustrated in
In the example illustrated in
The plurality of reception antenna arrays 31 may be arranged within a predetermined distance from one another such that the interval therebetween is, for example, a short-range interval. Each of the plurality of reception antenna arrays 31 is capable of detecting an object that is the same target as point-group coordinates. Setting a short distance between the respective centers of the reception antenna arrays 31 as described above makes it possible to ignore a difference among distances to the target. The center of the reception antenna array 31 mentioned here may be the center of a plurality of antenna elements (for example, those arranged in an array layout) that constitute the reception antenna array 31.
In one embodiment, each interval between one and another of the plurality of reception antenna arrays 31 may be set in such a way as to be less than the distance (range) resolution of the radar in relation to the predetermined object (the target device 200) that is the target. For example, let dij be the distance between any two reception antenna arrays i and j among the plurality of reception antenna arrays 31, let Di be the distance between the reception antenna array i and the target, Let Dj be the distance between the reception antenna array j and the target. The position of the reception antenna array i, the position of the reception antenna array j, and the position of the target may be the center position of the reception antenna array i, the center position of the reception antenna array j, and the center position of the target, respectively. In this case, the following formula, Formula (1), holds.
When the sign of inequality is true in Formula (1) disclosed above, the positions (of the centers) of the reception antenna arrays i and j and the position (of the center) of the target are in a layout illustrated in
On the other hand, when the sign of equality is true in Formula (1) disclosed above, the positions (of the centers) of the reception antenna arrays i and j and the position (of the center) of the target are in a layout illustrated in
In the electronic device 1 according to one embodiment, the transmission antenna array 24 and the three reception antenna arrays 31 illustrated in
As described above, in the electronic device 1 according to one embodiment, each of the plurality of reception antenna arrays 31 is capable of detecting an object that is the same target as point-group coordinates. In addition, as described above, in the electronic device 1 according to one embodiment, the difference among the distances to the target can be ignored by setting a short distance between the respective centers of the reception antenna arrays 31. With this configuration, each of the plurality of reception antenna arrays 31 is capable of calculating point-group coordinates detected as the target on the basis of two angles such as an azimuth angle and an elevation angle that are obtained through distance (range) and direction estimation.
The electronic device 1 according to one embodiment may perform coordinate transformation of the coordinates of the target detected by each of the plurality of reception antenna arrays 31 as described above, for example, by using a transformation matrix that is based on Euler angles.
The coordinate transformation based on Euler angles can be performed through the following steps (i) to (iii).
The coordinate system can be rotated through the three-step transformation described above. The coordinates (x′″, y′″, z′″) after the transformation and the original coordinates (x, y, z) can be calculated from, for example, Formula (3) disclosed below.
In one embodiment, for example, as illustrated in
For example, the electronic device 1 according to one embodiment, when transforming a coordinate system taking the reception antenna array 31A illustrated in
As described above, the electronic device 1 according to one embodiment is capable of detecting a faint and weak displacement such as, for example, vibrations of an apparatus. The electronic device 1 according to one embodiment is capable of detecting faint and weak oscillations such as a heartbeat in a human body. The subject that is to be detected by the electronic device 1 according to one embodiment is not specifically limited. The subject that is to be detected by the electronic device 1 according to one embodiment may be an engine, a machine tool, a lathe machine, a processing machine, or conveyance such as an automobile, etc., but is not limited to them, and thus may be any other kind of apparatus. A further explanation will now be given of operation for a case where the electronic device 1 according to one embodiment calculates the displacement of the subject that vibrates.
As illustrated in
As illustrated in
As described above, in the electronic device 1 according to one embodiment, the displacement vectors of vibrations obtained for the one detected object 200 are three vectors dv,1, dv,2, and dv,3. That is, in the electronic device 1 according to one embodiment, for example, the displacement vector dv,1 of vibrations is obtained on the basis of a reflected wave received by the transmission antenna array 24A. In the electronic device 1 according to one embodiment, for example, the displacement vector dv,2 of vibrations is obtained on the basis of a reflected wave received by the transmission antenna array 24B. In the electronic device 1 according to one embodiment, for example, the displacement vector dv,3 of vibrations is obtained on the basis of a reflected wave received by the transmission antenna array 24C. Therefore, the electronic device 1 according to one embodiment makes it possible to detect displacement of vibration, etc. of a predetermined object (the subject/the target device 200) that is the target in a three-dimensional manner.
Being comparatively different from the electronic device 100 illustrated in
The electronic device 1 according to one embodiment illustrated in
As illustrated in
Each coordinate transformation processing unit 13 illustrated in
As illustrated in
As described above, the electronic device 1 according to one embodiment may include at least one transmission antenna (for example, the transmission antenna array 24), a plurality of reception antenna arrays 31, and a signal processing unit 10′. In one embodiment, each of the plurality of reception antenna arrays 31 may include a plurality of reception antennas configured to receive a reflected wave that is a transmission wave having been reflected. As described above, the plurality of reception antenna arrays 31 may be arranged such that they are in different orientations from one another. Based on a transmission signal transmitted as the transmission wave and a reception signal received as the reflected wave, the signal processing unit 10′ detects the displacement of a subject. The signal processing unit 10′ may synthesizes the displacement of the subject detected by each of the plurality of reception antenna arrays 31 in a coordinate system of a plurality of dimensions identical thereto.
The electronic device 1 according to one embodiment may include, for example, three reception antenna arrays 31 as the plurality of reception antenna arrays 31. In this case, the signal processing unit 10′ may synthesize the displacement of the subject detected by each of the three reception antenna arrays in a coordinate system of three dimensions identical thereto. In one embodiment, the signal processing unit 10′ may synthesize the displacement of the subject detected by each of the plurality of reception antenna arrays 31 after performing coordinate transformation into a coordinate system of a plurality of dimensions by using, for example, a transformation matrix that is based on Euler angles.
In the electronic device 1 according to one embodiment, based on a transmission signal and a reception signal, the signal processing unit 10′ may detect vibrations of the target device based on the displacement of the subject or detect a heartbeat of a human or an animal that is the subject.
As described above, the electronic device 1 according to one embodiment makes it possible to detect vibrations of an apparatus well, for example. Therefore, the electronic device 1 according to one embodiment makes it possible to detect vibrations of an apparatus by transmitting and receiving a radio wave or the like and to use it for estimating the status of the apparatus.
As described above, the electronic device 1 according to one embodiment makes it possible to detect faint and weak oscillations such as, for example, a heartbeat in a human body. Therefore, with the electronic device 1 according to one embodiment, for example, a heartbeat in a human body or the like can be detected with good accuracy through transmission and reception of a radio wave or the like.
The effects of object detection by the electronic device 1 according to one embodiment will now be further described below.
In related art, it has been difficult to detect the displacement (a velocity and/or an acceleration) of vibrations of an object in a three-dimensional manner by using an ordinary radar sensor. The electronic device 1 according to one embodiment makes it possible to detect displacement of vibration of the subject in a three-dimensional manner, for example, as illustrated in
On the other hand, in the time-series waveforms in the respective directions of axes of the displacement traveled by the object that vibrates, frequency configurations and/or overall vibration displacement levels are different from one another.
As described here, the electronic device 1 according to one embodiment makes it possible to detect, for example, by using a radar, displacement traveled by an object that vibrates (a velocity and/or an acceleration), in a three-dimensional manner. Therefore, with the electronic device 1 according to one embodiment, for example, vibrations of an apparatus can be detected with good accuracy. With the electronic device 1 according to one embodiment, for example, a heartbeat in a human body or the like can be detected with good accuracy through transmission and reception of a radio wave or the like.
Other embodiments will be described below.
In the example illustrated in
In the example illustrated in
In the example illustrated in
In the example illustrated in
In one embodiment, the layout of the transmission antenna array 24 and/or the reception antenna array 31 of the electronic device 1 is not limited to the layout illustrated in
In the electronic device 100 illustrated in
While the present disclosure has been described based on various drawings and embodiments, it is to be noted that a person skilled in the art can easily make various variations or changes based on the present disclosure. Therefore, it is to be noted that these variations or changes are within the scope of the present disclosure. For example, functions and the like included in each functional unit can be reconfigured without causing any logical contradiction. A plurality of functional units or the like may be combined into one or may be divided. Each embodiment according to the present disclosure described above is not limited to strict implementation in accordance with each description of the embodiment, and may be implemented by appropriately combining the features or omitting a part thereof. That is, based on the present disclosure, a person skilled in the art can make various variations and changes to the content of the present disclosure. Therefore, the scope of the present disclosure encompasses these variations and changes. For example, in each embodiment, each functional unit, each means, each step, or the like can be added to another embodiment or replaced with each functional unit, each means, each step, or the like in another embodiment without causing any logical contradiction. In each embodiment, a plurality of functional units, means, steps, or the like may be combined into one or may be divided. Each embodiment according to the present disclosure described above is not limited to strict implementation in accordance with each description of the embodiment, and may be implemented by appropriately combining the features or omitting a part thereof.
The embodiments described above are not limited to implementation as the electronic device 1. For example, the embodiments described above may be implemented as a method for controlling a device such as the electronic device 1. For example, the embodiments described above may be implemented as a program to be run by a device such as the electronic device 1. The device that runs the program may be various kinds of electronic device capable of running the program, for example, a computer, an arithmetic processor, an information processing apparatus, or the like. The embodiments described above may be implemented as, for example, a storage medium storing a program to be run by a computer of a system or a device described above, that is, may be implemented as a computer-readable storage medium.
The electronic device 1 according to the above embodiments has been described as a device that includes components constituting a so-called radar sensor, such as the transmission antenna array 24 and the reception antenna array 31. However, the electronic device according to one embodiment may be implemented as a component such as, for example, the signal processing unit 10′. In this case, for example, the signal processing unit 10′ may have a function for processing signals dealt with by the transmission antenna array 24 and the reception antenna array 31.
Number | Date | Country | Kind |
---|---|---|---|
2021-188191 | Nov 2021 | JP | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2022/041428 | 11/7/2022 | WO |