The present invention relates to an object detection apparatus and an object detection method for detecting a target object based on radio waves reflected off the target object or radiated from the target object, and further relates to a computer-readable recording medium in which a program for realizing them is recorded.
In contrast to light, radio waves (such as microwaves, millimeter waves, and terahertz waves) are superior in terms of ability to penetrate through objects. Imaging devices (object detection apparatuses) that use this penetrating ability of radio waves to image items behind clothes, items in bags, or the like, and perform inspection have been put to practical use.
Some methods have been proposed as the imaging method of object detection apparatuses. One of the methods is the array antenna method (see Non-Patent Document 1, for example). Hereinafter, the array antenna method will be described with reference to
As shown in
The transmitter 211 emits, from the transmitting antenna 212, RF signals (radio waves) 213 to detection target objects 2041, 2042, . . . , 204K (where K is the number of target objects). The RF signals (radio waves) 213 are reflected off the detection target objects 2041, 2042, . . . , 204K, and reflected waves 2031, 2032, . . . , 203K are respectively generated.
The generated reflected waves 2031, 2032, . . . , 203K are received by the receiving antennas 2011, 2022, . . . , 202N. The receiver 201 calculates, based on the received reflected waves 2031, 2032, . . . , 203K, the radio wave strengths of the radio waves reflected off the detection target objects 2041, 2042, . . . , 204K. Then, the receiver 201 images distributions of the calculated radio wave strengths. Accordingly, respective images of the detection target objects 2041, 2042, . . . , 204K are obtained.
Furthermore, as shown in
Here, it is assumed that the incoming waves 2031, 2032, . . . , 203K respectively have complex amplitudes of [s(θ1), s(θ2), . . . , s(θK)]. Because the receiver 201 is provided with a down-converter (not shown in
In the receiving antennas 2021, 2022, . . . , 202N, the relationship between the corresponding complex amplitudes [r(d1), r(d2), . . . , r(dN)] of the received signal and the corresponding complex amplitudes [s(θ1), s(θ2), . . . , s(θK)] of the incoming wave is given by Formula (1) below.
In Formula (1) above, n(t) is a vector whose element is noise content. An additional character T denotes a transpose of a vector or a matrix. λ is a wavelength of the incoming waves (RF signals) 2031, 2032, . . . , 203K.
Furthermore, in Formula (1) above, a complex amplitude r of a reception signal is an amount obtained through a measurement. A direction matrix A is an amount that can be defined (designated) in signal processing. A complex amplitude s of an incoming wave is unknown, and estimation of the incoming wave direction aims to determine the direction of an incoming wave s based on a reception signal r obtained through a measurement.
In an incoming wave direction estimation algorithm, a correlation matrix R is calculated based on the reception signal r obtained through a measurement, which is given by Formula (2) below.
[Formula 2]
R=E[r·rH] (2)
In Formula (2) above, E[ ] denotes that an element in the parenthesis is subjected to temporal averaging processing, and the additional character H denotes a complex conjugate transpose. Then, based on the calculated correlation matrix R, any of the evaluation functions given by Formulae (3) to (5) below is calculated.
In the MUSIC method, EN=[eK+1, . . . , eN] is a matrix that is configured by N−(K+1) vectors whose characteristic numbers indicate electric power of a noise n(t), out of characteristic vectors of the correlation matrix R.
Furthermore, in the conventional antenna array shown in
According to the theory described in Non-Patent Document 1, the evaluation functions given by Formulae (3) to (5) have the peaks at angles θ1, θ2, . . . , θK of the incoming waves. Accordingly, if an evaluation function is calculated and a peak thereof is referenced, the angle of the corresponding incoming wave can be obtained. Based on a distribution of the angles of the incoming waves that are obtained using the evaluation functions given by Formulae (3) to (5), the positions and the shape of target objects can be displayed as images.
Other examples of object detection apparatuses according to the conventional antenna array type are also disclosed in Patent Documents 1 to 3. Specifically, the object detection apparatuses disclosed in Patent Documents 1 and 2 use phase shifters respectively connected to N receiving antennas built in a receiver to control the directionality of receiving array antennas, which are constituted by the N receiving antennas.
Also, the object detection apparatuses disclosed in Patent Documents 1 and 2 change the directionality of the N beam-shaped receiving array antennas, and emit directional beams of the receiving array antennas to K detection target objects. Accordingly, the strengths of radio waves reflected off the respective detection target objects are calculated.
Furthermore, the object detection apparatus disclosed in Patent Document 3 uses the frequency dependence of N receiving array antennas to control the directionality of the N receiving array antennas. Furthermore, similar to the examples of Patent Documents 1 and 2, the object detection apparatus disclosed in Patent Document 3 also emits directional beams of the N receiving array antennas to K detection target objects, and calculates the strengths of radio waves reflected off the respective detection target objects.
Furthermore, an actual object detection apparatus includes, as shown in
Patent Documents 4 and 5 disclose examples of a radar, instead of an imaging device. The radars disclosed in Patent Documents 4 and 5 measure a distance from the radar to a target object (at a position in the front-back direction with respect to the radar) using Frequency Modulated Continuous Wave (FMCW) signals. These radars also measure orientation in which the target object is present, by combining high resolution incoming direction estimation using the MUSIC method with the method for electronically scanning a beam direction of radio waves using array antennas, or the method for mechanically scanning a beam direction of radio waves by mechanically moving a device. Note that, in this case, the orientation of the target object is expressed by an angle with respect to a reference line that passes through the radar.
Meanwhile, in the array antenna method, if attempts are made to accurately detect a target object, the number of required receiving antennas and the number of associated receivers will significantly increase, resulting in the problem that the cost, size, and weight of an object detection apparatus will increase.
The above-described problem will be specifically described. First, in a case of the array antenna method, an inter-antenna distance between the receiving antennas 2011, 2022, . . . , 202N needs to be set to half or less of the wavelength λ of the reflected waves 2031, 2032, . . . , 203K that are received by the receiver 201. For example, if the reflected waves 2031, 2032, . . . , 203K are millimeter waves, the wavelength λ is about several millimeters, and thus the inter-antenna distance is not greater than several millimeters. Also, if this condition is not satisfied, a problem will occur in that, in a generated image, a virtual image appears at a position at which none of the detection target objects 2041, 2042, . . . , 204K are present.
Furthermore, the resolution of the image depends on a directional beam width Δθ of the receiving array antennas (2011, 2022, . . . , 202N). The directional beam width Δθ of the receiving array antennas (2011, 2022, . . . , 202N) is given as Δθ˜λ/D. Here, D is an aperture size of the receiving array antennas (2011, 2022, . . . , 202N), and corresponds to the distance between the receiving antennas 2021 and 202N provided at both ends. In other words, in order to achieve a resolution that can be practically used in imaging items behind clothes, items in bags, or the like, the aperture size D of the receiving array antennas (2011, 2022, . . . , 202N) needs to be set to a value from several tens of centimeters to about several meters.
In view of the above-described two conditions, namely, the condition that the inter-antenna distance between N receiving antennas is set to half or less of the wavelength λ (several millimeters or less), and the condition that the distance between the receiving antennas provided at two ends needs to be about at least several tens of centimeters, the number N of antennas required for each column is about several hundred.
Furthermore, an actual object detection apparatus includes, as shown in
Since large numbers of receiving antennas and receivers are required in this way, the array antenna method is significantly expensive in terms of cost as described above. Furthermore, each antenna is arranged in a square region with each side being several tens of centimeters to several meters, and thus the device is significantly large and heavy.
On the other hand, radars, which encompass the radars disclosed in Patent Documents 4 and 5, can be typically downsized relative to the imaging devices disclosed in Patent Documents 1 to 3. However, due to being downsized, the resolution of the radars is reduced relative to that of the imaging devices. Due to the reduced resolution, the radars cannot identify the shape of a target object but can only recognize the position of the target object.
Specifically, when the FMCW method disclosed in Patent Documents 4 and 5 is employed, the resolution can be given as c/(2BW), where c is the speed of light, and BW is a bandwidth of an RF signal. Accordingly, if the bandwidth BW is set to 2 GHz, the resolution is calculated as 7.5 cm. With this resolution, although the position of a target object that is several centimeters in size can be measured, the shape of the target object that is several centimeters in size is hard to identify.
In addition, in the radars disclosed in Patent Documents 4 and 5, particularly for on-board applications, the aperture size D is reduced to about several centimeters. Accordingly, the directional beam width Δθ˜λ/D increases, also leading to the problem that the resolution of measurement in an angle direction (incoming direction estimation) is reduced. This problem occurs in both cases where the beam direction of radio waves is electronically scanned by using a device including a plurality of transmitting/receiving units and antennas, such as an array antenna, and where the beam direction of radio waves is mechanically scanned by using a device including a single transmitting/receiving unit, and an antenna, such as a parabola antenna.
The problem of trade-off occurring between the aperture size D of the antennas and resolution in angular direction measurement (incoming direction estimation), as described in connection to the above-described Patent Documents 1 to 5 is due to employing a method in which the position and shape of a target object are expressed by variables of an angle or orientation.
Furthermore, in the mechanical scanning methods disclosed in Patent Documents 4 and 5, there are the problems that the scan rate is limited to a low rate since the radar device is moved mechanically, that the device is large since it requires a driving device for mechanically activating the radar device, that mechanical scanning involving wear-out of the mechanism thereby reducing the lifetime of the device and increasing the maintenance cost, and the like.
As described above, in the conventional object detection apparatus, if a desired resolution of a millimeter wave image is to be achieved, the cost, size, and weight of the device will be significantly increased. On the other hand, if an attempt is made to downsize the device, there is the problem that the resolution of a millimeter wave image will be reduced.
Therefore, the usages and chances in which an object detection apparatus can be actually used are restricted. Furthermore, depending on the employed method, the speed of inspection of a target object is also restricted. In view of the aforementioned circumstances, there is a demand for reducing the numbers of required antennas and receivers compared to those in a conventional case, and realizing image generation with high-speed scanning without the need to move a receiver.
An example object of the invention is to provide an object detection apparatus, an object detection method, and a program that can solve the aforementioned problems, and can improve the accuracy of detecting an object using radio waves, while suppressing increases in the device cost, size, and weight.
In order to achieve the above-described object, according to one aspect of the invention, an object detection apparatus for detecting an object using radio waves, including:
a transmitting unit for emitting, to the object, radio waves that serve as transmission signals;
a receiving unit for receiving the radio waves reflected off the object as reception signals;
a spectrum calculating unit for calculating, based on the transmission signals and the reception signals, a spectrum in which a region of a position parameter of the object and a region of a shape parameter of the object are taken as domains; and
a parameter value calculating unit for calculating, based on the spectrum calculated by the spectrum calculating unit, a value of the position parameter of the object and a value of the shape parameter of the object.
Furthermore, according to one aspect of the invention, an object detection method for detecting an object using a device that includes a transmitting unit for emitting, to the object, radio waves that serve as transmission signals, and a receiving unit for receiving the radio waves reflected off the object as reception signals, the method including:
(a) a step of calculating, based on the transmission signals and the reception signals, a spectrum in which a region of a position parameter of the object and a region of a shape parameter of the object are taken as domains; and
(b) a step of calculating, based on the spectrum calculated in the (a) step, a value of the position parameter of the object and a value of the shape parameter of the object.
Moreover, in order to achieve the above-described object, according to one aspect of the invention, a computer readable recording medium for use in an object detection apparatus that includes a transmitting unit for emitting, to an object, radio waves that serve as transmission signals, a receiving unit for receiving the radio waves reflected off the object as reception signals, and a processor, the computer readable recording medium including a program recorded thereon, the program including instructions that cause the processor to carry out:
(a) a step of calculating, based on the transmission signals and the reception signals, a spectrum in which a region of a position parameter of the object and a region of a shape parameter of the object are taken as domains; and
(b) a step of calculating, based on the spectrum calculated in the (a) step, a value of the position parameter of the object and a value of the shape parameter of the object.
As described above, according to the invention, it is possible to improve the accuracy of detecting an object using radio waves, while suppressing increases in the device cost, size, and weight.
Hereinafter, an object detection apparatus, an object detection method, and a program according to a first example embodiment of the invention will be described with reference to
[Apparatus Configuration]
First, a configuration of the object detection apparatus according to the first example embodiment will be described with reference to
An object detection apparatus 1000 according to the present example embodiment shown in
The transmitting unit 1101 emits, to an object 1003 to be detected (hereinafter, referred to as “target object”), radio waves that serve as transmission signals. The receiving unit 1102 receives the radio waves reflected off the target object 1003 as reception signals.
In the first example embodiment, the receiving unit 1102 further mixes the transmission signals generated by the transmitting unit 1101 with the received reception signals to generate intermediate frequency signals (hereinafter, referred to as “Intermediate Frequency (IF) signals”). Specifically, as shown in
Also,
The spectrum calculation unit 1103 calculates, based on the transmission signals and the reception signals, specifically, the IF signals, a spectrum in which a region of a parameter indicating the position of the target object 1003 (hereinafter, referred to as “position parameter”), and a region of a parameter indicating the shape of the target object 1003 (hereinafter, referred to as “shape parameter”) are taken as domains. The parameter value calculation unit 1107 calculates, based on the spectrum calculated by the spectrum calculation unit 1103, the value of the position parameter of the target object 1003, and the value of the shape parameter of the target object 1003.
The calculation result output unit 1108 outputs the values of the position parameter and the shape parameter of the target object 1003 that were calculated by the parameter value calculation unit 1107. Note that the format of output of the parameter values by the calculation result output unit 1108 is not particularly limited. A format of numerical value data, image data, and the like that is suitable for the system requirement is selected as the format of output.
In this way, in the first example embodiment, a spectrum in which a region of the position parameter of the target object 1003 and a region of the shape parameter thereof are taken as domains is calculated, and the values of the parameters indicating the position and the shape of the target object 1003 are calculated based on the spectrum. In other words, according to the first example embodiment, it is possible to calculate the value of the position parameter of the target object 1003 and the value of the shape parameter thereof, using a minimum configuration with a single transmitting unit 1101 and a single receiving unit 1102. Accordingly, in the first example embodiment, it is possible to improve the accuracy of detecting an object using radio waves, while suppressing increases in the device cost, size, and weight.
The following will more specifically describe a configuration of the object detection apparatus according to the first example embodiment with reference to
First, in the first example embodiment, as shown in
Furthermore, as shown in
In the transmitting unit 1101, the oscillator 1201 generates an RF signal (radio wave). The RF signal generated by the oscillator 1201 is transmitted as a transmission signal from the transmitting antenna 1202, and is emitted to the target object 1003. The radio wave reflected off the target object 1003 is received by the receiving antenna 1203 of the receiving unit 1102.
The mixer 1204 mixes the RF signal input from the oscillator 1201 via the terminal 1208 with the radio wave (reception signal) received by the receiving antenna 1203 to generate an IF signal. The IF signal generated by the mixer 1204 is transmitted to the arithmetic device 1211 via the interface circuit 1205. The interface circuit 1205 functions to convert an IF signal, which is an analog signal, into a digital signal, which can be handled by the arithmetic device 1211, and outputs the obtained digital signal to the arithmetic device 1211.
Furthermore, in the example shown in
Specifically, in the example of
Furthermore, in the example of
The variable phase shifters 1207 respectively control the phases of reception signals that are supplied from the receiving antennas 1203 to the mixers 1204, thereby controlling the directionality of the receiving antennas 1203. Note that the variable phase shifters 1207 may also be arranged between the mixers 1204 and the interface circuit 1205.
Furthermore, the transmitting/receiving device 1001 shown in
The following will describe a transmission signal that is emitted to an object in the present example embodiment, with reference to
First, in the first example embodiment, an RF signal that is generated by the oscillator 1201 is preferably an FMCW signal in which, as shown in
Furthermore, in the first example embodiment, if a plurality of transmitting/receiving devices 10011, 10012, . . . , 1001N (where N is the number of transmitting/receiving devices 1001) are used, it is preferable that each of the transmitting/receiving devices 10011, 10012, . . . , 1001N be controlled so as not to operate at the same time as another transmitting/receiving device, in order to avoid interference between the transmitting/receiving devices 10011, 10012, . . . , 1001N. That is, the respective transmitting/receiving devices 10011, 10012, . . . , 1001N are controlled so as to operate at timings different from each other, and the transmitting units 11011, 11012, . . . , 1101N provided on the transmitting/receiving devices 10011, 10012, . . . , 1001N emit radio waves at timings different from each other. By configuring the transmitting/receiving devices such that they do not operate at the same time, such a situation that the transmitting/receiving devices 10011, 10012, . . . , 1001N interfere with each other can be avoided.
Furthermore, in the first example embodiment, if each of the transmitting/receiving devices 10011, 10012, . . . , 1001N operates in the same time period as the time period in which another transmitting/receiving device operates, it is preferable that control be performed such that, as shown in
[Apparatus Operation]
The following will describe an operation of the object detection apparatus 1000 according to the first example embodiment with reference to
As shown in
Then, the receiving unit 1102 of the transmitting/receiving device 1001 receives the radio waves reflected off the target object 1003 as reception signals, and mixes the transmission signals generated by the transmitting unit 1101 with the received reception signals to generate IF signals (step A2).
Then, the spectrum calculation unit 1103 calculates, based on the IF signals generated in step A2, a spectrum (hereinafter, referred to as “target object spectrum”) in which a region of the position parameter of the target object 1003 and a region of the shape parameter thereof are taken as domains (step A3).
Then, the parameter value calculation unit 1107 calculates, based on the target object spectrum calculated in step A3, the value of the position parameter of the target object 1003 and the value of the shape parameter thereof (step A4).
Then, the calculation result output unit 1108 outputs the values of the position parameter and the shape parameter of the target object 1003 that were calculated by the parameter value calculation unit 1107 in step A4 (step A5).
The following will describe steps A3 to A5 shown in
[Step A3]
First, step A3 of calculating, based on the transmitted and received radio waves, a spectrum (target object spectrum) in which a region of the position parameter of the target object 1003 and a region of the shape parameter thereof are taken as domains will be described in detail.
In describing step A3, first, the positional relationship between a target object and a transmitting/receiving device will be described with reference to
First, a situation is taken as an example in which, as shown in
In Formula (6), σ(R) is a reflectance of the target object that is present at the distance R. c is the speed of light, α is the time rate of change of an RF frequency, and α=BW/Tchirp is satisfied. Tchirp is a chirp period as shown in
[Formula 7]
R
k±(uk)=√{square root over (Rk2+(Δk/2)2±LkΔk)}, (7)
Here, in Formula (7), uk is a two-dimensional variable that is a pair of distance Rk to the target object 1003k and width Δk thereof, and is thus given by uk=(Rk, Δk) (k=1, 2, . . . , K). Furthermore, Rk±(uk) indicates that Rk+ and Rk− are functions of uk=(Rk, Δk).
The reflectance σ(R) is assumed to take a finite constant value in a distance range from Rk− to Rk+ in which the target object 1003k (k=1, 2, . . . , K) is present. Also, the reflectance σ(R) is 0 (zero) in a distance range in which the target object 1003k (k=1, 2, . . . , K) is not present.
Also, the reception IF signal r(t) given by Formula (6) above can be modified as indicated by Formula (8) below.
In Formula (8) above, σ(uk) corresponds to a reflectance of the target object 1003k. That is, σ(uk) is assumed to be equal to the value of the reflectance σ(R) in a distance range from Rk− to Rk+ in which the target object 1003k is present.
Here, the characteristics of the reflectance σ(u) with the two-dimensional variable u=(R, Δ), which is a pair of distance R and width Δ, taken as an argument, that is, as a domain is considered with reference to
As show in
Here, if point coordinate values uk=(Rk, Δk) (k=1, 2, . . . , K) at which the reflectance σ(u) is nonzero can be obtained, the distance Rk and the width Δk of the target object 1003k (k=1, 2, . . . , K) can be calculated based on the values of uk.
The following will describe a method for obtaining point coordinate values uk=(Rk, Δk) (k=1, 2, . . . , K) at which the reflectance σ(u) is nonzero.
The reception IF signal r(t) is assumed to be obtained at a sampling time tm (m=1, 2, . . . , M0). M0 is the number of times sampling is performed. It is assumed that the range of tm is a chirp period. A sampling time period Δt is given as TChirp/M0, and tm=−TChirp/2+mΔt (m=1, 2, . . . , M0) is obtained.
In view of above, Formula (8) can be rewritten into Formula (9) below. In Formula (9), n is a vector whose element is noise content.
With reference to
As shown in
Furthermore, in both the conventional antenna array method and the method according to the first example embodiment, the same r=As+n is satisfied. Accordingly, based on the evaluation function of the same form as that of the conventional antenna array method, a desired target object state parameter can be calculated also in the present example embodiment.
Specifically, in the conventional antenna array method, the value of the incoming wave incident angle θk (k=1, 2, . . . , K) is calculated based on the value of the argument 9 that gives the peak of an evaluation function given by one of Formulae (3) to (5). On the other hand, in the method according to the present example embodiment, the value of the target object state parameter uk (k=1, 2, . . . , K) can be calculated based on the value of the argument u that gives the peak of an evaluation function given by one of Formulae (10) to (12), which are of the same forms as Formulae (3) to (5).
a(u) in Formulae (10) to (12) is given by M0×a one-dimensional vector given by Formula (9). In Formula (12), en (n=K+1, . . . , M) is a vector that has the minimum characteristic value, out of characteristic vectors of the correlation matrix Rall. The definition of M will be described later.
The following will describe how to obtain the correlation matrix Rall in Formulae (10) to (12), with reference to
The problem regarding correlation between reflections inevitably occurs as long as radio waves are emitted to the target objects 10031, 10032, . . . , 1003K from the same transmitter (transmitting antenna 1202). In contrast thereto, the problem regarding correlation between reflections can be avoided, as shown in
In
Specifically, the q-th sub array is configured by reception signals of the q-th to (q+M−1)-th sub arrays, that is, by rq=[r(tq), r(tq+1), . . . , r(tq+M-1)]T. M is also the number of times sampling is performed, of each sub array. The correlation matrix Rcol(q) obtained based on the q-th sub array is calculated using Formula (13) below.
[Formula 13]
R
col(q)
=r
Q
·r
Q
H, (53)
It is assumed that an average of correlation matrices Rcol(q) (q=1, 2, . . . , Q) of all of the sub arrays is defined as Rall. The number Q of sub arrays is set to be not smaller than the number K of target objects.
In the first example embodiment, a sub array 1221q (q=1, 2, . . . , Q) is configured in which the reception signal rq=[r(tq), r(tq+1), . . . , r(tq+M-1)]T at each sampling time is regarded as a virtual receiving antenna.
In the above-described method, by utilizing the characteristics that the correlation between reception signals of different sub arrays weakens, the problem resulting from correlation between reflected waves is avoided.
The terms in step A3 “a spectrum in which a region of the position parameter and a region of the shape parameter of the target object are taken as domains” refer to evaluation functions given by Formulae (10) to (12). A domain of a spectrum is designated by the argument u=(R, Δ) of the evaluation functions, and thus is designated by the parameter R indicating the position of the target object, and the parameter A indicating the shape of the target object. In step A3, it is sufficient to calculate an evaluation function given by one of Formulae (10) to (12), that is, a spectrum.
Furthermore, in step A3, the spectrum calculation unit 1103 takes the reception IF signal that is generated by the receiving unit 1102 and is given by Formulae (6) to (8). The spectrum calculation unit 1103 calculates, based on the reception IF signal, an evaluation function given by one of Formulae (10) to (12), that is, and a spectrum.
[Step A4]
In step A4, values of the position parameter and the shape parameter of the target object 1003 are calculated, based on the spectrum calculated in step A3, that is, an evaluation function given by one of Formulae (10) to (12). The following will describe step A4 in detail.
As already described in the description of step A3, the value of the target object state parameter uk (k=1, 2, . . . , K) can be calculated based on the value of the argument u that gives the peak of the evaluation function given by each of Formulae (10) to (12).
That is, if the distance and the width of the target object 1003k (k=1, 2, . . . , K) are respectively set to Rk and Δk, the evaluation functions P(u) given by Formulae (10) to (12) have, as shown in
Therefore, in step A4, the parameter value calculation unit 1107 calculates, based on the position of the point that gives the peak of the evaluation function P(u) calculated in step A3, the value of the position Rk and the value of the width Δk of the target object 1003k.
More specifically, in step A4, the parameter value calculation unit 1107 receives the evaluation function that was calculated in step A3 and is given by one of Formulae (10) to (12), that is, the spectrum. Then, the parameter value calculation unit 1107 calculates, based on the peak position of the received evaluation function given by one of Formulae (10) to (12), that is, the spectrum, the value of the position Rk and the value of the width Δk of the target object 1003k.
[Step A5]
In step A5, the calculation result output unit 1108 receives, from the parameter value calculation unit 1107, information relating to the position Rk and the width Δk of the target object 1003k (k=1, 2, . . . , K) that were calculated in step A4, and outputs the received information. Specifically, the calculation result output unit 1108 outputs the received information as numerical value data or image data. The output destination is the system on which the object detection apparatus 1000 is installed.
[Effects of First Example Embodiment]
The following will summarize effects of the first example embodiment. A typical conventional millimeter-wave imaging device according to the array antenna method requires a larger number (several thousands to several tens of thousands) of antennas than in the first example embodiment to perform estimation of the incoming direction (angular direction) of received radio waves and detect the shape of a target object. On the other hand, in contrast to the conventional method of estimating the incoming direction of radio waves, that is, measuring the angular direction, the first example embodiment employs a method for detecting information relating to the shape, such as the width, of a target object based on the result of measurement of the distance from the transmitting/receiving device to the target object.
With the method according to the first example embodiment that does not need to measure the angular direction, the problem of the conventional method that measures the angular direction, that is, the problem of trade-off occurring between the aperture size D of antennas and resolution in angular direction measurement (incoming direction estimation) can be solved. As a result, the first example embodiment realizes a radar method that can not only recognize the position of a target object but also detect information relating to the shape, such as the width, of the target object, while using a small radar device with a few (to several) antennas. Furthermore, the information relating to the shape, such as the width, of the target object that was detected using the present radar method can be used for identifying the type of the target object (such as a car or a foot passenger, for example). Furthermore, the first example embodiment realizes a significant reduction in the actual number of antennas compared to a conventional millimeter-wave imaging device according to the array antenna method, thus achieving significant reductions in the size, weight, and cost of the device.
Furthermore, in the first example embodiment, a desired function can be realized by electronically scanning a two-dimensional variable u=(R, Δ), which is a pair of the distance R and the width Δ, in the arithmetic device 1211, without using mechanical scanning. Thus, the first example embodiment can have advantages such that a higher scan rate can be realized than that of mechanical scanning, the device can be downsized since there is no need to provide a device for mechanically moving the antenna, and the lifetime and maintenance cost of the device can be improved compared to mechanical scanning, since the mechanism does not wear out.
[Program]
A program according to the first example embodiment is preferably a program that causes a computer, namely, the arithmetic device 1211 to execute steps A3 to A5 shown in
Furthermore, the program according to the first example embodiment may also be executed by a computer system constituted by a plurality of computers. In this case, for example, each of the computers may also function as any one of the spectrum calculation unit 1103, the parameter value calculation unit 1107, and the calculation result output unit 1108.
Hereinafter, an object detection apparatus, an object detection method, and a program according to a second example embodiment of the invention will be described with reference to
[Apparatus Configuration]
First, a configuration of the object detection apparatus according to the second example embodiment will be described with reference to
As shown in
On the other hand, as shown in
The position spectrum calculation unit 1111 calculates, based on the IF signals generated by the transmitting/receiving device 1001, a spectrum in which a region of a position parameter of the target object 1003 is taken as a domain (hereinafter, referred to as “position spectrum”).
The target object position parameter value calculation unit 1112 calculates, based on the position spectrum calculated by the position spectrum calculation unit 1111, the value of the position parameter of the target object 1003.
The shape spectrum calculation unit 1113 calculates, based on the IF signals generated by the transmitting/receiving device 1001 and the value of the position parameter of the target object 1003 calculated by the target object position parameter value calculation unit 1112, a spectrum in which a region of the shape parameter of the target object 1003 is taken as a domain (hereinafter, referred to as “shape spectrum”).
The target object shape parameter value calculation unit 1114 calculates, based on the shape spectrum calculated by the shape spectrum calculation unit 1113, the value of the shape parameter of the target object 1003.
The values of the position parameter of the target object 1003 calculated by the target object position parameter value calculation unit 1112 and the value of the shape parameter of the target object 1003 calculated by the target object shape parameter value calculation unit 1114 are transferred to the calculation result output unit 1108. The calculation result output unit 1108 outputs the transferred values of the position parameter and the shape parameter of the target object 1003.
Note that, also in the second example embodiment, as in the first example embodiment, the format of output of the parameter values by the calculation result output unit 1108 is not particularly limited. Also in the second example embodiment, the position spectrum calculation unit 1111, the target object position parameter value calculation unit 1112, the shape spectrum calculation unit 1113, the target object shape parameter value calculation unit 1114, and the calculation result output unit 1108 are configured by implementing a later-described program according to the second example embodiment into the arithmetic device (computer) 1212.
As described above, also in the second example embodiment, spectra in which a region of the position parameter and a region of the shape parameter of the target object 1003 are respectively taken as domains are calculated, and values of the position parameter and the shape parameter of the target object 1003 are calculated based on the spectra. In other words, also according to the second example embodiment, it is possible to calculate the value of the position parameter of the target object 1003 and the value of the shape parameter thereof, using a minimum configuration with a single transmitting unit 1101 and a single receiving unit 1102. Accordingly, also in the second example embodiment, as in the first example embodiment, it is possible to improve the accuracy of detecting an object using radio waves, while suppressing increases in the device cost, size, and weight.
[Apparatus Operation]
The following will describe an operation of the object detection apparatus 1020 according to the second example embodiment with reference to
As shown in
Then, the position spectrum calculation unit 1111 calculates, based on the IF signals generated in step A12, a position spectrum in which a region of the position parameter of the target object 1003 is taken as a domain (step A13).
Then, the target object position parameter value calculation unit 1112 calculates, based on the position spectrum calculated in step A13, the value of the position parameter of the target object 1003 (step A14). The target object position parameter value calculation unit 1112 also transfers the calculated value of the position parameter to the calculation result output unit 1108.
Then, the shape spectrum calculation unit 1113 calculates, based on the IF signals generated in step A2 and the value of the position parameter of the target object 1003 calculated in step A14, a shape spectrum in which a region of the shape parameter of the target object 1003 is taken as a domain (step A15).
Then, the target object shape parameter value calculation unit 1114 calculates, based on the shape spectrum calculated in step A15, the value of the shape parameter of the target object 1003 (step A16). The target object shape parameter value calculation unit 1114 also transfers the calculated value of the shape parameter to the calculation result output unit 1108.
Then, the calculation result output unit 1108 outputs the value of the position parameter calculated in step A14, and the value of the shape parameter calculated in step A16 (step A17).
In this way, in the second example embodiment, the position spectrum calculation unit 1111 and the shape spectrum calculation unit 1113 function as the spectrum calculation unit 1103 of the first example embodiment. Also, in the second example embodiment, the target object position parameter value calculation unit 1112 and the target object shape parameter value calculation unit 1114 function as the parameter value calculation unit 1107 of the first example embodiment.
The following will describe steps A13 to A17 shown in
[Step A13]
First, step A13 of calculating a spectrum in which a region of the position parameter of the target object 1003 is taken as a domain (position spectrum) based on transmitted and received radio waves will be described in detail.
As already described in the first example embodiment, in the system shown in
In step A13 of the second example embodiment, the IF signal given by Formula (6) is subjected to approximation in which the value of the width Δk of the target object 1003k (k=1, 2, . . . , K) is regarded as 0 and thus is disregarded. At this time, the IF signal given by Formula (6) is modified as indicated by Formula (14).
Here, the reflectance σ(R) with the distance R taken as an argument has a nonzero value at the distance Rk at which the target object 1003k (k=1, 2, . . . , K) is present, and is zero at positions other than the distance Rk.
Here, if the distance Rk (k=1, 2, . . . , K) at which the reflectance σ(R) is nonzero can be obtained, the distance Rk of the target object 1003k (k=1, 2, . . . , K) can be calculated based on the value of Rk.
The following will describe a method for obtaining the distance Rk (k=1, 2, . . . , K) at which the reflectance σ(R) is nonzero.
Formula (14) can be rewritten into Formula (15) below. In Formula (15) below, n is a vector whose element is noise content.
Formula (15) of the second example embodiment is compared with Formula (9) of the first example embodiment. In this case, Formula (9) and Formula (15) are of the same form, except for the argument of the reflectance σ being a two-dimensional variable u=(R, Δ) in Formula (9) and being a distance variable R in Formula (15). Accordingly, using Formulae (16) to (18), which are the same evaluation functions as those of Formulae (10) to (12), the position Rk of the target object 1003k (k=1, 2, . . . , K) can be detected.
Since the methods for obtaining the correlation matrices Rall in Formulae (16) to (18) are the same as in the first example embodiment, descriptions thereof are omitted here.
In step A13, using the evaluation function given by one of Formulae (16) to (18), the position Rk of the target object 1003k (k=1, 2, . . . , K) is detected based on the value of the argument R that gives the peak of the evaluation function.
The terms in step A3 “a spectrum (position spectrum) in which a region of the position parameter of the target object is taken as a domain” refer to evaluation functions given by Formulae (16) to (18). A domain of a spectrum is designated by the argument R of the evaluation functions, and thus is designated by the parameter R indicating the position of the target object. In step A13, it is sufficient to calculate an evaluation function given by one of Formulae (16) to (18), that is, a position spectrum.
In step A13, the position spectrum calculation unit till takes the reception IF signal that is generated by the receiving unit 1102 and is given by Formula (14). The position spectrum calculation unit till calculates, based on the reception IF signal, the evaluation function given by one of Formulae (16) to (18), that is, the position spectrum.
[Step A14]
In step A14, the value of the position parameter of the target object are calculated, based on the position spectrum, that is, the evaluation function given by one of Formulae (16) to (18). The following will describe step A14 in detail.
As already described in the description of step A13, the value of the distance Rk (k=1, 2, . . . , K) of the target object can be calculated based on the value of the argument R that gives the peak of the evaluation function given by each of Formulae (16) to (18).
More specifically, in step A14, an evaluation function that is given by one of Formulae (16) to (18) and is calculated by the position spectrum calculation unit 1111, that is, a position spectrum is given to the target object position parameter value calculation unit 1112. The target object position parameter value calculation unit 1112 calculates the value of the position Rk of the target object 1003k, based on the peak position of the evaluation function that was received from the position spectrum calculation unit 1111 and is given by one of Formulae (16) to (18), that is, the spectrum.
[Step A15]
The following will describe step A15 of calculating a shape spectrum in which a shape parameter of the target object 1003 is taken as a domain, based on the IF signal obtained on the basis of the transmitted and received radio waves and the information relating to the position of the target object 1003 that was obtained in step A4, in detail with reference to
In step A15, the shape spectrum calculation unit 1113 calculates, based on the IF signal that is given by one of Formulae (6) to (8) and is obtained by the transmitting/receiving device 1001, an evaluation function given by one of Formulae (10) to (12) according to the first example embodiment.
Note however that, in step A15 according to the second example embodiment, using information relating to the position Rk (k=1, 2, . . . , K) of the target object 1003k that was obtained in step A14, scanning is performed only in a Δ direction, while the range of the argument of the evaluation function in which scanning is performed being fixed to R=Rk, as show in
Also, as shown in
In step A15, the IF signals generated by the transmitting/receiving device 1001 in step A12, and the value of the position parameter of the target object 1003 generated by the target object position parameter value calculation unit 1112 in step A14 are transferred to the shape spectrum calculation unit 1113. Also, the shape spectrum calculation unit 1113 calculates a shape spectrum based on the above-described procedure.
[Step A16]
The following will describe details of step A16 of calculating the value of the shape parameter of the target object 1003 based on the shape spectrum.
In step A6, the shape spectrum calculation unit 1113 transfers the shape spectrum to the target object shape parameter value calculation unit 1114 in step A15. Accordingly, in step A16, the target object shape parameter value calculation unit 1114 calculates the width Δk of each target object 1003k, that is, the shape parameter, based on the value of A at which the shape spectrum of each target object 1003k (k=1, 2, . . . , K) takes the peak.
[Step A17]
The following will describe details of step A17 of outputting the calculated values of the position parameter and the shape parameter of the target object.
In step A17, the calculation result output unit 1108 first receives the information relating to the position Rk (value of the position parameter) of each target object 1003k calculated by the target object position parameter value calculation unit 1112 in step A14. The calculation result output unit 1108 also receives the information relating to the width Δk (value of the shape parameter) of each target object 1003k calculated by the target object shape parameter value calculation unit 1114 in step A6.
Then, the calculation result output unit 1108 outputs the information relating to the position Rk of the target object 1003k (k=1, 2, . . . , K) and the information relating to the width Δk thereof. Specifically, the calculation result output unit 1108 outputs the received information as numerical value data or image data. The output destination is a system on which the object detection apparatus 1020 is installed.
[Effects of Second Example Embodiment]
Also the second example embodiment can realize the effects described in the first example embodiment. That is, the second example embodiment also realizes a radar method that can not only recognize the position of a target object but also detect information relating to the shape, such as the width, of the target object, while using a small radar device with a few (to several) antennas. Furthermore, the information relating to the shape, such as the width, of the target object that was detected using the present radar method can be used for identifying the type of the target object (such as a car or a foot passenger, for example).
Furthermore, the second example embodiment also realizes a significant reduction in the actual number of antennas compared to a conventional millimeter-wave imaging device according to the array antenna method, thus achieving significant reductions in the size, weight, and cost of the device.
Furthermore, also in the second example embodiment, since electronic scanning is used instead of mechanical scanning, it is possible to achieve advantageous effects of increasing the scan rate, downsizing the device, extending the lifetime of the device, and improving the maintenance cost, compared to a method using mechanical scanning.
[Program]
A program according to the second example embodiment is preferably a program that causes a computer, namely, the arithmetic device 1212 to execute steps A13 to A17 shown in
Furthermore, the program according to the second example embodiment may also be executed by a computer system constituted by a plurality of computers. In this case, for example, each of the computers may also function as any one of the position spectrum calculation unit 1111, the target object position parameter value calculation unit 1112, the shape spectrum calculation unit 1113, the target object shape parameter value calculation unit 1114, and the calculation result output unit 1108.
Hereinafter, an object detection apparatus, an object detection method, and a program according to a third example embodiment of the invention will be described with reference to
[Apparatus Configuration]
First, a configuration of the object detection apparatus according to the third example embodiment will be described with reference to
Similar to the object detection apparatus 1000 according to the first example embodiment, an object detection apparatus 1030 according to the third example embodiment shown in
Note however that the object detection apparatus 1030 according to the third example embodiment differs from the object detection apparatus 1000 according to the first example embodiment in the configuration and function of the arithmetic device 1213. The following will mainly describe the differences from the first example embodiment.
As shown in
The arithmetic device 1213 is provided with, in addition to the spectrum calculation unit 1103 and the parameter value calculation unit 1107, a zone determination unit 1104, a reflectance distribution calculation unit 1105, and an image generation unit 1106. Note that, in the third example embodiment, the calculation result output unit 1108 used in the first example embodiment is omitted.
Also, in the object detection apparatus 1030 shown in
Also in the third example embodiment, the spectrum calculation unit 1103 calculates, based on an IF signal, a spectrum in which a region of the position parameter of the target object 1003 and a region of the shape parameter thereof are taken as domains, in accordance with the procedure shown in the first example embodiment.
Also, the parameter value calculation unit 1107 calculates, based on the spectrum calculated by the spectrum calculation unit 1103, the value of the position parameter of the target object 1003 and the value of the shape parameter thereof, in accordance with the procedure shown in the first example embodiment.
The zone determination unit 1104 determines, based on the values of the position parameter and the shape parameter of the target object 1003 that were calculated by the parameter value calculation unit 1107, zones for calculating the reflectance of the target object 1003.
The reflectance distribution calculation unit 1105 calculates, for each pair of transmitting unit 1101 and associated receiving unit 1102, that is, for each transmitting/receiving device 1001, the reflectance of the target object 1003 in each of the determined zones based on the IF signals.
The image generation unit 1106 calculates the product of distributions of the reflectance over the zones for the respective pairs. The image generation unit 1106 also generates an image of the target object 1003 using the product of distributions of the reflectance calculated for the respective pairs.
Also in the third example embodiment, as in the first example embodiment, the spectrum calculation unit 1103, the parameter value calculation unit 1107, the zone determination unit 1104, the reflectance distribution calculation unit 1105, and the image generation unit 1106 are configured by implementing a later-described program according to the third example embodiment into the arithmetic device (computer) 1213.
As such, also in the third example embodiment, a spectra that indicate the position and the shape of the target object 1003 is calculated, and based on the spectrum, values of the position parameter and the shape parameter of the target object 1003 are calculated. Then, zones for calculating the reflectance of the target object 1003 are determined based on the value of the position parameter of the target object 1003 and the value of the shape parameter thereof, and an image of the target object 1003 is formed based on the product of distributions of reflectance over the zones. Therefore, according to the third example embodiment, it is possible to improve the accuracy of detecting an object using radio waves, while suppressing increases in the device cost, size, and weight.
Subsequently, the configuration of the object detection apparatus according to the third example embodiment will be described more specifically with reference to
As shown in
In this case, the transmitting/receiving devices 10011, 10012, . . . , 1001N emit radio waves to the target object 1003. Then, the transmitting/receiving devices 10011, 10012, . . . , 1001N are assumed to receive the radio waves reflected off the target object 1003. Also, the transmitting/receiving devices 10011, 10012, . . . , 1001N respectively measure, based on the transmitted and received radio waves, distances R1, R2, . . . , RN between the respective transmitting/receiving devices 10011, 10012, . . . , 1001N and the target object 1003, and the width Δ1, Δ2, . . . , ΔN of the target object 1003 viewed from the transmitting/receiving devices 10011, 10012, . . . , 1001N.
Also in the third example embodiment, as in the first example embodiment, if a plurality of transmitting/receiving devices 10011, 10012, . . . , 1001N (N is the number of transmitting/receiving devices 1001) are used, it is preferable that each of the transmitting/receiving devices 10011, 10012, . . . , 1001N be controlled so as not to operate at the same time as another transmitting/receiving device, in order to avoid interference between the transmitting/receiving devices 10011, 10012, . . . , 1001N.
Furthermore, if each of the transmitting/receiving devices 10011, 10012, . . . , 1001N operates in the same time period as the time period in which another transmitting/receiving device operates, it is preferable that control be performed such that, as shown in
[Apparatus Operation]
The following will describe an operation of the object detection apparatus 1030 according to the third example embodiment with reference to
As shown in
Then, the receiving unit 1102 of the corresponding transmitting/receiving device 1001 receives the radio waves reflected off the target object 1003 as reception signals, and mixes the transmission signals generated by the transmitting unit 1101 with the received reception signals to generate IF signals (step A22). Step A22 is the same as step A2 shown in
Then, the spectrum calculation unit 1103 calculates, based on the IF signals generated in step A22, a spectrum (target object spectrum) in which a region of the position parameter of the target object 1003 and a region of the shape parameter thereof are taken as domains (step A23). Step A23 is the same as step A3 shown in
Then, the parameter value calculation unit 1107 calculates, based on the target object spectrum calculated in step A23, the value of the position parameter of the target object 1003 and the value of the shape parameter thereof (step A24). Step A24 is the same as step A4 shown in
Then, the zone determination unit 1104 determines, based on the values of the position parameter and the shape parameter of the target object 1003 that were calculated in step A24, zones for calculating the reflectance of the object 1003 (step A25).
Then, the reflectance distribution calculation unit 1105 calculates, for each pair of transmitting unit 1101 and associated receiving unit 1102, that is, for each transmitting/receiving device 1001, the reflectance of the target object 1003 in each of the zones determined in step A25, based on the IF signals (step A26).
Then, the image generation unit 1106 calculates the product of distributions of the reflectance over the zones for the respective pairs, and generates an image of the target object 1003 using the product of distributions of the reflectance calculated for the respective pairs (step Nil). The generated image is displayed on a picture plane of an image display device, or the like.
The following will describe steps A25 to Nil shown in
[Step A25]
In describing step A25, a method for determining zones for calculating the effective reflectance of the target object 1003 will be described with reference to
In the example of
In step A25, based on the position parameters R1 and R2 of the target object 1003 and the shape parameters Δ1 and Δ2 that correspond to the width of the target object that were obtained in the procedure from steps A21 to A24, the zone 1 and the zone 2 are determined. In other words, based on Formula (7) described in the first example embodiment, the zone 1 is determined as a region in which the distance from the transmitting/receiving device 1001 is in the range of sqrt(R1+(Δ1/2)2±zΔ1), and the zone 2 is determined as a region in which the distance from the transmitting/receiving device 1001 is in the range of sqrt(R2+(Δ2/2)2±zΔ2).
[Step A26]
The following will describe step A26. As indicated by Formula (9) shown in the first example embodiment, the relationship r=As is satisfied between a reception IF signal r=[r(t1), r(t2), . . . , r(tM0)]T, the reflectance s=[σ(u1), σ(u2), . . . , σ(uk)]T of the target object 1003, and a direction matrix A=(a(u1), a(u2), . . . , a(uK)). Note here that the noise content n is disregarded. The reception IF signal r is a measured value obtained in steps A21 to A22. The direction matrix A is a function of the target object state parameter u1, u2, . . . , uK, and if the target object state parameter u1, u2, . . . , uK is determined in step A24, the value of the direction matrix A is also determined. In other words, at a point in time when the processing of step A24 is complete, the reception IF signal r and the direction matrix A are determined.
Then, using all pieces of sampling data r=[r(t1), r(t2), . . . , r(tM0)]T of the reception IF signal, the correlation matrix Rall(0) is calculated using Formula (19) below.
[Formula 19]
R
all(0)
=r·r
H, (19)
Based on Formula (19) and the relationship r=As, the relationship given by Formula (20) below is obtained.
[Formula 20]
R
all(0)
=A·S·A
H,
S≡{s
ij}=σ(ui)·{σ(uj)}*, (20)
Furthermore, by applying the pseudo inverse matrix of A to Formula (20), S can be calculated by using Formula (21) below.
[Formula 21]
S=(AH·A)−1·AH·R0·A·(AH·A)−1, (21)
Based on the diagonal component of S obtained by Formula (21), the effective reflectance |σ(uk)|2 (k=1, 2, . . . , K) of the target object for each zone can be obtained.
Here, the calculation results of the effective reflectance of the target object 1003 for the zones obtained in step A26 are shown in
The transmitting/receiving devices 10011 to 10014 can respectively measure the positions of the target object 1003 in the distance direction (direction toward the target object when viewed from the transmitting/receiving devices 10011 to 10014). However, it is difficult for the transmitting/receiving devices 10011 to 10014 to measure the positions in the angular direction (direction toward a side of the target object when viewed from the transmitting/receiving devices 10011 to 10014). Accordingly, zones are defined only in the distance direction. Also, each zone is a region on the target object arranged plane 1004 that is enclosed by a circle whose origin is the point (O shown in
Effective reflectance is an amount that is proportional to the width, in the angular direction, and the reflectance of the target object 1003. Because the reflectance of the target object 1003 are uniform, the effective reflectance of the pattern of a larger width in the angular direction when viewed from the transmitting/receiving device 1001 has a particularly large value. For example, the transmitting/receiving device 10011 or 10013 is used to perform measurement, the effective reflectance of the vertical bar portion of the T-shaped target object 1003 is high. On the other hand, when the transmitting/receiving device 10012 or 10014 is used to perform measurement, the effective reflectance of the horizontal bar portion of the -shaped target object 1003 is high.
[Step A27]
The following will describe step A7. First, an effective reflectance distribution on an X-Y plane of a transmitting/receiving device 1001n (n=1, 2, . . . , N, and in the example of
In Formula (22), δ is a parameter for adjusting a dynamic range of an image. A millimeter wave image obtained when δ=2 based on Formula (22) is shown in
[Effects of Third Example Embodiment]
Similar to the first example embodiment, also in the third example embodiment, a method for detecting information relating to the shape, such as the width, of the target object, based on a result of measurement of a distance between the transmitting/receiving device and a target object is used, in contrast to radio wave incoming direction estimation, that is, a conventional method for measuring an angular direction.
Thus, the third example embodiment also realizes a radar method that can not only recognize the position of a target object but also detect information relating to the shape, such as the width, of the target object, while using several small radar devices with a few (to several) antennas. Furthermore, in the third example embodiment, since an image showing the shape of the target object is formed, it is possible to detect and identify, for example, dangerous goods such as weapons concealed under clothes, in bags, or the like, as well or better than a conventional millimeter-wave imaging device.
Furthermore, similar to the first example embodiment, the third example embodiment also realizes a significant reduction in the actual number of antennas compared to a typical millimeter-wave imaging device according to the array antenna method, thus achieving significant reductions in the size, weight, and cost of the device. Additionally, also in the third example embodiment, since electronic scanning is used instead of mechanical scanning, it is possible to achieve advantageous effects of increasing the scan rate, downsizing the device, extending the lifetime of the device, and improving the maintenance cost, compared to a method using mechanical scanning.
[Program]
A program according to the third example embodiment is preferably a program that causes a computer, namely, the arithmetic device 1213 to execute steps A23 to A27 shown in
Furthermore, the program according to the third example embodiment may also be executed by a computer system constituted by a plurality of computers. In this case, for example, each of the computers may also function as any one of the spectrum calculation unit 1103, the parameter value calculation unit 1107, the zone determination unit 1104, the reflectance distribution calculation unit 1105, and the image generation unit 1106.
Hereinafter, an object detection apparatus, an object detection method, and a program according to a fourth example embodiment of the invention will be described with reference to
[Apparatus Configuration]
First, a configuration of the object detection apparatus according to the fourth example embodiment will be described with reference to
As shown in
On the other hand, as shown in
The position spectrum calculation unit 1111, the target object position parameter value calculation unit 1112, the shape spectrum calculation unit 1113, and the target object shape parameter value calculation unit 1114 that are used in the fourth example embodiment are the same as those of the second example embodiment shown in
In other words, the position spectrum calculation unit 1111 calculates, based on IF signals generated by the transmitting/receiving device 1001, a position spectrum in which a region of the position parameter of the target object 1003 is taken as a domain. The target object position parameter value calculation unit 1112 calculates, based on the position spectrum, the value of the position parameter of the target object 1003.
The shape spectrum calculation unit 1113 calculates, based on the IF signals generated by the transmitting/receiving device 1001 and the value of the position parameter of the target object 1003 calculated by the target object position parameter value calculation unit 1112, a shape spectrum in which a region of the shape parameter of the target object 1003 is taken as a domain. The target object shape parameter value calculation unit 1114 calculates, based on the shape spectrum, the value of the shape parameter of the target object 1003.
Note that, also in the third example embodiment, the position spectrum calculation unit 1111, the target object position parameter value calculation unit 1112, the shape spectrum calculation unit 1113, the target object shape parameter value calculation unit 1114, the zone determination unit 1104, the reflectance distribution calculation unit 1105, and the image generation unit 1106 are configured by implementing a later-described program according to the fourth example embodiment into the arithmetic device (computer) 1214.
[Apparatus Operation]
The following will describe an operation of the object detection apparatus 1040 according to the fourth example embodiment of the invention with reference to
As shown in
Then, the position spectrum calculation unit till calculates, based on the IF signals generated in step A32, a position spectrum in which a region of the position parameter of the target object 1003 is taken as a domain (step A33). Then, the target object position parameter value calculation unit 1112 calculates, based on the position spectrum calculated in step A33, the value of the position parameter of the target object 1003 (step A34). Steps A33 and A34 are the same as steps A13 and A14 shown in
Then, the shape spectrum calculation unit 1113 calculates, based on the IF signals generated in step A32 and the value of the position parameter of the target object 1003 calculated in step A34, a shape spectrum in which a region of the shape parameter of the target object 1003 is taken as a domain (step A35). Then, the target object shape parameter value calculation unit 1114 calculates, based on the shape spectrum calculated in step A35, the value of the shape parameter of the target object 1003 (step A36). Steps A35 and A36 are the same as steps A15 and A16 shown in
Then, the zone determination unit 1104 determines, based on the value of the position parameter of the target object 1003 calculated in step A34 and the value of the shape parameter calculated in step A36, zones for calculating the reflectance of the object 1003 (step A37). Step A37 is the same as step A25 shown in
Then, the reflectance distribution calculation unit 1105 calculates, for each pair of transmitting unit 1101 and associated receiving unit 1102, that is, for each transmitting/receiving device 1001, the reflectance of the target object 1003 in each of the zones determined in step A37, based on the IF signals (step A38). Step A38 is the same as step A26 shown in
Then, the image generation unit 1106 calculates the product of distributions of the reflectance over the zones for the respective pairs, and generates an image of the target object 1003 using the product of distributions of the reflectance calculated for the respective pairs (step A39). The generated image is displayed on a picture plane of an image display device, or the like. Step A39 is the same as step A27 shown in
As such, also in the fourth example embodiment, an image of the target object 1003 is formed through execution of steps A31 to A39. Also in the fourth example embodiment, it is possible to improve the accuracy of detecting an object using radio waves, while suppressing increases in the device cost, size, and weight.
[Effects of Fourth Example Embodiment]
Also the fourth example embodiment can realize the effects described in the third example embodiment. That is, the fourth example embodiment also realizes a radar method that can not only recognize the position of a target object but also detect information relating to the shape, such as the width, of the target object, while using several small radar devices with a few (to several) antennas.
Furthermore, also in the fourth example embodiment, since an image showing the shape of the target object is formed, it is possible to detect and identify, for example, dangerous goods such as weapons concealed under clothes, in bags, or the like, as well or better than a conventional millimeter-wave imaging device. Furthermore, the fourth example embodiment can also achieve significant reductions in the size, weight, and cost of the device.
Furthermore, also in the fourth example embodiment, since electronic scanning is used instead of mechanical scanning, it is possible to achieve advantageous effects of increasing the scan rate, downsizing the device, extending the lifetime of the device, and improving the maintenance cost, compared to a method using mechanical scanning.
[Program]
A program according to the fourth example embodiment is preferably a program that causes a computer, namely, the arithmetic device 1214 to execute steps A33 to A39 shown in
Furthermore, the program according to the fourth example embodiment may also be executed by a computer system constituted by a plurality of computers. In this case, for example, each of the computers may also function as any one of the position spectrum calculation unit 1111, the target object position parameter value calculation unit 1112, the shape spectrum calculation unit 1113, the target object shape parameter value calculation unit 1114, the zone determination unit 1104, the reflectance distribution calculation unit 1105, and the image generation unit 1106.
(Physical Configuration)
The following will describe the computers (arithmetic devices) that execute the programs according to the first to fourth example embodiments to realize the object detection apparatuses, with reference to
As shown in
The CPU 111 expands the programs (codes) according to the example embodiments stored in the storage device 113 onto the main memory 112, and executes them in a predetermined order, thereby executing various types of calculation. The main memory 112 is typically a volatile storage device such as a Dynamic Random Access Memory (DRAM). Furthermore, the programs according to the example embodiments are provided in a state of being stored in the computer-readable recording medium 120. Note that the programs according to the example embodiments may also be distributed on the Internet connected via the communication interface 117.
Furthermore, specific examples of the storage device 113 include, besides a hard disk drive, a semiconductor storage device such as a flash memory. The input interface 114 intermediates data transmission between the CPU 111 and an input device 118 such as a keyboard or a mouse. The display controller 115 is connected to a display device 119, and controls display on the display device 119.
The data reader/writer 116 intermediates data transmission between the CPU 111 and the recording medium 120, and executes reading of a program from the recording medium 120, and writing of a result of processing by the computer 110 to the recording medium 120. The communication interface 117 intermediates data transmission between the CPU 111 and another computer.
Furthermore, specific examples of the recording medium 120 include a general-purpose semiconductor storage device such as a Compact Flash (registered trademark) (CF) and a Secure Digital (SD), a magnetic recording medium such as a flexible disk, or and optical recording medium such as a Compact Disk Read Only Memory (CD-ROM).
Note that the object detection apparatus 1000 according to the example embodiment may also be realized by, instead of a computer in which a program is installed, hardware that corresponds to the constituent components. Furthermore, a configuration may also be employed in which part of the object detection apparatus 1000 is realized by a program, and the remaining part thereof is realized by hardware.
Although the invention of the present application has been described with reference to the embodiments above, the invention of the present application is not limited to the above example embodiments. Furthermore, the content disclosed in the above-described Patent Documents and the like may also be incorporated in the invention of the present application by reference. In the frame of the entire disclosure (including the claims) of the invention of the present application, and further on the basis of its basic technical concept, modification and adjustment of the example embodiments are possible. Furthermore, in the frame of the claims of the invention of the present application, various combinations or selection of various disclosed elements is also possible. In other words, the invention of the present application, of course, encompasses various modifications and corrections understandable to a person skilled in the art, according to the entire disclosure including the claims and the technical idea.
Parts or whole of the above-described example embodiments can be expressed in the below-described Supplementary notes 1 to 18, but the present invention is not limited to the below description.
(Supplementary Note 1)
An object detection apparatus for detecting an object using radio waves, including:
a transmitting unit for emitting, to the object, radio waves that serve as transmission signals;
a receiving unit for receiving the radio waves reflected off the object as reception signals;
a spectrum calculating unit for calculating, based on the transmission signals and the reception signals, a spectrum in which a region of a position parameter of the object and a region of a shape parameter of the object are taken as domains; and
a parameter value calculating unit for calculating, based on the spectrum calculated by the spectrum calculating unit, a value of the position parameter of the object and a value of the shape parameter of the object.
(Supplementary Note 2)
The object detection apparatus according to Supplementary note 1,
wherein a plurality of the transmitting units and a plurality of the receiving units are provided,
the plurality of receiving units are respectively associated with the plurality of transmitting units,
the spectrum calculating unit calculates, for each pair of transmitting unit and associated receiving unit, a spectrum in which a region of a position parameter of the object and a region of a shape parameter of the object are taken as domains based on the transmission signals and the reception signals,
the parameter value calculating unit calculates, based on the spectrum calculated for each pair by the spectrum calculating unit, a value of the position parameter of the object and a value of the shape parameter of the object, and
the object detection apparatus further includes:
(Supplementary Note 3)
The object detection apparatus according to Supplementary note 1 or 2,
wherein the transmitting unit transmits, as the transmission signals, radio waves whose frequency is modulated.
(Supplementary Note 4)
The object detection apparatus according to any one of Supplementary notes 1 to 3,
wherein a plurality of the transmitting units are provided, and the plurality of transmitting units respectively emit the transmission signals at different timings, or emit the transmission signals in different transmission frequencies.
(Supplementary Note 5)
The object detection apparatus according to any one of Supplementary notes 1 to 4,
wherein the receiving unit receives radio waves reflected off the object as the reception signals, and further mixes the transmission signals with the received reception signals to generate intermediate frequency signals, and
the spectrum calculating unit calculates the spectrum based on the intermediate frequency signals.
(Supplementary Note 6)
The object detection apparatus according to Supplementary note 5,
wherein the spectrum calculating unit calculates, based on measured values of the intermediate frequency signals for which different sampling time ranges are preset, correlation matrices that correspond to the respective sampling time ranges, and
the spectrum calculating unit further calculates an average of the correlation matrices that correspond to the respective sampling time ranges, and then calculates the spectrum based on the average of the correlation matrices.
(Supplementary Note 7)
An object detection method for detecting an object using a device that includes a transmitting unit for emitting, to the object, radio waves that serve as transmission signals, and a receiving unit for receiving the radio waves reflected off the object as reception signals, the method including:
(a) a step of calculating, based on the transmission signals and the reception signals, a spectrum in which a region of a position parameter of the object and a region of a shape parameter of the object are taken as domains; and
(b) a step of calculating, based on the spectrum calculated in the (a) step, a value of the position parameter of the object and a value of the shape parameter of the object.
(Supplementary Note 8)
The object detection method according to Supplementary note 7,
wherein the device includes a plurality of the transmitting units and a plurality of the receiving units, the plurality of receiving units being respectively associated with the plurality of transmitting units,
in the (a) step, for each pair of transmitting unit and associated receiving unit, a spectrum in which a region of a position parameter of the object and a region of a shape parameter of the object are taken as domains is calculated based on the transmission signals and the reception signals,
in the (b) step, based on the spectrum calculated for each pair in the (a) step, a value of the position parameter of the object and a value of the shape parameter of the object are calculated, and
the object detection method further includes:
(Supplementary Note 9)
The object detection method according to Supplementary note 7 or 8,
wherein the transmitting unit transmits, as the transmission signals, radio waves whose frequency is modulated.
(Supplementary Note 10)
The object detection method according to any one of Supplementary notes 7 to 9,
wherein a plurality of the transmitting units are provided, and
the plurality of transmitting units respectively emit the transmission signals at different timings, or emit the transmission signals in different transmission frequencies.
(Supplementary Note 11)
The object detection method according to any one of Supplementary notes 7 to 10,
wherein the receiving unit receives radio waves reflected off the object as the reception signals, and further mixes the transmission signals with the received reception signals to generate intermediate frequency signals, and
in the (a) step, the spectrum is calculated based on the intermediate frequency signals.
(Supplementary Note 12)
The object detection method according to Supplementary note 11,
wherein, in the (a) step, correlation matrices that correspond to the respective sampling time ranges are calculated based on measured values of the intermediate frequency signals for which different sampling time ranges are preset, an average of the correlation matrices that correspond to the respective sampling time ranges is further calculated, and then the spectrum is calculated based on the average of the correlation matrices.
(Supplementary Note 13)
A computer readable recording medium for use in an object detection apparatus that includes a transmitting unit for emitting, to an object, radio waves that serve as transmission signals, a receiving unit for receiving the radio waves reflected off the object as reception signals, and a processor, the computer readable recording medium including a program recorded thereon, the program including instructions that cause the processor to carry out:
(a) a step of calculating, based on the transmission signals and the reception signals, a spectrum in which a region of a position parameter of the object and a region of a shape parameter of the object are taken as domains; and
(b) a step of calculating, based on the spectrum calculated in the (a) step, a value of the position parameter of the object and a value of the shape parameter of the object.
(Supplementary Note 14)
The computer readable recording medium according to Supplementary note 13,
wherein the device includes a plurality of the transmitting units and a plurality of the receiving units, the plurality of receiving units being respectively associated with the plurality of transmitting units,
in the (a) step, for each pair of transmitting unit and associated receiving unit, a spectrum in which a region of a position parameter of the object and a region of a shape parameter of the object are taken as domains is calculated based on the transmission signals and the reception signals,
in the (b) step, based on the spectrum calculated for each pair in the (a) step, a value of the position parameter of the object and a value of the shape parameter of the object are calculated, and
the program further including instructions that cause the processor to carry out:
(Supplementary Note 15)
The computer readable recording medium according to Supplementary note 13 or 14,
wherein the transmitting unit transmits, as the transmission signals, radio waves whose frequency is modulated.
(Supplementary Note 16)
The computer readable recording medium according to any one of Supplementary notes 13 to 15,
wherein a plurality of the transmitting units are provided, and
the plurality of transmitting units respectively emit the transmission signals at different timings, or emit the transmission signals in different transmission frequencies.
(Supplementary Note 17)
The computer readable recording medium according to any one of Supplementary notes 13 to 16,
wherein the receiving unit receives radio waves reflected off the object as the reception signals, and further mixes the transmission signals with the received reception signals to generate intermediate frequency signals, and
in the (a) step, the spectrum is calculated based on the intermediate frequency signals.
(Supplementary Note 18)
The computer readable recording medium according to Supplementary note 17,
wherein, in the (a) step, correlation matrices that correspond to the respective sampling time ranges are calculated based on measured values of the intermediate frequency signals for which different sampling time ranges are preset, an average of the correlation matrices that correspond to the respective sampling time ranges is further calculated, and then the spectrum is calculated based on the average of the correlation matrices.
The present application is based upon and claims the benefit of priority from Japanese application No. 2017-131542, filed on Jul. 4, 2017, the disclosure of which is incorporated herein in its entirety by reference.
As described above, according to the invention, it is possible to improve the accuracy of detecting an object using radio waves, while suppressing increases in the device cost, size, and weight. The invention is useful when used as a radar device that functions to calculate parameters relating to the position and the shape of a target object, measure the position of the target object, and identify the type of the target object based on the shape parameter of the target object, or an imaging device that images items behind clothes, items in bags, or the like, and inspect them.
Number | Date | Country | Kind |
---|---|---|---|
2017-131542 | Jul 2017 | JP | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2018/025416 | 7/4/2018 | WO | 00 |