The present invention relates to an object sensing device and an object sensing method for recognizing or identifying presence of an object to be detected by irradiating a radio wave to the object to be detected, and detecting a radio wave reflected or irradiated from a target object.
Unlike light, a radio wave (such as a micro wave, a millimeter wave, and a terahertz wave) has a superior capability of penetrating through an object. A device for imaging and inspecting an article under clothes or within a bag by using a penetration capability of a radio wave, and a remote sensing technique of imaging an earth's surface through clouds from a satellite or an aircraft are put into practice.
Several methods are proposed for an imaging device (object sensing device) employing a radio wave. One of the methods is an array antenna method illustrated in a conceptual diagram of
The transmitter 211 includes a transmission antenna 212. Further, the receiver 201 includes reception antennas 2021, 2022, . . . , and 202N (where N is a number of reception antennas).
The transmitter 211 irradiates, from the transmission antenna 212, a radio frequency (RF) signal (radio wave) 213 toward objects to be detected 2041, 2042, . . . , and 204D (where D is a number of objects). The RF signal (radio wave) 213 is reflected on the objects to be detected 2041, 2042, . . . , and 204D, and reflected waves 2031, 2032, . . . , and 203D occur. The reflected waves 2031, 2032, . . . , and 203D are received by the reception antennas 2021, 2022, . . . , and 202N. The receiver 201 calculates an intensity of a radio wave reflected from the objects to be detected 2041, 2042, . . . , and 204D, based on the received reflected waves 2031, 2032, . . . , and 203D. By imaging a distribution of intensities of the radio wave, it is possible to acquire an image of the objects to be detected 2041, 2042, . . . , and 204D.
Note that, in the array antenna method, as illustrated in
Note that the phase shifters 2061, 2062, . . . , and 206N, and the adder 207 may be implemented by an analog circuit, or may be implemented by digital processing circuit. In the array antenna method, by setting the phase rotation amounts Φ1, Φ2, . . . , and ΦN by the phase shifters 2061, 2062, . . . , and 206N, directivity of an array antenna is controlled. When it is assumed that g(θ) is directivity of the reception antenna 202, and an and ϕn are respectively an amplitude and a phase of an incoming wave 208n (where n=1, 2, . . . , and N) received by a reception antenna 202n, directivity E(θ) of an array antenna is calculated as expressed by the following Eq. (1).
Note that, in Eq. (1), a directivity component AF(θ) acquired by removing directivity g(θ) of the reception antenna 202 from directivity E(θ) of an array antenna is referred to as an array factor. The array factor AF(θ) represents an effect of directivity by forming an array antenna. A signal received by the reception antenna 202n (where n=1, 2, . . . , and N) is g(θ)anexp(jϕn). A signal acquired by summing a signal g(θ)anexp(jθn)exp(jΦn) which undergoes a phase rotation amount Φn of a phase shifter 206n where n=1, 2, . . . , and N by the adder 207 is acquired as directivity E(θ) in Eq. (1).
When an incident angle of the incoming waves 2081, 2082, . . . , and 208N is θ, the phase ϕn of the incoming wave 208n is given by −2π·n·d·sin θ/λ (where n=1, 2, . . . , and N). Note that, herein, d is an interval of the reception antenna 202n (where n=1, 2, . . . , and N), and λ is a wavelength of the incoming waves 2081, 2082, . . . , and 208N. In Eq. (1), when it is assumed that the amplitude an is constant irrespective of n, and when a relationship between the phase rotation amount Φn of the phase shifter 206n (where n=1, 2, . . . , and N), and the phase ϕn of the incoming wave 208n is set to satisfy: Φn=−ϕn, the array factor AF(θ) becomes maximum in a direction of the angle θ. Specifically, by setting the phase rotation amount Φn in such a way that a phase becomes opposite to the phase ϕn of the incoming wave 208n, it is possible to align directivity of an array antenna with an incoming wave.
An example of a radio wave imaging device by an array antenna method is disclosed in PTLs 1 to 3.
In the array antenna method described in PTLs 1 and 2, directivity of a receiving array antenna constituted of the reception antennas 2021, 2022, . . . and 202N is controlled by a phase shifter (not illustrated) incorporated in the receiver 201 and connected to the reception antennas 2021, 2022, . . . , and 202N. By changing directivity of a receiving array antenna (2021, 2022, . . . , and 202n) formed in a beam shape, and directing a directive beam of the receiving array antenna (2021, 2022, . . . , and 202N) to each of the objects to be detected 2041, 2042, . . . , and 204D, an intensity of a radio wave reflected from the objects to be detected 2041, 2042, . . . , and 204D is calculated.
In PTL 3, directivity of a receiving array antenna (2021, 2022, . . . , and 202N) is controlled by using frequency dependency of the receiving array antenna (2021, 2022, . . . , and 202N). A point that an intensity of a radio wave reflected from the objects to be detected 2041, 2042, . . . , and 204D is calculated by directing a directive beam of the receiving array antenna (2021, 2022, . . . , and 202N) to each of the objects to be detected 2041, 2042, . . . , and 204D is common with PTLs 1 and 2.
As another method for an imaging device employing a radio wave, there is a synthetic aperture radar (SAR) method illustrated in a conceptual diagram of
In a synthetic aperture radar method, a measuring device is constituted of a transmitter 311 and a receiver 301.
The transmitter 311 includes a transmission antenna 312. Further, the receiver 301 includes a reception antenna 302.
The transmitter 311 irradiates an RF signal (radio wave) 313 from the transmission antenna 312 toward objects to be detected 3041, 3042, . . . , and 304D (where D is a number of target objects). The RF signal (radio wave) 313 is reflected on the objects to be detected 3041, 3042, . . . , and 304D, and reflected waves 3031, 3032, . . . , and 303D are respectively generated. At this occasion, the receiver 301 receives the reflected waves 3031, 3032, . . . , and 303D at (positions of) reception antennas 3021, 3022, . . . , and 302N, while moving to positions of receivers 3011, 3012, . . . , and 301N. At this occasion, the reception antennas 3021, 3022, . . . , and 302N constitute a receiving array antenna (virtual array antenna) constituted by N antennas, similarly to the reception antennas 2021, 2022, . . . , and 202N by the array antenna method illustrated in
Examples of a radio wave imaging device by a synthetic aperture radar method are disclosed in PTLs 4 to 6.
First of all, a problem of an array antenna method described in
The above-described point is described specifically. In a case of an array antenna method, an interval between respective antennas of the reception antennas 2021, 2022, . . . , and 202N is required to be equal to or smaller than half of a wavelength λ of the reflected waves 2031, 2032, . . . , and 203N to be received by the receiver 201. When the above-described condition is not satisfied, there occurs a problem that, in a generated image, a virtual image is generated at a position where the objects to be detected 2041, 2042, . . . , and 204D are not present. When the reflected waves 2031, 2032, . . . , and 203D are millimeter waves, a wavelength thereof is about several millimeters.
Further, image resolution is determined by a width Δθ of a directive beam of a receiving array antenna (2021, 2022, . . . , and 202N). The width Δθ of a directive beam of a receiving array antenna (2021, 2022, . . . , and 202N) is given by Δθ˜λ/D. Herein, D is an aperture size of a receiving array antenna (2021, 2022, . . . , and 202N), and is associated with a distance between the reception antennas 2021 and 202N present at both ends. In order to acquire practical resolution in imaging an article under clothes or within a bag, it is required to set the aperture size D of a receiving array antenna (2021, 2022, . . . , and 202N) from about several ten centimeters to about several meters.
In view of the above-described condition, specifically, in view of two points that an interval between respective antennas of the reception antennas 2021, 2022, . . . , and 202N is required to be equal to or smaller than half of the wavelength λ (equal to or smaller than several millimeters), and a distance between the reception antennas 2021 and 202N present at both ends is required to be at least about several centimeters, a number N of required antennas per row becomes about several hundreds. Further, in view of that an actual radio wave imaging device is required to capture a two-dimensional image, as illustrated in
Alternatively, as a method for acquiring a two-dimensional image, a Mills cross method described in NPL 2 and
Next, a problem on a synthetic aperture radar method described in
As discussed above, in a general radio wave imaging device, a cost, a size, and a weight of a device become extremely large. Therefore, there is a problem that applications and chances with which the device is actually usable are limited. Further, there is a problem that a speed at which a target object is inspected is also limited. An object of the present invention is to provide a technique for solving these problems.
An aspect of the present invention is an object sensing device constituted of a transmitter including a transmission antenna, and a receiver including a reception antenna, wherein a radio wave of a plurality of frequencies is irradiated from the transmission antenna toward a target object, the receiver receives the radio wave of a plurality of frequencies reflected from the target object, the receiver has a phase adjusting function of respectively adjusting phases with respect to the received radio wave of respective frequencies, the receiver controls directivity of antenna gain by the phase adjusting function, and the receiver detects a position or a shape of the target object by measuring an intensity distribution of a radio wave incoming to the receiver by directivity control of the antenna gain.
Further, an aspect of the present invention is an object sensing method employing a transmitter including a transmission antenna, and a receiver including a reception antenna, wherein the object sensing method includes: irradiating a radio wave of a plurality of frequencies toward a target object by using the transmission antenna; receiving the radio wave of a plurality of frequencies reflected from the target object by using the receiver; adjusting phases respectively with respect to the received radio wave of respective frequencies by the receiver; controlling directivity of antenna gain of the receiver by the phase adjustment; and detecting a position or a shape of the target object by measuring an intensity distribution of a radio wave incoming to the receiver by directivity control of the antenna gain of the receiver.
In an object sensing device and an object sensing method according to the present invention, it is possible to increase the number of virtual antennas by increasing the number of frequencies of a received radio wave (RF signal), in place of increasing the number of actual antennas in a receiver. Consequently, in the present invention, it is possible to remarkably reduce the number of antennas, as compared with a general array antenna method.
When compared to the present invention, in the synthetic aperture radar method, it is required to mechanically move a receiver. This leads to a problem that time for detecting or inspecting an object increases. On the other hand, in the present invention, since not a position of a receiver but a receiving frequency is electronically scanned, it is possible to shorten time for detecting or inspecting an object, as compared with the synthetic aperture radar method.
Specifically, in the object sensing device and the object sensing method according to the present invention, since it is possible to reduce the number of required antennas and receivers accompanied thereby, as compared with a general array antenna method, an advantageous effect that it is possible to reduce a cost, a size, and a weight of a device is provided. Further, in the above-described object sensing device and object sensing method, unlike a general synthetic aperture radar method, since it is not required to mechanically move a device, an advantageous effect that it is possible to shorten time for detecting and inspecting an object is provided.
In the following, preferred example embodiments of a transmitting device and a transmitting method according to the present invention are described with reference to the accompanying drawings. Note that, in respective drawings illustrated hereinafter, it is assumed that elements identical or equivalent are indicated with the same reference numbers, and description thereof is not repeated.
(Summary of Present Invention)
A summary of the present invention is described first of all, prior to description on example embodiments of the present invention.
The present invention is directed to an object sensing device and an object sensing method for generating an image of an object to be detected by irradiating a radio wave of a plurality of RF frequencies to the object to be detected, and detecting a radio wave to be reflected or irradiated from a target object, and main features of the present invention are reducing the number of required antennas and receiving units, as compared with a general configuration, and implementing image generation by high-speed scanning without the need of moving.
Specifically, an object sensing device according to the present invention is an object sensing device constituted by a transmitter including a transmission antenna, and a receiver including a reception antenna. A radio wave of a plurality of frequencies is irradiated from the transmission antenna toward a target object. The receiver receives the radio wave of a plurality of frequencies reflected from the target object. The receiver has a function of adjusting phases with respect to the received radio wave of respective frequencies. The receiver controls directivity of antenna gain by the phase adjusting function, and the receiver detects a position or a shape of the target object by measuring an intensity distribution of a radio wave incoming to the receiver by directivity control of the antenna gain.
Specifically, in the above-described object sensing device and object sensing method, since it is possible to reduce the number of required antennas and receivers accompanied thereby, as compared with a general array antenna method, an advantageous effect that it is possible to reduce a cost, a size, and a weight of a device is provided. Further, in the above-described object sensing device and object sensing method, unlike a general synthetic aperture radar method, since it is not required to mechanically move a device, an advantageous effect that it is possible to shorten time for detecting or inspecting an object is provided.
In the first example embodiment, the transmitter 1091 irradiates, from the transmission antenna 1003, a radio wave 1010 of a plurality of (M) RF frequencies (carrier frequencies f1, f2, . . . , and fM) to a target object 1001. In the present example embodiment, the radio wave 1010 of a plurality of RF frequencies may be transmitted by switching the RF frequencies of the radio wave 1010 to be transmitted depending on a time. Alternatively, the radio wave 1010 of a plurality of RF frequencies may be simultaneously transmitted. The transmitted radio wave 1010 is reflected on the target object 1001, and a reflected wave 1007 generated thereby is received by the receiver 1092.
Operation principles of the first example embodiment are described with reference to
As described above, principles of the present example embodiment are regarded as configuring a virtual array antenna by measurement data at the carrier frequencies f1, f2, . . . , and fM. Also in a virtual array illustrated in
Further, a phase ϕm (where m=1, 2, . . . , and M) of the reflected wave 1007(fm) is given by the following Eq. (3).
[Eq. 3]
ϕm=−2π(m−1)Δf[Lt(xd)+Lr(xd)]/c, (3)
Herein, Δf is an interval of the carrier frequencies f1, f2, . . . , and fM for use in measurement, Lt(xd) is a distance between the transmitter 1091 and the target object 1001, and Lr(xd) is a distance between the receiver 1092 and the target object 1001. c is a speed of light. In Eq. (3), when it is assumed that the amplitude am is constant irrespective of m, and when a relationship between a phase rotation amount Φm (where m=1, 2, . . . , and M) of a phase shifter 1031(fm), and the phase ϕm of the reflected wave 1007(fm) is set to satisfy: Φm=−ϕm, the array factor AF(xd) becomes maximum in a direction of the target object 1001 (position xd). These procedures are associated with aligning directivity of a virtual array with a direction of a reflected wave.
It is possible to calculate a beam width of a beam pattern from the array factor AF(xd) given by Eqs. (2) and (3). A beam width is a factor that estimates an incoming direction or determines imaging (image) resolution. A beam width Δx in the present example embodiment is given by the following equation.
In Eq. (4), BW is a bandwidth to be used (BW=Δf×(M−1) with respect to a frequency interval Δf and a number M of frequencies), and h(xr, xd, z) is a function of a position variable (xr, xd, z). Note that, when xr=xd, h(xr, xd, z) is given by [1+(z/xr)2]½. As expressed by Eq. (4), in a virtual array of the present example embodiment, as the bandwidth BW is widened, the beam width Δx is shortened, and further enhanced resolution performance is acquired.
Also in a virtual array of the present example embodiment, a virtual image by a grating lobe may be generated similarly to a general array antenna. The following phase amount ϕ(xa) is defined.
[Eq. 5]
ϕ(xa)=−2πΔf[Lt(xa)+Lr(xa)−Lt(xd)−Lr(xd)]/c, (5)
In
From Eq. (6), it is clear that a visible area increases, as the frequency interval Δf is reduced. A size (length) of a visible area is generally inversely proportional to the frequency interval Δf.
When an incoming direction of a reflected wave is estimated by using a virtual array of the present example embodiment, and imaging processing (image generation) is performed from the estimation result, the number of pixels per direction is given by a ratio between a visible area and resolution. From a result expressed by Eq. (4) and Eq. (6), a relationship that the number of pixels per direction=visible area/resolution∝BW/Δf=M is acquired (where BW is a bandwidth, Δf is a frequency interval, and M is a number of frequencies). Specifically, in the present example embodiment, a number M of frequencies may be set depending on a required number of pixels.
As illustrated in
In the transmitter 1091 illustrated in
In the transmitter 1091 illustrated in
As illustrated in
As described with reference to
After complex amplitudes of the reflected wave 1007 received by the reception antenna 1004 are acquired by the receiving control unit 1102 by the above-described processing, the complex amplitudes are transmitted to the data processing unit 1106. Further, complex amplitudes of the radio wave 1010 transmitted from the transmission antenna 1003 are transmitted from the transmitting control unit 1104 to the data processing unit 1106. The data processing unit 1106 performs estimation of an incoming direction of the reflected wave 1007 and imaging processing (image generation) of the target object 1001, from the complex amplitudes of the reflected wave 1007 being a received radio wave, and the complex amplitudes of the radio wave 1010 being a transmitted RF signal. A data processing result of the data processing unit 1106 (specifically, a result on incoming direction estimation and image generation) is output to the output device 1105.
A carrier frequency of the radio wave 1010 to be transmitted from the transmission antenna 1003 of the transmitter 1091, and a carrier frequency of the reflected wave 1007 to be received by the reception antenna 1004 of the receiver 1092 are the same.
A case where the transmitter 1091 performs an operation of switching an RF frequency of the radio wave 1010 to be transmitted depending on a time is described. Since a carrier frequency of the radio wave 1010 to be transmitted from the transmitter 1091 has a plurality of values, the reflected wave 1007 to be received by the receiver 1092 also has a plurality of values. In the present example embodiment, the receiving control unit 1102 is able to acquire complex amplitudes of the reflected wave 1007, even when a carrier frequency of the reflected wave 1007 is changed by changing a frequency of an LO signal to be output from the oscillator 1101 in the receiver 1092.
Next,
A method for simultaneously transmitting the radio wave 1010 of a plurality of RF frequencies in the transmitter 1091 illustrated in
Next, in the receiver 1092 illustrated in
In an example illustrated in
In the present example embodiment, it is assumed that phase rotation amounts by the phase shifters 1031(f1), 1031(f2), . . . , and 1031(fM) illustrated in
An object sensing device described in the first example embodiment is applicable to estimating a position (particularly, a one-dimensional direction) of a target object 1001 as described in a second example embodiment, or displaying a disposition condition and a shape of a target object 1001 as a two-dimensional image as described in a third example embodiment. These processes are also carried out by the data processing unit 1106.
In a second example embodiment, a method for estimating a position (particularly, a one-dimensional direction) of a target object 1001 by using an object sensing device described in the first example embodiment is described.
RF signals of M carrier frequencies f1, f2, . . . , and fM are transmitted from the transmission antenna 1003. The transmitter 1091 (transmission antenna 1003) transmits a CW signal irrespective of a carrier frequency. Specifically, it is assumed that complex amplitudes of a radio wave 1010 have a constant value (complex number) s0 that does not depend on a carrier frequency. The reception antenna 1004 receives a reflected wave 1007 from the target object 1001. A carrier frequency of the reflected wave 1007 has M carrier frequencies f1, f2, . . . , and fM similarly to the radio wave 1010. It is assumed that the receiver 1092 acquires a signal per carrier frequency by causing the transmitter 1091 to perform frequency sweeping, or causing the receiver 1092 to separate signals per carrier frequency (in a state that the transmitter 1091 transmits broadband signals).
It is assumed that complex amplitudes of a reflected wave 1007 of a carrier frequency fm (where m=1, 2, . . . , and M) reflected from a d-th target object 1001d (where d=1, 2, . . . , and D) and received by a n-th reception antenna 1004n are sxn(xd, fm) (the suffix xn denotes a signal received by the n-th reception antenna 1004n disposed in the x-axis direction). Signals to be actually measured by the reception antenna 1004n are respectively combination of reflected waves 1007 from all target objects 1001d (where d=1, 2, . . . , and D). Complex amplitudes sxn(xd, fm) of the reflected wave 1007 from individual targets are unknown numbers. When it is assumed that complex amplitudes of a signal to be actually measured by the reception antenna 1004n is s′xn (fm, t), the following relationship is established between s′xn(fm, t) and sxn(xd, fm).
In Eq. (7), nxn(fm, t) is noise held by a receiver connected to the n-th reception antenna 1004n.
Next, complex amplitudes sxn(xd, fm) of the reflected wave 1007 reflected from respective target objects 1001d (where d=1, 2, . . . , and D) and received by the n-th reception antenna 1004n are analyzed in detail. A distance L0(xd) from the transmission antenna 1003 to the target object 1001d, and a distance Lxn(xd) from the n-th transmission antenna 1004n to the target object 1001d are given by the following Eqs. (8) and (9).
[Eq. 8]
L
0(xd)=√{square root over ((xd−d0)2+z02)}, (8)
[Eq. 9]
L
xn(xd)=√{square root over ((xd−dxn)2+z02)}, (9)
The following relationship is established between complex amplitudes s0 of the radio wave 1010 to be transmitted from the transmission antenna 1003, and complex amplitudes sxn(xd, fm) of the reflected wave 1007 of a carrier frequency fm received by the n-th reception antenna 1004n.
In Eq. (10), σ(xd) is an unknown number representing a reflectance of the target object 1001d. An exponential term in a right side of Eq. (10) represents a phase shift of a radio wave generated in a path from the transmission antenna 1003 to the reception antenna 1004n via the target object 1001d.
By substituting Eq. (10) for Eq. (7), the following equation is yielded.
When analysis is performed, several signals are defined as follows. The following measurement signal vector sx(t) is defined by using a signal s′xn(fm, t) (where n=1, 2, . . . and N, and m=1, 2, . . . , and M) in a left side of Eq. (11).
[Eq. 12]
s
x(t)=[s′xl(f1,t),s′xl(f2,t), . . . ,s′xl(FM,t), . . . ,s′XN(f1,t),s′xN(f2,t) . . . ,s′xN(fM,t)]T, (12)
A suffix [ ]T represents a vector and transpose of a matrix. Next, the following direction matrix A is defined by using an exponential term included in a right side of Eq. (11).
In Eq. (13), a size of a matrix A is MN×D, a size of a matrix An is M×D, and a size of a vector an(xd) is M×1. Note that, in the present specification, a size of a matrix is expressed by (number of raws)×(number of columns).
Further, the following desired signal vector s is defined by using variables s0 and σ(xd) in the right side of Eq. (11).
[Eq. 14]
s=s
0[σ(x1),σ(x2), . . . ,σ(xD)]T, (14)
Note that, in the present method, determining an evaluation function that reflects xd dependency (specifically, σ(xd)) of a desired signal vector s by measurement by the reception antenna 1004 becomes an object. A distribution and a shape of the target object 1001 are detected from xd dependency of the desired signal vector s.
A relationship expressed by Eq. (11) can be expressed as the following Eq. (15) by using a measurement signal vector sx(t), a direction matrix A and a desired signal vector s.
[Eq. 15]
s
x=(t)=As+n(t), (15)
Herein, n(t) is a vector of an (MN×1)-th order in which noise nxn(fm, t) is an element.
In the present example embodiment, a measurement signal vector sx(t) defined by Eq. (12) is measured by the reception antenna 1004. Next, the following correlation matrix Rx is calculated by using a measurement signal vector sx(t) acquired by measurement.
Herein, E[u(t)] represents a time average of a signal u(t). When signals of respective carrier frequencies are acquired in a period T, E[u(t)] becomes a time average in the period T. When frequency sweeping is performed, and signals of respective carrier frequencies are acquired at different timings, delay correction is performed, and calculation of a correlation matrix is performed after domains of all signal data are aligned in a range of t=0 to T. In order to perform delay correction, it is required to perform measurement in a state that the transmitter 1091 and the receiver 1092 are synchronized.
By substituting Eq. (15) for definition of the correlation matrix Rx in Eq. (16), a relationship between the correlation matrix Rx and the direction matrix A is derived as expressed by the following Eq. (17).
In Eq. (17), PN denotes noise power, and I denotes a unit matrix of an (MN×MN)-th order. A suffix H represents a complex conjugate transpose. Sizes of a correlation matrix Rx, a matrix A, and a matrix S respectively are an (MN×MN)-th order, an (MN×D)-th order, and a (D×D)-th order.
As described in NPL 1, it is known that by applying a multiple signal classification (MUSIC) method to a system in which Eq. (15) and Eq. (17) are established, it is possible to calculate an evaluation function PMU(x) that reflects x-dependency (specifically, σ(x)) of an intensity of a desired signal vector s. However, as an applicable condition of a MUSIC method, it is required that the matrixes A and S in Eq. (17) are full rank matrixes. Full rank is defined that the rank of a matrix coincides with a size of a matrix (a smaller number between the number of rows and the number of columns), and all row vectors and all column vectors in a matrix are all linearly independent.
Since a direction matrix A is a function of a position xd at which respective column vectors are different, the respective column vectors are independent and become full rank vectors. When elements of a matrix S are observed, and when σ(xi)=(xj) (i≠j), a row vector at an i-th row and a row vector at a j-th row in the matrix S have the same values, and become linearly dependent. Therefore, the rank is decreased by one, and the matrix is no longer a full rank matrix. Although Eq. (17) is regarded as simultaneous equations, decreasing the rank of the matrix S is equivalent to decreasing the number of independent equations, and it becomes difficult to acquire information on a desired unknown number σ(xd) (where d=1, 2, . . . , and D).
In the following, a method for returning a matrix S to a full rank matrix by using a concept of a subarray is described. As described in the first example embodiment of the present invention, the present example embodiment is directed to a virtual array in which one frequency is handled as one antenna. In the present example embodiment, as illustrated in
A measurement signal vector sxq(t) of a subarray q (where q=1, 2, . . . , and Q) is defined as follows.
[Eq. 18]
s
x
q(t)=[xxl(fq,t),sxl(fq+1,t), . . . sxl(fq+M−1,t), . . . sxN(fq,t),sxN(fq+1,t), . . . ,sxN(fq+M−1,t)]T, (18)
At this occasion, the measurement signal vector sxq(t) of a subarray q in Eq. (18) has a relationship given by the following Eq. (19) between the direction matrix A in Eq. (13), and the desired signal vector s in Eq. (14).
Herein, it is assumed that carrier frequencies f1, f2, . . . , and fM of an RF signal are equi-spaced, and a frequency interval thereof is Δf. Specifically, it is assumed that fm=f1+(m−1)Δf, (where m=1, 2, . . . , and M).
A correlation matrix Rqx of a subarray q is calculated as expressed by the following Eq. (20).
In Eq. (20), sizes of a correlation matrix Rqx, a matrix A′, and a matrix S′ respectively are an (NM×NM)-th order, an (NM×ND)-th order, and an (ND×ND)-th order. Next, an average correlation matrix R′x of all subarrays q (where q=1, 2, . . . , and Q) is calculated. A relationship between an average correlation matrix R′x of all subarrays, and a direction matrix A is calculated as expressed by the following Eq. (21).
The correlation matrix R′x in Eq. (21) has a configuration of A′S″A′H similarly to the correlation matrix in Eq. (17). In view of the above, when it is assumed that matrixes A′ and S″ are full rank matrixes, it is possible to calculate an evaluation function PMU(x) that reflects x-dependency (specifically, σ(x)) of an intensity of a desired signal vector s by applying a MUSIC method to the correlation matrix R′x.
Regarding the matrix A′, since direction matrixes A1, A2, . . . , and AN are independent and full rank matrixes, the matrix A′ given by Eq. (20) is also a full rank matrix.
Next, a matrix S″ is considered. In Eq. (17), a condition that reflectances of all target objects are the same, specifically, a condition: σ=σ(x1)=σ(x2)= . . . =σ(xD) by using σ as a constant is considered. At this occasion, the rank of the matrix S becomes 1, which is a most severe condition when a MUSIC method is applied. Even in this condition, the matrix S″ in Eq. (21) becomes a full rank matrix, when a condition is satisfied. When σ=σ(x1)=σ(x2)= . . . =σ(xD), a calculation result on the matrix S′ in Eq. (21) is expressed by the following Eq. (22).
In a matrix Ci, when biu=biv (u≠v), since a row vector at a u-th row and a row vector at a v-th row in a matrix C have the same values, and become linearly dependent, the rank is decreased by one, and the matrix is no longer a full rank matrix. On the other hand, as is clear from Eq. (19), when bid is a function of distances L0(xd) and L0(xd), and a position xd differs, these distances have different values. Therefore, a condition that biu=biv (u≠v) is not satisfied, and Ci becomes a full rank matrix. Since a matrix size of Ci is D×Q, the rank of Ci is equal to a smaller value between D and Q. Therefore, when Q≥D, a rank of Ci becomes D, the rank of S″ij also becomes D, and a condition on a full rank matrix is satisfied. Further, since respective S″ij are independent, S″ becomes a full rank matrix.
There is a case where the matrix S in Eq. (17) does not become a full rank matrix from a condition that a reflectance σ(xd) may have the same value even when a position xd differs. On the other hand, it is guaranteed that the matrix S″ becomes a full rank matrix from a property that distances L0(xd) and Lx(xd) always change, when a position xd is changed.
In a condition: Q<D, the rank of S″ becomes Q, and the rank of S″ is increased by one, each time a number Q of subarrays is increased by one. This can be interpreted that respective subarrays are signal sets independent of one another, and the rank of the matrix S″ is also increased by one, since the number of independent signal sets is increased by one by increasing the number Q of subarrays by one.
Note that when a relationship: Q=M0−M+1, and another applicable condition of a MUSIC method: MN≥D+1 are also taken into consideration, a condition on a number M0 of required frequencies is given by the following Eq. (23). Specifically, a number M0 of required frequencies increases in proportion to a number D of positions to be detected.
In NPL 1, incoming direction estimation is performed by applying a MUSIC method to a correlation matrix of a general array antenna. In the present example embodiment, an evaluation function PMU(x) that reflects x-dependency (specifically, σ(x)) of an intensity of a desired signal vector s(t) is calculated by applying a MUSIC method (the same method as applied to a formally general array antenna) to the average correlation matrix R′x of all subarrays calculated in Eq. (21). At this occasion, the evaluation function PMU(x) is given by the following Eq. (24).
Herein, a(x) is a column vector of the direction matrix A defined by Eq. (13). Further, EN is given by the following Eq. (25).
[Eq. 25]
E
N=[eD+1,eD+2, . . . ,eMN], (25)
Herein, an eigenvalue of a vector ek (where k=D+1, D+2, . . . , and MN) is equal to noise power among eigenvectors of a correlation matrix R′x. According to a MUSIC method, the evaluation function PMU(x) in Eq. (24) gives a peak at a position xd of a target object 1001d (where d=1, 2, . . . , and D). Therefore, it is possible to detect a position xd of a target object 1001d (where d=1, 2, . . . , and D) from a position x, at which an evaluation function PMU(x) gives a peak value. When a MUSIC method is applied, (MN−D) eigenvectors {eD+1, eD+2, . . . , and eMN} noise spaces are used. Since, at least one eigenvector is required, it is required to satisfy: MN−D≥1, specifically, MN≥D+1.
In the foregoing, a position xd of a target object 1001d (where d=1, 2, . . . , and D) is detected by using a MUSIC method. It is also possible to calculate an evaluation function that reflects x-dependency (specifically, σ(x)) of an intensity of a desired signal vector s(t) by applying a beam former method, a Capon method, or a linear prediction method (the same method as applied to a formally general array antenna, and described in NPL1) to the correlation matrix R′x. An evaluation function PBF(x) based on a beam former method in the second example embodiment of the present invention is given by the following Eq. (26).
Further, an evaluation function PLP(x) based on a Capon method in the second example embodiment of the present invention is given by the following Eq. (27).
Further, an evaluation function PLP(x) based on a linear prediction method in the second example embodiment of the present invention is given by the following Eq. (28).
The above-described evaluation functions PBF(x), PCP(x), and PLP(x) also have a peak value at a position xd of a target object 1001d (where d=1, 2, . . . , and D), similarly to an evaluation function PMU(x) to be acquired by a MUSIC method. Therefore, it is possible to detect a position xd of a target object 1001d (where d=1, 2, . . . , and D), from a position x at which an evaluation function gives a peak value.
Processing disclosed in the second example embodiment of the present invention, specifically, processing of calculating an evaluation function from a measurement result of a reflected wave, and detecting a position of a target object from the evaluation function is performed by the data processing unit 1106 in circuit block diagrams of
Processing disclosed in the second example embodiment of the present invention, specifically, processing of calculating an evaluation function from a measurement result of a reflected wave, and detecting a position of a target object from the evaluation function is performed by the data processing unit 1106 in block diagrams of
Note that, in the second example embodiment of the present invention, it is possible to detect only position information xd (specifically, only a position in a one-dimensional direction) of a coordinate (specifically, x-axis) in a direction connecting the transmitter 1091 and the receiver 1092. This is because since an object sensing device constituted by the transmitter 1091 and the receiver 1092 has rotational symmetry with respect to the x-axis as an axis, it is not possible to distinguish coordinate values, even when coordinate values in axes other than the x-axis of a target object 1001 differ. A method for also detecting position information on coordinate in the axes other than the x-axis is disclosed in a third example embodiment of the present invention.
An object sensing method in the second example embodiment of the present invention is summarized in a flowchart of
In a third example embodiment of the present invention, a method for generating a two-dimensional image that identifies a disposition or a shape of a target object 1001, based on a concept of the virtual array described in the first example embodiment of the present invention is disclosed.
An RF signal (radio wave) 1010 is irradiated from the transmission antenna 1003 toward a target object 1001 present on a focal plane 1002. After the radio wave 1010 is irradiated to the target object 1001, reflected waves 1007(x) and 1007(y) from the target object 1001 are respectively received by the reception antennas 1004(x) and 1004(y). In the third example embodiment of the present invention, a plurality of values are employed for a carrier frequency of the radio wave 1010 to be output from the transmission antenna 1003.
The third example embodiment illustrated in
Next, details of two-dimensional image generation processing are disclosed. First of all, a method for calculating a correlation matrix of a two-dimensional frequency virtual array is described.
Similarly to other example embodiments of the present invention, also in the third example embodiment, the transmission antenna 1003(x0) and 1003(y0) transmit a radio wave 1010 of M carrier frequencies f1, f2, . . . , and fM. Modulating the ratio wave 1010 to a CW signal (non-modulated signal) irrespective of a carrier frequency is a preferred example embodiment.
It is assumed that complex amplitudes of a reflected wave 1007 of a carrier frequency fm (where m=1, 2, . . . , and M) reflected from a target object 1001d (where d=1, 2, . . . , and D) and received by the n-th reception antenna 1004(xn) on the x-axis are sxn(xd, yd, fm). Further, it is assumed that complex amplitudes of a received signal actually measured by the n-th reception antenna 1004(xn) on the x-axis (combination of reflected waves from respective targets) are sx(fm, t). The following relationship is established between sxn(fm, t), and sxn(xd, yd, fm).
[Eq. 29]
s
xn(fm,t)=Σd=1Dsxn(xd,yd,fm)+nxn(fm,t),(n=1,2, . . . ,N,m=1,2, . . . ,M) (29)
In Eq. (29), nxn(fm, t) is noise held by the receiver 1092 connected to the n-th reception antenna 1004(xn) on the x-axis.
When signals syn(fm, t), syn(xd, yd, fm), and nyn(fm, t) are defined similarly regarding the n-th reception antenna 1004(yn) on the y-axis, a relationship similar to Eq. (29) is also established as follows.
[Eq. 30]
s
yn(fm,t)=Σd=1Dsyn(xd,yd,fm)+nyn(fm,t),(n=1,2, . . . ,N,m=1,2, . . . ,M) (30)
When it is assumed that a distance between the target object 1001d and the transmission antenna 1003(x0) on the x-axis, and a distance between the target object 1001d and the n-th reception antenna 1004(xn) on the x-axis are respectively Lx0(xd, yd), and Lxn(xd, yd), these distances are given by the following Eqs. (31) and (32).
[Eq. 31]
L
x0(xd,yd)=√{square root over ((xd−dx0)2+yd2+z02)}, (31)
[Eq. 32]
L
xn(xd,yd)=√{square root over ((xd−dxn)2+yd2+z02)}, (32)
Likewise, when it is assumed that a distance between the target object 1001d and the transmission antenna 1003(y0) on the y-axis, and a distance between the target object 1001d and the n-th reception antenna 1004(yn) on the y-axis are respectively Ly0(xd, yd), and Lyn(xd, yd), these distances are given by the following Eqs. (33) and (34).
[Eq. 33]
L
y0(xd,yd)=√{square root over (xd2+(yd−dy0)2+z02)}, (33)
[Eq. 34]
L
yn(xd,yd)=√{square root over (xd2+(yd−dyn)2+z02)}, (34)
The following relationship is established between complex amplitudes s0 of an RF signal to be transmitted from the transmission antenna 1003(x0), and complex amplitudes sxn(xd, yd, fm) of an RF signal of a carrier frequency fm received by the n-th reception antenna 1004(xn) on the x-axis.
σ(xd, yd) is an unknown number representing a reflectance of a target object 1001d (where d=1, 2, . . . , and D). A similar relationship is established regarding the reception antenna 1004(yn) on the y-axis.
By substituting Eq. (35) for Eq. (29), and substituting Eq. (36) for Eq. (30), the following equations are yielded.
Next, the following measurement signal vector sx(t) is defined by using a measurement signal sxn(fm, t) in the n-th reception antenna 1004(xn) (where n=1, 2, . . . , and N) on the x-axis.
[Eq. 39]
s
x(t)=[sx11(t), . . . ,sxIM(t), . . . ,sxNI(t), . . . sxNM(t)]T,
s
xNM(t)=sxn(fm,t),(n=1,2, . . . ,N,m=1,2, . . . ,M,) (38)
Likewise, a measurement signal in the reception antenna 1004(yn) (where n=1, 2, . . . , and N) in the y-axis direction is defined as follows.
[Eq. 40]
s
y(t)=[sy11(t), . . . ,syIM(t), . . . ,syNI(t), . . . syNM(t)]T,
s
yvw(t)=syv(fw,t),(v=1,2, . . . ,N,w=1,2, . . . ,M,) (40)
Next, a product is acquired regarding all combinations of elements of the x-axis-direction measurement vector sx(t) in Eq. (39) and the y-axis-direction measurement vector sy(t) in Eq. (40) in accordance with a Mills cross method, and the following direct product vector sxy(t) is generated.
[Eq. 41]
s
xy(nv)(mw)(t)=sxmn(t)syvw(t),(n,v=1,2, . . . ,N,m,w=1,2, . . . ,M,)
s
xy(t)=[sxy(11)(11)(t),sxy(11)(12)(t), . . . ,sxy(11)(1M)(t), . . . ,
s
xy(11)(M1)(t),sxy(11)(M2)(t), . . . , sxy(11)(MM)(t), . . . ,
s
xy(1N)(11)(t),sxy(1N)(12)(t), . . . , sxy(1N)(1M)(t), . . . ,
s
xy(1N)(M1)(t),sxy(1N)(M2)(t), . . . , sxy(1N)(MM)(t), . . . ,
s
xy(NN)(11)(t),sxy(NN)(12)(t), . . . , sxy(NN)(1M)(t), . . . ,
s
xy(NN)(M1)(t),sxy(NN)(M2)(t), . . . , sxy(NN)(MM)(t),]T (41)
In Eq. (41), n and v are respectively numbers of antennas disposed in the x-direction and the y-direction, and m and w are respectively suffixes representing frequency numbers of signals received by the antennas disposed in the x-direction and the y-direction.
Next, a direction matrix A is defined as follows.
In Eq. (42), a size of a direction matrix A is (MN)2×D, a size of a matrix Anv is M2×D, and a size of a vector anv(xd, yd) is M2×1. The matrix Anv is a direction matrix involving the n-th x-direction antenna 1004(xn), and the v-th y-direction antenna 1004(yv). The direction matrix A of a whole system becomes a matrix acquired by integrating direction matrixes Anv of sets (n, v) of all antenna numbers.
Similarly to the above-described case on one-dimensional incoming direction estimation, the following desired signal vector s is defined by using complex amplitudes s0 and a reflectance σ(xd, yd).
[Eq. 43]
s=s
0[σ(x1,y1),σ(x2y2), . . . σ(xDyD)]T, (43)
From Eqs. (37) and (38), the following relational expression is acquired between the measurement signal vector sxy(t) in Eq. (41), the direction matrix A in Eq. (42), and the desired signal vector s in Eq. (43).
[Eq. 44]
s
xy(t)=As+n(t) (44)
In Eq. (44), n(t) is a vector term involving noise. Next, a correlation matrix Rxy is calculated by using the measurement signal vector sx(t) in Eq. (41) acquired by measurement. The following relationship between a correlation matrix Rxy and a direction matrix A is given from the relationship expressed by Eq. (44).
In Eq. (45), PN is average power of a noise term n(t), and I is a unit matrix of an (MN)2×(MN)2-th order. Sizes of a correlation matrix Rxy, a matrix A, and a matrix S respectively is an (MN)2×(MN)2-th order, an (MN)2×D-th order, and a D×D-th order.
Since Eqs. (44) and (45) are the same types as Eqs. (15) and (17) in one-dimensional incoming direction estimation discussed in the second example embodiment of the present invention, it is possible to calculate an evaluation function PMU(x, y) that reflects σ(xd, yd) by applying a MUSIC method to a correlation matrix Rxy in accordance with the same procedure as one-dimensional incoming direction estimation. However, similarly to a case of one-dimensional incoming direction estimation, it is required that the matrixes A and S in Eq. (45) are full rank matrixes, as an applicable condition of a MUSIC method. Further, similarly to the above-described discussion, although the direction matrix A is a full rank matrix, the matrix S is not a full rank matrix when σ(xi)=σ(xj) (i≠j). Therefore, it is required to perform processing in such a way that the matrix S becomes a full rank matrix by a subarray method.
Also in a case of two-dimensional image generation, one subarray is configured by M frequencies, and Q subarrays are configured in accordance with the same procedure as a subarray method in one-dimensional incoming direction estimation discussed in the second example embodiment of the present invention. When it is assumed that a total number of frequencies is M0, a relationship: Q=M0−M+1 is established. A q-th subarray signal is defined as follows. A signal acquired by simultaneously shifting suffixes m and w representing a frequency of a component sxy(nv)(mw)(t) of a signal vector sxy(t) by +(q−1) becomes the q-th subarray signal.
[Eq. 46]
s
q
xy(t)=[sxy(11)(qq)(t),sxy(11)(q,q+1)(t), . . . ,sxy(11)(q,M+q−1)(t), . . . ,
s
xy(11)(M+q−1,q)(t),sxy(11)(M+q−1,q+1)(t), . . . , sxy(11)(M+q−1,M+q−1), . . . ,
s
xy(1N)(qq)(t),sxy(1N)(q,q+1)(t), . . . , sxy(1N)(q,M+q−1)(t), . . . ,
s
xy(1N)(M+q−1,q)(t),sxy(1N)(M+q−1,q+1)(t),sxy(1N)(M+q−1,M+q−1), . . . ,
s
xy(NN)(qq)(t),sxy(NN)(q,q+1)(t), . . . , sxy(NN)(q,M+q−1)(t), . . . ,
s
xy(NN)(M+q−1,q)(t),sxy(NN)(M+q−1,q+1)(t),sxy(NN)(M+q−1,M+q−1)]T (46)
The following relational expression is established between the subarray signal sxyq(t) in Eq. (46) and the direction matrix in Eq. (42).
A correlation matrix Rqx of a subarray q is calculated as expressed by the following Eq. (48).
In Eq. (48), sizes of a correlation matrix Rqxy, a matrix A′, and a matrix S′ respectively is an (NM)2×(NM)2-th order, an (NM)2×N2D-th order, and an N2D×N2D-th order. Next, an average correlation matrix R′xy of all subarrays q (where q=1, 2, . . . , and Q) is calculated. A relationship between an average correlation matrix R′xy of all subarrays, and a direction matrix A′ is calculated as expressed by the following Eq. (49).
The following matters are clear by similar discussion as in a case of one-dimensional incoming direction estimation described in the second example embodiment of the present invention.
(1) When matrixes A′ and S are full rank matrixes, it is possible to calculate an evaluation function PMU(x, y) that reflects σ(xd, yd) by applying a MUSIC method to a correlation matrix R′xy.
(2) Regarding the matrix A′, since direction matrixes A11, A12, . . . , A1N, . . . , AN1, . . . , and ANN are independent and full rank matrixes, A′ to be given by Eq. (48) also becomes a full rank matrix.
(3) When the condition: Q≥D is satisfied, the matrix S″ becomes a full rank matrix.
An applicable condition MN≥D+1 of a MUSIC method in one-dimensional incoming direction estimation becomes (MN)2≥D+1 in two-dimensional image generation. When this matter, and conditions: Q=M0−M+1 and Q≥D in a subarray are taken into consideration, a condition on a number M0 of required frequencies is given by the following Eq. (50). Specifically, a number M0 of required frequencies increases substantially proportional to a number D of positions to be detected.
Next, an evaluation function PMU(x, y) that reflects σ(xd, yd) is calculated by applying a MUSIC method to the average correlation matrix R′xy of all subarrays calculated by Eq. (49). Consequently, an evaluation function is acquired as follows.
Herein, a(x, y) is a column vector of the direction matrix A defined by Eq. (42). Further, EN is given by the following equation.
[Eq. 52]
E
N=[eD+1,eD+2, . . . ,e(MN)02], (52)
Herein, a vector ek (where k=D+1, D+2, . . . , and (MN)2) is one of eigenvectors of a correlation matrix R′sxy whose eigenvalue is equal to noise power.
An evaluation function PMU(x, y) gives a peak at a position (xd, yd) (where d=1, 2, . . . , and D) of a target object 1001d. Therefore, it is possible to detect position information (xd, yd) (where d=1, 2, . . . , and D) of a target object 1001d from the evaluation function PMU(x, y), and detect a distribution or a shape of a target object 1001 therefrom.
In the foregoing, a position of a target object 1001d (where d=1, 2, . . . , and D) is detected by using a MUSIC method. Alternatively, it is also possible to calculate an evaluation function of respective methods by applying a beam former method, a Capon method, or a linear prediction method (the same method as applied to a formally general array antenna, and described in NPL 1) to a correlation matrix R′sxy.
In accordance with the above-described observation, an evaluation function PBF(x, y) based on a beam former method in the third example embodiment of the present invention is given by the following Eq. (53).
Further, an evaluation function PCP(x, y) based on a Capon method in the third example embodiment of the present invention is given by the following Eq. (54).
Further, an evaluation function PLP(x, y) based on a linear prediction method in the third example embodiment of the present invention is given by the following Eq. (55).
The above-described evaluation functions PBF(x, y), PCP(x, y), and PLP(x, y) also have a peak value at a position (xd, yd) of a target object 1001d (where d=1, 2, . . . , and D), similarly to the evaluation function PMU(x, y) to be acquired by a MUSIC method. Therefore, it is possible to detect a position xd of a target object 1001d (where d=1, 2, . . . , and D) from a position (x, y) at which an evaluation function gives a peak value.
Processing disclosed in the third example embodiment of the present invention, specifically, processing of calculating an evaluation function from a measurement result of a reflected wave, and detecting a position of a target object from the evaluation function is performed by the data processing unit 1106 in circuit block diagrams of
An object sensing method in the third example embodiment of the present invention is summarized in a flowchart of
In the present example embodiment, since the object sensing device 1202 is implemented with a compact size and at a low cost, it is easy to increase the number P of object sensing devices 1202. In the fourth example embodiment of the present invention illustrated in
In the fourth example embodiment of the present invention illustrated in
Further,
In the following, advantageous effects of respective example embodiments of the present invention are summarized.
When compared to respective example embodiments, the array antenna method requires a large number of antennas. On the other hand, in the respective example embodiments, it is possible to increase the number of virtual antennas by increasing the number of frequencies, in place of increasing the number of actual antennas. Consequently, in the respective example embodiments, it is possible to implement a function equivalent to a function of a general array antenna method by at least one transmission antenna and one reception antenna per direction, and it is possible to remarkably reduce the number of actual antennas, as compared with a general array antenna method.
When compared to respective example embodiments, the synthetic aperture radar method requires the receiver 301 to be mechanically moved. This causes a problem that time for detecting or inspecting an object increases. On the other hand, in the respective example embodiments, not a position of a receiver but a receiving frequency is electronically scanned. Therefore, it is possible to shorten time for detecting or inspecting an object, as compared with a synthetic aperture radar method.
Specifically, in the above-described object sensing device and object sensing method, since it is possible to reduce the number of required antennas and receivers accompanied thereby, as compared with a general array antenna method, an advantageous effect that it is possible to reduce a cost, a size, and a weight of a device is provided. Further, in the above-described object sensing device and object sensing method, unlike a general synthetic aperture radar method, since it is not required to mechanically move a device, an advantageous effect that it is possible to shorten time for detecting or inspecting an object is provided.
Example embodiments of the present invention are directed to an object sensing device and an object sensing method for generating an image of an object to be detected by irradiating a radio wave of a plurality of RF frequencies to the object to be detected, and detecting a radio wave to be reflected or irradiated from a target object, and main features of the example embodiments are reducing the number of required antennas and receiving units, as compared with a general configuration, and implementing image generation by high-speed scanning without the need of moving.
Specifically, an object sensing device in the respective example embodiments of the present invention is an object sensing device constituted by a transmitter including a transmission antenna and a receiver including a reception antenna. A radio wave of a plurality of frequencies is irradiated from the transmission antenna toward a target object. The receiver receives the radio wave of a plurality of frequencies reflected from the target object. The receiver has a function of respectively adjusting phases with respect to the received radio wave of respective frequencies. The receiver controls directivity of antenna gain by the phase adjusting function, and the receiver detects a position or a shape of the target object by measuring an intensity distribution of a radio wave incoming to the receiver by directivity control of the antenna gain.
In the description above, the preferable example embodiments of the present invention are explained. However, the contents disclosed in the PTLs can be inserted with quotation to the corresponding description in the example embodiments. Among all the disclosure (including the claims) of the present invention or based on the fundamental technical ideas therein, the embodiments can be changed or adjusted. It is also possible that the disclosed elements can be combined each other or selected, in various manner. Accordingly, it is obvious that the present invention includes various changes or revisions that those of ordinary skill in the art may achieve based on all the disclosure including the claims or technical ideas therein.
This application is based upon and claims the benefit of priority from Japanese patent application No. 2016-050700 filed on Mar. 15, 2016, the disclosure of which is incorporated herein in its entirety by reference.
Number | Date | Country | Kind |
---|---|---|---|
2016-050700 | Mar 2016 | JP | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2017/009392 | 3/9/2017 | WO | 00 |