This application claims priority to and the benefit of Japanese Patent Application No. 2018-193350 filed on Oct. 12, 2018, the entire disclosure of which is incorporated herein by reference.
The present disclosure relates to an electronic device, a control method of an electronic device, and a control program of an electronic device.
In fields such as automobile-related industry, techniques of measuring, for example, the distance between a vehicle and a certain object are considered important. In particular, various techniques of radar (radio detecting and ranging) that measures, for example, the distance from an object such as an obstacle by transmitting radio waves such as millimeter waves and receiving reflected waves reflected off the object are studied in recent years. The importance of such techniques of measuring distance and the like is expected to further increase in the future, with the development of techniques of assisting the driver in driving and techniques related to automated driving whereby driving is wholly or partly automated.
There are also several proposals for techniques of detecting the presence of a certain object by providing a plurality of sensors for receiving reflected waves resulting from reflection of transmitted radio waves off the object. As an example, WO 2010/140239 A1 (PTL 1) discloses a technique of monitoring the surroundings of a vehicle with reduced processing load using a plurality of monitoring sensors for monitoring different regions around the vehicle. As another example, JP 2018-67237 A (PTL 2) discloses a technique of performing a predetermined process on each of a plurality of output values output from a plurality of sensors based on a priority that is set depending on the angle between a reference direction on a road around a vehicle and the direction of the vehicle.
PTL 1: WO 2010/140239 A1
PTL 2: JP 2018-67237 A
An electronic device according to an embodiment comprises a plurality of sensors and a main controller. The plurality of sensors are each configured to detect, based on a transmission signal transmitted from a transmission antenna as transmission waves and a reception signal received by a reception antenna as reflected waves, an object reflecting the transmission waves. The main controller is configured to control the plurality of sensors independently of each other.
A control method of an electronic device according to an embodiment comprises: (1) detecting, based on a transmission signal transmitted from a transmission antenna as transmission waves and a reception signal received by a reception antenna as reflected waves, an object reflecting the transmission waves, by each of a plurality of sensors; and (2) controlling the plurality of sensors independently of each other.
A control program of an electronic device according to an embodiment causes a computer to execute the foregoing (1) and (2).
In the accompanying drawings:
It is desirable to improve convenience in techniques of detecting a certain object by providing a plurality of sensors for receiving reflected waves resulting from reflection of transmitted transmission waves off the object. It could therefore be helpful to provide an electronic device, a control method of an electronic device, and a control program of an electronic device that can improve convenience in object detection by a plurality of sensors. According to an embodiment, it is possible to provide an electronic device, a control method of an electronic device, and a control program of an electronic device that can improve convenience in object detection by a plurality of sensors. One of the disclosed embodiments will be described in detail below, with reference to the drawings.
An electronic device according to an embodiment can be mounted in a vehicle (mobile body) such as a car (automobile) to detect a certain object around the mobile body. The electronic device according to the embodiment can transmit transmission waves to the surroundings of the mobile body from a transmission antenna installed in the mobile body. The electronic device according to the embodiment can also receive reflected waves resulting from reflection of the transmission waves, by a reception antenna installed in the mobile body. At least one of the transmission antenna and the reception antenna may be included in, for example, a radar sensor installed in the mobile body.
The following will describe a structure in which the electronic device according to the embodiment is mounted in a car such as a passenger car, as a typical example. The electronic device according to the embodiment is, however, not limited to being mounted in a car. The electronic device according to the embodiment may be mounted in various mobile bodies such as a bus, a truck, a motorcycle, a bicycle, a ship, an airplane, an ambulance, a fire engine, a helicopter, and a drone. The electronic device according to the embodiment is not limited to being mounted in a mobile body that moves with its own power. For example, the mobile body in which the electronic device according to the embodiment is mounted may be a trailer portion towed by a tractor. The electronic device according to the embodiment can measure, for example, the distance between the sensor and the object in a situation in which at least one of the sensor and the object can move. The electronic device according to the embodiment can also measure, for example, the distance between the sensor and the object when both the sensor and the object are stationary.
An example of object detection by the electronic device according to the embodiment will be described below.
A sensor 5 including a transmission antenna and a reception antenna according to the embodiment is installed in a mobile body 100 illustrated in
As illustrated in
The sensor 5 transmits electromagnetic waves from the transmission antenna as transmission waves. For example, in the case where there is a certain object (e.g. an object 200 illustrated in
The sensor 5 including the transmission antenna may be typically a radar (radio detecting and ranging) sensor that transmits and receives radio waves. The sensor 5 is, however, not limited to a radar sensor. For example, the sensor 5 according to the embodiment may be a sensor based on a technique of lidar (light detection and ranging, laser imaging detection and ranging) by lightwaves. Such sensors may include, for example, patch antennas and the like. Since the techniques of radar and lidar are already known, detailed description is simplified or omitted as appropriate.
The electronic device 1 mounted in the mobile body 100 illustrated in
The object 200 may be, for example, at least one of an oncoming car running in a lane adjacent to the mobile body 100, a car running parallel to the mobile body 100, and a car running ahead or behind in the same lane as the mobile body 100. The object 200 may be any object around the mobile body 100, such as a motorcycle, a bicycle, a stroller, a pedestrian, a guardrail, a median strip, a road sign, a manhole, a slope, a sidewalk step, a wall, and an obstacle. The object 200 may be moving or stopped. For example, the object 200 may be a car parked or stopped around the mobile body 100. The object 200 is not limited to being on a roadway, and may be in any appropriate location such as a sidewalk, a farm, farmland, a parking lot, a vacant lot, a space on a road, inside a store, a pedestrian crossing, on water, in the air, a gutter, a river, inside another mobile body, a building, or inside or outside of any other structure. In the present disclosure, examples of the object 200 detected by the sensor 5 include not only non-living objects but also living objects such as humans, dogs, cats, horses, and other animals. In the present disclosure, the object 200 detected by the sensor 5 includes a target such as a human, a thing, or an animal detected by radar technology.
In
It is assumed here that the transmission antenna in the sensor 5 transmits radio waves in a frequency band such as millimeter waves (30 GHz or more) or submillimeter waves (e.g. about 20 GHz to 30 GHz), as a typical example. For example, the transmission antenna in the sensor 5 may transmit radio waves with a frequency bandwidth of 4 GHz, e.g. 77 GHz to 81 GHz.
When measuring distance or the like by millimeter wave radar, frequency-modulated continuous wave radar (hereafter. “FMCW radar”) is often used. FMCW radar sweeps the frequency of transmitted radio waves to generate a transmission signal. Therefore, for example, in millimeter-wave FMCW radar using radio waves in a frequency band of 79 GHz, the radio waves used have a frequency bandwidth of 4 GHz, e.g. 77 GHz to 81 GHz. Radar of 79 GHz in frequency band has a feature that its usable frequency bandwidth is broader than that of other millimeter wave/submillimeter wave radar of 24 GHz, 60 GHz, 76 GHz, etc. in frequency band. This embodiment will be described below. A radar system of FMCW radar used in the present disclosure may include a fast-chirp modulation (FCM) system that transmits a chirp signal in a cycle shorter than normal. The signal generated by the signal generator 21 is not limited to a FMCW signal. The signal generated by the signal generator 21 may be a signal of any of various systems other than FMCW. A transmission signal sequence stored in the memory 40 may be different depending on the system used. For example, in the case of a FMCW radar signal, a signal whose frequency increases and a signal whose frequency decreases for each time sample may be used. Well-known techniques can be appropriately applied to the foregoing various systems, and therefore more detailed description is omitted.
The electronic device 1 according to the embodiment includes the sensor 5 and an electronic control unit (ECU) 50, as illustrated in
The controller 10 includes a distance FFT processor 11, a speed FFT processor 12, an arrival angle estimation unit 13, an object detector 14, a detection range determination unit 15, and a parameter setting unit 16. These functional parts included in the controller 10 will be described in detail later.
The transmitter 20 may include a signal generator 21, a synthesizer 22, phase controllers 23A and 23B, amplifiers 24A and 24B, and transmission antennas 25A and 25B, as illustrated in
The respective receivers 30 may include corresponding reception antennas 31A to 31D, as illustrated in
The sensor 5 may include, for example, the transmission antennas 25 and the reception antennas 31. The sensor 5 may include at least one of the other functional parts such as the controller 10, as appropriate.
The controller 10 included in the electronic device 1 according to the embodiment controls overall operation of the electronic device 1, including control of each of the functional parts included in the electronic device 1. The controller 10 may include at least one processor such as a central processing unit (CPU), to provide control and processing capacity for achieving various functions. The controller 10 may be implemented by one processor, by several processors, or by respective separate processors. Each processor may be implemented as a single integrated circuit (IC). Each processor may be implemented as a plurality of integrated circuits and/or discrete circuits communicably connected to one another. Each processor may be implemented based on any of other various known techniques. In an embodiment, the controller 10 may be implemented, for example, by a CPU and a program executed by the CPU. The controller 10 may include a memory necessary for the operation of the controller 10.
The memory 40 may store the program executed by the controller 10, results of processes performed by the controller 10, and the like. The memory 40 may function as a work memory of the controller 10. The memory 40 may be implemented, for example, by a semiconductor memory, a magnetic disk, or the like. The memory 40 is, however, not limited to such, and may be any storage device. For example, the memory 40 may be a storage medium such as a memory card inserted in the electronic device 1 according to the embodiment. The memory 40 may be an internal memory of the CPU used as the controller 10 as described above.
In an embodiment, the memory 40 may store various parameters for setting the range of object detection by the transmission waves T transmitted by the transmission antenna 25 and the reflected waves R received by the reception antenna 31. Such parameters will be described in detail later.
In the electronic device 1 according to the embodiment, the controller 10 can control at least one of the transmitter 20 and the receiver 30. In this case, the controller 10 may control at least one of the transmitter 20 and the receiver 30 based on various information stored in the memory 40. In the electronic device 1 according to the embodiment, the controller 10 may instruct the signal generator 21 to generate a signal, or control the signal generator 21 to generate a signal.
The signal generator 21 generates a signal (transmission signal) transmitted from the transmission antenna 25 as the transmission waves T, based on control by the controller 10. When generating the transmission signal, for example, the signal generator 21 may assign the frequency of the transmission signal based on control by the controller 10. Specifically, the signal generator 21 may assign the frequency of the transmission signal according to a parameter set by the parameter setting unit 16. For example, the signal generator 21 receives frequency information from the controller 10 (the parameter setting unit 16), and generates a signal of a predetermined frequency in a frequency band of 77 GHz to 81 GHz. The signal generator 21 may include a functional part such as a voltage controlled oscillator (VCO).
The signal generator 21 may be configured as hardware having the function, configured as a microcomputer or the like, or configured as a processor such as a CPU and a program executed by the processor. Each functional part described below may be configured as hardware having the function, or, if possible, configured as a microcomputer or the like or configured as a processor such as a CPU and a program executed by the processor.
In the electronic device 1 according to the embodiment, the signal generator 21 may generate a transmission signal (transmission chirp signal) such as a chirp signal. In particular, the signal generator 21 may generate a signal (linear chirp signal) whose frequency linearly changes periodically. For example, the signal generator 21 may generate a chirp signal whose frequency linearly increases periodically from 77 GHz to 81 GHz with time. For example, the signal generator 21 may generate a signal whose frequency periodically repeats a linear increase (up-chirp) and decrease (down-chirp) from 77 GHz to 81 GHz with time. The signal generated by the signal generator 21 may be, for example, set by the controller 10 beforehand. The signal generated by the signal generator 21 may be, for example, stored in the memory 40 or the like beforehand. Since chirp signals used in technical fields such as radar are already known, more detailed description is simplified or omitted as appropriate. The signal generated by the signal generator 21 is supplied to the synthesizer 22.
In
In the example illustrated in
In
Thus, the electronic device 1 according to the embodiment may transmit a transmission signal composed of subframes each of which includes a plurality of chirp signals. The electronic device 1 according to the embodiment may transmit a transmission signal composed of frames each of which includes a predetermined number of subframes.
In the following description, it is assumed that the electronic device 1 transmits a transmission signal of the frame structure illustrated in
Referring back to
The phase controller 23 controls the phase of the transmission signal supplied from the synthesizer 22. Specifically, the phase controller 23 may, for example, adjust the phase of the transmission signal by advancing or delaying the phase of the signal supplied from the synthesizer 22 as appropriate, based on control by the controller 10. In this case, based on the path difference between the transmission waves T transmitted from the plurality of transmission antennas 25, the phase controllers 23 may adjust the phases of the respective transmission signals. As a result of the phase controllers 23 adjusting the phases of the respective transmission signals as appropriate, the transmission waves T transmitted from the plurality of transmission antennas 25 intensify each other and form a beam in a predetermined direction (i.e. beamforming). In this case, the correlation between the beamforming direction and the amount of phase to be controlled in the transmission signal transmitted from each of the plurality of transmission antennas 25 may be stored in, for example, the memory 40. The transmission signal phase-controlled by the phase controller 23 is supplied to the amplifier 24.
The amplifier 24 amplifies the power of the transmission signal supplied from the phase controller 23, for example based on control by the controller 10. In the case where the sensor 5 includes a plurality of transmission antennas 25, a plurality of amplifiers 24 may each amplify the power of the transmission signal supplied from a corresponding one of the plurality of phase controllers 23, for example based on control by the controller 10. The technique of amplifying the power of the transmission signal is known, and therefore its more detailed description is omitted. The amplifier 24 is connected to the transmission antenna 25.
The transmission antenna 25 outputs (transmits) the transmission signal amplified by the amplifier 24, as the transmission waves T. In the case where the sensor 5 includes a plurality of transmission antennas 25, each of the plurality of transmission antennas 25 may output (transmit) the transmission signal amplified by a corresponding one of the plurality of amplifiers 24, as the transmission waves T. Since the transmission antenna 25 can be configured in the same way as transmission antennas used in known radar techniques, more detailed description is omitted.
Thus, the electronic device 1 according to the embodiment includes the transmission antenna 25, and can transmit the transmission signal (e.g. transmission chirp signal) from the transmission antenna 25 as the transmission waves T. At least one of the functional parts included in the electronic device 1 may be contained in one housing. The housing may have a structure that cannot be opened easily. For example, the transmission antenna 25, the reception antenna 31, and the amplifier 24 may be contained in one housing having a structure that cannot be opened easily. In the case where the sensor 5 is installed in the mobile body 100 such as a car, the transmission antenna 25 may transmit the transmission waves T to outside the mobile body 100 through a cover member such as a radar cover. In this case, the radar cover may be made of a material that allows electromagnetic waves to pass through, such as synthetic resin or rubber. For example, the radar cover may be a housing of the sensor 5. By covering the transmission antenna 25 with a member such as a radar cover, the risk that the transmission antenna 25 breaks or becomes defective due to external contact can be reduced. The radar cover and the housing are also referred to as “radome”.
In the example illustrated in
The reception antenna 31 receives reflected waves R. The reflected waves R result from reflection of the transmission waves T off the object 200. The reception antenna 31 may include a plurality of antennas such as the reception antennas 31A to 31D. Since the reception antenna 31 can be configured in the same way as reception antennas used in known radar techniques, more detailed description is omitted. The reception antenna 31 is connected to the LNA 32. A reception signal based on the reflected waves R received by the reception antenna 31 is supplied to the LNA 32.
The electronic device 1 according to the embodiment can receive the reflected waves R as a result of the transmission waves T transmitted as the transmission signal such as a chirp signal (transmission chirp signal) being reflected off the object 200, by the plurality of reception antennas 31. In the case where the transmission chirp signal is transmitted as the transmission waves T, the reception signal based on the received reflected waves R is referred to as “reception chirp signal”. That is, the electronic device 1 receives the reception signal (e.g. reception chirp signal) by the reception antenna 31 as the reflected waves R. In the case where the sensor 5 is installed in the mobile body 100 such as a car, the reception antenna 31 may receive the reflected waves R from outside the mobile body 100 through a cover member such as a radar cover. In this case, the radar cover may be made of a material that allows electromagnetic waves to pass through, such as synthetic resin or rubber. For example, the radar cover may be a housing of the sensor 5. By covering the reception antenna 31 with a member such as a radar cover, the risk that the reception antenna 31 breaks or becomes defective due to external contact can be reduced. The radar cover and the housing are also referred to as “radome”.
In the case where the reception antenna 31 is installed near the transmission antenna 25, these antennas may be included in one sensor 5 in combination. For example, one sensor 5 may include at least one transmission antenna 25 and at least one reception antenna 31. For example, one sensor 5 may include a plurality of transmission antennas 25 and a plurality of reception antennas 31. In such a case, for example, one radar sensor may be covered with one cover member such as a radar cover.
The LNA 32 amplifies the reception signal based on the reflected waves R received by the reception antenna 31, with low noise. The LNA 32 may be a low-noise amplifier, and amplifies the reception signal supplied from the reception antenna 31 with low noise. The reception signal amplified by the LNA 32 is supplied to the mixer 33.
The mixer 33 mixes (multiplies) the reception signal of RF frequency supplied from the LNA 32 and the transmission signal supplied from the synthesizer 22, to generate a beat signal. The beat signal generated by the mixer 33 is supplied to the IF unit 34.
The IF unit 34 performs frequency conversion on the beat signal supplied from the mixer 33, to lower the frequency of the beat signal to intermediate frequency (IF). The beat signal lowered in frequency by the IF unit 34 is supplied to the AD converter 35.
The AD converter 35 digitizes the analog beat signal supplied from the IF unit 34. The AD converter 35 may include any analog-to-digital converter (ADC). The beat signal digitized by the AD converter 35 is supplied to the distance FFT processor 11 in the controller 10. In the case where there are the plurality of receivers 30, the respective beat signals digitized by the plurality of AD converters 35 may be supplied to the distance FFT processor 11.
The distance FFT processor 11 estimates the distance between the mobile body 100 having the electronic device 1 mounted therein and the object 200, based on the beat signal supplied from the AD converter 35. The distance FFT processor 11 may include, for example, a processor that performs a fast Fourier transform (FFT). In this case, the distance FFT processor 11 may be composed of any circuit, chip, or the like for performing FFT processing.
The distance FFT processor 11 performs FFT processing (hereafter also referred to as “distance FFT processing”) on the beat signal digitized by the AD converter 35. For example, the distance FFT processor 11 may perform FFT processing on the complex signal supplied from the AD converter 35. The beat signal digitized by the AD converter 35 can be expressed as the temporal change of the signal intensity (power). As a result of the distance FFT processor 11 performing FFT processing on such a beat signal, the signal intensity (power) corresponding to each frequency can be expressed. In the case where the peak of the result obtained by the distance FFT processing is greater than or equal to a predetermined threshold, the distance FFT processor 11 may determine that the object 200 is present at a distance corresponding to the peak. For example, there is a known method that, upon detecting a peak value greater than or equal to a threshold from an average power or amplitude of a disturbance signal, determines that there is an object (reflecting object) reflecting transmission waves, as in constant false alarm rate (CFAR) detection.
Thus, the electronic device 1 according to the embodiment can detect the object 200 reflecting the transmission waves T, based on the transmission signal transmitted as the transmission waves T and the reception signal received as the reflected waves R.
The distance FFT processor 11 can estimate the distance from the object based on one chirp signal (e.g. c1 in
The speed FFT processor 12 estimates the relative speed of the mobile body 100 having the electronic device 1 mounted therein and the object 200, based on the beat signal subjected to distance FFT processing by the distance FFT processor 11. The speed FFT processor 12 may include, for example, a processor that performs a fast Fourier transform (FFT). In this case, the speed FFT processor 12 may be composed of any circuit, chip, or the like for performing FFT processing.
The speed FFT processor 12 performs FFT processing (hereafter also referred to as “speed FFT processing”) on the beat signal subjected to distance FFT processing by the distance FFT processor 11. For example, the speed FFT processor 12 may perform FFT processing on the complex signal supplied from the distance FFT processor 11. The speed FFT processor 12 can estimate the relative speed with respect to the object, based on a subframe of chirp signals (e.g. subframe 1 in
The arrival angle estimation unit 13 estimates the direction in which the reflected waves R reach from the object 200, based on the result of speed FFT processing by the speed FFT processor 12. The electronic device 1 can estimate the direction in which the reflected waves R reach, by receiving the reflected waves R from the plurality of reception antennas 31. For example, suppose the plurality of reception antennas 31 are arranged at predetermined intervals. The transmission waves T transmitted from the transmission antenna 25 are reflected off the object 200 to become the reflected waves R, which are received by each of the plurality of reception antennas 31 arranged at the predetermined intervals. Based on the phase of the reflected waves R received by each of the plurality of reception antennas 31 and the path difference between the reflected waves R of the plurality of reception antennas 31, the arrival angle estimation unit 13 can estimate the direction in which the reflected waves R reach the reception antennas 31. That is, the electronic device 1 can measure (estimate) the arrival angle θ illustrated in
There are various proposed techniques of estimating the direction in which the reflected waves R reach based on the result of speed FFT processing Examples of known arrival direction estimation algorithms include multiple signal classification (MUSIC) and estimation of signal parameters via rotational invariance technique (ESPRIT). Detailed description of such known techniques is simplified or omitted as appropriate. Information (angle information) of the arrival angle θ estimated by the arrival angle estimation unit 13 may be supplied to the object detector 14.
The object detector 14 detects an object present in the range in which the transmission waves T are transmitted, based on the information supplied from at least one of the distance FFT processor 11, the speed FFT processor 12, and the arrival angle estimation unit 13. For example, the object detector 14 may detect the object by performing clustering processing based on the supplied distance information, speed information, and angle information. As an algorithm used when clustering data, for example, density-based spatial clustering of applications with noise (DBSCAN) is known. In clustering processing, for example, the average power of points constituting the detected object may be calculated. The distance information, speed information, angle information, and power information of the object detected by the object detector 14 may be supplied to the detection range determination unit 15. The distance information, speed information, angle information, and power information of the object detected by the object detector 14 may be supplied to the ECU 50. In the case where the mobile body 100 is a car, the communication may be performed using a communication interface such as CAN (Controller Area Network).
The detection range determination unit 15 determines the range (hereafter also referred to as “object detection range”) of detecting an object reflecting the transmission waves T based on the transmission signal and the reception signal. The detection range determination unit 15 may determine the object detection range based on, for example, an operation by the driver of the mobile body 100 in which the electronic device 1 is mounted. For example, in the case where the driver of the mobile body 100 or the like operates a parking assistance button, the detection range determination unit 15 may determine the object detection range appropriate for parking assistance. The detection range determination unit 15 may determine the object detection range based on, for example, an instruction from the ECU 50. For example, in the case where the ECU 50 determines that the mobile body 100 is about to be reversed, the detection range determination unit 15 may determine, based on an instruction from the ECU 50, the object detection range appropriate when reversing the mobile body 100. The detection range determination unit 15 may determine the object detection range based on, for example, a change in the operating state of the steering, the accelerator, the gear, etc. in the mobile body 100. Moreover, the detection range determination unit 15 may determine the object detection range based on the result of object detection by the object detector 14.
The parameter setting unit 16 sets various parameters defining the transmission signal and the reception signal for detecting the object reflecting the transmission waves T as the reflected waves R. In detail, the parameter setting unit 16 sets various parameters for transmitting the transmission waves T by the transmission antenna 25 and various parameters for receiving the reflected waves R by the reception antenna 31.
In particular, in an embodiment, the parameter setting unit 16 may set various parameters relating to the transmission of the transmission waves T and the reception of the reflected waves R, in order to perform object detection in the foregoing object detection range. For example, the parameter setting unit 16 may define the range of receiving the reflected waves R, in order to receive the reflected waves R and detect an object in the object detection range. For example, the parameter setting unit 16 may define the range of aiming the beam of the transmission waves T, in order to transmit the transmission waves T from the plurality of transmission antennas 25 and detect an object in the object detection range. The parameter setting unit 16 may set various parameters for performing the transmission of the transmission waves T and the reception of the reflected waves R.
The parameters set by the parameter setting unit 16 may be supplied to the signal generator 21. Thus, the signal generator 21 can generate the transmission signal transmitted as the transmission waves T based on the parameters set by the parameter setting unit 16. The parameters set by the parameter setting unit 16 may be supplied to the object detector 14. Thus, the object detector 14 can perform the process of object detection in the object detection range determined based on the parameters set by the parameter setting unit 16.
The ECU 50 included in the electronic device 1 according to the embodiment controls overall operation of the mobile body 100, including control of each of the functional parts included in the mobile body 100. In the electronic device 1 according to the embodiment, the ECU 50 controls a plurality of sensors 5 as described later. Hereafter, in an embodiment, the ECU 50 is also referred to as “main controller”. The ECU 50 may include at least one processor such as a central processing unit (CPU), to provide control and processing capacity for achieving various functions. The ECU 50 may be implemented by one processor, by several processors, or by respective separate processors. Each processor may be implemented as a single integrated circuit (IC). Each processor may be implemented as a plurality of integrated circuits and/or discrete circuits communicably connected to one another. Each processor may be implemented based on any of other various known techniques. In an embodiment, the ECU 50 may be implemented, for example, by a CPU and a program executed by the CPU. The ECU 50 may include a memory necessary for the operation of the ECU 50. The ECU 50 may have at least part of the functions of the controller 10, and the controller 10 may have at least part of the functions of the ECU 50.
Although the electronic device 1 illustrated in
For example, the sensor 5 in the electronic device 1 according to the embodiment may include two transmission antennas 25A and 25A′, as illustrated in
The four reception antennas 31A, 31B. 31C, and 31D are arranged at an interval λ/2 in the horizontal direction (X-axis direction), where λ is the wavelength of the transmission waves T. By aligning the plurality of reception antennas 31 in the horizontal direction and receiving the transmission waves T by the plurality of reception antennas 31, the electronic device 1 can estimate the direction in which the reflected waves R reach. For example, in the case where the frequency band of the transmission waves T is 77 GHz to 81 GHz, the wavelength λ of the transmission waves T may be the wavelength of the transmission waves T at the center frequency 79 GHz.
The two transmission antennas 25A and 25A′ are arranged at an interval λ/2 in the vertical direction (Z-axis direction), where λ is the wavelength of the transmission waves T. By aligning the plurality of transmission antennas 25 in the vertical direction and transmitting the transmission waves T by the plurality of transmission antennas 25, the electronic device 1 can change the direction of the beam of the transmission waves T to the vertical direction.
The sensor 5 in the electronic device 1 according to the embodiment may include, for example, four transmission antennas 25A, 25A′, 25B, and 25W′, as illustrated in
The two transmission antennas 25A and 25B are arranged at an interval λ/2 in the horizontal direction (X-axis direction) where λ is the wavelength of the transmission waves T, as illustrated in
The two transmission antennas 25B and 25B′ are arranged at an interval λ/2 in the vertical direction (Z-axis direction) where λ is the wavelength of the transmission waves T, as illustrated in
In the electronic device 1 according to the embodiment, in the case of beamforming the transmission waves T transmitted from the plurality of transmission antennas 25, the transmission waves T of the plurality of transmission antennas 25 may be in phase with each other in a predetermined direction based on the path difference when transmitting the transmission waves T of the plurality of transmission antennas 25. In the electronic device 1 according to the embodiment, for example, the phase controller 23 may control the phase of the transmission waves transmitted from at least one of the plurality of transmission antennas 25 so that the transmission waves T of the plurality of transmission antennas 25 will be in phase with each other in the predetermined direction.
The amount of phase controlled so that the plurality of transmission waves T will be in phase with each other in the predetermined direction may be stored in the memory 40 in association with the predetermined direction. That is, the relationship between the beam direction and the phase amount when performing beamforming may be stored in the memory 40.
The relationship may be determined, for example, based on actual measurement in a test environment, before object detection by the electronic device 1. In the case where the relationship is not stored in the memory 40, the phase controller 23 may estimate the relationship as appropriate based on predetermined data such as past measurement data. In the case where the relationship is not stored in the memory 40, the phase controller 23 may acquire an appropriate relationship through, for example, network connection to the outside.
In the electronic device 1 according to the embodiment, at least one of the controller 10 and the phase controller 23 may perform control to beamform the transmission waves T transmitted from the plurality of transmission antennas 25. In the electronic device 1 according to the embodiment, a functional part including at least the phase controller 23 is also referred to as “transmission controller”.
Thus, in the electronic device 1 according to the embodiment, the transmission antenna 25 may include a plurality of transmission antennas. Moreover, in the electronic device 1 according to the embodiment, the reception antenna 31 may include a plurality of reception antennas. In the electronic device 1 according to the embodiment, the transmission controller (e.g. the phase controller 23) may perform control to form (beamforming) a beam of the transmission waves T transmitted from the plurality of transmission antennas 25 in the predetermined direction. In the electronic device 1 according to the embodiment, the transmission controller (e.g. the phase controller 23) may form the beam in the direction of the object detection range.
In the electronic device 1 according to the embodiment, the transmission antenna 25 may include a plurality of transmission antennas 25 arranged to include a vertical component, as mentioned above. In this case, in the electronic device 1 according to the embodiment, the phase controller 23 (transmission controller) may change the direction of the beam to the direction of the object detection range, including the vertical component.
Moreover, in the electronic device 1 according to the embodiment, the transmission antenna 25 may include a plurality of transmission antennas 25 arranged to include a horizontal component, as mentioned above. In this case, in the electronic device 1 according to the embodiment, the phase controller 23 (transmission controller) may change the direction of the beam to the direction of the object detection range, including the horizontal component.
In the electronic device 1 according to the embodiment, the transmission controller (e.g. the phase controller 23) may form the beam in a direction that covers at least part of the object detection range. In the electronic device 1 according to the embodiment, the transmission controller (e.g. the phase controller 23) may control the phase of the transmission waves transmitted from at least one of the plurality of transmission antennas 25 so that the transmission waves T of the plurality of transmission antennas 25 will be in phase with each other in the predetermined direction.
The electronic device 1 according to the embodiment can calculate a phase compensation value based on frequency information of a wide frequency band signal (e.g. FMCW signal) output from the plurality of transmitting antennas 25, and perform frequency-dependent phase compensation on each of the plurality of transmitting antennas. In this way, beamforming can be performed with high accuracy in a specific direction in all possible frequency bands of the transmission signal.
With such beamforming, the distance within which object detection is possible can be expanded in a specific direction in which object detection is required. Moreover, with such beamforming, a reflection signal from any unnecessary direction can be reduced. This improves the distance/angle detection accuracy.
The electronic device 1 according to the embodiment is capable of performing object detection range cutout and/or transmission wave beamforming, as mentioned above. With use of at least one of object detection range cutout and transmission wave beamforming, the range of distance in which an object is detectable by the transmission signal and the reception signal can be defined.
For example, the electronic device 1 according to the embodiment can perform object detection in a range r1, as illustrated in
Thus, the electronic device 1 according to the embodiment may set the range of distance in which an object is detected by the transmission signal and the reception signal, depending on the object detection range.
The state of connection between the sensor 5 and the main controller (ECU) 50 in the electronic device 1 will be described below.
In an embodiment, the plurality of sensors 5 are each connected to the ECU 50, as illustrated in
The plurality of sensors 5 illustrated in
The ECU 50 can perform various types of detection such as the detection of an object around the mobile body 100, based on information output from the plurality of sensors 5. When performing various types of detection, the ECU 50 can control each of the plurality of sensors 5. The functions and operations of the plurality of sensors 5 controlled by the ECU 50 will be described in detail later.
For example in the case where the mobile body 100 is a car, the ECU (electronic control unit) 50 can acquire the states of various functional parts, such as the steering 82 and the gear 84, in the mobile body 100. The ECU 50 is also referred to as “main controller” as appropriate, as mentioned earlier.
The steering 82 controls the steering angle of each wheel including a tire and the like for causing the mobile body 100 to run. The mobile body 100 can change the direction during running, by controlling the steering 82. The steering 82 in the mobile body 100 may be, for example, the same as a steering used to steer a typical car. In an embodiment, the steering 82 in the mobile body 100 may be operated by the driver, or operated by the ECU 50 in automatic driving.
The gear 84 may be a transmission, such as a gearbox, capable of changing the reduction ratio of the power of the mobile body 100. The mobile body 100 can change the forward movement or backward movement during running, by operation of the gear 84. The mobile body 100 can also change the running speed, by operation of the gear 84. The gear 84 in the mobile body 100 may be, for example, the same as a transmission used to shift gears in a typical car. In an embodiment, the gear 84 in the mobile body 100 may be operated by the driver, or operated by the ECU 50 in automatic driving.
Not only the steering 82 and the gear 84 but also functional parts such as a throttle and/or a brake may be connected to the ECU 50. The throttle and/or the brake in the mobile body 100 may be the same as those used for shifting gears in typical cars. In an embodiment, the throttle and/or the brake in the mobile body 100 may be operated by the driver, or operated by the ECU 50 in automatic driving.
The notification interface 90 notifies the driver of the mobile body 100 or the like of predetermined information. The notification interface 90 may be any functional part that stimulates at least one of the hearing, vision, and touch of the driver of the mobile body 100, such as sound, voice, light, text, video, and vibration. Specifically, the notification interface 90 may be, for example, a buzzer, a speaker, a light emitting part such as an LED, a display such as an LCD, or a tactile sensation providing part such as a vibrator. In an embodiment, the notification interface 90 notifies the driver of the mobile body 100 or the like of information about the result of detecting an object around the mobile body 100. For example, in an embodiment, when an object around the mobile body 100 is detected, the notification interface 90 that provides visual information may notify the driver of the mobile body that the object is detected, by light emission, display, or the like. In an embodiment, when an object around the mobile body 100 is detected, the notification interface 90 that provides auditory information may notify the driver of the mobile body that the object is detected, by sound or voice.
In the case where the mobile body 100 is driven by the driver, the ECU 50 can detect the states of various functional parts in the mobile body 100. For example, the ECU 50 can detect the steering angle at which the steering 82 of the mobile body 100 is operated. For example, the ECU 50 can detect whether the gear 84 of the mobile body 100 is operated for forward movement or backward movement, the speed at which the transmission is operated, etc. For example, the ECU 50 may detect the on/off state of the throttle and the brake and the level of the throttle and the brake in the mobile body 100.
In the case where the mobile body 100 is driven by the driver, the notification interface 90 may notify the driver of information of the result of detecting an object around the mobile body 100. In this case, the controller 10 may control the notification interface 90 to notify the driver of the information of the result of detecting an object around the mobile body 100.
In the case where the mobile body 100 is driven by automatic driving, the ECU 50 can control various functional parts in the mobile body 100. Herein, “automatic driving” may denote automatic driving of levels 1 to 5 defined by the Japanese government and the National Highway Traffic Safety Administration (NHTSA). For example, the ECU 50 may automatically control the steering 82 of the mobile body 100 depending on the detection result of each sensor 5. The ECU 50 may automatically control the gear 84 of the mobile body 100 (for example, control the gear 84 to move forward or backward) depending on the detection result of each sensor 5. The ECU 50 may automatically control the speed at which the gear 84 is operated, depending on the detection result of each sensor 5. The ECU 50 may, for example, automatically control the on/off state of the throttle and the brake and the level of the throttle and the brake in the mobile body 100, depending on the detection result of each sensor 5.
Thus, the electronic device 1 may include the ECU 50 that controls the operation of the mobile body 100. In this case, the plurality of sensors 5 may supply information of the result of detecting an object around the mobile body 100, to the ECU 50. The ECU 50 may then control the operation of the mobile body 100 based on the information supplied from at least one of the plurality of sensors 5.
Operations of the electronic device 1 according to the embodiment will be described below.
In the electronic device according to the embodiment, the main controller 50 controls the plurality of sensors 5 independently of each other. Herein, controlling each of the plurality of sensors 5 may involve, for example, changing the object detection range of the sensor 5 and/or changing the transmission wave reaching distance of the sensor 5. Moreover, controlling each of the plurality of sensors 5 may involve control of object detection range cutout by the sensor 5 and/or transmission wave beamforming by the sensor 5. The independent control of each of the plurality of sensors 5 will be described in detail below.
In the example illustrated in
In the electronic device according to the embodiment, the main controller 50 can control the plurality of sensors 5 independently of each other. Accordingly, the main controller 50 can independently control the range of distance in which an object is detected by each of the plurality of sensors 5, for example as illustrated in
In the detection form illustrated in
The main controller 50 may initially be in a state in which none of the plurality of sensors 5 has started object detection. In this case, as a result of the plurality of sensors 5 each detecting an object, the main controller 50 may start the detection as illustrated in
In the example illustrated in
In the detection form illustrated in
The main controller 50 may initially be in a state in which none of the plurality of sensors 5 has started beamforming. In this case, as a result of the plurality of sensors 5 each detecting an object, the main controller 50 may form the beams as illustrated in
Moreover, for example, the main controller 50 may initially create a state in which the beam by each of the plurality of sensors 5 is aimed in a reference direction. The reference direction of the beam may be a direction in which, in a state in which the phase is not controlled in each sensor 5, the plurality of transmission waves are in phase with each other. For example, the reference direction of the beam in the sensor 5a may be a direction Dan illustrated in
Thus, the main controller 50 in the electronic device 1 according to the embodiment may perform control so that the operation of at least one sensor (e.g. the sensor 5a) from among the plurality of sensors 5 is different from the operation of the sensors (e.g. the sensors 5b, 5c, and 5d) other than the at least one sensor from among the plurality of sensors 5.
The main controller 50 in the electronic device 1 according to the embodiment may control each of the plurality of sensors 5 to perform a predetermined operation, based on the occurrence of a predetermined event. For example, the main controller 50 in the electronic device 1 according to the embodiment may control each of the plurality of sensors 5 to perform a predetermined operation, based on the detection of an object reflecting the transmission waves T.
The operation illustrated in each of
For example, in the case where the mobile body 100 changes course to the right in the situation illustrated in
For example, in the case where the mobile body 100 changes course to the right in the situation illustrated in
For example, in the case where the mobile body 100 accelerates in the situation illustrated in
Thus, the main controller 50 in the electronic device 1 according to the embodiment may control each of the plurality of sensors 5 to perform a predetermined operation, based on the behavior of the mobile body 100 in which the electronic device 1 is mounted. In this case, the behavior of the mobile body 100 may be determined based on, for example, information supplied from the main controller, e.g. the ECU 50, mounted in the mobile body 100.
The main controller 50 in the electronic device 1 according to the embodiment can independently control each of the plurality of sensors 5. For example, the electronic device 1 may independently control the on/off state of each of the plurality of sensors 5. For example, the electronic device 1 may independently control at least one of the beam width and the reaching distance of the transmission waves transmitted from each of the plurality of sensors 5. For example, the electronic device 1 may independently control the operation mode (e.g. normal mode/BF mode) of each of the plurality of sensors 5. For example, the electronic device 1 may independently control the beamforming direction of the transmission waves transmitted from each of the plurality of sensors 5. By appropriately controlling, for example, the beam width and/or the reaching distance of the transmission waves transmitted from each of the plurality of sensors 5, the electronic device 1 according to the embodiment can perform object detection substantially all around the mobile body 10 in
In the case of independently controlling each of the plurality of sensors 5 as mentioned above, if the sensors 5 perform detection at the same timing using the same frequency, there is risk of interference in the object detection by the plurality of sensors 5. In view of this, for example, in the case of independently controlling each of the plurality of sensors 5, the main controller 50 in the electronic device 1 according to the embodiment may cause the timing of detection by each sensor 5 to be different. For example, the main controller 50 in the electronic device 1 according to the embodiment may assign the detection by each of the different sensors 5 to a different one of a plurality of frames of the transmission waves T.
For example, the electronic device 1 according to the embodiment may set (assign) the detection by different radar from among the plurality of sensors 5 in a different frame of the transmission waves T, as illustrated in
In the example illustrated in
For example, the electronic device 1 according to the embodiment may set (assign) the detection by a different sensor 5 in a different subframe of the transmission waves T, as illustrated in
For example, the electronic device 1 according to the embodiment may set (assign) the detection by a different sensor 5 in a different chirp signal included in a subframe of the transmission waves T, as illustrated in
In the above-described example, the risk of interference in the object detection by the plurality of sensors 5 is reduced by making the timing of detection by each of the plurality of sensors 5 different. The risk of interference in the object detection by the plurality of sensors 5 can also be reduced by making the frequency of the radio waves used for detection by each of the plurality of sensors 5 different. For example, object detection may be started after setting the frequency (band) of the radio waves used for detection to be different between the plurality of sensors 5. In detail, in
In the example illustrated in each of
For example, in the situation illustrated in
In the frames of the transmission waves T illustrated in
As illustrated in
Thus, for example, the main controller 50 in the electronic device 1 according to the embodiment may control the plurality of sensors 5 with different priority levels depending on the direction of travel of the mobile body 100 in which the electronic device 1 is mounted. For example, the operation of one or more sensors (e.g. the sensors 5b and 5c) corresponding to the direction of travel of the mobile body 100 from among the plurality of sensors 5 may be prioritized over the operation of one or more sensors (e.g. the sensors 5a and 5d) other than the sensors corresponding to the direction of travel of the mobile body 100 from among the plurality of sensors 5.
As described above, the electronic device 1 according to the embodiment can perform a variety of control on the plurality of sensors 5 independently of each other, triggered by any of various events. The electronic device 1 according to the embodiment can thus improve convenience in object detection by the plurality of sensors.
The operation illustrated in
After the operation illustrated in
The operation in step S1 may be not an operation performed for the first time after the start of the operation illustrated in
After the control of the plurality of sensors 5 starts in step S1, the main controller 50 determines whether a predetermined event as a trigger occurs (step S2). The predetermined event determined in step S2 may be, for example, the detection of an object, or a change in the position, distance, and/or relative speed of the detected object. The predetermined event determined in step S2 may be, for example, a change in the behavior of the mobile body 100 (e.g. turn, acceleration, deceleration, or gear change).
In the case where the event does not occur in step S2, the main controller 50 performs object detection operation from step S4 onward, while maintaining the setting of the control started in step S1.
In the case where the event occurs in step S2, the main controller 50 sets each of the plurality of sensors 5 to perform a predetermined operation, depending on the event (step S3). The predetermined operation by each of the plurality of sensors 5 may be, for example, any of various operations described with reference to
After the plurality of sensors 5 are set in step S3, the main controller 50 performs control to transmit the transmission waves T from the transmission antenna 25 (step S4). In the case of performing beamforming of the transmission waves T, in step S4, the phase controller 23 (transmission controller) may control the phase of the transmission waves T transmitted from each of the plurality of transmission antennas 25 so that the transmission waves T transmitted from the plurality of transmission antennas 25 will form a beam in a predetermined direction. The phase controller 23 (transmission controller) may also perform control to aim the beam of the transmission waves T in the direction of the object detection range so as to cover, for example, at least part of the object detection range.
After the transmission waves T are transmitted in step S4, the main controller 50 performs control to receive the reflected waves R by the reception antenna 31 (step S4).
After the reflected waves R are received in step S5, the main controller 50 detects an object present around the mobile body 100 (step S6). In step S6, the object detector 14 in the controller 10 may perform object detection in the object detection range set in step S3 (object detection range clipping). In step S6, the object detector 14 in the controller 10 may detect an object based on an estimation result of at least one of the distance FFT processor 11, the speed FFT processor 12, and the arrival angle estimation unit 13. Since the object detection in step S6 can be performed using a known millimeter wave radar technique according to any of various algorithms, more detailed description is omitted.
After the object detection is performed in step S6, the main controller 50 determines whether to end the object detection by the plurality of sensors 5 (step S7). In the case of not ending the detection in step S7, the main controller 50 may return to step S1 and repeat the operation. In the case of ending the detection in step S7, the main controller 50 may end the operation illustrated in
While some embodiments and examples of the present disclosure have been described above by way of drawings, various changes and modifications may be easily made by those of ordinary skill in the art based on the present disclosure. Such changes and modifications are therefore included in the scope of the present disclosure. For example, the functions included in the functional parts, etc. may be rearranged without logical inconsistency, and a plurality of functional parts, etc. may be combined into one functional part, etc. and a functional part, etc. may be divided into a plurality of functional parts, etc. Moreover, each of the disclosed embodiments is not limited to the strict implementation of the embodiment, and features may be combined or partially omitted as appropriate. That is, various changes and modifications may be made to the presently disclosed techniques by those of ordinary skill in the art based on the present disclosure. Such changes and modifications are therefore included in the scope of the present disclosure. For example, functional parts, means, steps, etc. in each embodiment may be added to another embodiment without logical inconsistency, or replace functional parts, means, steps, etc. in another embodiment. In each embodiment, a plurality of functional parts, means, steps, etc. may be combined into one functional part, means, step, etc., and a functional part, means, step, etc. may be divided into a plurality of each functional parts, means, steps, etc. Moreover, each of the disclosed embodiments is not limited to the strict implementation of the embodiment, and features may be combined or partially omitted as appropriate.
The foregoing embodiment is not limited to implementation as the electronic device 1. For example, the foregoing embodiment may be implemented as a control method of a device such as the electronic device 1. For example, the foregoing embodiment may be implemented as a control program of a device such as the electronic device 1.
Number | Date | Country | Kind |
---|---|---|---|
2018-193350 | Oct 2018 | JP | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2019/039539 | 10/7/2019 | WO | 00 |