The present invention relates to a system for use in a vehicle that profiles the terrain ahead of the vehicle and, in particular, enables the detection of obstacles such as debris, dips, troughs, potholes or sleeping policemen in the path ahead of the vehicle. Aspects of the invention relate to a system, to a method, and to a vehicle itself.
Many modern vehicles are fitted with systems (anti-lock braking, adjustable ride height etc.) designed to improve the riding experience of the users. The riding experience could be a measure of safety, comfort, or something else, and the setup of the systems of a vehicle to optimise the riding experience is dependent on the type of terrain over which the vehicle travels. Current systems with defined system settings for a plurality of different terrain types use sensors to determine characteristics about the terrain over which a vehicle is travelling and then select the most appropriate setting.
It is also desirable on the vehicle to be able to predict in advance not only the type of terrain that the vehicle is travelling over, or approaching, but whether there are obstructions in the likely path of the vehicle which, if they are encountered, may cause damage to the vehicle or undue discomfort to the users. Debris such as general rubbish or detached car parts can be commonplace on highways and other roadways. Potholes are another type of common obstruction. If a vehicle encounters debris or potholes that are not anticipated, damage can be done to the vehicle, as well as to the vehicle contents, and the users may experience an uncomfortable jolt as the vehicle impacts the obstruction.
There are a variety of current techniques for determining the profile of the terrain ahead of a vehicle and for detecting an obstruction in the likely path of the vehicle: infrared sensors detect infrared radiation being emitted from the surface ahead of the vehicle and optical sensors scan the surface ahead for characteristics relating to certain terrain types and for obstructions in the vehicle's path. However, both suffer from the disadvantage of being short-range and being unreliable in certain weather conditions.
One aim of the invention is to provide a system and method for use on a vehicle in determining the presence and location of an obstruction such as a pothole in the path ahead of the vehicle, whilst addressing the disadvantages of the systems in the prior art.
According to an aspect of the invention there is provided a system for use in a vehicle for profiling the terrain ahead of the vehicle, the system comprising receiving means configured to receive sensor output data from a plurality of vehicle-mounted sensors, including at least one radar sensor and at least one acoustic sensor, each for receiving a reflected signal from the terrain ahead of the vehicle. The system also includes determining means configured to determine at least one parameter from the sensor output data for the at least one radar sensor and the at least one acoustic sensor. The system further includes image generation means configured to generate an image of the terrain ahead of the vehicle based on the at least one parameter from the at least one radar sensor, and processing means configured to enhance the clarity of the image based on the at least one parameter from the at least one acoustic sensor.
In the context of the present invention, “vehicle-mounted” may refer to a portable device which is carried on the vehicle temporarily or may refer to a permanent fixture of the vehicle, for example one which is present on the vehicle for other purpose also. The combination of sensor output data from both a radar sensor and an acoustic sensor can result in a more accurate profiling of the terrain ahead of the vehicle. In particular, a radar sensor may be used to generate an image of the terrain at long range and the acoustic sensor may be used to enhance the clarity of this image at short range.
In one embodiment, the receiving means comprises means configured to receive frequency-domain sensor output data from the at least one radar sensor.
In addition, the determining means may include conversion means configured to convert the frequency-domain sensor output data into time-dependent, and/or spatially-varying, power magnitude sensor output data. For example, the conversion means may include an inverse Fourier Transform algorithm.
The image generation means may be configured to generate the image based on the determined power magnitude.
The system may comprise first compensation means configured to compensate the image to account for power magnitude loss in the sensor output data, and/or second compensation means configured to compensate the image to remove background noise in the sensor output data from the at least one radar sensor.
For example, the system may further comprise means for comparing the determined power magnitude with a minimum threshold value for the power magnitude and for removing from the image sensor output data having a determined power magnitude that is below the minimum threshold value (i.e. thereby removing data that is background noise).
Image processing of the type mentioned above can help to increase the accuracy and the clarity of the image of the terrain, and increase the possibility of extracting particular features such as obstacles or potholes in the image of the terrain.
In one embodiment, the system comprises means configured to communicate the image to the user. This may be in the form of a human machine interface including, for example, a visual display and/or an audio system. This allows the user to take the appropriate action on the basis of the information contained in the image (for example, by altering the speed of the vehicle).
The system may comprise processing means configured to detect the presence of an obstruction in the image, and may further comprise processing means for detecting the location of the obstruction with respect to the vehicle. The system may comprise means configured to alert the user to the presence of, and/or the location of, the obstruction ahead of the vehicle, and this may comprise at least one of visual and audio means. This will allow the user to prepare the vehicle in the most appropriate way to best negotiate the obstruction (for example, to take avoidance action).
The system may further comprise means for transmitting radar and/or acoustic signals at a plurality of different angles with respect to the direction in which the vehicle is travelling. In this way, sensor output data corresponding to a wide range of the terrain in both the lateral and longitudinal directions with respect to the direction in which the vehicle is travelling is included in the generated image so as to provide a more complete image of the terrain ahead of the vehicle.
In one embodiment, the system comprises at least one radar sensor and at least one acoustic sensor. The system may further comprise means configured to move angularly the at least one radar sensor and/or the at least one acoustic sensor about its axis with respect to the direction in which the vehicle is travelling so as to permit sensor data corresponding to a wide range of the terrain, in both the lateral and longitudinal directions with respect to the direction in which the vehicle is travelling, to be included in the generated image.
According to another aspect of the invention, there is provided a method for implementing the system capabilities described above to enable the system to profile the terrain ahead of the vehicle.
According to another aspect of the invention, there is provided a vehicle comprising a vehicle control system as described above, at least one radar sensor, and at least one acoustic sensor.
Other features of the invention will be apparent from the appended claims.
Within the scope of this application it is expressly envisaged that the various aspects, embodiments, examples and alternatives set out in the preceding paragraphs, in the claims and/or in the following description and drawings, and in particular the individual features thereof, may be taken independently or in any combination. For example, features disclosed in connection with one embodiment are applicable to all embodiments, except where such features are incompatible.
The invention will now be described, by way of example only, with reference to the accompanying figures in which:
In one embodiment of the present invention, the power magnitude of sensor output data from backscattered signals relating to the terrain ahead of a vehicle, that are transmitted from a plurality of different types of sensor, is used to generate an image of the terrain ahead of the vehicle and, in particular, to detect and locate obstructions in the vehicle's path.
Typically, parking assistance systems are used to warn a vehicle user, either by visual or audible means, of the vehicle's proximity to an obstacle such as a wall or another vehicle. In the case of an audible warning, a warning tone may sound with increasing frequency as the obstacle becomes closer to the vehicle. The acoustic sensors used for parking assistance systems are typically able to detect obstacles at short-range (0.25-1.5 metres) but at a wide angle from the direction in which the sensor is pointed. The parking assistance system may transmit acoustic pulses 18 (typically 51 Hertz) and then receive back any reflected signal 20 from an obstacle, which may then be processed to calculate the distance between the vehicle and the obstacle.
Also in current systems, there may be a radar sensor 22 positioned at the front of the vehicle: commonly, radar sensors are used to send and receive radar signals to collect and receive data to be input to, for example, adaptive cruise control (ACC) systems. In an ACC system, the time between a radar signal being sent and then received back is measured, and then the distance to a vehicle in front is calculated. This information is sent to other systems of the vehicle (throttle control, brake control etc.) and the necessary action is taken to maintain a constant distance to the vehicle in front. The radar sensors in an ACC system are typically able to detect an obstacle up to about 150 metres in front of the vehicle but at a narrow angle from the direction in which the sensor is pointed; other ACC systems may use shorter range, wider angle radars, or a combination of both.
Radar sensors may be positioned at other locations on the vehicle to collect data to be input to, for example, blind spot detection (BSD) systems, lane departure warning systems, or speed-gun detector systems.
Referring to
In some vehicles a separate VCS is configured to improve the riding experience of the vehicle user: for example, a vehicle system in the form of a vehicle terrain response system 38 (VTRS, such as a Terrain Response® system) receives sensor output data from one or more sensors (such as a wheel speed sensor, tyre pressure sensor, vehicle speed sensor, brake pedal position sensor, suspension articulation, acceleration, wheel slip, pitch rate, and yaw rate) relating to the terrain in the vicinity of the vehicle, processes the data, and sends control signals via a controller to one or more subsystems 42 (such as a suspension system, traction-control system, stability-control system, engine torque system, or ride height system) so as to allow adjustment of the setup of the vehicle 10 accordingly. Adjustment of the vehicle setup may be automatic in response to the sensor signals, or may be user-initiated following prompts from the VTRS 38.
In a vehicle incorporating a VTRS 38, in response to a user-input via the HMI 36, a control signal is sent via the controller 34 of the VCS 30 to one or more vehicle subsystems 42 to adjust the vehicle setup, according to the terrain type in the vicinity of the vehicle 10.
The VCS 30 may also send alerts to the vehicle user, via the HMI 36, to adjust his/her driving style (for example, to reduce the vehicle speed), according to the terrain type in the vicinity of the vehicle 10.
In addition to the VTRS 38 adjusting the vehicle setup, and/or the HMI 36 alerting the user, according to the terrain type in the vicinity of the vehicle 10, it is desirable that obstructions (such as potholes or sleeping policemen) in the path ahead of the vehicle 10 are detected and located so that the VTRS 38 can adjust the vehicle setup, and/or the HMI 36 can alert the user, accordingly.
In one embodiment, one or more radar sensors from an ACC system are adjusted to transmit and receive radar signals to be used to detect and locate obstructions in the path ahead of the vehicle 10. Radar signals are typically transmitted and received at a plurality of discrete frequencies; however, for example, in the automotive industry the licensed band for short-range radars is restricted to 21.65-26.65 GHz and 76-81 GHz.
The radar sensor 22 is positioned on an angularly adjustable support such as a turntable 60 that rotates about its axis to allow radar signals to be transmitted at various azimuthal angles with respect to the direction in which the vehicle 10 is travelling. In particular,
In addition to the one or more radar sensors 22 from an ACC system, one or more acoustic sensors 12, 16 from the parking assistance system could be used to collect data relating to the terrain 24 ahead of the vehicle 10. The acoustic sensors 12, 16 are mounted on the vehicle 10 in a similar manner as for the radar sensors 22, namely on an angularly adjustable support such as a turntable 60.
An acoustic sensor 12, 16 may be used to characterise, for example, the roughness, texture, or sound absorption of a given type of terrain. Referring to
The collected data from the radar sensors 22 is used to generate an image of the terrain 24 ahead of the vehicle 10, including any obstructions in the vehicle's path. The collected data from the acoustic sensors 12, 16 is then used to enhance the clarity of the determined size and location of any obstructions that have been detected using the radar sensors 22. The detection of obstructions in the vehicle's path is therefore a two-stage process involving two different types of sensor, the radar sensors 22 and the acoustic sensors 12, 16. Once an obstruction has been detected and located with respect to the vehicle, the driver is alerted to the obstruction via the HMI 36, as shown in
The image 104 is then processed at steps 108, 110 and 112 to enhance the clarity of the detected obstructions in the image 104. In particular, a degree of noise is to be expected in any received signal and so at step 108, this noise is removed from the background of the image 104, for example using an average background image, a fixed or adaptive noise threshold, or a constant false alarm rate threshold, and this gives the updated image 114 shown in
The greater the distance that a backscattered signal 56 travels to the receiving antenna 58, the greater the amount of power that will be transferred to the surroundings before the signal is received, thus resulting in a lower signal magnitude. This means that smaller obstructions that are relatively close to the receiving antenna 58 may have the same level of power magnitude as larger obstructions that are relatively far from the receiving antenna 58. For example, despite the fact that square holes 100, 102 in
For the purposes of the present invention, relatively small obstructions that have no bearing on the comfort or safety of the vehicle users are not required to be detected because the user does not need to be informed of such obstructions, and the setup of the vehicle 10 does not require to be altered via the VTRS 38 because of such obstructions. Therefore, at step 112, any backscattered signals 56 below a minimum threshold value (corresponding to obstructions with dimensions below a minimum threshold) are removed from the image 116 to produce the image 118 shown in
Despite the use of image processing as described above, the resolution of a received radar signal is limited by its transmitted bandwidth; however, an image of the terrain 24 over a relatively long range (up to 150 metres, as mentioned above) may be generated with reasonable accuracy by using the radar signal. In one embodiment, acoustic sensor output data 120 from one or more acoustic sensors 12, 16 may be used to enhance the accuracy of the generated size and location of the obstructions in the path ahead of the vehicle 10. Acoustic sensors provide better resolution than radar sensors but are, in general, limited to use over a shorter range. At step 122, the detected obstructions in image 118 shown in
The controller 34 then communicates with the HMI 36 and the image of the terrain 24 ahead of the vehicle 10 with the detected obstructions may be shown to the user by visual means and/or the user may be warned to adjust his/her driving (for example, by reducing the speed of the vehicle or by taking avoidance action) to negotiate the obstruction. In addition, or alternatively, the controller 34 may communicate with the VTRS 38 to adjust the setup of the vehicle so as to best negotiate the obstruction (for example, to adjust the suspension if the vehicle is approaching a pothole).
In one embodiment, the present invention has the advantage of simply requiring existing systems on a vehicle to be modified (for example, parking assistance and ACC systems), and so the present invention doesn't incur additional cost to the user and does not require extra equipment that may add extra weight or take up more space in a vehicle.
It is to be understood that the controller or controllers described herein can comprise a control unit or computational device having one or more electronic processors. The system may comprise a single control unit or electronic controller or alternatively different functions of the controller may be embodied in, or hosted in, different control units or controllers. As used herein the term “control unit” will be understood to include both a single control unit or controller and a plurality of control units or controllers collectively operating to provide the stated control functionality. A set of instructions could be provided which, when executed, cause said computational device to implement the control techniques described herein. The set of instructions could be embedded in said one or more electronic processors. Alternatively, the set of instructions could be provided as software to be executed on said computational device. The controller may be implemented in software run on one or more processors. One or more other controllers may be implemented in software run on one or more processors, optionally the same one or more processors as the first controller. Furthermore, the term processor as used herein may refer to a single processor or a plurality of processors configured to communicate with one another to perform one or more control or processing functions.
It will be appreciated by a person skilled in the art that the invention could be modified to take many alternative forms without departing from the scope of the appended claims.
Further aspects of the present invention are set out in the following numbered Clauses:
Number | Date | Country | Kind |
---|---|---|---|
1402397.2 | Feb 2014 | GB | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2015/052289 | 2/4/2015 | WO | 00 |