The invention relates to an on-board system and corresponding method for monitoring a vehicle, in particular for damage event detection.
U.S. Pat. No. 10,604,096 B2 relates to a system for damage event detection relying on a plurality of body mounted sound sensors distributed on the vehicle surface. This approach requires a larger number of body sound sensors in continuous operation. The system can detect that a damage event occurred.
U.S. Pat. No. 9,902,571 B2 relates to a parked vehicle monitoring system, where the system is external to the vehicle. A region of interest about the vehicle is defined and a person within the region of interest is detected and tracked.
DE 10 2016 210 773 A1 relates to a method according to which sensors (e.g. microphones, acceleration sensors, inclination sensors) on board of a vehicle are relied on to detect a damage event. If a damage event is detected, an on-board camera may be activated.
Damage event detection according to prior art either relies on a system external to the vehicle, and thus is only possible where such an external system is present, or on a plurality of on-board sensors in constant operation, requiring a corresponding power supply and furthermore not able to provide information on the cause of the damage, e.g. a person damaging the vehicle, or perhaps to prevent the damage.
The object of the invention is to provide a system for a vehicle which overcomes at least some of the disadvantages of the prior art. This object is achieved by a system and method described herein.
The system, according to an embodiment of the invention, for a vehicle comprises at least one detector for radiation in the visible and/or the infrared portion of the electromagnetic spectrum. The system also includes at least one sensor, which at least one sensor includes at least one sensor for vibration and/or acceleration.
According to an embodiment of the invention a control and evaluation unit is provided which is connected to the at least one detector and at least one sensor. The control and evaluation unit is configured to receive and evaluate signals from the at least one detector, and is further configured to activate the at least one sensor if the control and evaluation unit determines from the signals received from the at least one detector that an entity is approaching the vehicle.
In this way, the system according to the invention does not require the sensors to be in constant operation.
The entity may be an object, a human being, or an animal. The control and evaluation unit, for carrying out its functions, may include one or more data processors and one or more memory units, and may be suitably programmed to carry out the functions. A corresponding computer program may be stored in the one or more memory units or be loadable into the one or more memory units. The control and evaluation unit may be configured to carry out further functions not related to the invention. The control and evaluation unit may be implemented as or in an ECU (electronic control unit).
In an embodiment of the invention the at least one detector includes at least one camera operating in the visible range and/or the infrared range of the electromagnetic spectrum. Both the visible range and the infrared range allow to detect an approaching entity. This may be done, for example, by known image-processing methods.
In an embodiment of the invention the system includes at least one camera in addition to the at least one detector, and the control and evaluation unit is further configured to activate this at least one camera, if the control and evaluation unit determines that an entity is approaching the vehicle. This at least one camera may specifically serve to record images which assist in identifying an entity which may cause damage to the vehicle. It is conceivable that in this embodiment one or more cameras are also used as detectors to determine whether an entity is approaching the vehicle. These latter cameras may for example be low resolution and/or low power consumption types in comparison to the one or more cameras activated only once an entity approaching the vehicle has been detected. Instead of or in addition to such low-resolution cameras, also detectors for infrared radiation may be used to determine whether an entity is approaching the vehicle.
In an embodiment of the invention, the at least one detector includes at least one thermoelectric or pyroelectric detector. These detectors operate in the infrared portion of the electromagnetic spectrum, i.e. they are capable of detecting radiation from the infrared portion of the electromagnetic spectrum.
In an embodiment of the invention the at least one sensor includes at least one body sound sensor and/or at least one inertial sensor. Vibrations caused by a contact or by a damage event (e.g. a scratch to the surface of the vehicle) propagate as sound within the materials of the vehicle, which sound may be detected by body sound sensors, e.g. accelerometers. An inertial sensor can sense accelerations of the vehicle or of parts thereof, caused for example by an impact leading to a displacement of the vehicle and/or a deformation of a section of the vehicle. Inertial sensors may also be employed to sense vibrations of parts of the vehicle and may therefore also be used as body sound sensors. In a further development the at least one sensor additionally includes at least one microphone. Such a microphone may be used to detect sound propagating through the air, for example from an external noise event or produced by an event causing damage to the vehicle, like scratching.
In an embodiment of the invention the at least one sensor further includes at least one capacitive sensor and/or at least one conductive sensor. These may be used to obtain further information on a contact or damage event, in particular they may serve to locate a contact on the vehicle's surface more precisely than possible with e.g. body sound sensors. The at least one sensor may also further include at least one ultrasonic sensor. This may be used to track an entity to provide further information; to this end, the ultrasonic sensor may emit ultrasonic waves and receive ultrasonic waves reflected from surrounding surfaces, including surfaces of the entity.
Each of these types, capacitive, conductive, ultrasonic, can be employed by itself in addition to the vibrational and/or acceleration sensors, or any combination of these types can be employed in addition to the vibrational and/or acceleration sensors.
In an embodiment of the invention the control and evaluation unit is further configured to classify a contact between the vehicle and the entity based on signals received from the at least one sensor. Such a classification may for example distinguish between scratches and impacts, and may further distinguish damage events according to severity, e.g. an impact of a pebble on a door of the vehicle or an impact of another vehicle, possibly travelling at high speed. One approach to such a classification of a contact between the vehicle and the entity uses envelope curves calculated from the signals of the at least one sensor and the contact is classified based on characteristics of the envelope curves.
A contact between the entity and the vehicle primarily is understood in the usual direct sense, meaning the entity at least touching the vehicle. It furthermore includes an indirect sense, the entity acting on the vehicle via an object, e.g. a person hitting the vehicle with a stick or with a projectile, like a hurled stone. As a contact is sensed by the at least one sensor, ultimately a contact within the meaning of this application is any event that to the at least one sensor appears as a contact, i.e. any event causing sensor signals that the system (e.g. the control and evaluation unit) qualifies as a contact. Therefore, for example, a heavy impact of an object may occur close to the vehicle, without the vehicle being touched by the object or by debris resulting from the impact. The impact may, however, cause strong vibrations and/or shock waves in the ground on which the vehicle is located. The system according to embodiments of the invention, via the sensors, may sense these vibrations/shock waves as a contact. This is quite reasonable, as such vibrations/shock waves may cause damage to the vehicle. The occurrence of a contact in this general sense may be stored by the system, and, as described above, in embodiments the contact may be classified.
In an embodiment of the invention the control and evaluation unit is further configured to trigger a warning signal if the control and evaluation unit determines that a contact between the entity and the vehicle is likely. The warning signal, if triggered, may be generated by devices present in the vehicle primarily for other purposes, e.g. by a horn of the vehicle, lights of the vehicle, or a combination thereof. Whether a contact between the entity and the vehicle is likely may be determined by various criteria. For example, a contact may be deemed likely if a distance between the entity and the vehicle is below a predefined threshold (such a threshold stored in the control and evaluation unit in suitable format). A direction of motion of the entity may also be taken into account. The warning signal has a chance to prevent damage to the vehicle, i.e. it may alert an unaware entity to the vehicle's presence or deter an individual intending to damage the vehicle.
In an embodiment in which the system includes at least one camera, the system is configured to store image data from the camera captured within a time-interval stretching from a predefined temporal distance before to a predefined temporal distance after a contact between the vehicle and the entity. In this way image data can be stored which show the contact, e.g. a damage event, occurring.
The cameras used in embodiments of the system may include cameras which are provided on board of the vehicle for further purposes, not related to the invention. The cameras may also include dedicated cameras, provided specifically for purposes of the invention. Likewise, sensors used in embodiments of the system may include sensors which are provided on board of the vehicle for further purposes, not related to the invention. The sensors may also include dedicated sensors, provided specifically for purposes of the invention.
A vehicle benefits from the advantages provided by the system according to the invention if the system according to the invention is implemented in the vehicle. The vehicle may in particular be configured such that the system is activated if the vehicle is in a parked state. The at least one detector for radiation in the visible and/or the infrared portion of the electromagnetic spectrum may be suitably arranged in the vehicle. For example, one such detector may be integrated in a rear-view mirror of the vehicle. If the system comprises a plurality of such detectors, these detectors may be distributed in the vehicle in such a way that the fields of view of the detectors add up to a total field of view which is 360 degrees about the vehicle in a plane parallel or essentially parallel to a surface on which the vehicle is located. The total field of view also covers an angle orthogonal to this plane, for example 30 degrees or 45 degrees above and below this plane.
The method according to the invention may for example be implemented using a system for a vehicle as described above, the system provided on board of the vehicle. The steps of the method may in particular be performed by or under control of a control and evaluation unit carrying out program instructions stored e.g. in the control and evaluation unit.
The method according to the invention for monitoring a vehicle includes the steps described subsequently.
At least one detector for radiation in the visible and/or the infrared portion of the electromagnetic spectrum is operated. The at least one detector therein is provided on board of the vehicle; the at least one detector has a field of view covering a portion of an environment of the vehicle. Signals from the at least one detector are evaluated to determine if an entity is approaching the vehicle. This evaluation may be carried out by a control and evaluation unit which receives the signals from the at least one detector and is provided on board of the vehicle. If from this evaluation it is determined that an entity is approaching the vehicle, at least one sensor for vibration and/or acceleration on board of the vehicle is activated.
In this way, the method according to the invention does not require to keep the sensors in constant operation.
In an embodiment the method includes the subsequently described further steps.
Image data are captured with at least one camera on board of the vehicle if the method has determined that an entity is approaching the vehicle. The image data represent one or more images of a part of an environment of the vehicle. The image data are first temporarily retained, and if a contact between the vehicle and the entity has occurred, image data pertaining to a time-interval stretching from a predefined temporal distance before to a predefined temporal distance after the contact between the vehicle and the entity are stored, for example for later read-out. Image data outside this time-interval may be deleted. In this way, the contact itself is captured by the camera and recorded, i.e. the image data pertaining to the contact are stored. These image data may assist, for example, in identifying an entity having caused the contact, which may be of interest in particular if the contact resulted in damage to the vehicle. Whether a contact between the entity and the vehicle has occurred may be determined based on signals from the sensors.
In an embodiment, a warning signal is triggered if it is determined that a contact between the entity and the vehicle is likely. Whether a contact is likely may be determined as described above in the context of the system. The warning signal may alert unaware entities to the vehicle's presence or may deter an individual intent on causing damage to the vehicle.
The above embodiments may also be used in combination, i.e. a warning signal may be triggered, as described above, and image data may be stored, as described above, if a contact between the entity and the vehicle occurs despite the warning signal.
Signals from the at least one sensor may also be stored for later additional analysis.
Below, the invention and its advantages will be described with reference to the accompanying figures.
The figures are schematic illustrations related to embodiments of the invention. The figures therefore are not intended to be construed as limitations of the invention to these specific embodiments.
The method according to the invention, and thus in particular the embodiment described here, may be carried out by a system according to the invention, in particular under control by a control and evaluation unit carrying out suitable program instructions. One possibility to determine if a contact between the entity and the vehicle is likely may rely on a distance between the entity and the vehicle. For example, by definition, a contact between the entity and the vehicle may be deemed likely if a distance between the entity and the vehicle is below a predefined threshold.
At time 620 the detector outputs signals which lead to the determination that an entity is approaching the vehicle. For a subsequent time-interval 621 no further action is taken, to avoid spurious false alarms. If the detector signal 612 still indicates an approaching entity after time-interval 621, at time 622 sensors (e.g. sensors 4 in
While the above description constitutes the preferred embodiment of the present invention, it will be appreciated that the invention is susceptible to modification, variation and change without departing from the proper scope and fair meaning of the accompanying claims.
Number | Date | Country | Kind |
---|---|---|---|
21178413.7 | Jun 2021 | EP | regional |
This application is a 35 U.S.C. § 371 national phase of PCT International Application No. PCT/EP2022/065349, filed Jun. 7, 2022, which claims the benefit of priority under 35 U.S.C. § 119 to European Patent Application No. 21178413.7, filed Jun. 9, 2021, the contents of which are incorporated herein by reference in its entirety.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2022/065349 | 6/7/2022 | WO |