Patent Grant
11709242
This application claims priority to German Patent Application No. DE 10 2019 203 688.0, filed on Mar. 19, 2019, the disclosure of which is hereby incorporated in its entirety by reference herein.
The present disclosure relates to a system and method to detect occupancy of a vehicle.
In the interior, passenger transport vehicles, such as automobiles, typically have front seats for the driver and a passenger and rear seats for transporting further people.
Modern vehicles usually have a ventilation and air-conditioning system so as to air-condition the interior to a temperature which is comfortable for the occupants. However, the operation of the ventilation and air-conditioning system is typically coupled to an operating state of the drive motor of the vehicle. If the drive motor is in an off state, the ventilation and air-conditioning system is generally also switched off automatically. As a result, the vehicle is exposed to the thermal influences of the environment, typically leading to a change in the temperature in the interior of the vehicle. In particular, during high external temperatures, and in particular during insolation, rapid heating of the interior of the vehicle takes place. Typically, the interior of the vehicle forms a type of greenhouse, in such a way that during insolation temperatures of over 50 degrees Celsius are reached there even at a comparatively low external temperature. If animals or people, in particular children, are enclosed in the interior at these temperatures, this can lead to serious harm to health.
One or more objects of the present disclosure may be to provide a reliable and efficient method for detecting a living being on a seat of a vehicle.
According to one embodiment, a method for detecting a living being, in particular a person or a mammal, on a seat of a vehicle, is provided. The method may include in particular emitting electromagnetic waves or electromagnetic radiation of at least one predetermined frequency or at least one predetermined frequency band towards the seat by means of an electromagnetic radiator and receiving electromagnetic waves of radiation reflected on a surface by means of a sensor. By means of the radiator, electromagnetic waves, for example microwaves or radio waves, acoustic waves such as ultrasonic waves, or waves in the form of light, such as infrared radiation, are thus directed towards a seat or a region in which the seat is arranged. The electromagnetic waves reflected by the seat or by an object located on the seat, or generally the electromagnetic waves reflected by a surface in the seat region, are detected by the sensor, the sensor generating a sensor signal on the basis of the reflected electromagnetic waves or radiation, for example using an electric circuit. From the reflected waves, in particular a change in the frequency of the reflected waves by comparison with the electromagnetic waves emitted by the radiator or transmitter and/or a transit time of the waves from the transmitter to the surface and back to the sensor or receiver can be detected.
In one or more embodiments, an object on the seat is detected from the sensor signals or from a transit time of the emitted and the reflected electromagnetic waves between the radiator, the surface and the sensor by means of a detection device. For example, from the transit time, a distance between the sensor and a surface which reflects the waves emitted by the radiator can be determined, and the determined distance can be compared with a reference distance, the presence of an object being detected if the determined distance is less than the reference distance. In practice, the actual transit time may also be compared with a reference transit time, the presence of an object being detected if the actual transit time is less than a reference transit time. It is thus initially determined by a distance measurement whether any object other than the seat, such as an item, an animal or a person, is located in the seat region. If the presence of an object has been detected, movements of the object are detected by the detection device from the reflected electromagnetic or from the sensor signals, and it is determined from the detected movements of the object whether the detected object is a living being. The processing device thus only analyses the reflected electromagnetic waves or the sensor signals representing them for the presence of movements if it is been determined that an object is present on the seat. If it has been determined that the detected object is a living being, a detection signal is outputted by the detection device, for example in the form of an electric voltage above a predetermined threshold.
According to another embodiment, a detection arrangement for or in a vehicle. The detection arrangement may include at least one seat for a person, an electromagnetic radiator which is set up and arranged for emitting electromagnetic waves of at least one frequency or at least one frequency band towards the seat, a sensor which is arranged and set up to receive electromagnetic waves reflected by a surface, and a detection device connected to the sensor and the radiator and formed to carry out the steps of a method according to the present invention. As a result, the detection device is set up to detect an object on the seat from a transit time of the emitted and the reflected electromagnetic waves between the radiator, the surface and the sensor, to detect movements of the object from the reflected electromagnetic waves if an object has been detected, and to determine from the detected movements of the object whether the detected object is a living being. Further, the detection device is set up to output or generate a detection signal if it has been determined that the detected object is a living being.
According to yet another embodiment a vehicle, such as a motor vehicle, such as a car or a van, may be provided. The vehicle may include a detection arrangement according to the second aspect of the invention.
The method of detection may include cascaded detection in that the sensor data representing the reflected waves are initially only evaluated as to whether an object is actually present in the seat region, and only if this is the case is a further analysis performed as to whether the object is moving. In this case, the object can be classified as a living being. The classification may for example be provided by the detection device as an electrical signal, which can be used for example to trigger different warning functions of the vehicle. If no movements are detected, the object can be classified as a loading item, and this can also be provided as a signal by the detection device.
This cascaded process may improve the efficiency of the detection method, since the mere presence of an object can be determined comparatively rapidly and simply by a distance determination between the sensor and the surface from which the waves are reflected is evaluated by way of a determination of the transit time of the waves. This distance measurement may provide a comparatively high reliability level, since the size of relevant objects, such as people, such as babies and toddlers, is in a range which results in a sufficiently large change in distance from the reference distance, for example the distance between the seat surface and the sensor device, and is thus easily detectable, if the sensor device is arranged for example in the vehicle ceiling.
Advantageous configurations and developments can be derived from the further, dependent claims and from the description with reference to the drawings.
One embodiment of the method provides that a size of the object is determined from the reflected electromagnetic waves. Since the radiator irradiates the seat or seat region in a planar manner, a spatial extent of an object can be determined from the reflected waves received by the sensor or the corresponding sensor signals. By way of example, an area occupied by the object and located within a region irradiated by the waves emitted by the radiator can be determined from the reflected waves, and the size of the object can be determined from a comparison of the occupied area with a reference area.
As an example, movements of the object are only detected if the determined size of the object is less than a reference value for the size. Thus, a further checking step takes place before movements are detected, the size of the detected object as determined from the received reflected waves being compared with a reference size, and movements only being detected for “small objects”, in other words objects of which the determined size is less than the reference size. This advantageously contributes to the possibility of determining more rapidly and simply whether an object requires further checking. For example, for adult people, who can generally make themselves noticeable or escape from the vehicle by themselves, detection of movements can be omitted and computational power can thus be saved.
As another example, the received reflected electromagnetic waves or the generated sensor signals can be filtered on the basis of the determined size of the object, and movements of the object can be detected from the filtered reflected electromagnetic waves. In particular, if it is determined that the detected object is of a size within a predetermined size range, received reflected electromagnetic waves of predetermined frequencies can be filtered out using analogue or digital signal filters. In this case, only the filtered waves or signals are analysed to detect movements. This may take into account of the fact that people perform different typical movements depending on size, resulting in typical frequencies of the reflected waves. As a result, the movement detection can be carried out particularly efficiently if only the typically occurring frequencies are initially analysed.
In another embodiment, the detection of movements of the object may include determining a relative speed between the sensor and the surface which reflects the electromagnetic waves emitted by the radiator. For example, it may be provided that a movement is detected if the relative speed is greater than a predetermined threshold. The relative speed may for example be determined from a change over time in the distance between the sensor and the irradiated surface or from a change in the transit time. A frequency shift or change between the emitted and reflected electromagnetic waves may also be detected. The relative speed can also be determined by other signal processing methods.
As an example, the determination as to whether the detected object is a living being may include analysing the reflected electromagnetic waves or the corresponding sensor signals in the time domain for the presence of predetermined patterns.
In one or more embodiment, during this analysis, the reflected electromagnetic waves are checked for the presence of one or more of the following reference patterns:
a) reference patterns representing breathing movements of people in predetermined age ranges; b) reference patterns representing breathing movements of pets. The age ranges mentioned in a) may for example be between 0 years and 1 year, between 1 year and 2 years, between 2 years and 3 years, between 3 years and 5 years, between 5 years and 10 years, and older than 10 years. Naturally, other age ranges are also conceivable.
By way of the comparison with reference patterns, a detected movement pattern can be assigned to a reference pattern, and a type or state of the movement can thus be determined. For example, the breathing frequency is approximately 40-45 breaths/min for newborns, approximately 35-40 breaths/min for infants, approximately 20-30 breaths/min for toddlers, approximately 16-25 breaths/min for children and approximately 12-18 breaths/min for adults. Particularly advantageously, the received reflected waves may be filtered for example by way of the determined size of the object, as described above, and a comparison only made with reference patterns which match the determined size of the object. This further improves the reliability and efficiency of the method. To determine whether a detected movement progression, represented by the reflected waves received in temporal succession, corresponds to or is sufficiently similar to a reference pattern, mathematical pattern recognition methods may be used, by means of which for example regularities in the signal progression can be detected.
In a further embodiment, the frequency of the electromagnetic waves emitted by the radiator is modulated. In particular, the frequency can be modulated in such a way that it rises linearly, optionally in discrete steps, and at a particular value abruptly falls back to the initial value again (sawtooth pattern), or in such a way that it alternately rises and falls with a constant rate of change. For example, the frequency may be modulated in a range between 77 GHz and 81 GHz. As a result of the modulation of the electromagnetic waves during steady emission of the waves, advantageously both the differential speed between the sensor and the irradiated surface and their absolute distance from one another can be determined simultaneously.
In one or more embodiments, the radiator may include a radar transmitter configured to emit radio waves or microwaves, and the sensor is set up to receive radio waves or microwaves.
In a further embodiment, the radiator has an ultrasonic transmitter for emitting electromagnetic waves in the ultrasonic range, and the sensor is set up to receive ultrasonic waves.
In a further embodiment, the radiator may have a lighting unit for emitting light that may be within the infrared range, and the sensor may have a photonic mixer detector as a receiver. A sensor device that may include a radiator and the sensor may be implemented as a ToF camera, where “ToF” stands for “time-of-flight”.
The radiator and sensor may each be combined to form a joint sensor device, that may be attached inside the interior of the vehicle. The radiator and sensor may be oriented to face the seat or seating region. For example, the sensor device may be attached in the vehicle ceiling, on the dashboard, on a seat other than the seat to be irradiated, or on another interior design item of the vehicle.
One or more methods described herein may be used in a vehicle.
The above configurations and developments may be combined with one another as desired, within reason. Further possible configurations, developments and implementations of the invention comprise combinations, including those not explicitly mentioned, of features of the invention which are described above or in the following in relation to the embodiments. In particular, a person skilled in the art will also add individual aspects, as improvements or supplements, to each basic form of the present invention.
In the following, the present invention is described in greater detail with reference to the embodiments specified in the schematic drawings, in which:
The accompanying drawings are intended to impart further understanding of the embodiments of the invention. They illustrate embodiments and serve, in connection with the description, to explain principles and concepts of the invention. Other embodiments and many of the stated advantages can be derived from the drawings. The elements of the drawings are not necessarily shown to scale with one another.
In the drawings, like, functionally equivalent and equivalently operating elements features and components are provided with like reference numerals in each case unless otherwise specified.
As required, detailed embodiments of the present invention are disclosed herein; however, it is to be understood that the disclosed embodiments are merely exemplary of the invention that may be embodied in various and alternative forms. The figures are not necessarily to scale; some features may be exaggerated or minimized to show details of particular components. Therefore, specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a representative basis for teaching one skilled in the art to variously employ the present invention.
US 2018/0170213 A1 describes detection of people in the vehicle using radar sensors, detection of a presence of an object and classification of the object as a living person taking place on the basis of a movement measurement in that a radar signal of the radar sensor is analysed in the time domain.
As is schematically shown in
The radiator 31 is set up to emit electromagnetic waves of at least one frequency or at least one frequency band, and serves to emit electromagnetic waves E towards the at least one seat 2. For example, the radiator 31 may be formed as a radar transmitter for emitting radio waves or microwaves, as an ultrasonic transmitter for emitting waves in the ultrasonic range, or as an optical transmitter or lighting unit for emitting light waves, in particular in the infrared range. The radiator 31 may in particular itself be set up to generate electromagnetic waves.
The sensor 32 is set up to receive reflected electromagnetic waves R which have been emitted by the radiator 31 and reflected on a surface 11. Corresponding to the radiator 31, the sensor 32 may be implemented as a radar receiver, as an ultrasonic receiver or as an optical receiver, as a photonic mixer detector. In the last of these cases, the sensor device 3 may be implemented using a ToF camera, where “ToF” stands for “time-of-flight”. As is schematically shown in
By means of the evaluation unit 33 of the sensor 31, a sensor signal S3 is generated from the received waves R. The sensor signal S3 may for example represent a transit time or transit length which the waves E, R require for the path from the radiator 31 to the surface 11 and back to the receiver 32 and/or a frequency of the reflected waves R and optionally of the emitted waves E. Thus, a distance d1 between the surface 11 and the sensor device 3 or sensor 32, and optionally a differential speed, a change in the distance d1, can be determined from the sensor signal S3. The evaluation unit 33 is connected to the sensor 32 and optionally also to the radiator 31.
The detection device 4 is set up to process the sensor signals S3, and connected for this purpose to the sensor device 3 or to the radiator 31 and sensor 32, for example via the evaluation unit 33 by means of a wired or wireless communications interface (not shown). As is schematically shown in
The detection device 4 may be configured to carry out a method which is explained in the following by way of example with reference to
In a first step of the method, electromagnetic waves E are emitted towards the seat 2, electromagnetic waves E of at least one frequency or at least one frequency band being emitted by means of the radiator 31. Optionally, the frequency of the emitted waves E is modulated, for example in a range between 77 GHz and 81 GHz. As was explained previously, the waves R reflected by the surface 11 are received by means of sensors 32, and the evaluation unit 33 generates corresponding sensor signals S3 which are conveyed to the detection device 4.
In a further step, the detection device 4 detects from the sensor signals S3 whether an object X is present on the seat 2. This is shown by way of example in
If the presence of an object X has been detected, the detection device 4 detects movements A1, A2, A3 of the object X from the sensor signals S3. This may for example comprise determining a relative speed between the sensor 32 and the surface 11 of the object X which reflects the waves E emitted by the radiator 31. For this purpose, the detection device 4 may apply conventional signal processing algorithms to the sensor signals S3. For example, a frequency shift between the emitted waves E and the reflected waves R can be detected by the detection device 4 to determine the relative speed.
As is shown by way of example in
The detection of movements A1, A2, A3 of the object X now only takes place under the condition that the presence of an object X has been established during the distance determination. This has the advantage that simple, rapid detection of an object can take place using comparatively simple means, and complex detection of movements is only carried out when it is required. This improves the reliability and efficiency of the method.
Optionally, the detection of movements A1, A2, A3 of the object X may be linked to the further condition that the determined size of the object X is less than a reference value for the size. As can be seen from a comparison of
Optionally, the reflected electromagnetic waves or the sensor signals S3 may moreover be filtered on the basis of the determined size of the object X. The filtering may for example take place using band-pass filters or the like, it being possible for the corresponding filters to be implemented either in analogue in the evaluation unit 33 or in digital as software stored in the data memory 41. For example, it may be determined in tests which movements are typical of people or children of a particular age and thus of approximately a particular external constitution and size, and which sensor signals S3 result from this. From the determined size, it can thus be predetermined by the detection device 4 which information contained in the sensor signals S3, for example in the form of frequencies of the relative speed between the object X and the sensor device 3, should be filtered. The movements A1, A2, A3 of the object X are subsequently detected from the filtered reflected waves R or sensor signals S3 by means of the detection device 4.
To determine whether the detected object X is a living being B, the detection device 4 may analyse the reflected electromagnetic waves R or the sensor signals S3 in the time domain for the presence of particular patterns. This is shown schematically by way of example in
If the detection device 4 has determined that the detected object is a living being L, a detection signal S4 is outputted by the detection device 4, as is shown symbolically in
Although the present invention has been fully described by way of preferred embodiments in the above, it is not limited thereto, but rather can be modified in a variety of ways.
The following is a list of reference numbers shown in the Figures. However, it should be understood that the use of these terms is for illustrative purposes only with respect to one embodiment. And, use of reference numbers correlating a certain term that is both illustrated in the Figures and present in the claims is not intended to limit the claims to only cover the illustrated embodiment.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10 2019 203 688.0 | Mar 2019 | DE | national |
| Number | Name | Date | Kind |
|---|---|---|---|
| 6270116 | Breed et al. | Aug 2001 | B1 |
| 6474683 | Breed | Nov 2002 | B1 |
| 6904347 | Berenz | Jun 2005 | B1 |
| 8260502 | Yonak | Sep 2012 | B2 |
| 10953830 | Christensen | Mar 2021 | B1 |
| 20050006884 | Cooper | Jan 2005 | A1 |
| 20070120347 | Breed | May 2007 | A1 |
| 20070193811 | Breed | Aug 2007 | A1 |
| 20170039835 | Brankovic et al. | Feb 2017 | A1 |
| 20180170213 | Lu-Dac et al. | Jun 2018 | A1 |
| 20190293171 | Cuddihy | Sep 2019 | A1 |
| 20200041997 | Tuukkanen | Feb 2020 | A1 |
| 20200249337 | Darko | Aug 2020 | A1 |
| Number | Date | Country |
|---|---|---|
| 102017210342 | Dec 2017 | DE |
| 102017214009 | Feb 2019 | DE |
| Number | Date | Country | |
|---|---|---|---|
| 20200300997 A1 | Sep 2020 | US |
