The present application relates to an abnormality detection device, a method for abnormality detection, a non-transitory storage medium for abnormality detection, and a vehicle recording device.
In recent years, drive recorders have been known that can detect and record an event/incident, such as some kind of impact to a vehicle during driving or parking.
For example, in a technique disclosed in Japanese Patent Application Laid-open No. 2010-128610, a determination threshold of an acceleration sensor is changed based on a change in a signal for detecting a parking state of a vehicle, and some kind of event is determined to have occurred when an output signal of the acceleration sensor has exceeded the determination threshold.
In a technique disclosed in Japanese Patent Application Laid-open No. 2005-161996, radio waves are emitted around a vehicle, and an abnormality is detected when a low frequency component of a reflected wave from a moving object has exceeded a predetermined level.
In a technique disclosed in Japanese Patent Application Laid-open No. 2007-161226, using an angular velocity sensor hardly susceptible to a shake of a vehicle caused by, for example, wind, an angular velocity of the vehicle in a direction orthogonal to a floor direction thereof is detected, and, based on the detected angular velocity signal, a determination is made as to whether the vehicle is being stolen.
Although the technique disclosed in Patent Literature 1 is described such that the determination threshold of the acceleration sensor is changed based on the change in the signal for detecting the parking state of the vehicle, the threshold for detecting the event is not changeable according to a state of periphery of the vehicle.
Although the technique disclosed in Patent Literature 2 is described such that a monitoring area is optimized and a detection sensitivity is adjusted, the threshold for detecting the abnormal state is not controllable according to the state of the periphery of the vehicle.
In the technique disclosed in Patent Literature 3, the threshold for detecting whether the vehicle is being stolen is not controllable according to the state of the periphery of the vehicle.
An abnormality detection device, a method for abnormality detection, a non-transitory storage medium for abnormality detection, and a vehicle recording device are disclosed.
According to the present invention, there is provide an abnormality detection device comprising: a detector configured to detect a shake of a vehicle; a threshold setting unit configured to set at least one threshold for determining whether the detected shake of the vehicle is abnormal; a vehicle peripheral information acquisition unit configured to acquire at least one of a video around the vehicle, illuminance information around the vehicle, and sound information around the vehicle; and a vehicle information acquisition unit configured to acquire information about a driving state of the vehicle, wherein the threshold setting unit is further configured to control the at least one threshold based on the information acquired by the vehicle peripheral information acquisition unit when the vehicle is determined to be being parked based on the information acquired by the vehicle information acquisition unit.
According to the present invention, there is provide a method for abnormality detection comprising: detecting a shake of a vehicle; setting at least one threshold for determining whether the detected shake of the vehicle is abnormal; acquiring vehicle peripheral information by acquiring at least one of a video around the vehicle, illuminance information around the vehicle, and sound information around the vehicle; and acquiring vehicle information by acquiring information about a driving state of the vehicle, wherein the setting further comprising controlling the at least one threshold based on the information acquired at the acquiring of the vehicle peripheral information when the vehicle is determined to be being parked based on the vehicle information acquired at the acquiring of the vehicle information.
According to the present invention, there is provide a non-transitory storage medium for abnormality detection that stores a computer program to be executed on a computer of a vehicle recording device, the computer program causing the computer to execute: detecting a shake of a vehicle; setting at least one threshold for determining whether the detected shake of the vehicle is abnormal; acquiring vehicle peripheral information by acquiring at least one of a video around the vehicle, illuminance information around the vehicle, and sound information around the vehicle; and acquiring vehicle information by acquiring information about a driving state of the vehicle, wherein the setting further comprising controlling the at least one threshold based on the information acquired at the acquiring of the vehicle peripheral information when the vehicle is determined to be being parked based on the vehicle information acquired at the acquiring of the vehicle information.
The above and other objects, features, advantages and technical and industrial significance of this application will be better understood by reading the following detailed description of presently preferred embodiments of the application, when considered in connection with the accompanying drawings.
The following describes an abnormality detection device, a method for abnormality detection, a non-transitory storage medium for abnormality detection, and a vehicle recording device according to an embodiment of the present application by way of an example of a case of implementing them in a drive recorder, with reference to
Hereinafter, in the present embodiment, examples of events to be detected as an abnormality include an impact caused by sudden starting, sudden braking, or sudden steering, while a vehicle is driving, and a collision action by another vehicle, an action in which the vehicle is damaged (an action in which a vehicle body is scraped by, for example, another vehicle or a cart, window glass is broken, a side mirror or a door contacts an obstacle, or a tire is punctured), and an action in which tires are stolen, while the vehicle is being parked. The event to be detected as the abnormality may, however, be an event other than the above-listed events.
As illustrated in
The CPU 11 operates according to a control program and control data stored in the internal memory 15, and controls the units of the drive recorder 1 in an integrated manner. The CPU 11 executes the control program stored in the internal memory 15 to perform functions described later.
The main imager 12 is a camera that includes the camera lens 5 illustrated in
The sub imager 13 is a camera provided with, for example, a CMOS sensor capable of imaging 360 degrees around itself.
The acceleration sensor 14 is, for example, a sensor that detects acceleration in the directions of three axes of the x-axis, y-axis, and z-axis, and detects a change in physical location of the drive recorder 1. The acceleration sensor 14 serves as a detector for detecting a shake of the vehicle.
The internal memory 15 is constituted by, for example, a read-only memory (ROM) and a random access memory (RAM). The ROM is used as a storage area for the control program (not illustrated) to be executed by the CPU 11. The RAM is used as a work area for the CPU 11, and also used as a buffer area for temporarily storing the image data (image data 15A in
The GPS receiver 16 receives GPS signals transmitted from GPS satellites (not illustrated). The CPU 11 performs a positioning calculation processing based on the received GPS signals, and can detect position information including a latitude, a longitude, and a altitude of the drive recorder 1 at the current time. The GPS receiver 16 may receive GPS signals included in another device, such as a vehicle navigation device (not illustrated).
The illuminance sensor 17 detects illuminance information (brightness) around the vehicle.
The storage 18 is, for example, a secure digital (SD) memory card, and is a flash memory capable of recording the image data captured by the main imager 12.
The speaker 19 includes the speaker unit 8 of
The microphone 20 includes the microphone unit 7 of
The input unit 21 is an interface that includes physical operation buttons (not illustrated), and is used to enter various types of information into the CPU 11.
The following describes a recording operation of the drive recorder 1 illustrated in
The following describes the functions included in the drive recorder 1.
The information acquisition unit 41 acquires vehicle peripheral information including the surrounding video captured by the sub imager 13, the surrounding illuminance information detected by the illuminance sensor 17, and the surrounding sound information detected by the microphone 20. The information acquisition unit 41 also acquires vehicle information including, for example, gear information and engine off information through, for example, a controller area network (CAN). The vehicle peripheral information and the vehicle information thus acquired are supplied to the threshold setting unit 42. The information acquisition unit 41 serves as a vehicle peripheral information acquisition unit for acquiring the vehicle peripheral information and a vehicle information acquisition unit for acquiring information about a driving state of the vehicle.
The threshold setting unit 42 determines whether the vehicle is being parked based on the vehicle information supplied from the information acquisition unit 41, and when the vehicle is determined to be being parked, changes preset thresholds based on the vehicle peripheral information supplied from the information acquisition unit 41 such that the abnormality can be more easily determined to have occurred.
More specifically, when the vehicle peripheral information supplied from the information acquisition unit 41 is the sound information around the vehicle detected by the microphone 20 and the sound volume of the acquired sound is equal to or lower than a predetermined value A1, or equal to or higher than another predetermined value A2 that has been separately set from the predetermined value A1, the threshold setting unit 42 changes the thresholds such that the abnormality can be more easily determined to have occurred. When the threshold setting unit 42 determines a human voice from the acquired sound information, and when the sound volume of the human voice is equal to or lower than a predetermined value A3, the threshold setting unit 42 changes the threshold such that the abnormality can be more easily determined to have occurred. Furthermore, when the threshold setting unit 42 determines a number of people who have produced voices from the acquired human voices and the number of the people who have produced the voices is equal to or lower than a predetermined value A4, the threshold setting unit 42 changes the threshold such that the abnormality can be more easily determined to have occurred.
As described above, the threshold setting unit 42 has a function as a voice determination unit for determining the human voice from the sound information included in the vehicle peripheral information and a function as a number of people determination unit for determining the number of the people who have produced the voices from the determined human voices.
When the vehicle peripheral information supplied from the information acquisition unit 41 is the illuminance information around the vehicle detected by the illuminance sensor 17 and the acquired illuminance information is equal to or lower than a predetermined value B, the threshold setting unit 42 changes the threshold such that the abnormality can be more easily determined to have occurred.
In addition, when the vehicle peripheral information supplied from the information acquisition unit 41 is the video around the vehicle captured by the sub-imager 13 and motion information that is a processing result obtained by known motion detection processing on the acquired captured video is equal to or higher than a predetermined value C, the threshold setting unit 42 changes the threshold such that the abnormality can be more easily determined to have occurred.
The abnormality determination unit 43 compares sensor information supplied from the acceleration sensor 14 with the threshold set by the threshold setting unit 42, and determines whether an abnormality needed to be recorded in the abnormality recording area 48 of the storage 18 has occurred, that is, whether the sensor output value detected by the acceleration sensor 14 has exceeded the threshold. The abnormality determination unit 43 supplies the determination result to the recording process controller 44.
When the result of the determination supplied from the abnormality determination unit 43 is that an abnormality has occurred, the recording process controller 44 transfers the image data 15A for the predetermined periods of time before and after the time of the determination of the abnormality from the internal memory 15 to the storage 18 to record the image data 15A as the image data 48A.
The abnormality recording area 48 is a storage area of the storage 18 in which overwriting is prohibited. The image data 15A for the predetermined periods of time in which the recording process controller 44 has determined that the abnormality has occurred is transferred from the internal memory 15, and stored as the image data 48A in the abnormality recording area 48.
The following describes examples of the thresholds set by the threshold setting unit 42.
As can be seen from the thresholds illustrated in
In other words, during driving, the relatively high threshold TH1 for the sensor output value of the acceleration sensor 14 is set such that an abnormality (large change), such as a collision (accident) or sudden braking, can be detected, whereas during parking, the threshold TH2 that makes determination of abnormality easier is set such that an abnormality (slight change), such as a vehicle break-in or mischief, can be accurately detected. In particular, among the sensor output values detected by the acceleration sensor 14, the amount of reduction or the amount of change in the threshold TH2-y for the sensor output value in the Y-axis direction and in the threshold TH2-z for the sensor output value in the Z-axis direction is set greater than the amount of reduction or the amount of change in the threshold TH2-x for the sensor output value in the X-axis direction. This setting can increase sensitivity of abnormality detection in the right-left direction and the up-down direction, so that the abnormality can be accurately detected and recorded even if the vehicle suffers damage, such as the vehicle break-in or the mischief.
The following describes abnormality determination processing performed by the CPU 11 of the drive recorder 1 illustrated in
At Step S1, the information acquisition unit 41 acquires the vehicle information including the gear information and the engine off information through the CAN, and acquires the vehicle peripheral information including the video around the vehicle captured by the sub imager 13, the illuminance information around the vehicle detected by the illuminance sensor 17, and the sound information around the vehicle detected by the microphone 20.
At Step S2, the abnormality determination unit 43 acquires the sensor information supplied from the acceleration sensor 14.
At Step S3, the threshold setting unit 42 determines whether the vehicle is being parked based on the vehicle information acquired at Step S1, and, when the vehicle is determined to be being parked (Yes at Step S3), the threshold setting unit 42 performs a processing at Step S4 to change the thresholds based on the vehicle peripheral information acquired at Step S1 such that the abnormality can be more easily determined to have occurred. This change allows the abnormality to be accurately detected even if the vehicle suffers damage, such as the vehicle break-in or the mischief.
In contrast, when, at Step S3, the vehicle is determined not to be being parked (No at Step S3), the threshold setting unit 42 skips the processing at Step S4, and performs a processing at Step S5.
At Step S5, the abnormality determination unit 43 compares the sensor information acquired at step S2 with the thresholds set by the threshold setting unit 42, and supplies the comparison results to the recording process controller 44.
At Step S6, the recording process controller 44 determines whether an abnormality has occurred based on the comparison results supplied from the abnormality determination unit 43, and, when the abnormality is determined to have occurred (Yes at Step S6), the recording process controller 44 performs a processing at Step S7 to transfer the image data 15A for the predetermined periods of time before and after the time of the determination of the abnormality from the internal memory 15 to the storage 18. The image data 48A before and after the abnormality detection is recorded in the storage 18 by this transfer.
In contrast, when, at Step S6, the recording process controller 44 determines from the comparison results supplied from the abnormality determination unit 43 that no abnormality has occurred (No at Step S6), the recording process controller 44 performs control not to transfer the image data to the storage 18.
As can be understood from the above description, the drive recorder 1 includes the detector (acceleration sensor 14) that detects the shake of the vehicle, the threshold setting unit 42 that sets the thresholds for determining whether the output values of the detector is abnormal, the vehicle peripheral information acquisition unit (information acquisition unit 41) that acquires at least one of the video around the vehicle, the illuminance information around the vehicle, and the sound information around the vehicle, and the vehicle information acquisition unit (information acquisition unit 41) that acquires the information about the driving state of the vehicle, and controls the thresholds based on the vehicle peripheral information when the vehicle is determined to be being parked based on the vehicle information. Therefore, the abnormality can be accurately detected according to the state of the periphery of the vehicle.
The outputs of the detector are the sensor output values in the front-rear direction, the right-left direction, and the up-down direction with respect to the vehicle, and the amount of reduction in the threshold in the right-left direction and the amount of reduction in the threshold in the up-down direction with respect to the vehicle are greater than the amount of reduction in the threshold in the front-rear direction with respect to the vehicle. Therefore, the abnormality can be accurately detected even if the vehicle suffers damage, such as the vehicle break-in or the mischief.
When the illuminance information around the vehicle included in the vehicle peripheral information is equal to or lower than the predetermined value, the threshold is changed such that the abnormality can be more easily determined to have occurred. Therefore, the abnormality can be more accurately detected when the vehicle is being parked and the periphery thereof is dark, and accordingly, the video can be recorded more easily to capture an evidence video in situations where the vehicle break-in or the mischief is likely to occur.
When the sound volume of the sound around the vehicle included in the vehicle peripheral information is equal to or lower than the predetermined value, or equal to or higher than the other predetermined value that has been separately set from the predetermined value, the thresholds are changed such that the abnormality can be more easily determined to have occurred. Therefore, the abnormality can be accurately detected in situations where the vehicle is being parked and the periphery of the vehicle is quieter or louder than a predetermined range, and accordingly, the video can be recorded more easily to capture the evidence video in situations where the vehicle break-in or the mischief is likely to occur.
The human voice is determined from the sound information included in the vehicle peripheral information, and, when the sound volume of the human voice is equal to or lower than the predetermined value, the threshold is changed such that the abnormality can be more easily determined to have occurred. Therefore, the abnormality can be accurately detected in situations where the vehicle is being parked, and a suspicious person talking in a low voice is present at the periphery of the vehicle or only few people are present around the vehicle, and accordingly, the video can be recorded more easily to capture the evidence video in situations where the vehicle break-in or the mischief is likely to occur.
The number of people who have produced voices is determined from the human voices included in the vehicle peripheral information, and, when the number of the people who have produced the voices is equal to or smaller than the predetermined value, the threshold is changed such that the abnormality can be more easily determined to have occurred. Therefore, the abnormality can be accurately detected in situations where the vehicle is being parked and a suspicious person may be present at the periphery of the vehicle, and accordingly, the video can be recorded more easily to capture the evidence video in situations where the vehicle break-in or the mischief is likely to occur.
The drive recorder 1 is further provided with the imager (main imager 12) that outputs the captured image as the image data, the abnormality determination unit 43 that compares the sensor output values detected by the detector (acceleration sensor 14) with the threshold set by the threshold setting unit 42 and determines whether an abnormality has occurred, and the recording process controller 44 that records the image data output from the imager in the storage 18 when the abnormality determination unit 43 determines that the abnormality has occurred. Therefore, the image data before and after the abnormality detection can be recorded.
In the above description, the vehicle peripheral information is acquired from the sub imager 13, the illuminance sensor 17, and the microphone 20 provided in the drive recorder 1. The vehicle peripheral information may, however, be acquired from, for example, an imager, an illuminance sensor, and a microphone (which are not illustrated) mounted on the vehicle. In other words, by not being provided with the sub imager 13, the illuminance sensor 17, and the microphone 20, the drive recorder 1 can be reduced in size, and the present application can be implemented with a simple configuration.
As described above, the functions of the drive recorder 1 may or may not be all in the same housing. For example, some of the functions of the abnormality detection device including the acceleration sensor 14, the threshold setting unit 42, and the information acquisition unit 41 may be housed in a housing different from the drive recorder 1. Also, in addition to the functions of the abnormality detection device, for example, some of the functions of the vehicle recording device including the main imager 12, the abnormality determination unit 43, and the recording process controller 44 may be housed in a housing different from the drive recorder 1.
While the embodiment of the present application has been described, the present application is not limited to the embodiment described above, and can be variously modified within a scope not deviating from the gist of the present application. For example, although the thresholds during parking are changed in the abnormality determination processing illustrated in
In the above description, as illustrated in
The series of processing described above can be performed by hardware or software. When the series of processing is performed by software, a computer program constituting the software is installed from a program recording medium to a computer incorporated in dedicated hardware, or, for example, to a general-purpose personal computer capable of executing various functions by installing various computer programs.
The program executed by the computer may be a program that performs processing in chronological order according to the order described in this specification, or a program that performs processing in parallel or at necessary time when, for example, calling is made.
The present application can provide an abnormality detection device, a method for abnormality detection, a non-transitory storage medium for abnormality detection, and a vehicle recording device that are capable of controlling thresholds for detecting abnormality according to a state of periphery of a vehicle.
Although the application has been described with respect to specific embodiments for a complete and clear disclosure, the appended claims are not to be thus limited but are to be construed as embodying all modifications and alternative constructions that may occur to one skilled in the art that fairly fall within the basic teaching herein set forth.
Number | Date | Country | Kind |
---|---|---|---|
JP2017-220165 | Nov 2017 | JP | national |
This application is a continuation of PCT International Application No. PCT/JP2018/039324 filed in Japan on Oct. 23, 2018, which claims priority to and incorporates by references the entire contents of Japanese Patent Application No. 2017-220165 filed in Japan on Nov. 15, 2017.
Number | Name | Date | Kind |
---|---|---|---|
20070103279 | Hayashi et al. | May 2007 | A1 |
20080186153 | Hayashi | Aug 2008 | A1 |
20090121850 | Tanaka et al. | May 2009 | A1 |
20160152211 | Owens et al. | Jun 2016 | A1 |
20160280131 | Carson, Jr. | Sep 2016 | A1 |
20180050696 | Misu | Feb 2018 | A1 |
20190118751 | Ghannam | Apr 2019 | A1 |
20200198527 | Koehler | Jun 2020 | A1 |
Number | Date | Country |
---|---|---|
2515079 | Oct 2012 | EP |
2005-161996 | Jun 2005 | JP |
2006-235732 | Sep 2006 | JP |
2007-011965 | Jan 2007 | JP |
2007-161226 | Jun 2007 | JP |
2008-189140 | Aug 2008 | JP |
2010-128610 | Jun 2010 | JP |
2017013685 | Jan 2017 | WO |
Entry |
---|
Extended European Search Report for European Patent Application No. 18879024.0 dated May 6, 2020. |
International Search Report and Written Opinion for International Patent Application No. PCT/JP2018/039324 dated Jan. 15, 2019, 9 pages. |
Number | Date | Country | |
---|---|---|---|
20200055476 A1 | Feb 2020 | US |
Number | Date | Country | |
---|---|---|---|
Parent | PCT/JP2018/039324 | Oct 2018 | US |
Child | 16662097 | US |