The present application claims priority from Japanese Patent Application No. 2018-180058 filed on Sep. 26, 2018, the entire contents of which are hereby incorporated by reference.
The disclosure relates to occupant monitoring devices for vehicles and to occupant protection systems for vehicles.
Japanese Unexamined Patent Application Publication Nos. 11-043009 and 2015-140146 each disclose an occupant monitoring device that monitors on-board occupants in vehicles.
An aspect of the disclosure provides an occupant monitoring device for a vehicle. The device is configured to monitor an occupant sitting on a seat provided in a vehicle and including a light projector, an imaging device, and a processor. The light projector is configured to project light toward the occupant sitting on the seat. The imaging device is configured to capture an image of the occupant sitting on the seat. The processor is configured to control the light projector and the imaging device to capture the image of the occupant sitting on the seat. In a case where a collision of the vehicle is predicted, the imaging device captures the image at a higher speed than in a normal case where a collision of the vehicle is not predicted.
An aspect of the disclosure provides an occupant protection system vehicle. The system includes the above occupant monitoring device and an occupant protection device configured to execute occupant protection control based on the image of the occupant captured by the occupant monitoring device.
The accompanying drawings are included to provide a further understanding of the disclosure and are incorporated in and constitute a part of this specification. The drawings illustrate example embodiments and, together with the specification, serve to explain the principles of the disclosure.
In the following, some embodiments of the disclosure are described in detail with reference to the accompanying drawings. Note that sizes, materials, specific values, and any other factors illustrated in respective embodiments are illustrative for easier understanding of the disclosure, and are not intended to limit the scope of the disclosure unless otherwise specifically stated. Further, elements in the following example embodiments which are not recited in a most-generic independent claim of the disclosure are optional and may be provided on an as-needed basis. Throughout the present specification and the drawings, elements having substantially the same function and configuration are denoted with the same reference numerals to avoid any redundant description. Further, elements that are not directly related to the disclosure are unillustrated in the drawings. The drawings are schematic and are not intended to be drawn to scale. It is conceivable that an image of an occupant is captured in the event of a collision and is utilized for occupant protection control.
However, a vehicle occupant monitoring device is normally provided for warning an occupant sitting on a seat by detecting the level of fatigue, dozing, and inattentive driving of the occupant.
Therefore, the vehicle occupant monitoring device captures an image of the entire upper body of the occupant sitting on the seat and determines the state of the occupant in accordance with, for example, movement of the upper body.
Furthermore, it is conceivable that the vehicle occupant monitoring device is sufficiently practical by simply capturing an image of the occupant about once every several tens of milliseconds to several hundreds of milliseconds.
However, if an image of the entire upper body of the occupant is captured about once every several tens of milliseconds to several hundreds of milliseconds, there is a possibility that the image cannot be sufficiently utilized in occupant protection control in the event of a collision. In occupant protection control in the event of a collision, immediacy is demanded such that the time from the detection of the collision to the control is short and the processing can be completed within the short period of time.
Accordingly, in the vehicle, it is desirable that the occupant protection control in the event of a collision be further improved based on the image captured by the occupant monitoring device.
The automobile 1 is an example of a movable automobile 1 that accommodates one or more people. Other examples of the automobile 1 include a large-size vehicle, a two-wheeled vehicle, a personal mobility vehicle, a bicycle, a railway vehicle, an airplane, and a boat.
The automobile 1 in
In such an automobile 1, an occupant boarding the occupant compartment 4 of the vehicle body 2 sits on the seat 5. Moreover, the occupant operates, for example, the steering wheel 7. The automobile 1 travels in accordance with the operation performed by the occupant by using a driving force of an engine and a motor (not illustrated).
Furthermore, for example, a destination is set in the automobile 1, so that the automobile 1 guides a route to the destination and travels automatically along the route to the destination.
As illustrated in
If excessive acceleration is not applied, the behavior of the upper body of the occupant is not significant.
However, for example, in the event of a collision, an excessive impact occurring during the collision may cause the upper body of the occupant to tilt greatly so as to protrude out from the seat 5.
Therefore, in order to support the upper body of each occupant sitting on the corresponding seat 5, an occupant protection device 60 including an airbag member 70 and a seatbelt member 71, as illustrated in
The seatbelt member 71 has a belt extended across the front of the occupant sitting on the seat 5. The seatbelt member 71 actuates a belt actuator 63 in the event of a collision so as to apply tension to the belt. Consequently, in the event of a collision, the upper body of the occupant sitting on the seat 5 is supported by the belt, so that the upper body is less likely to protrude any further from the seat 5.
The airbag member 70 deploys an airbag 64 by using gas generated by an inflator in the event of a collision. In
With such an occupant protection device 60, the automobile 1 is capable of protecting the occupants even in the event of a collision.
When the automobile 1 is involved in a collision, it is conceivable that an image of each occupant is captured and is used for occupant protection control.
However, an occupant monitoring device 50 for the automobile 1 is normally provided for warning the occupant sitting on the seat 5 by detecting the level of fatigue, dozing, and inattentive driving of the occupant.
Therefore, the occupant monitoring device 50 for the automobile 1 captures an image of the entire upper body of the occupant sitting on the seat 5 and determines the state of the occupant in accordance with, for example, movement of the upper body.
Furthermore, it is conceivable that the occupant monitoring device 50 for the automobile 1 is sufficiently practical by simply capturing an image of the occupant about once every several tens of milliseconds to several hundreds of milliseconds, similar to a normal moving image.
However, if an image of the entire upper body of the occupant is captured about once every several tens of milliseconds to several hundreds of milliseconds, there is a possibility that the image cannot be sufficiently utilized in occupant protection control in the event of a collision. In occupant protection control in the event of a collision, immediacy is demanded such that the time from the detection of the collision to the control is short and the processing can be completed within the short period of time.
Accordingly, in the automobile 1, it is desirable that the occupant protection control in the event of a collision be further improved based on the image captured by the occupant monitoring device 50.
The vehicle control system 10 in
The vehicle-interior network 21 includes, for example, a wired communication network compliant with a controller area network (CAN), a local interconnect network (LIN), and so on. The devices coupled to the vehicle-interior network 21 are distributively disposed at respective locations of the vehicle body 2 and exchange data with one another via the vehicle-interior network 21. The devices coupled to the vehicle-interior network 21 may individually be provided with central processing units (CPUs) for exchanging data via the vehicle-interior network 21, and may each serve as an individual device.
The vehicle speed sensor 11 detects a speed according to, for example, movement of the vehicle body 2 of the automobile 1 and outputs the speed to the vehicle-interior network 21.
The acceleration sensor 12 detects acceleration acting on the vehicle body 2 of the automobile 1 and outputs the acceleration to the vehicle-interior network 21. If impacts input to the vehicle body 2 from a plurality of directions are to be detected, a plurality of acceleration sensors 12 may be provided in the automobile 1 such that they are distributively provided near the outer peripheral surface of the vehicle body 2.
The display device 13 acquires display data from the vehicle-interior network 21 and displays an image based on the display data.
The operable device 14 is provided in, for example, the occupant compartment 4 and is to be operated by the occupant. The operable device 14 includes, for example, the steering wheel 7, a select lever, and a brake pedal.
The loudspeaker device 15 acquires sound data from the vehicle-interior network 21 and outputs sound based on the sound data.
The vehicle-exterior imaging device 16 is provided in, for example, the occupant compartment 4 of the automobile 1, captures an image of the surroundings of the automobile 1, and outputs the image data to the vehicle-interior network 21. For example, the vehicle-exterior imaging device 16 is provided facing forward near the ceiling of the occupant compartment 4, as illustrated in
The wireless communication device 17 communicates wirelessly with, for example, another device not coupled to the vehicle-interior network 21, such as another vehicle located outside the automobile 1, a base station, and a beacon device, and exchanges data therewith.
The system timer 18 measures a time period or a time point. The system timer 18 outputs the measured time period or time point to the devices coupled to the vehicle-interior network 21 via the vehicle-interior network 21. Thus, the plurality of devices coupled to the vehicle-interior network 21 can operate synchronously in accordance with, for example, the time point measured by the system timer 18.
The memory device 19 stores programs and data to be used for vehicle control by the ECU 20. The memory device 19 may be, for example, either one of a semiconductor memory device and a hard disk device.
The ECU 20 is a computer equipped with a CPU, such as a one-chip microcomputer. The one-chip microcomputer may contain the system timer 18 and the memory device 19 in addition to the CPU. The ECU 20 reads and executes a program stored in the memory device 19. Accordingly, a controller that controls the overall operation of the automobile 1 is realized in the ECU 20. The automobile 1 may be provided with a plurality of ECUs 20. In this case, the plurality of ECUs 20 operate in cooperation with each other to function as a controller.
In
The communication controller 34 manages data communication performed by the wireless communication device 17 and constitutes a wireless communication apparatus of the automobile 1, together with the wireless communication device 17. The communication controller 34 uses the wireless communication device 17 to exchange data, for controlling the driving of the automobile 1, with, for example, a server device of a traffic system (not illustrated), another vehicle corresponding to the traffic system, and so on.
The air-conditioning controller 35 controls air-conditioning operation in the occupant compartment 4 of the automobile 1.
The driving support controller 32 constitutes a driving support device 40 for the automobile 1, together with the vehicle-exterior imaging device 16 and a support memory 41 in
Furthermore, the support controller 32 determines a possibility of an unavoidable collision with, for example, another vehicle by performing a process in
The occupant monitoring device 50 in
As illustrated in
The onboard imaging device 53 is provided facing rearward in the central region of the dashboard 6 in the occupant compartment 4. As indicated by a single-dot chain frame in
Each light projector 54 is provided facing rearward in the central region of the dashboard 6 in the occupant compartment 4. As indicated by a two-dot chain frame in
For example, the monitor memory 51 may be provided as a part of the memory device 19. The monitor memory 51 stores, for example, setting data 58 used for monitoring the occupants.
As illustrated in
Furthermore, if a collision is predicted, the monitoring controller 31 executes occupant monitoring control for protecting the occupants when a collision is predicted in accordance the process in
The occupant protection device 60 in
One set of a seatbelt 62 and a belt actuator 63 constitutes a single seatbelt member 71.
One set of an airbag 64, a base member 65, an airbag actuator 66, a first inflator 67, and a second inflator 68 constitutes a single airbag member 70.
In other words, in
Each seatbelt 62 is a belt extended across the front of the waist and the upper body of the occupant sitting on the corresponding seat 5.
Each belt actuator 63 applies variable tension to the corresponding seatbelt 62. The seatbelt 62 receiving the tension may function to press the waist and the upper body of the occupant against the seat 5.
The airbags 64 are bags that are deployed instantaneously by high-pressure gas.
The first inflators 67 and the second inflators 68 generate high-pressure gas to be injected into the airbags 64. In a case where the first inflators 67 and the second inflators 68 are both actuated, the airbags 64 can be deployed with high pressure. In a case where the first inflators 67 or the second inflators 68 are actuated, the airbags 64 can be deployed with low pressure. By starting the operation of the first inflators 67 and the operation of the second inflators 68 at different timings, the airbags 64 can be deployed with a pressure change different from that when the inflators are actuated at the same timing.
Each base member 65 has the corresponding airbag 64 attached thereto and accommodates the airbag 64 in a folded state. The first inflators 67 and the second inflators 68 may also be provided in the base members 65.
Each airbag actuator 66 drives the corresponding base member 65 and adjusts either one of the position and the orientation of the base member 65. If the base member 65 is attached to the vehicle body 2 in a movable manner in, for example, the vehicle-width direction, the front-rear direction, and the up-down direction, the airbag actuator 66 slidably drives the base member 65 to adjust the position thereof.
If the base member 65 is provided in a rotatable manner at the attached position, the airbag actuator 66 rotatably drives the base member 65 to adjust the orientation thereof.
For example, the protection memory 61 may be provided as a part of the memory device 19. The protection memory 61 stores, for example, setting data 69 used for protecting the occupants.
The protection controller 33 for the occupants constitutes the occupant protection device 60 of the automobile 1, together with the acceleration sensor 12, and the airbag member 70 and the seatbelt member 71 illustrated in
If a collision of the automobile 1 is predicted, the protection controller 33 executes occupant protection control based on an occupant image captured by the occupant monitoring device 50.
When the power of the vehicle control system 10 in
In step ST1 of the normal monitoring control in
When an occupant boards the automobile 1 and sits on the corresponding seat 5, the onboard imaging device 53 periodically repeats imaging, thereby capturing an image of the occupant sitting on the seat 5.
In step ST2, the monitoring controller 31 uses, for example, the setting data 58 for the occupant stored in the monitor memory 51 so as to identify the face of the occupant appearing in the image captured by the onboard imaging device 53.
In step ST3, the monitoring controller 31 uses, for example, the setting data 58 for the occupant stored in the monitor memory 51 so as to execute a setting process corresponding to the identified occupant. The monitoring controller 31 outputs either one of an identification number of the recognized occupant and the setting data 58 to the vehicle-interior network 21. Accordingly, for example, the operable device 14 adjusts the steering wheel 7 to a previously set position for the recognized occupant, the support controller 32 performs a driving-support setting process corresponding to the past driving history of the recognized occupant, the protection controller 33 performs a protection-control setting process corresponding to the recognized occupant, the air conditioner starts air-conditioning operation in accordance with past settings designated by the recognized occupant, and so on.
After the above-described setting process performed at the time of boarding, the support controller 32 starts to monitor the occupant.
In step ST4, the monitoring controller 31 causes each light projector 54 to emit light in accordance with normal light projection control. In normal light projection, the monitoring controller 31 causes the light projector 54 to intermittently emit light such that the light is output steadily in a continuously lit manner over a long period of time. By emitting light intermittently, the light projector 54 starts to project infrared light at a wide angle to the entire upper body of the occupant.
In step ST5, the monitoring controller 31 causes the onboard imaging device 53 to capture an image of the occupant sitting on the seat 5. The onboard imaging device 53 captures the image of the occupant sitting on the seat 5 at a normal imaging rate.
In step ST6, the monitoring controller 31 determines whether a warning is necessary based on the state of the occupant appearing in the captured image. The monitoring controller 31 identifies the position and movement of the upper body of the occupant in the captured image, and determines whether the occupant is dozing or driving inattentively in accordance with the identified position and movement of the upper body. If the occupant is neither dozing nor driving inattentively, the monitoring controller 31 determines that a warning is not necessary and causes the process to proceed to step ST8. If the occupant is dozing and driving inattentively, the monitoring controller 31 determines that a warning is necessary and causes the process to proceed to step ST7.
In step ST7, the monitoring controller 31 executes a warning process for drawing the attention of the occupant. For example, the monitoring controller 31 displays a warning on the display device 13 and outputs a warning sound from the loudspeaker device 15.
In step ST8, the monitoring controller 31 determines whether the occupant has exited the automobile 1. When the occupant no longer appears in the image captured by the onboard imaging device 53, the monitoring controller 31 determines that the occupant has exited the automobile 1. If the occupant has not exited the automobile 1, the monitoring controller 31 causes the process to return to step ST5. The monitoring controller 31 repeats the above-described monitoring process for the occupant who has not exited the automobile 1 based on a subsequent image captured by the onboard imaging device 53. When the occupant has exited the automobile 1, the monitoring controller 31 ends the process in
The support controller 32 repeats the process in
In step ST11 of the driving support control in
In step ST12, the support controller 32 generates a path of the automobile 1 based on the acquired information about the driving of the automobile 1. For example, the support controller 32 generates a most recent path based on the route information of the automobile 1.
In step ST13, the support controller 32 determines whether there is a possibility of a collision between another moving object, such as another vehicle, and the automobile 1. For example, the support controller 32 generates a path of the moving object from either one of the captured image and the movement data and determines whether the path of the moving object intersects with or comes close to the most recent path of the automobile 1. Then, if the most recent path of the automobile 1 and the path of the moving object intersect with or come close to each other, the support controller 32 determines that there is a possibility of a collision, and causes the process to proceed to step ST14. If the most recent path of the automobile 1 and the path of the moving object do not intersect with or come close to each other, the support controller 32 determines that there is no possibility of a collision, and causes the process to proceed to step ST15.
In step ST14, the support controller 32 updates the path generated in step ST12 such that the path is less likely to intersect with or come close to the path of the moving object. The support controller 32 updates the generated path such that, for example, the automobile 1 accelerates, decelerates, and stops along the path.
In step ST15, the support controller 32 controls the driving of the automobile 1 in accordance with the generated or updated path. The support controller 32 prioritizes the updated path over the generated path. If the automobile 1 is traveling in a self-driving mode, the support controller 32 causes the automobile 1 to travel along the generated or updated path. If the occupant operates the operable device 14, such as the steering wheel 7, the support controller 32 adjusts the operational amount in accordance with the generated or updated path, and causes the automobile 1 to travel accordingly.
In step ST16, the support controller 32 determines whether there is a possibility of avoiding a collision in a controlled driving mode. The support controller 32 acquires information from a sensor of the automobile 1, such as a most recent image captured by the vehicle-exterior imaging device 16, and determines whether there is a possibility of avoiding a collision with another moving object. Since the automobile 1 normally moves in accordance with the path updated in step ST14 to avoid a collision, the automobile 1 is capable of avoiding a collision with the moving object. However, for example, if the moving object moves unexpectedly, there is a possibility of a collision even if the automobile 1 moves in accordance with the updated path. The support controller 32 determines whether there is a possibility of avoiding a collision in accordance with, for example, relative movement of the moving object appearing in the captured image. The process of determining whether there is a possibility of avoiding a collision in step ST16 is stricter than the process of predicting a possibility of a collision in step ST14 and is for determining a possibility of whether a collision may actually occur. If there is no possibility of avoiding a collision, the support controller 32 causes the process to proceed to step ST17. If there is a possibility of avoiding a collision, the support controller 32 causes the process to proceed to step ST18.
In step ST17, the support controller 32 outputs a collision prediction to the vehicle-interior network 21. Subsequently, the support controller 32 ends the driving support control in
In step ST18, the support controller 32 outputs a collision prediction cancellation to the vehicle-interior network 21. Subsequently, the support controller 32 ends the driving support control in
According to the above-described process, the support controller 32 outputs a collision prediction in step ST17 if the support controller 32 determines that a collision may actually occur. If the support controller 32 determines that a collision may not actually occur, the support controller 32 outputs a collision prediction cancellation in step ST18.
If the monitoring controller 31 receives the collision prediction output in step ST17, the monitoring controller 31 executes the process in
The monitoring controller 31 performs the process in
In step ST21 in the process in
When the collision prediction is acquired, the monitoring controller 31 starts occupant monitoring control for protecting the occupant during a collision.
In step ST22, the monitoring controller 31 stops other normal processes executed in a normal state when a collision of the automobile 1 is not predicted. For example, the monitoring controller 31 stops the process in
In step ST23, the monitoring controller 31 changes the light projection mode of each light projector 54.
In detail, the monitoring controller 31 switches from the intermittent lighting mode in which the light projector 54 intermittently emits light with normal output to the continuous lighting mode in which the light projector 54 continuously emits light with maximum output. The maximum-output lighting mode involves causing the light projector 54 to emit light with maximum capacity. Although it is not possible to cause the light projector 54 to emit light continuously over a long period of time due to the effect of heat generation, the light projector 54 may be caused to continuously emit light with high output over a short period of time of, for example, about several minutes. The light projector 54 continuously emits light with a luminance higher the maximum luminance in a normal blinking mode.
Furthermore, in order to increase the amount of light to be radiated onto the head of the occupant, the monitoring controller 31 may further execute light-projection switching control.
For example, in order to reduce the light projection area, the monitoring controller 31 may switch the light projector 54 from a mode in which light is projected at a wide angle onto the entire upper body of the occupant sitting on the seat 5 to a mode in which light is projected at a narrow angle onto the head of the occupant and its periphery.
By performing such switching control for increasing the amount of light to be radiated onto the head of the occupant, if a collision of the automobile 1 is predicted, the light projector 54 can radiate intense light with a reduced light projection area than in the normal mode toward the head of the occupant whose image is to be captured by the onboard imaging device 53.
Moreover, because the light projector 54 continuously emits light, the amount of light from the light projector 54 is not limited for synchronizing with the imaging operation by the onboard imaging device 53.
In step ST24, the monitoring controller 31 switches the imaging operation of the onboard imaging device 53 so as to cause the onboard imaging device 53 to operate with, for example, a maximum frame rate that is higher than the normal frame rate. If a collision of the automobile 1 is predicted, the onboard imaging device 53 performs the imaging operation at a higher speed than in the normal case where a collision of the automobile 1 is not predicted.
In step ST25, the monitoring controller 31 clips out and extracts the regional image corresponding to the imaging range of the head of the occupant irradiated with the continuous intense light from the image captured by the onboard imaging device 53. The imaging range of the head may be a predetermined range with reference to, for example, an upper region of the seat 5.
In step ST26, the monitoring controller 31 uses the clipped regional image to identify the position and movement of the head.
For example, the monitoring controller 31 identifies the position of the head in the occupant compartment 4 in accordance with the imaged position of the head in the clipped regional image. The monitoring controller 31 identifies the movement of the head in the occupant compartment 4 in accordance with changes in the imaged position of the head in a plurality of regional images. The monitoring controller 31 predicts the behavior of the head in the occupant compartment 4, assuming that the head moves linearly at a speed according to the amount of identified movement of the head in the direction of movement of the head identified from the identified position of the head.
In step ST27, the monitoring controller 31 outputs head behavior information based on the identified head behavior to the vehicle-interior network 21. The monitoring controller 31 outputs predicted head behavior data in the occupant compartment 4 as the behavior information to the vehicle-interior network 21.
In step ST28, the monitoring controller 31 determines whether the collision prediction is cancelled.
If the monitoring controller 31 has not acquired the collision prediction cancellation output in step ST18, the monitoring controller 31 determines that the collision prediction is not cancelled and causes the process to return to step ST25. The monitoring controller 31 repeats the process from step ST25 to step ST28 until the collision prediction is cancelled, and repeatedly outputs the behavior information based on the most-recent regional image of the head.
When the monitoring controller 31 acquires the collision prediction cancellation output in step ST18, the monitoring controller 31 causes the process to proceed to step ST29.
In step ST29, the monitoring controller 31 resumes the normal process stopped in step ST22.
In step ST30, the monitoring controller 31 switches the light projection mode of each light projector 54, switched in step ST23, back to the normal light projection mode. The light projector 54 starts emitting light intermittently with normal output.
In step ST31, the monitoring controller 31 switches the imaging operation of the onboard imaging device 53, switched in step ST24, back to the normal mode. The onboard imaging device 53 starts operating with the normal frame rate.
Subsequently, the monitoring controller 31 ends the process in
The protection controller 33 for occupants executes the process in
In step ST41 in the occupant protection process in
If the collision prediction is not acquired, the protection controller 33 ends the occupant protection process in
If the collision prediction is acquired, the protection controller 33 causes the process to proceed to step ST42.
In step ST42, the protection controller 33 acquires the most-recent behavior information output in step ST24.
In step ST43, the protection controller 33 changes the setting data 69 in the protection memory 61 based on the acquired most-recent behavior information.
For example, the protection controller 33 updates the setting data 69 with regard to the start timing for actuating the belt actuators 63, the setting for whether the first inflators 67 are to be actuated, the start timing for actuating the first inflators 67, the setting for whether the second inflators 68 are to be actuated, and the start timing for actuating the second inflators 68, based on a behavior prediction of the heads of the occupants included in the behavior information.
Furthermore, based on the behavior prediction and the head position of the occupants included in the behavior information, the protection controller 33 uses the airbag actuators 66 to drive the base members 65 such that the airbags deploy in the direction in which the occupants' heads tilt due to an impact of a collision.
Accordingly, the protection controller 33 can change the settings for the occupant protection control in accordance with either one of the head position and behavior based on the image of the occupants captured by the occupant monitoring device 50. In accordance with either one of the head position and behavior based on the image of the occupants captured by the occupant monitoring device 50, the protection controller 33 can change the settings with regard to the start timing for deploying the airbags 64, the position of deployment of the airbags 64, the direction of deployment of the airbags 64, the size of deployment of the airbags 64, the speed of deployment of the airbags 64, and the firmness of the airbags 64 when deployed.
In step ST44, the protection controller 33 executes preliminary control prior to collision detection based on the fact that a collision is predicted.
In preliminary control, for example, the protection controller 33 actuates the belt actuators 63 to pull in the seatbelts 62, thereby causing the seatbelts 62 to come into contact with the occupants.
In step ST45, the protection controller 33 determines whether a collision is detected. For example, the protection controller 33 determines whether a collision is detected based on whether excessive acceleration corresponding to an impact of a collision is detected by the acceleration sensor 12.
If a collision is not detected, the protection controller 33 determines in step ST46 whether the collision prediction is cancelled in step ST18. If the collision prediction is cancelled, the protection controller 33 ends the occupant protection process in
If a collision is detected, the protection controller 33 executes the occupant protection control based on the changed settings in step ST47.
In control performed during a collision, for example, the protection controller 33 causes the belt actuators 63 to apply tension to the seatbelts 62 in accordance with the settings. The protection controller 33 actuates the first inflators 67 and the second inflators 68 in accordance with the settings. This causes the airbags 64 to deploy. The kinetic energy of the occupants during the collision may be absorbed by the seatbelts 62 and the airbags 64.
Accordingly, in this embodiment, the occupant monitoring device 50 of the automobile 1 monitors the occupants sitting on the seats 5 provided in the automobile 1 during a normal driving mode. In a case where a collision of the automobile 1 is predicted, the onboard imaging device 53 that captures an image of the occupants sitting on the seats 5 performs the imaging operation at higher speed, for occupant protection control, than in the normal mode in which a collision of the automobile 1 is not predicted. Thus, in this embodiment, the position and behavior of the head of each occupant sitting on the corresponding seat 5 can be identified quickly in real time based on the image captured at a shorter time interval than in the normal mode.
As a result, in this embodiment, the position and behavior of the head of each occupant sitting on the corresponding seat 5 in the captured image can be identified at high speed and in real time, so that the position and behavior of the head of the occupant can be presumed immediately. If a collision of the automobile 1 is predicted, the occupant protection device 60 can favorably predict the position and movement of the head of each occupant during the collision based on an image captured in real time in accordance with temporal resolution at a high speed at which immediacy can be obtained such as to be usable in control during the collision, so that the occupant protection device 60 can execute occupant protection control in correspondence with the position and movement. Thus, proper occupant protection control that can be expected as a result of using the occupant monitoring device 50 can be executed.
Accordingly, in this embodiment, the occupant protection control performed in the event of a collision can be further improved based on the image captured by the occupant monitoring device 50.
In this embodiment, if a collision of the automobile 1 is predicted, the process executed in the normal mode in which a collision of the automobile 1 is not predicted is stopped, and a process is performed on an image captured by the onboard imaging device 53 such that only an imaged region of the head of each occupant sitting in the corresponding seat 5 is processed. Thus, in this embodiment, when a collision is predicted, the imaging operation is performed at a higher speed than in the normal mode and a larger number of captured images can thus be processed, without being inhibited by other processes. In this embodiment, when a collision of the automobile 1 is predicted, a larger number of captured images than in the normal mode can be appropriately processed without impairing the real-time properties.
In this embodiment, the light projectors 54 project nonvisible infrared light toward the heads of the occupants sitting on the seats 5. Thus, even if the heads are irradiated with intense light, the visibility of the occupants is less likely to be obstructed.
In this embodiment, the occupant protection device 60 changes the settings for the occupant protection control in accordance with either one of the position and behavior of the head based on the image of each occupant captured by the occupant monitoring device 50. If a collision is detected, the occupant protection device 60 executes the occupant protection control based on the changed settings.
For example, the occupant protection device 60 changes the settings with regard to the start timing for deploying the airbags 64, the position of deployment of the airbags 64, the direction of deployment of the airbags 64, the size of deployment of the airbags 64, the speed of deployment of the airbags 64, and the firmness of the airbags 64 when deployed.
Accordingly, in this embodiment, the occupant protection control performed in the event of a collision can be further improved based on the image captured by the occupant monitoring device 50.
Next, an automobile 1 and a vehicle control system 10 according to a second embodiment of the disclosure will be described. The following description is mainly directed to differences from the above-described embodiment. Components identical to those in the above-described embodiment are given the same reference signs, and descriptions thereof are omitted.
Specifically,
As illustrated in
The light receiver 55 is, for example, either one of a charge-coupled device (CCD) sensor and a complementary metal oxide semiconductor (CMOS) sensor capable of receiving infrared light.
The lens 56 is movable along the optical axis of the light receiver 55. The lens 56 collects light from each occupant as a subject sitting on the corresponding seat 5 and focuses the light onto the light receiver 55.
The lens actuator 57 is controlled by the monitoring controller 31 so as to drive the lens 56 in the optical-axis direction of the light receiver 55.
As illustrated in
As illustrated in
Accordingly, the onboard imaging device 53 has an adjustable focusing lens so as to be capable of switching between a wide-range imaging mode in
In
In step ST51, the monitoring controller 31 switches the imaging operation of the onboard imaging device 53.
For example, the monitoring controller 31 switches the onboard imaging device 53 from the normal wide-range imaging mode in
Furthermore, the monitoring controller 31 causes the onboard imaging device 53 to operate with, for example, a maximum frame rate that is higher than the normal frame rate.
Accordingly, when a collision of the automobile 1 is predicted, the onboard imaging device 53 captures an image of the head of each occupant at a higher speed than in the normal case where a collision of the automobile 1 is not predicted.
Subsequently, in step ST26, the monitoring controller 31 uses a clipped regional image to identify the position and movement of the head.
Accordingly, when a collision of the automobile 1 is predicted, the imaging operation by the onboard imaging device 53 is switched to the narrow-range imaging mode. Because the head of the occupant in the captured image is expanded, the monitoring controller 31 can perform step ST26 after step ST51 without performing the regional-image clipping process in step ST25 in
In step ST31 after a collision of the automobile 1 is no longer predicted, the monitoring controller 31 switches the imaging mode of the onboard imaging device 53 switched in step ST51 back to the normal mode. The onboard imaging device 53 starts the wide-range imaging operation with the normal frame rate.
Subsequently, the monitoring controller 31 ends the process in
Accordingly, in this embodiment, when a collision of the automobile 1 is predicted, the imaging range of the onboard imaging device 53 is switched from the wide-range imaging mode in which an image of the upper body of each occupant sitting on the corresponding seat 5 is captured to the narrow-range imaging mode in which an image of the head of the occupant is captured. Accordingly, for example, the onboard imaging device 53 captures only an expanded image of the head of the occupant instead of capturing the entire upper body. Therefore, in this embodiment, the position and behavior of the head can be accurately identified from the head of the occupant appearing largely in the captured image.
The above-described embodiments are merely examples of the disclosure and are not limited thereto. Various modifications and alterations are possible within the scope of the disclosure.
For example, in each of the above-described embodiments, the occupant monitoring device 50 is coupled to the vehicle-interior network 21. Alternatively, for example, since the occupant monitoring device 50 is communicable with the wireless communication device 17, the occupant monitoring device 50 may exchange data with the occupant protection device 60. The occupant monitoring device 50 and the wireless communication device 17 may exchange data by a relatively-short-distance communication method compliant with, for example, the IEEE 802.1X standard. In this case, the occupant monitoring device 50 may be detachable from the automobile 1. The occupant monitoring device 50 detachable from the automobile 1 may be positioned and fixed to the occupant compartment 4 by using a mounter.
Number | Date | Country | Kind |
---|---|---|---|
JP2018-180058 | Sep 2018 | JP | national |
Number | Name | Date | Kind |
---|---|---|---|
20080234899 | Breed | Sep 2008 | A1 |
20090092284 | Breed | Apr 2009 | A1 |
20140168441 | Koike | Jun 2014 | A1 |
Number | Date | Country |
---|---|---|
H11043009 | Feb 1999 | JP |
2015140146 | Aug 2015 | JP |
Number | Date | Country | |
---|---|---|---|
20200097744 A1 | Mar 2020 | US |