Modern automotive vehicles typically include seat-belt-latch sensors that detect when the seat belt is properly latched and alert a driver of the vehicle when any occupant's seat belt is not latched. The alert is typically a combination of an audible chime and a visible icon that is displayed in a field of view of the driver, with limited or no visibility to the other occupants of the vehicle. In some vehicles, a transitory icon is displayed to the driver for a brief period after all of the occupied seats are determined to have properly latched seat belts, after which the display is removed from the driver's view. These types of alerts are not suitable for driverless vehicles where none of the occupants is a driver responsible to remind the other occupants to latch their seat belts.
This document describes one or more aspects of a vehicle occupancy-monitoring system. In one example, the system includes a controller circuit configured to receive occupant data from an occupancy-monitoring sensor of a vehicle. The controller circuit is also configured to determine an occupancy status of respective seats in a cabin of the vehicle based on the occupancy-monitoring sensor. The controller circuit is also configured to indicate the occupancy status of the respective seats on a display located in a field of view of occupants of the vehicle. The display is integral to one of a roof light module, a door panel, a headliner of the cabin.
In another example, a method includes receiving, with a controller circuit, occupant data from an occupancy-monitoring sensor of a vehicle. The method also includes determining, with the controller circuit, an occupancy status of respective seats in a cabin of the vehicle based on the occupancy-monitoring sensor. The method also includes indicating, with the controller circuit, the occupancy status of the respective seats on a display located in a field of view of occupants of the vehicle, wherein the display is integral to one of a roof light module, a door panel, a headliner of the cabin.
This summary is provided to introduce aspects of a vehicle occupancy-monitoring system, which is further described below in the Detailed Description and Drawings. For ease of description, the disclosure focuses on vehicle-based or automotive-based systems, such as those that are integrated on vehicles traveling on a roadway. However, the techniques and systems described herein are not limited to vehicle or automotive contexts but also apply to other environments where cameras can be used to detect objects. This summary is not intended to identify essential features of the claimed subject matter, nor is it intended for use in determining the scope of the claimed subject matter.
The details of one or more aspects of a vehicle occupancy-monitoring system are described in this document with reference to the following drawings. The same numbers are used throughout the drawings to reference like features and components:
Overview
The techniques of this disclosure relate to a vehicle occupancy-monitoring system. A controller circuit receives data from in-cabin sensors that detect whether the seat is occupied and whether the occupant is an adult or a child. The in-cabin sensors also detect whether the occupant is properly wearing a seat belt or whether a child safety seat is properly installed. The system displays an occupancy status of each seat in the vehicle on a lighted display that is visible to all passengers in the vehicle. The occupancy status indicates whether the seat is occupied or unoccupied and whether the passenger is correctly restrained by seat belts or child safety seats. Sections of the display correspond to the seating layout of the vehicle so that not only the driver (or operator) but other passengers can also see which seats are occupied and in compliance with vehicle safety laws. The controller circuit notifies all occupants of the vehicle when a passenger is noncompliant by pulsating the light on the display and increases the intensity of the notifications when the noncompliance continues over time. The vehicle occupancy-monitoring system can improve passenger compliance with wearing seat belts by alerting non-driving occupants to buckle-up.
Example System
In the example illustrated in
Controller Circuit
The controller circuit 12 may be implemented as a microprocessor or other control circuitry such as analog and/or digital control circuitry. The control circuitry may include one or more application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs) that are programmed to perform the techniques, or one or more general-purpose hardware processors programmed to perform the techniques pursuant to program instructions in firmware, memory, other storage, or a combination. The controller circuit 12 may also combine custom hard-wired logic, ASICs, or FPGAs with custom programming to perform the techniques. The controller circuit 12 may include a memory or storage media (not shown), including non-volatile memory, such as electrically erasable programmable read-only memory (EEPROM) for storing one or more routines, thresholds, and captured data. The EEPROM stores data and allows individual bytes to be erased and reprogrammed by applying programming signals. The controller circuit 12 may include other examples of non-volatile memory, such as flash memory, read-only memory (ROM), programmable read-only memory (PROM), and erasable programmable read-only memory (EPROM). The controller circuit 12 may include volatile memory (e.g., dynamic random-access memory (DRAM), static random-access memory (SRAM)). The one or more routines may be executed by the processor to perform steps for determining the occupancy status 20 based on signals received by the controller circuit 12 from the occupancy-monitoring sensor 16 as described herein.
Occupancy-Monitoring Sensor
The OCS 17 can use the cameras of the occupancy-monitoring sensor 16 to detect when a seat belt is not properly aligned to the passenger, for example, when a passenger places a shoulder strap under an arm instead of across a shoulder. The OCS 17 can determine the seat-belt alignment by using edge-detection techniques, for example, Kalman filters, to detect the edges of the seat belts and compare the position of the edges to points on the body of the passenger based on the software models.
The OCS 17 can also use the cameras of the occupancy-monitoring sensor 16 to detect when a child safety seat is not properly aligned to the seats, for example, when the child safety seat is forward-facing instead of rear-facing, or when the child safety seat is otherwise installed incorrectly. The OCS 17 can determine the misaligned child safety seat by detecting features of the child safety that indicate the alignment, for example, a longitudinal axis of the child safety seat compared to a vehicle longitudinal axis, or features of the child that may indicate the child is facing a particular direction in relation to the seat.
The occupancy-monitoring sensor 16 can also include a seat-pressure sensor that detects a pressure or pressure distribution applied to the seat. The OCS 17 can determine whether an adult or the child is occupying the seat based on a pressure threshold indicative of a weight of the occupant, and by the distribution of the pressure that can indicate whether a child safety seat is installed. For example, if the weight of the occupant is greater than thirty kilograms, the OCS 17 may determine that the passenger is considered an adult. The OCS 17 can deactivate an air bag, for example, when a child safety seat is detected or when the seat is not occupied by a person. The OCS 17 can also reduce an inflation force of the air bag based on a size and weight of the occupant.
The occupancy-monitoring sensor 16 can also include a seat-belt-latch sensor that detects whether the seat belt is latched, and the OCS 17 can determine whether the passenger occupying the seat requires a latched seat belt (e.g., when the vehicle 18 is in motion). The seat-belt-latch sensor can be a reed sensor located in a latch housing that is actuated when a tongue of the buckle is inserted into the latch housing. The actuated reed sensor completes an electrical circuit that indicates to the OCS 17 that the buckle is properly latched. The OCS 17 can determine, based on the respective electrical circuit, which seat in the cabin corresponds to the latched or unlatched seat belt.
The occupancy-monitoring sensor 16 can also include a radar sensor that detects a presence of objects in the vehicle cabin, and the OCS 17 can determine whether the seat is occupied by the person or the inanimate object based on point cloud data received from the radar sensor. The OCS 17 compares the point cloud data to models in the software to determine whether the seat is occupied by the person or the inanimate object. In some examples, the radar sensor can detect relatively small movements, for example, movements of a chest wall of the passenger that is breathing. The radar sensor can be used to detect the presence of the child that may be seated in the child safety seat and covered where the camera or thermal camera may not detect the child.
The occupant data 14 from the OCS 17 can be periodically updated by the OCS 17 to ensure the controller circuit 12 can accurately determine the occupancy status 20. For example, the OCS 17 can update the occupant data 14 at thirty-second intervals to account for temporary changes in the seat occupancy due to passengers exiting or entering the vehicle.
Occupancy Status
The controller circuit 12 is configured to determine the occupancy status 20 of respective seats in the cabin of the vehicle 18 based on the occupant data 14 received from the occupancy-monitoring sensor 16. The occupancy status 20 can be indicative of several occupancy-status parameters that include a seat occupancy, a seat-belt engagement, a seat-belt alignment relative to the occupants, a child safety seat alignment relative to the seat, or any combination thereof.
The seat-occupancy parameter indicates whether the seat is occupied or vacant and whether the seat is occupied by an adult, a child, or an inanimate object. The controller circuit 12 can determine the seat occupancy based on the occupant data 14 from one or more of the devices that are included in the occupancy-monitoring sensor 16. For example, the cameras or radar sensors can capture image or cloud-point data of the seat locations in the cabin, and the OCS 17 can process the data to determine whether the seats are empty or occupied by a person or an object. In some examples, the OCS 17 uses data from the seat-pressure sensor in addition to the image or cloud-point data to support the determination that the seat is occupied. The controller circuit 12 can use the determination of the seat occupancy from the OCS 17 to present the seat-occupancy status on the display 22, as will be described in further detail below.
The seat-belt engagement parameter indicates whether the seat-belt latch is engaged, and the controller circuit 12 can use the determination of the seat-belt latch engagement from the OCS 17 to present a seat-belt engagement status on the display 22.
The seat-belt alignment relative to the occupants parameter indicates whether the occupants are properly restrained by the seat belt, and the controller circuit 12 can use the determination of the seat-belt alignment relative to the occupants from the OCS 17 to present a seat-belt alignment status on the display 22.
The child safety seat alignment relative to the seat parameter indicates whether the child safety seat is properly installed in the seat, as described above. The controller circuit 12 can use the determination of the child safety seat alignment relative to the seats from the OCS 17 to present a child safety seat alignment status on the display 22.
The controller circuit 12 can present the individual occupancy status parameters on the display 22 or can display the occupant status 20 that is indicative of two or more of the occupancy status parameters, as indicated in Table 1 below.
Display
The display 22 can be located in different parts of the vehicle 18 other than the roof light module.
Notifications
The controller circuit 12 can use the light color or illumination effects to provide notifications about the occupancy status 20 of the respective seats in the vehicle 18, for example, when the seat belt is unlatched or misaligned, or when the child safety seat is misaligned or improperly installed. Referring back to
At 106, the controller circuit 12 starts a timer for any occupancy status parameter that is noncompliant. The controller circuit 12 can start timers for any number of occupancy status indicators that are noncompliant, for example, a first timer for the unlatched seat belt, a second timer for the misaligned seat belt, and a third timer for the misaligned child safety seat.
At 108, the controller circuit 12 determines whether a time duration of the noncompliant occupancy status parameter is greater than a threshold. If the time is greater than the threshold, at 110, the controller circuit 12 sends a first notification to the driver. The first notification can be the pulsating light for the light bar segment that corresponds to the seat indicating the noncompliant occupancy-status parameter. For example, the controller circuit 12 can pulsate the yellow light on the light bar to notify the driver of the misaligned seat belt and can pulsate the orange light to notify the driver of the misaligned child safety seat. At 112, the controller circuit 12 again determines whether the occupancy-status parameter is noncompliant. If the occupancy status parameter is compliant, the controller circuit 12 indicates the status on the display, and if the occupancy status parameter remains noncompliant, at 114, the controller circuit 12 again determines whether the time is greater than the threshold. If the time is greater than the threshold, at 116, the controller circuit 12 increases the intensity of the notification to the driver, for example, by increasing the pulsation frequency of the light on the light bar.
The controller circuit 12 can use other notification methods in addition to the light color and effects, for example, voice notifications and haptic or vibrational notifications. For example, the voice notifications can call out the specific seat and the specific noncompliant occupancy-status parameter with a message audible to all vehicle occupants. The haptic notifications can be applied to the seat of the passenger that is noncompliant and can also vibrate the driver's seat. In some examples, a portion of the driver's seat that corresponds to the noncompliant seat position can be vibrated. For example, vibrating a right shoulder portion of the driver's seat-back can indicate the right-rear passenger is noncompliant, and vibrating the left front portion of the driver's seat-bottom can indicate that the driver is noncompliant. These other notification methods can also be escalated by increasing the intensity, for example, by increasing a volume of the voice notification, increasing the frequency of the repeated voice notification, and vibrating the driver's and passenger's seats with increasing frequency or amplitude.
Example Method
Step 202 includes RECEIVE OCCUPANT DATA. This can include receiving, with the controller circuit 12, occupant data 14 from the occupancy-monitoring sensor 16 installed on the vehicle 18 via the transmission link. The occupancy-monitoring sensor 16 can include multiple sensors that detect the occupancy of the seats in the vehicle 18 and can be components of the OCS 17, as described above. The occupancy-monitoring sensor 16 can include 2D cameras, 3D cameras, and IR cameras that capture video or thermal images of the vehicle cabin, and the OCS 17 determines whether the seat is occupied by the person or the inanimate object based on the images, as described above. The occupancy-monitoring sensor 16 can also include the radar sensor that detects the presence of objects in the seats and can detect the presence of the child that may be covered and not visible to the cameras, as described above. The OCS 17 can use the cameras to detect when the seat belt is not properly aligned to the passenger or instances of misaligned child safety seats, as described above. The occupancy-monitoring sensor 16 can also include seat-pressure sensors that detect when the adult, the child, or the inanimate object are occupying the seat and can include seat-belt-latch sensors that detect whether the seat belts of the occupied seats are latched, as described above. The occupant data 14 can be periodically updated by the OCS 17 and transferred to the controller circuit 12 to ensure the controller circuit 12 can accurately determine the occupancy status 20.
Step 204 includes DETERMINE OCCUPANCY STATUS. This can include determining, with the controller circuit 12, the occupancy status 20 of the respective seats in the vehicle 18 based on the occupant data 14 received from the OCS 17. The occupancy status 20 includes the seat occupancy, the seat-belt engagement, the seat-belt alignment relative to the occupants, and the child safety seat alignment relative to the seats, as described above. The seat occupancy indicates whether the seat is occupied by the adult, the child, the inanimate object, or is unoccupied. The controller circuit 12 determines whether the seat is occupied or unoccupied based on the occupant data 14 from the cameras, radar sensors, and the seat-pressure sensors. The controller circuit 12 determines whether the seat-belt latch is engaged or disengaged based on the data received from the seat-belt-latch sensor. The controller circuit 12 determines whether the seat belt is aligned or misaligned based on the data received from the cameras of the OCS 17. The controller circuit 12 determines whether the child safety seat is aligned or misaligned and whether the child safety seat is properly installed in the seat based on the data received from the cameras, seat-pressure sensors, and seat-belt-latch sensors, as described above.
Step 206 includes INDICATE OCCUPANCY STATUS. This can include indicating, with the controller circuit 12, the occupancy status 20 on the display 22 in view of the vehicle occupants. The display 22 can be integral to the roof light module as illustrated in
Step 208 includes NOTIFY OPERATOR. This can include notifying, with the controller circuit 12, the driver or operator of the vehicle 18 about the occupancy status 20 of the respective seats in the vehicle 18. The notifications can include the seat belt being unlatched or misaligned, and the child safety seat being misaligned or improperly installed, as described above. The controller circuit 12 uses the light color and illumination effects to provide notifications to the operator when the controller circuit 12 determines whether any occupancy-status parameter is noncompliant with vehicle safety laws, for example, unlatched seat belts, misaligned seat belts, and misaligned or mis-installed child safety seats. The controller circuit 12 can pulsate the lights on the light bar to indicate to the operator that the occupancy status 20 is determined to conflict with vehicle safety laws and can increase the intensity of the notifications when the noncompliance exists for a time period exceeding a threshold, as described above. The controller circuit 12 can notify the operator using the light color and effects, voice notifications, and haptic or vibrational notifications, as described above.
In the following section, examples are provided.
Example 1. A system, comprising: a controller circuit configured to: receive occupant data from an occupancy-monitoring sensor of a vehicle; determine an occupancy status of respective seats in a cabin of the vehicle based on the occupancy-monitoring sensor; and indicate the occupancy status of the respective seats on a display located in a field of view of occupants of the vehicle, wherein the display is integral to one of a roof light module, a door panel, a headliner of the cabin.
Example 2. The system of the previous example, wherein the display is duplicated at a monitoring facility remote from the vehicle.
Example 3. The system of any of the previous examples, wherein the display comprises lighting configured to change a color of light displayed and the controller circuit is further configured to change the color of light displayed based on the occupancy status of the respective seats.
Example 4. The system of any of the previous examples, wherein the display is projected on a windshield of the vehicle.
Example 5. The system of any of the previous examples, wherein the occupancy-monitoring sensor is one or more of a camera, a seat-pressure sensor, and a seat-belt-latch sensor, and a radar sensor.
Example 6. The system of any of the previous examples, wherein determining the occupancy status includes determining one or more of a seat occupancy, a seat-belt engagement, a seat-belt alignment relative to the occupants, and a child safety seat alignment relative to the seats.
Example 7. The system of any of the previous examples, wherein the seat occupancy includes one or more of an occupied seat, a vacant seat, a presence of an adult, the presence of a child, and the presence of an inanimate object.
Example 8. The system of any of the previous examples, wherein the controller circuit is further configured to notify an operator of the vehicle when the seat-belt engagement is determined to be unlatched.
Example 9. The system of any of the previous examples, wherein the controller circuit is further configured to notify the operator of the vehicle when the seat-belt alignment is determined to be misaligned.
Example 10. The system of any of the previous examples, wherein the controller circuit is further configured to notify the operator of the vehicle when the child safety seat alignment is determined to be misaligned.
Example 11. The system of any of the previous examples, wherein the notifications to the operator include one of a voice notification, a light color, and a haptic notification.
Example 12. The system of any of the previous examples, wherein an intensity of the notifications increase when the occupancy status is determined to conflict with vehicle safety laws for a time duration exceeding a threshold.
Example 13. A method, comprising: receiving, with a controller circuit, occupant data from an occupancy-monitoring sensor of a vehicle; determining, with the controller circuit, an occupancy status of respective seats in a cabin of the vehicle based on the occupancy-monitoring sensor; and indicating, with the controller circuit, the occupancy status of the respective seats on a display located in a field of view of occupants of the vehicle, wherein the display is integral to one of a roof light module, a door panel, a headliner of the cabin.
Example 14. The method of the previous example, including indicating the occupancy status, with the controller circuit, by changing a color of light displayed on the display corresponding to the occupancy status of the respective seats.
Example 15. The method of any of the previous examples, including determining the occupancy status by determining one or more of a seat occupancy, a seat-belt engagement, a seat-belt alignment relative to the occupants, and a child safety seat alignment relative to the seats.
Example 16. The method of any of the previous examples, including determining the seat occupancy by determining one or more of an occupied seat, a vacant seat, a presence of an adult, the presence of a child, and the presence of an inanimate object.
Example 17. The method of any of the previous examples, including notifying, with the controller circuit, an operator of the vehicle when the seat-belt engagement is determined to be unlatched.
Example 18. The method of any of the previous examples, including notifying, with the controller circuit, the operator of the vehicle when the seat-belt alignment is determined to be misaligned.
Example 19. The method of any of the previous examples, including notifying, with the controller circuit, the operator of the vehicle when the child safety seat alignment is determined to be misaligned.
Example 20. The method of, including increasing an intensity of the notifications, with the controller circuit, when the occupancy status is determined to conflict with vehicle safety laws for a time duration exceeding a threshold, wherein the notifications to the operator include one of a voice notification, a light color, and a haptic notification.
While various embodiments of the disclosure are described in the foregoing description and shown in the drawings, it is to be understood that this disclosure is not limited thereto but may be variously embodied to practice within the scope of the following claims. From the foregoing description, it will be apparent that various changes may be made without departing from the spirit and scope of the disclosure as defined by the following claims.
The use of “or” and grammatically related terms indicates non-exclusive alternatives without limitation unless the context clearly dictates otherwise. As used herein, a phrase referring to “at least one of” a list of items refers to any combination of those items, including single members. As an example, “at least one of: a, b, or c” is intended to cover a, b, c, a-b, a-c, b-c, and a-b-c, as well as any combination with multiples of the same element (e.g., a-a, a-a-a, a-a-b, a-a-c, a-b-b, a-c-c, b-b, b-b-b, b-b-c, c-c, and c-c-c or any other ordering of a, b, and c).
This application claims the benefit under 35 U.S.C. 119(e) of U.S. Provisional Application No. 62/956,951 filed Jan. 3, 2020, the disclosures of which are hereby incorporated by reference in their entirety herein.
Number | Name | Date | Kind |
---|---|---|---|
7359527 | Breed et al. | Apr 2008 | B2 |
10391972 | Chengalva | Aug 2019 | B1 |
10457208 | Moffa | Oct 2019 | B1 |
20090132128 | Marriott | May 2009 | A1 |
20130021476 | Trummer | Jan 2013 | A1 |
20140085070 | Schoenberg | Mar 2014 | A1 |
20140104053 | Clark, Jr. | Apr 2014 | A1 |
20180033277 | Entis | Feb 2018 | A1 |
Number | Date | Country |
---|---|---|
204641663 | Sep 2015 | CN |
105459950 | Apr 2016 | CN |
107599904 | Jan 2018 | CN |
109153356 | Jan 2019 | CN |
102015218588 | Mar 2016 | DE |
2016012117 | Jan 2016 | JP |
Entry |
---|
“Extended European Search Report”, EP Application No. 20217784.6, dated May 28, 2021, 7 pages. |
“Foreign Office Action”, CN Application No. 202110004102.0, dated Sep. 5, 2022, 18 pages. |
Number | Date | Country | |
---|---|---|---|
20210206343 A1 | Jul 2021 | US |
Number | Date | Country | |
---|---|---|---|
62956951 | Jan 2020 | US |