Patent Application
20250128568
The present invention relates generally to a vehicle sensing system for a vehicle and, more particularly, to a vehicle sensing system that utilizes one or more air quality sensors at a vehicle.
Use of cameras or imaging sensors in vehicle imaging systems is common and known. Examples of such known systems are described in U.S. Pat. Nos. 5,949,331; 5,670,935 and/or 5,550,677, which are hereby incorporated herein by reference in their entireties. It is also known to implement a camera within the cabin of the vehicle for use in monitoring the driver of the vehicle, such as to determine driver attentiveness or gestures made by the driver.
A vehicular cabin monitoring system includes an air sensing device disposed at a vehicular component disposed at an interior portion of a cabin of a vehicle equipped with the vehicular cabin monitoring system. For example, the air sensing device is disposed at an interior rearview mirror assembly or an overhead console module or a windshield-mounted forward-viewing camera module. The air sensing device samples air at the vehicular component and generates sensor data representative of a sample of air at the vehicular component. An electronic control unit (ECU) includes electronic circuitry and associated software. The electronic circuitry includes a data processor configured to process sensor data captured by the air sensing device. The vehicular cabin monitoring system, based on processing at the ECU of sensor data captured by the air sensing device, determines a level of air contaminant within the interior cabin of the vehicle that is indicative of at least one selected from the group consisting of (i) a level of contaminant particulates within the cabin of the vehicle and (ii) a level of contaminant gas within the cabin of the vehicle. The vehicular cabin monitoring system generates an alert to a driver of the vehicle in response to determining that the level of air contaminant is greater than a threshold level of harmful gas.
These and other objects, advantages, purposes and features of the present invention will become apparent upon review of the following specification in conjunction with the drawings.
Referring now to the drawings and the illustrative embodiments depicted therein, an interior rearview mirror assembly 10 for a vehicle includes a mirror head 12 that includes a mirror casing 14 and a mirror reflective element 16 positioned at a front portion of the casing 14 (
Drivers and occupants often spend significant time in their vehicles (some studies have found that Americans spend up to 10 hours and 50 minutes or more per week travelling in their vehicles). Modern vehicles include an increasing number of safety measures, including driver monitoring and occupant monitoring systems including cameras and/or radar sensors that monitor the driver and/or occupants within the vehicle, such as to determine driver attentiveness. However, vehicles typically do not include systems for detecting and/or alerting drivers to the air quality within the vehicle cabin and often the only action for improving the cabin air quality is manually inspecting and replacing an air cabin filter of the vehicle. The air quality within the cabin of the vehicle may be reduced based on poor quality air (carrying particulates and/or harmful gasses) entering the cabin from the environment and/or the air cabin filter needing replacement (and thus being clogged and/or not adequately filtering air circulating within and entering the cabin).
As discussed further below, the cabin monitoring system actively monitors air quality within the cabin of the vehicle, detects poor or reduced air quality, generates an alert to the driver of the vehicle based on the detected reduced air quality, and may perform an action to counteract the reduced air quality and/or improve the air quality within the cabin of the vehicle. The cabin monitoring system includes a sensor or air quality sensing device configured to determine presence and concentration levels of toxic, combustible and otherwise harmful gasses, such as carbon monoxide (CO), carbon dioxide (CO2), nitrogen oxide (NO2) and/or volatile organic compounds (VOCs) and other harmful gasses at the interior cabin of the vehicle. Further, the sensor may be configured to determine presence and concentration of particulate matter (e.g., dust and pollen) and smoke within the air.
Referring to
The air quality sensing device 26 receives or captures a sample of air from within the interior cabin of the vehicle and the system processes the sample of air to determine a level of contaminants or harmful gas (e.g., CO) within the sample, which may be representative of a level of contaminants or harmful gas at the interior of the vehicle. The air quality sensing device 26 may utilize aspects of known gas sensing devices. For example, the air quality sensing device 26 may be a nondispersive infrared (NDIR) sensor that includes an infrared (IR) light emitter or IR light source, an IR detector, and an optical chamber that allows ambient air to pass in front of an optical filter. The IR light source emits a continuous beam of IR light inside the optical chamber and the detector measures the amount of IR light that passes through the optical filter. As the IR light passes along the length of the optical chamber, particular gasses absorb specific bands of IR light and allow the remaining wavelengths to pass through the optical filter. The IR detector measures the remaining amount of IR light and determines the amount of IR light absorbed, which is proportional to the concentration of gases in the sample of air within the optical chamber. The air quality sensing device may utilize characteristics of the sensing devices and systems described in U.S. Publication Nos. US-2024-0042826 and/or US-2024-0017610, which are hereby incorporated herein by reference in their entireties.
In the illustrated example, the air quality sensing device 26 is disposed at the interior rearview mirror assembly 10, such as at the rear surface of the mirror casing of the mirror head, so that the sensing device 26 may be in fluid communication with the ambient air of the cabin at a central location of the cabin. Optionally, the sensing device 26 may be disposed at any suitable location within the vehicle (e.g., at an elevated region of the vehicle cabin and in communication with the ambient air within the cabin), such as at an overhead console or the windshield mounted electronics module 28 or integrated with the heating, ventilation, and air conditioning (HVAC) system of the vehicle (such as at an air intake of the HVAC system).
The system may passively monitor air samples from the interior cabin of the vehicle, such that the sensing device 26 captures or measures the air sample as unassisted air flow in the cabin causes the air sample to flow to the sensing device 26. That is, the air quality sensing device 26 may always be in communication with the air inside the vehicle and, as air circulates throughout the vehicle, the sensing device 26 may constantly or episodically determine level of harmful gasses and/or contaminants within the air sample. Optionally, the system actively captures samples from the vehicle cabin, such that the air quality sensing device may include a collection device, such as a fan or suction device, that is operated to direct the sample of air to the air quality sensing device 26.
Based on detected levels of contaminants and/or harmful gasses within the cabin of the vehicle, the system determines that the air quality within the cabin is poor or reduced and the system generates an alert to the driver and/or occupants of the vehicle. That is, the system may generate the alert in response to determining that the level of harmful gas is greater than a threshold level, where the threshold level may be based on a level of the particular gas that is harmful to humans. For example, the system may generate the alert when the detected level of CO gas is greater than 70 parts per million, greater than 150 parts per million, greater than 200 parts per million, and the like. The system may generate the alert when the detected level of CO2 gas is greater than 500parts per million, 1,000 parts per million, 1,500 parts per million, 5,000 parts per million, and the like. Optionally, detecting presence of any level of certain harmful gasses greater than about 0 parts per million (e.g., CO) may result in the system generating the alert to the driver. Optionally, the system may generate the alert responsive to determination that the level of contaminants in the air at the cabin of the vehicle is greater than a threshold level of contaminants (e.g., determination of particulates in the air greater than 50 parts per million, greater than 75 parts per million, greater than 100 parts per million, and the like).
When the system determines that the air quality within the cabin is poor and/or when the system determines presence of harmful gas (e.g., CO) within the cabin, the system generates an alert to the driver and/or occupants of the vehicle, such as an audible tone or message played through an audio system or speaker system of the vehicle. Optionally, the alert may include a visual signal, such as a message displayed at a display screen of the vehicle (e.g., an infotainment screen at a center console of the vehicle) and/or illumination of a visual icon (e.g., at the gauge cluster or dashboard or interior rearview mirror assembly of the vehicle). Further, the alert may include a haptic signal, such as at the steering wheel, driver and/or passenger seat, seatbelts of the vehicle, and the like. The alert may communicate to the driver that the air quality within the cabin is poor and the alert may include a message or recommendation to the driver, such as to replace the air cabin filter or to seek another route to avoid driving through an area with poor air quality.
Optionally, the system may trigger an evasive maneuver in response to determining the poor air quality and/or presence of harmful gas to reduce or mitigate potential harm to the occupant(s) that may arise from the poor air quality and/or presence of harmful gas. For example, the system may adjust operation of the HVAC system, such as to turn on or increase fan speed (or turn off or reduce fan speed) and/or to adjust the HVAC system between operating in an air recirculation mode (where air is recirculated from the cabin through the HVAC system and air cabin filter) and a fresh air mode (where air is drawn from exterior the vehicle and through the HVAC system into the cabin). Optionally, the system may open the windows and/or doors in response to determining poor air quality.
In some examples, the system may perform the evasive maneuver until the system determines that the air quality has improved. For example, in response to determining that the concentration of contaminants in the air is below the threshold level and/or determining that the harmful gas is no longer present in the air within the cabin, the system may adjust operation of the HVAC system back to its previous setting and/or close the windows and/or doors of the vehicle.
Optionally, the system may display information to the driver and/or occupants of the vehicle based on the determined concentration or presence of particulates and/or harmful gasses within the vehicle. For example, based on processing of the sensor data captured by the air quality sensing device 26, the system may generate graphical display images to display at a display screen within the vehicle, where the graphical display images include air quality metrics representative of the air quality within the cabin of the vehicle. The air quality metrics may include determined concentrations of particulates and/or harmful gasses within the vehicle and/or an icon or representation summarizing the overall air quality within the cabin, such as a green icon for safe air quality levels, a yellow icon for moderate air quality levels, and a red icon for dangerous air quality levels. The graphical display and/or icons may be displayed at any suitable location within the vehicle, such as at the instrument gauge cluster, a display screen at the interior rearview mirror assembly, the infotainment display screen, and the like. Optionally, the system is in wireless communication with a mobile device of the driver, such as via a remote server in communication with the mobile device, for displaying the air quality metrics to the driver via an application on the driver's mobile device.
Thus, the system includes the air quality sensor 26 that may detect harmful gas (e.g., CO) within the vehicle cabin and initiate passenger protection measures, such as to alert the driver and/or occupants with audio, visual, and/or haptic signals. Further, the system triggers evasive maneuvers like opening the windows and/or doors and/or turning on the air circulation fan of the HVAC system to improve ventilation of the cabin. The air quality sensor 26 captures sensor data that is processed by the data processor at the ECU to trigger the passenger alert system and/or evasive actuators. The ECU and/or sensor may be integrated with the vehicle network. For example, the ECU and/or sensor may be part of the front camera module or interior rearview mirror assembly (and may be part of or associated with a driver or occupant or cabin monitoring camera and/or system disposed at the interior rearview mirror assembly) as these systems are mounted high in the cabin and can easily integrate the CO sensor. Optionally, the system may include a standalone ECU and system within the vehicle cabin, such as for higher end vehicle models or trims. In some examples, the system includes a standalone module with sensor and buzzer, such as for entry level vehicles without advanced safety systems, and that may be provided as an aftermarket product.
The cabin monitoring system improves passenger safety and comfort with seamless integration of additional sensors into the vehicular systems that automates CO detection and prevention. The system may save lives and lower health risks associated with breathing particulate matter and/or harmful gasses (e.g., CO). The vehicular ECU may integrate and automate the system, reducing implementation costs.
Further, the vehicle may be in wireless communication with a remote server, such as a cloud-based data collection system, and the vehicle may transmit captured sensor data representative of the air quality within the cabin of the vehicle to the remote server. The remote server may receive sensor data from a plurality of vehicles in communication with the remote server. The remote server processes the sensor data from the plurality of vehicles to determine trends, such as to determine air quality in a geographical region based on sensor data from vehicles within or near the geographical region, or to determine a lung illness rate for occupants of the vehicles based on cabin air quality across the vehicles (e.g., a trend between time spent in the vehicle, an incidence rate of lung cancer across occupants, and the air quality of the cabins).
The remote server may determine a characteristic of the air quality within the cabin of the equipped vehicle based on processing of sensor data received from the plurality of vehicles. For example, the remote server may compare the air quality within the cabin of the equipped vehicle to air quality of other vehicles in the geographic region and determine that, if the air quality is worse in the equipped vehicle, that the poor air quality may be caused at the vehicle (e.g., an exhaust leak, a clogged or degraded air cabin filter, and the like). Based on determination that the poor air quality is isolated to the equipped vehicle, the remote server may instruct the system to generate the alert and/or take an appropriate mitigating action to increase environmental airflow to the cabin (e.g., open the vehicle windows, adjust the HVAC system to operate in the fresh air mode, and the like).
If the air quality is substantially similar at the equipped vehicle to air quality at other vehicles in the geographic region, the remote server may determine that the poor air quality is caused by environmental factors (e.g., a construction zone, high pollen, and the like). Based on this determination, the remote server may instruct the system to generate the alert and/or take an appropriate mitigating action to reduce environmental airflow to the cabin (e.g., adjust the HVAC system to operate in the cabin recirculation mode). The remote server may determine that the other vehicles are within the same geographic region as the equipped vehicle based on, for example, the other vehicles being within a threshold distance of the equipped vehicle (such as within a radius of 1,000 feet or 3,000feet, or 1 mile or less, 5 miles or less, 10 miles or less, 50 miles or less, 100 miles or less and the like) or the other vehicles travelling along the same road or highway as the equipped vehicle. Further, the remote system may communicate with emergency services based on an elevated level of contaminants or harmful gas within the vehicle.
In some examples, the cabin monitoring system is integrated with or associated with a driver monitoring system (DMS) and/or occupant monitoring system (OMS) of the vehicle. For example, the mirror assembly 10 includes or is associated with the DMS, with the mirror assembly including a driver/occupant monitoring camera disposed at a back plate (and viewing through an aperture of the back plate) behind the reflective element 16 and viewing through the reflective element 16 toward at least a head region of the driver of the vehicle. The DMS may include an infrared light (IR light) or near infrared light (near IR light) emitter disposed at the back plate and emitting IR light or near IR light that passes through another aperture of the back plate and through the reflective element 16. Further, the ECU includes an image processor for processing image data captured by the DMS/OMS camera. Image data captured by the camera may be processed for a head and face direction and position tracking system and/or eye tracking system and/or gesture recognition system. The DMS camera and monitoring system and/or head and face direction and/or position tracking systems and/or eye tracking systems and/or gesture recognition systems may utilize aspects of the systems described in U.S. Pat. Nos. 11,827,153; 11,780,372; 11,639,134; 11,582,425; 11,518,401; 10,958,830; 10,065,574; 10,017,114; 9,405,120 and/or 7,914, 187, and/or U.S. Publication Nos. US-2024-0190456; US-2024-0168355; US-2022-0377219; US-2022-0254132; US-2022-0242438; US-2021-0323473; US-2021-0291739; US-2020-0320320; US-2020-0202151; US-2020-0143560; US-2019-0210615; US-2018-0231976; US-2018-0222414; US-2017-0274906; US-2017-0217367; US-2016-0209647; US-2016-0137126; US-2015-0352953; US-2015-0296135; US-2015-0294169; US-2015-0232030; US-2015-0092042; US-2015-0022664; US-2015-0015710; US-2015-0009010 and/or US-2014-0336876, and/or U.S. patent application Ser. No. 18/666,959, filed May 17, 2024 (Attorney Docket DON01 P5121), and/or U.S. provisional application Ser. No. 63/641,574, filed May 2, 2024, and/or International Publication No. WO 2023/220222, which are all hereby incorporated herein by reference in their entireties.
Optionally, the driver monitoring system may be integrated with a camera monitoring system (CMS) of the vehicle. The integrated vehicle system incorporates multiple inputs, such as from the inward viewing or driver monitoring camera and from a forward or outward viewing camera, as well as from a rearward viewing camera and sideward viewing cameras of the CMS, to provide the driver with unique collision mitigation capabilities based on full vehicle environment and driver awareness state. The image processing and detections and determinations are performed locally within the interior rearview mirror assembly and/or the overhead console region, depending on available space and electrical connections for the particular vehicle application. The CMS cameras and system may utilize aspects of the systems described in U.S. Pat. No. 11,242,008 and/or U.S. Publication Nos. US-2024-0064274; US-2021-0162926; US-2021-0155167; US-2018-0134217 and/or US-2014-0285666, which are all hereby incorporated herein by reference in their entireties.
The ECU may receive image data captured by a plurality of cameras of the vehicle, such as by a plurality of surround view system (SVS) cameras and a plurality of camera monitoring system (CMS) cameras and optionally one or more driver monitoring system (DMS) cameras. The ECU may comprise a central or single ECU that processes image data captured by the cameras for a plurality of driving assist functions and may provide display of different video images to a video display screen in the vehicle (such as at the interior rearview mirror assembly or at a central console or the like) for viewing by a driver of the vehicle. The system may utilize aspects of the systems described in U.S. Pat. Nos. 11,242,008; 10,442,360 and/or 10,046,706, and/or U.S. Publication Nos. US-2024-0064274; US-2021-0155167 and/or US-2019-0118717, which are all hereby incorporated herein by reference in their entireties.
The system may transmit captured sensor data from the air quality sensing device 26 and/or the DMS camera to the remote server. The remote server may process sensor data from the vehicle to monitor driver drowsiness and/or alertness, monitor passenger behavior, monitor air quality within the cabin and/or trigger the alert system, monitor oxygen (O2) levels within the cabin and maintain an optimal O2 level within the cabin via an oxygenator device at the vehicle. Optionally, the remote server processes sensor data received from a plurality of vehicles, such as to determine health trends between quality of air within the cabin and driver drowsiness and/or alertness, passenger behavior, and the like.
Optionally, the driver monitoring system or cabin monitoring system may process captured image data to identify the driver or a passenger within the vehicle, and the air quality sensing system may adjust one or more threshold levels of gasses or particulates based on the identified driver or occupant. For example, if the driver or occupant is identified as a person with a profile that indicates a lung issue or a heightened sensitivity to a particular gas or particulate, the system may generate an alert to that person or may generate an evasive action responsive to a lower threshold of the particular gas or particulate that the person is sensitive to. In other words, one or more profiles may be stored in memory and, based on determination that an identity of the driver and/or occupant of the vehicle corresponds to a stored profile, the threshold level of air particulates and/or harmful gas for triggering the alert and/or evasive maneuver may be adjusted, such as reducing the threshold levels if the profile identifies a health condition or sensitivity of the identified driver and/or occupant. Optionally, the DMS may categorize the driver and/or occupant (e.g., an elderly driver, or a child or infant) and the system may adjust the threshold level of air particulates and/or harmful gas based on the determined category of driver and/or occupant, such as to reduce the threshold levels if the driver and/or occupant is elderly or a child or infant.
The forward viewing camera module or windshield electronics module (WEM) may utilize aspects of the systems described in U.S. Pat. Nos. 9,896,039; 9,871,971; 9,596,387; 9,487,159; 8,256,821; 7,480,149; 6,824,281 and/or 6,690,268, and/or U.S. Publication Nos. US-2020-0039447; US-2015-0327398; US-2015-0015713; US-2014-0160284; US-2014-0226012 and/or US-2009-0295181, which are all hereby incorporated herein by reference in their entireties.
Changes and modifications in the specifically described embodiments can be carried out without departing from the principles of the invention, which is intended to be limited only by the scope of the appended claims, as interpreted according to the principles of patent law including the doctrine of equivalents.
The present application claims the filing benefits of U.S. provisional application Ser. No. 63/591,799, filed Oct. 20, 2023, which is hereby incorporated herein by reference in its entirety.
| Number | Date | Country | |
|---|---|---|---|
| 63591799 | Oct 2023 | US |
