Patent Application
20060012679
The present invention generally relates to imaging within a vehicle, and more particularly relates to a multifunction imaging system for the interior of a vehicle.
The ongoing advancement of digital imaging technology has enabled new application areas to be developed, including those related to automotive safety and security. For example, imager surveillance of a vehicle interior can provide information relating to driver/passenger identity and activity, air bag deployment constraints, vehicle condition, and many other types of activities related to the vehicle interior. Digital imaging surveillance can also enable images to be processed, analyzed, responded to, and/or communicated to a remote location.
Automotive applications for interior surveillance can include driver authorization/intruder detection, driver attentiveness monitoring, and driver personalization. Other imaging applications may relate to air bag deployment control, seat belt usage, passenger occupancy status, and so forth. An imaging system can also include an alarm capability, which may be used, for example, to alert a driver to a potentially unsafe situation. Stored images can be recalled to identify vehicle interior conditions before, during, and after an unusual event, providing valuable information to investigators.
Imaging systems for the types of applications previously described generally require significant technical content, in the form of hardware and software. For example, a single-function system would typically include a digital camera, a processor, a communication interface, and perhaps an alarm system and/or other auxiliary devices. To accommodate multiple functions, a number of single-function systems could be considered for installation into a vehicle. Typically, however, the feasibility of installing multiple single-function imaging systems into a production vehicle may be highly constrained due to space and cost considerations.
Accordingly, it is desirable to provide a multifunction imaging system for a vehicle interior that is compatible with the typical space and cost constraints of production vehicles. In addition, it is desirable to provide a multifunction imaging system that is capable of performing a wide range of monitor and control functions. Furthermore, other desirable features and characteristics of the present invention will become apparent from the subsequent detailed description and the appended claims, taken in conjunction with the accompanying drawings and the foregoing technical field and background.
According to various exemplary embodiments, devices and methods are provided for monitoring and responding to the activity within a vehicle interior. One embodiment comprises a single multifunction imaging system for the interior of a vehicle. In this embodiment, imaging devices are typically mounted within the interior of the vehicle, in order to monitor the driver and passenger areas of the vehicle interior. An electronic control unit is typically installed within the vehicle to communicate with the imaging devices. The imaging devices communicate images of the monitored activity within the vehicle interior to the electronic control unit, and the electronic control unit takes responsive courses of action based on analyses of the monitored activity images.
The imaging devices can typically function in either visible light or in the dark. To function in the dark, an illuminating medium is generally used, such as infrared. A typical illuminating medium can be formed from infrared light emitting diodes, which can provide sufficient illumination for the imagers without being visible to the driver or passengers.
The electronic control unit generally includes a processor configured to receive and analyze the vehicle interior activity images from the imaging devices. The processor typically makes assessments of the driver and passenger characteristics, based on previously stored algorithms and data, and then generates an appropriate predetermined course of action.
Typical predetermined courses of action might include alerting a drowsy driver, identifying an unauthorized intrusion, adjusting air bag deployment for different-sized passengers, personalizing the vehicle environment for the driver, and transmitting images to a remote location for emergency response or subsequent investigation. Due to the exemplary system configuration of a single processor implementing multiple response functions based on received images, the resulting economies of space and cost enhance the feasibility of installing this type of surveillance system into a production vehicle.
The present invention will hereinafter be described in conjunction with the following drawing figures, wherein like numerals denote like elements, and
The following detailed description is merely exemplary in nature and is not intended to limit the invention or the application and uses of the invention. Furthermore, there is no intention to be bound by any expressed or implied theory presented in the preceding technical field, background, brief summary or the following detailed description.
Various embodiments of the present invention pertain to the area of monitoring the activity in a vehicle interior and responding automatically to the monitored activity in an appropriate manner. In the exemplary embodiment, a single processor typically receives imaging data from multiple imaging devices that cover fields of view encompassing the driver and passenger areas of the vehicle interior. The processor is typically configured to process and analyze the received image data, and to perform multiple responsive functions, based on the data analysis. The responsive functions may include intrusion detection, driver personalization, air bag control, and other responses related to activity occurring in the vehicle interior. The use of a single processor combined with multiple imaging devices results in a multifunction system that is typically compatible with the space and cost constraints of a production vehicle.
According to an exemplary embodiment of a multifunction imaging system 100 for a vehicle interior 102, as illustrated in
A more detailed block diagram of system 100 is shown in
Processor 202 typically provides output signals to various functional devices, such as an automotive sub-system 208 or an alarm device 210. These output signals can be provided directly from ECU 104 (as shown in
Imagers 106, 108, 110 are typically digital camera devices, although other equivalent devices may be used as well. Imagers 106, 108, 110 are generally configured to capture, store and/or transfer two-dimensional or three-dimensional images in their respective fields of view (A, B, C). In this exemplary embodiment, such images are typically transferred to processor 202, where they can be analyzed and/or stored in memory 204. Imagers 106, 108, 110 can typically operate in visible light, and can also function in the dark with the aid of infrared or other appropriate illumination. Infrared illumination would typically be in the form of a cluster of light emitting diodes (LED's) located adjacent to their respective imagers (not shown in
According to exemplary embodiments of the present invention, processor 202 can provide multiple functions that are responsive to the analysis of incoming images from imagers 106, 108, 110. Typical examples of functional responses are driver personalization, event recorder, air bag suppression/modulation, and security function. It will be appreciated that many other types of functional responses can also be implemented within the same exemplary embodiment, such as intrusion detection, alerting a drowsy driver with an alarm signal, monitoring driver and passenger seat belt usage, and many other aspects of vehicle interior surveillance and response. The typical examples of processor 202 functional responses initially listed above can be more fully described as follows:
a) Driver Personalization
The exemplary system would typically recognize the driver in accordance with previously stored facial characteristics. Processor 202 would then typically transmit personalization commands to appropriate sub-systems 208, based on options previously selected by the driver. For example, the driver seat could be adjusted to a memory position automatically, without the need for manual activation, as is typically the case in current automobile production. Other personalization actions might include pedal and mirror adjustments, climate control, entertainment system settings, and so forth.
b) Event Recorder
Image data can be recorded on the basis of specified trigger criteria. Typical examples of specified trigger criteria can include vehicle intrusion (see paragraph d, below), unusual vehicle maneuvers, vehicle collision, a driver-selected event, or any other type of activity of interest. Such triggered images can be used, for example, to transmit an emergency signal to a call center, or for subsequent analysis.
c) Air Bag Suppression/Modulation
Air bag deployment can be totally suppressed or modulated (adjusted) in compliance with Federal Motor Vehicle Safety Standard 208, based on the viewed images of passengers in the vehicle interior. Imager 108, for example, can provide images of the front seat passenger to processor 202 for analysis, with respect to the size and position of the passenger. As a result of this analysis, processor 202 can command an appropriate sub-system 208 to suppress and/or modulate air bag deployment corresponding to the size and position of the passenger. For example, if a very small child or an “out of position” occupant (i.e., an occupant too close to an air bag) is viewed by an imager, processor 202 would typically signal the suppression of a potential air bag deployment. Alternately, processor 202 might signal a modulated air bag deployment for a relatively small-sized passenger.
d) Security Function
An exemplary embodiment of a multifunction imaging system can include a subscription function to enroll all authorized drivers of a vehicle. The exemplary system can be configured to store multiple images of an authorized driver in order to subscribe that individual as an authorized driver into the system memory. If an unauthorized person attempted to drive the vehicle, the exemplary system could disable the ignition, for example, and/or activate an alarm.
Accordingly, the shortcomings of the prior art have been overcome by providing an improved imaging system for a vehicle interior. In the exemplary embodiment described herein, a single, multifunction processor 202 and associated memory 204 are typically configured within a vehicle ECU to receive images received from multiple imagers (106, 108, 110) having fields of view that typically encompass the driver and passenger areas of the vehicle interior. Processor 202 is typically configured to analyze and respond to the received images in accordance with various pre-programmed options, such as driver personalization, air bag control, intrusion detection, and the like. The use of a single, multifunction processor communicating with multiple imagers enables the exemplary system to be compatible with the space and cost limitations of a production vehicle.
While at least one exemplary embodiment has been presented in the foregoing detailed description, it should be appreciated that a vast number of variations exist. It should also be appreciated that the exemplary embodiment or exemplary embodiments are only examples, and are not intended to limit the scope, applicability, or configuration of the invention in any way. Rather, the foregoing detailed description will provide those skilled in the art with a convenient road map for implementing the exemplary embodiment or exemplary embodiments. It should be understood that various changes can be made in the function and arrangement of elements without departing from the scope of the invention as set forth in the appended claims and the legal equivalents thereof.
