Apparatus and method for responding to the health and fitness of a driver of a vehicle

Information

  • Patent Grant
  • 6734799
  • Patent Number
    6,734,799
  • Date Filed
    Thursday, March 1, 2001
    23 years ago
  • Date Issued
    Tuesday, May 11, 2004
    20 years ago
  • Inventors
  • Original Assignees
  • Examiners
    • Wu; Daniel J.
    • Nguyen; Tai T.
    Agents
    • Tarolli, Sundheim, Covell & Tummino L.L.P.
Abstract
An apparatus (10) helps protect an occupant (1) of a vehicle (100). The apparatus (10) includes first means (11) for non-intrusively sensing at least one health condition of the vehicle occupant (1) and for producing a first output signal (110) indicative of the health condition of the vehicle occupant (1). The apparatus (10) further includes 2ND means (21) for transmitting a health condition signal derived from the first output signal (110) to a person at a location remote from the vehicle (100) to convey health condition information to the person and to enable the person to determine a suitable type of response.
Description




BACKGROUND OF THE INVENTION




1 Field of the Invention




The present invention relates to an apparatus and method for helping to protect an occupant of a vehicle and, more particularly, determining whether a driver of the vehicle is fit to operate the vehicle.




2 Description of Related Art




There is a continuing increase in the density of vehicles traveling the world's roadways. This increase raises the probability of vehicles colliding with objects. Simultaneously, a need to improve the safety of vehicle operations, as it currently stands, by reducing the occurrences of vehicles colliding with stationary and moving objects (such as roadside obstacles and other vehicles) is present. One means for reconciling these competing factors includes monitoring the relative speed, direction of travel, and distance between vehicles sharing the roadway, and to use such information to provide direct indications to the driver of the vehicle of potential danger. It is known for automotive engineers to use microwave radar systems as a means to monitor and warn drivers of such environmental conditions.




Another means for reconciling these factors is to evaluate a driver's operational performance over time to determine if the driver has lost the capability of operating the vehicle safely. Whenever a driver is responsible for operating a motor vehicle, it is critical that the driver be capable of demonstrating basic cognitive and motor skills at a level that will assure the safe operation of the vehicle. A number of conditions can impair a driver's ability to perform the basic cognitive and motor skills that are necessary for the safe operation of a motor vehicle. For example, consumption of alcohol or narcotic drugs, or lack of sleep, can make it impossible for a driver to react appropriately to a potentially hazardous situation with sufficient speed and skill to avoid danger to the driver, the vehicle, other people (i.e., passengers, pedestrians, etc.), other vehicles and their occupants, and property that might be in a potential zone of danger at any given time. Therefore, it is very important to continuously evaluate a driver's ability to identify hazardous conditions and react to those conditions while operating a motor vehicle.




A number of electronic devices are known that record data on various aspects of vehicle performance and/or environment information. These devices primarily function as trip recorders, storing information such as trip distance, trip time, miles per gallon consumed, and average speed.




It would be desirable to have an apparatus and method which utilizes the information that is gathered by a radar system and other sensors, and the information that has been recorded during past trips and/or a present trip, to evaluate not only a driver's operational performance, but also the driver's health condition (i.e., breathing, heart rate, etc.), in real-time and under actual conditions. It would also be desirable for such an apparatus and method to predict when a driver is near the point of being unfit, whether it be because of a medical condition or other reason, to safely operate a vehicle and determine exactly when the driver is actually unfit to safely operate a vehicle. Thus, a conclusion that a driver's health condition and/or operational performance is unacceptable may be communicated to a remote person, the driver, and/or the vehicle itself in order that one or all of these take appropriate action to mitigate or correct the potential or actual danger of this situation.




SUMMARY OF THE INVENTION




In accordance with the present invention, an apparatus helps protect an occupant of a vehicle. The apparatus includes first means for non-intrusively sensing at least one health condition of the vehicle occupant and for producing a first output signal indicative of the health condition of the vehicle occupant. The apparatus further includes first means for transmitting a health condition signal derived from the first output signal to a person at a location remote from the vehicle to convey health condition information to the person and to enable the person to determine a suitable type of response.











BRIEF DESCRIPTION OF THE DRAWINGS




The foregoing and other features of the present invention will become apparent to those skilled in the art to which the present invention relates upon reading the following description with reference to the accompanying drawings, in which:





FIG. 1

is a simplified block diagram of the apparatus and method of the present invention;





FIG. 2

is a simplified block diagram of a radar system that may be used in conjunction with the apparatus of

FIG. 1

;





FIG. 3

is a detailed block diagram showing the radar system of

FIG. 2

;





FIG. 4

is a table illustrating the use of assessments by the controller of

FIG. 1

in various driving environments of the vehicle;





FIG. 5

is a schematic view of a vehicle in which part of the apparatus of

FIG. 1

may be located; and





FIG. 6

is a flow chart of one possible fitness algorithm used to determine the fitness of a vehicle driver in accordance with the present invention.











DESCRIPTION OF PREFERRED EMBODIMENT




The present invention is an apparatus and method for helping to protect an occupant of a vehicle and, more specifically, for determining whether a driver


1


of a motor vehicle


100


is fit to operate the motor vehicle. The fitness of the driver


1


is determined by utilizing various factors including the health condition of the driver, the past/current driving performance of the driver, the awareness of the driver, and/or a predetermined set of performance parameters. An apparatus


10


in accordance with the present invention may operate, for example, as a stand alone system in which information is dynamically gathered for determining the fitness of the driver


1


of the vehicle


100


to operate the vehicle. Alternatively, the apparatus


10


may operate in cooperation with an obstacle detection and collision avoidance system and an operational event recording system.




Generally, the apparatus


10


monitors the driver


1


of the vehicle


100


and the operation of the vehicle over time in order to determine if either the driver or vehicle goes outside a predetermined norm or displays some other erratic activity. When the abnormal/erratic activity is found, the apparatus


10


may automatically send detailed information about the activity and/or a simple alert to a multitude of receivers.




Specifically, the apparatus


10


includes first sensing means


11


, second sensing means


12


, an electronic controller


1000


, first transmitting means


21


, second transmitting means


22


, first communicating means


31


, second communicating means


32


, third communicating means


33


, fourth communicating means


34


, and fifth communicating means


35


. All of these elements may be disposed within the vehicle


100


.




The first sensing means


11


non-intrusively senses at least one health condition of the driver


1


of the vehicle


100


and produces a first output signal


110


indicative of the health condition of the driver


1


. The first sensing means


11


may include an audio sensor


111


and a heat emission sensor


112


.




The audio sensor


111


senses auditory output from the driver


1


such as the driver's breathing pattern, the driver's speech pattern, and/or the driver's heart rate pattern over time. The audio sensor


111


may, for example, include a piezoelectric element that produces an electric voltage in response to vibrations produced in the air by sound.




The driver's breathing pattern may be indicative of a health condition which is impairing, or will impair, the driver's ability to safely operate the vehicle


100


(i.e., short shallow breathes may indicate an occurring heart attack). The controller


1000


can intermittently compare the driver's breathing pattern to the driver's normal breathing pattern recorded by the controller or to a predetermined normal breathing pattern that has been programmed into the controller and is non-specific to any individual driver. The comparison will reveal whether the driver's breathing pattern is abnormal and possibly indicative of a health condition that is impairing, or will impair, the driver's ability to safely operate the vehicle


100


.




The driver's speech pattern may be indicative of a health condition that is impairing, or will impair, the driver's ability to safely operate the vehicle


100


(i.e., slurred speech may indicate an occurring stroke). The controller


1000


can intermittently compare the driver's speech pattern to the driver's normal speech pattern recorded by the controller or to a predetermined normal speech pattern that has been programmed into the controller and is non-specific to any individual driver. The comparison will reveal whether the driver's speech pattern is abnormal and possibly indicative of a health condition that is impairing, or will impair, the driver's ability to safely operate the vehicle


100


.




The driver's heart rate pattern may be indicative of a health condition that is impairing, or will impair, the driver's ability to safely operate the vehicle


100


(i.e., an erratic heart rate may indicate an occurring heart attack). The controller


1000


can intermittently compare the driver's heart rate pattern to the driver's normal heart rate pattern recorded by the controller or to a predetermined normal heart rate pattern that has been programmed into the controller and is non-specific to any individual driver. The comparison will reveal whether the driver's heart rate pattern is abnormal and possibly indicative of a health condition that is impairing, or will impair, the driver's ability to safely operate the vehicle


100


.




The heat emission sensor


112


senses infrared output from the driver


1


in order to determine the body temperature of the driver. The heat emission sensor


112


may, for example, include at least one infrared projection unit and/or at least one infrared reception unit.




The body temperature of the driver


1


may be indicative of a health condition which is impairing, or will impair, the driver's ability to safely operate the vehicle


100


(i.e., an extremely high body temperature may indicate that the driver is on the verge of fainting). The controller


1000


can intermittently compare the driver's body temperature to the driver's normal body temperature recorded by the controller or to a predetermined normal body temperature that has been programmed into the controller and is non-specific to any individual driver. The comparison will reveal whether the driver's body temperature is abnormal and possibly indicative of a health condition that is impairing, or will impair, the driver's ability to safely operate the vehicle


100


.




The first transmitting means


21


transmits a health condition signal derived from the first output signal


110


by the controller


1000


to a person at a location remote from the vehicle


100


to convey health condition information to the remote person and to enable the remote person to determine a suitable type of response. For example, if the driver's breathing pattern and/or heart rate pattern indicate that the driver


1


is having a heart attack, the remote person may dispatch an EMS unit as well as a tow truck to the location of the vehicle


100


. The first transmitting means


21


may, for example, include an oscillator such as a Gunn diode, a directional coupler, a receive coupler, a Schottsky diode mixer, a microwave antenna, and/or a RF load.




The second sensing means


12


intermittently senses operational characteristics of the vehicle


100


and produces a second output signal


120


indicative of those characteristics. The second sensing means


12


may include sensors for sensing a wide range of operational and environmental conditions.




For example, a speed sensor may be coupled to the drive train of the vehicle


100


for sensing the speed of the vehicle


100


. A steering wheel position sensor, such as a dual Hall-effect device, may sense the location of a magnet located on the steering wheel shaft that determines the position of the steering wheel. A tachometer may be coupled to the engine and may sense the number of revolutions per minute of the engine. A pressure gauge may sense the engine oil pressure. A thermometer may sense the temperature of the engine oil, the engine block, the transmission fluid (if the vehicle


100


uses any such fluid), and/or the temperature of the engine coolant.




Accelerometers may sense the rate of horizontal acceleration in the direction of forward motion, the direction of rearward motion, and/or at right angles to the direction of forward/rearward motion. Inclinometers may sense the attitude of the vehicle


100


with respect to the gravitational field of the earth. A sensor may sense activation of an anti-lock braking system and/or an air bag. Pressure sensors may sense the amount of pressure being applied to the accelerator and/or brake pedals and the air pressure in each tire. A sensor may sense which, if either, of the right or left vehicle turn signals is active. An external thermometer may sense the temperature outside the vehicle


100


. A sensor may sense when the windshield wipers are active.




This list of sensors is not intended to be exhaustive, nor is each output from each of these particular sensors utilized under all situations. These sensors produce output that the controller


1000


may use to determine the operational conditions under which the driver


1


and vehicle


100


are operating over time.




The above operational and environmental characteristics of the vehicle


100


may be indicative of a condition that has impaired the driver's ability to operate the vehicle (i.e., intoxication, emotional instability, or a health condition not detected by the first sensing means


11


). The controller


1000


can develop a profile of the driver's operation of the vehicle


100


over time that can be compared to a previously recorded normal operational profile of the driver


1


or a general profile that is non-specific to any individual driver. The profile may be stored in an Event Recording Apparatus (ERA)


1005


. The comparison will reveal whether the driver's recent operation of the vehicle


100


presents a hazard to the driver


1


, the vehicle


100


, and/or objects external to the vehicle. Excessive vehicle speed, engine revolutions, and/or braking may be indicative of real and/or potential hazardous operation of the vehicle


100


.




The second transmitting means


22


transmits a vehicle operation signal derived from the second output signal


120


by the controller


1000


to a person at a location remote from the vehicle


100


to convey vehicle operation information to the person and to enable the person to, along with the health condition signal, determine a suitable type of response. For example, if a sensor indicates the actuation of an air bag, the remote person may dispatch an EMS unit as well as a tow truck.




The second transmitting means


22


may, for example, include an oscillator such as a Gunn diode, a directional coupler, a receive coupler, a Schottsky diode mixer, a microwave antenna, and/or a RF load. Alternatively, the second transmitting means


22


and the first transmitting means


21


may comprise a single device that receives a single signal containing both health condition information and vehicle operation information and transmits the single signal derived therefrom to the remote person.




The controller


1000


analyzes the health condition signal derived from the first output signal


110


of the first sensing means


11


and determines whether the operational characteristics of the vehicle


100


should be altered due to the driver's health condition. If the controller


1000


determines that certain operational characteristics of the vehicle


100


should be altered, the first communicating means


31


communicates a health condition response signal from the controller


1000


to the vehicle


100


and alters the operational characteristics of the vehicle in response to the health condition response signal. The first communicating means


31


may, for example, include various control devices for controlling operation of the vehicle


100


and a hardwire connection between the controller


1000


and those control devices. The control devices may include an ignition cut-off switch, a brake activation switch, an air bag actuation switch, a side curtain actuation switch, an external hazard lights activation switch, and/or a steering lock mechanism. For example, the controller


1000


determines if a hazard exists and, if it does, sends an activation signal to some or all of the above control devices.




The controller


1000


also analyzes the vehicle operation signal derived from the second output signal


120


of the second sensing means


12


and determines whether the operational characteristics of the vehicle


100


should be altered due to the driver's operation of the vehicle over time. If the controller


1000


determines that certain operational characteristics of the vehicle


100


should be altered, the second communicating means


31


communicates a vehicle operation response signal from the controller


1000


to the vehicle


100


and alters the operational characteristics of the vehicle in response to the vehicle operation response signal. The second communicating means


31


may, for example, include the above control devices for controlling operation of the vehicle


100


and the hardwire connection between the controller


1000


those control devices. The control devices may include the above ignition cut-off switch, brake activation switch, air bag actuation switch, side curtain actuation switch, external hazard lights activation switch, and/or steering lock mechanism, as described above. For example, the controller


1000


determines if a hazard exists and, if it does, sends an activation signal to some or all of the above control devices.




The controller


1000


analyzes the health condition signal derived from the first output signal


110


of first sensing means


11


and determines whether the driver


1


should be warned concerning the driver's health condition. If the controller


1000


determines that the driver


1


should be warned, the third communicating means


33


communicates a health alarm response signal to the driver


1


and informs the driver that the health condition of the driver requires a change in conduct by the driver. The third communicating means


33


may, for example, include various health alarm devices and a hardwire connection between the controller


1000


and those health alarm devices. The health alarm devices alert the driver


1


that a condition is occurring to the driver that places the driver at a high level of medical risk and impairs, or is about to impair, the driver's ability to operate the vehicle


100


. The health alarm devices may include a visual warning device such as a dashboard “Health Alarm” light being illuminated or flashing, an auditory warning device such as a horn sounding off, and/or a tactile warning device such as a mechanism for vibrating the steering wheel, vehicle seat, and/or accelerator pedal.




The controller


1000


analyzes the vehicle operation signal derived from the second output signal


120


of the second sensing means


12


and determines whether the driver


1


should be warned concerning the driver's operation of the vehicle


100


. If the controller


1000


determines that the driver


1


should be warned, the fourth communicating means


34


communicates a vehicle operation alarm response signal to the driver


1


and informs the driver that the operation of the vehicle


100


over time requires a change in conduct by the driver. The third communicating means


33


may, for example, include various operational alarm devices and a hardwire connection between the controller


1000


and those operational alarm devices. The operational alarm devices alert the driver


1


that the driver is placing the driver and the vehicle


100


at a high level of risk and the driver's ability to safely operate the vehicle is, or is about to be, impaired. The operational alarm devices may include a visual warning device such as a dashboard “Operational Alarm” light being illuminated or flashing, an auditory warning device such as a horn sounding off within the vehicle


100


, and/or a tactile warning device such as a mechanism for vibrating the steering wheel, vehicle seat, and/or accelerator pedal.




The controller


1000


analyzes a third output signal


350


from a visual sensor


351


that detects the eye blink duration of the driver


1


and determines whether the driver should be warned concerning the driver's possible fatigue level. If the controller


1000


determines that the driver


1


should be warned, the fifth communicating means


35


communicates a fatigue alarm response signal to the driver


1


and informs the driver that the eye blink duration of the driver over time requires a change in conduct by the driver. The fifth communicating means


33


may, for example, include various fatigue alarm devices and a hardwire connection between the controller


1000


and those fatigue alarm devices. The fatigue alarm devices alert the driver


1


that the driver is falling asleep and that this impairs, or is about to impair, the driver's ability to safely operate the vehicle


100


. The fatigue alarm devices may include a visual warning device such as a dashboard “Fatigue Alarm” light being illuminated or flashing, an auditory warning device such as a horn sounding off within the vehicle


100


, and/or a tactile warning device such as a mechanism for vibrating the steering wheel, vehicle seat, and/or accelerator pedal.




The obstacle detection and collision avoidance system and operational event recording system with which the above apparatus


10


may operate includes a plurality of obstacle sensors


40


and receiver/transmitter modules (such as an antenna/microwave transceiver


200


) that may be strategically located within the vehicle


100


. As viewed in

FIG. 5

, one antenna/microwave transceiver


200


is located in the front of the vehicle


100


and one antenna/microwave transceiver


200


is located in the rear of the vehicle. Each of the sensors


40


and antenna/microwave transceivers


200


are electrically coupled to a controller, for example, the controller


1000


. The controller


1000


includes a front end electronics section


300


and a digital electronics section


500


. Each antenna/microwave transceiver


200


is associated with a front end electronics section


300


.




Transceivers (not shown) may also be installed on the sides of the vehicle


100


to detect obstacles in the vehicle's “blind spot”. Each of the sensors


40


independently collects information about the environment in which the vehicle


100


is operating.





FIG. 2

is a simplified block diagram of the radar system


1001


of this feature. The system


1001


detects objects (targets) in the environment surrounding the vehicle


100


, determines the range and relative motion of each target with respect to the vehicle


100


, and alerts the driver


1


of potential hazards that could result from the presence or motion of such targets.




The antenna/microwave transceiver section


200


of the system


1001


transmits and receives Radio Frequency (RF) signals. The controller


1000


compares received signals and transmitted signals. A difference signal is generated having a frequency equal to the difference between the frequency of the transmit and the receive signal. The difference signal is coupled to the front end electronics section


300


. The front end electronics section


300


digitizes the difference signal. The digitized difference signal is coupled to the digital electronics section


500


, which determines the range and relative motion of each target. The digital electronics section


500


is coupled to an input/output module, such as a display and sensor section


600


. The display and sensor section


600


has a plurality of sensors that indicate to the system


1001


the status of various vehicle controls.




The display and sensor section


600


also produces audio, visual, and/or tactile indications for presentation to the driver


1


similar to the third, fourth, and/or fifth communicating means


33


,


34


,


35


, discussed above. The radar system


1001


is capable of determining the rate at which a target is approaching, or retreating, and the distance to a plurality of different targets. The radar system


1001


may also determine the special relationship of the vehicle


100


to the roadway (i.e., whether the vehicle is centered within an appropriate travel lane and/or whether the roadway is straight or curved with a radius of curvature).




A removable, externally readable, non-volatile, solid-state memory event recording apparatus, such as ERA


1005


, may be coupled to the controller


1000


. The ERA


1005


may alternatively be an internal part of the controller


1000


, as viewed in FIG.


6


. The ERA


1005


records the output of each of the sensors


40


and information about targets detected by the radar system


1001


. The ERA


1005


may use digital signal processing in conjunction with the apparatus


10


and the radar system


1001


. The radar system


1001


and ERA


1005


are referenced by way of example, but the apparatus


10


could be readily adapted to be used in conjunction with other radar systems and ERA's.




Using the ERA


1005


in conjunction with the radar system


1001


, as well as the controller


1000


, allows recording of important data relating to obstacles in the path of the vehicle


100


that were detected by the radar system. This type of information may be useful in accident reconstruction, as well as in determining a driver's ability to safely operate the vehicle


100


. The driver's performance in avoiding these obstacles may also be recorded and incorporated into the evaluation, by the controller


1000


, of the driver's fitness to safely operate the vehicle


100


.




Referring to

FIG. 3

, the antenna/microwave transceiver


200


of the radar system


1001


transmits a radar signal from a radar transmitter


151


via a radar antenna


211


, and receives reflected Doppler shifted radar echoes in a receiver


152


through the antenna


211


. The controller


1000


is coupled to the antenna/microwave transceiver


200


and contains a modulation and timing circuit


212


that controls the transmission of the radar signal and an A/D converter


311


for converting the received echo signal into a digital data stream. The modulation and timing circuit


212


and the A/D converter


311


may be part of the front end electronics


300


of FIG.


2


. The controller


1000


further includes a signal processing module (such as the digital electronics section


500


of FIG.


2


). The signal processing module


500


includes a digital signal processor (DSP)


508


, a microcontroller


510


, and a field programmable gate array


504


, configured to control the flow of digital radar data to the DSP


508


under the control of the microcontroller


510


. The signal processing module


500


is also coupled to the display and sensor section


600


.




The display and sensor section


600


provides information from the sensors


40


to the microcontroller


510


for use in calculating a hazard level. The hazard level is presented by targets indicated from the received radar signal.




The digital electronics section


500


generates information from the transmitted and received radar signal, such as the closing rate (CR) of a target with respect to the vehicle


100


, the distance (D) of various targets, and the direction of movement (towards or away from) of the targets with respect to the vehicle. The display and sensor section


600


has a display for indicating to the driver


1


an alarm (for example, flashing a dashboard “Collision” warning light to the driver


1


if a another vehicle is approaching too rapidly, and/or, in extreme conditions, automatically activating the vehicle brakes and/or air bag or disabling the vehicle


100


). The communicating means


31


,


32


described above may be utilized here, as well.




In operation, the radar system


1001


communicates information to the microcontroller


510


from the DSP


508


. The microcontroller


510


calculates the range and relative speed of each target. The determination of the relative speed and distance is directly calculated by multiplying the frequency and phase difference by fixed factors, since the phase is linearly proportional to distance to (or range of) the target according to the formula:







R=C





1


−θ


2


)/(4π(


f




1




−f




2


)).




In the range formula, R is the range in feet, C is the speed of light in feet/second, f


1


is the frequency of a first channel signal, and f


2


is the frequency of a second channel signal. Frequency is linearly proportional to the relative speed of the target according to the formula:








f




d


=72(


Hz


·hours/mile)×


V


(miles/hour)






In the relative speed formula, f


d


is the frequency shift due to the Doppler phenomenon, and V is the relative velocity of the target with respect to the transceiver


200


. However, other means to map the frequency to a relative speed and the phase relationship to range may be used. For example, a table, stored in the controller


1000


, may be used to cross-reference frequency and phase to relative speed and distance, respectively.




If the data is not within selected preset limits, it is deemed to be invalid and is disregarded. If the data is within the preset limits, the microcontroller


510


compares the new target range and relative speed with ranges and relative speeds previously recorded. If the range and relative speed of a target is consistent with the range and relative speed of a previously recorded target (i.e., if the difference between the range and speed of a new target and the range and speed of a previously recorded target is within a predetermined amount), the microcontroller


510


updates the range and relative speed previously recorded with the newly received range and relative speed. If the new target does not correspond to an existing target, the range and relative speed are stored and a new target is thus defined.




When the microcontroller


510


fails to receive data that closely matches a previously recorded target, the previously recorded target is assumed to have left the environment and the range and relative speed are dropped from the record. Thus, the radar system


1001


identifies and tracks a multiplicity of targets concurrently.




The microcontroller


510


may employ a target priority system, for example, to determine which one of the multiplicity of targets presents the greatest hazard level. The radar system


1001


will then assign a hazard priority and alert the driver


1


with the appropriate level of urgency (i.e., flash the “Collision” warning light with greater frequency). The radar system


1001


continues to track and reevaluate the hazard priority assigned to each target. If the range and relative speed of an older target fails to be similar to the range and relative speed of newer targets, the radar system


1001


discontinues tracking the old target while continuing to track each of the remaining targets. A hazard algorithm may be used which is as simple as alerting the driver


1


that a target is present within a range of 500 ft. More sophisticated algorithms may alternatively be used.




In the context of the obstacle detection and collision avoidance system, the controller


1000


controls indicators and/or controls various aspects of vehicle operation (for example, flashing a dashboard warning light to the driver


1


if the vehicle


100


is approaching too rapidly, and/or, in extreme conditions, automatically activating the vehicle brakes and/or air bag).




The apparatus


100


may utilize appropriately selected outputs from the sensors


40


, the first and second sensing means


11


,


12


, and the radar system


1001


, which have been recorded in the ERA


1005


(which may include the outputs recorded during past and present trips), to develop a profile of the driver


1


. The driver's performance over a period of time is compared to a standard derived from the personal profile calculated using the driver's past performance. The results of the comparison are used to partially determine the driver's current fitness to safely operate the vehicle


100


.




If the driver's performance at any time during a trip is found to be below the personal standard calculated for that driver


1


, the driver may be alerted that driving performance is not up to the driver's personal standard. If the driver's performance continues to degrade or does not improve, an indication of the driver's performance is communicated to a person at a location remote from the vehicle


100


to convey the health condition information from the first transmitting means


21


, vehicle operation information from the second sensing means


22


, and driver performance information from the event recording apparatus


1005


to enable the remote person to determine a suitable type of response. The remote person may be a police dispatcher or an EMS operator. If the driver's performance degrades still further, the remote person may transmit a signal to the controller


1000


to cause the vehicle


100


to cease operating, after a sufficient warning is provided to the driver


1


that such action is imminent. If an extremely hazardous situation exists, the remote person may also immediately transmit a signal to the controller


1000


to manually shut down the vehicle


100


from the remote location. Each step of the process, along with the data that is collected at each step of the process, is recorded in the ERA


1005


.




In addition to the information that is gathered by the sensors


40


, other information may also be gathered by the apparatus


10


. The controller


1000


may determine that the noise floor is above a selected threshold value. An assumption is then made that there is RF interference with the transmitting means


21


,


22


at one or more of the transmit frequencies. In such a case, for example, the controller


1000


would send a command to the ERA


1005


to flush the data that has thus far been stored and restart the recording. In addition, the microcontroller


510


may command a frequency voltage generator to change the level of the voltages applied to a Gunn diode, thereby changing the transmit frequency.




The first output signal


110


from the first sensing means


11


, the second output signal


120


from the second sensing means


12


, and output signals from the sensors


40


provide information which is used to determine whether there is a danger present and/or to alter the factors used to compute a hazard level. For example, if the controller


1000


determines that the windshield wipers of the vehicle


100


have been turned ON, thus indicating a rain condition, the preferred following distance utilized by the radar system


1001


for targets may be lengthened to account for longer stopping distances on a wet road. Additionally, the power output by the first and second transmitting means


21


,


22


may be increased to compensate for the attenuation caused by rain or snow conditions.




If a danger is present, the controller


1000


may activate an appropriate warning. The level of the danger may, for example, be based upon brake lag, brake range, vehicle speed, closing rate, target distance, and the reaction time of the operator. An average reaction time may be used. However, the controller


1000


could request the driver


1


to perform various exercises to establish the particular reaction time of the driver at the time that a trip begins. Alternatively, the driver's reaction to events that occur throughout a trip, stored in the ERA


1005


, may be used to determine the reaction time of the driver


1


. It should be understood that a wide variety of methods for warning the driver


1


of danger may be used, such as inducing vibration in the steering wheel, pedals, or other vehicle controls, such that the vibration increases as the level of the warning increases, and/or activating an audible tone that increases in pitch or volume as the level of the warning increases, as discussed above.




In operation, as viewed in

FIG. 6

, the information recorded in the ERA


1005


is assessed by the controller


1000


and applied to a fitness algorithm which (1) generates a personalized performance standard for the driver


1


; and (2) compares the driver's performance over a recent, and relatively short, period of time to the personalized performance standard.




As viewed in

FIG. 4

, the driving environment may, for example, be classified by determining whether the vehicle is (1) stopped, (2) in an urban environment, (3) in a suburban environment, or (4) on an open highway. In the present example, environmental classification is determined using speed. Thus, if the speed is 0 mph, then the vehicle


100


is determined to be stopped. An urban environment is determined if the speed is within the range of 0-35 mph. A suburban environment is determined if the vehicle speed is in the range of 35-45 mph. Finally, a highway environment is determined if the speed exceeds 45 mph.




In addition to classifying the environment, certain time factors may be classified. The time factors include time of day (morning nadir, afternoon nadir, or other), trip length, and duty period as determined by length. The fitness algorithm classifies time factors, inasmuch as accidents may be more likely to occur during the early morning, pre-dawn hours, and during the mid-afternoon hours. In particular, when the end of a long trip or a long duty period occurs in conjunction with such time periods, the risk of an accident usually rises.




Certain profiles may then be generated. These profiles include characterizations of the history of the throttle, speed, headway (closure, distance, and phase as determined by margin), steering, headlights, windshield wipers, and/or turn signal use. The throttle profile may be determined in accordance with mean value and variability thereof, as is the speed profile. The headway profile may include: (1) the rate at which the vehicle


100


approaches obstacles, including other vehicles (i.e., closure); (2) the vehicle speed; (3) how smoothly the vehicle accelerates, decelerates, and closes on obstacles (i.e., jerk); (4) the sustained distance between the vehicle


100


and other vehicles, determined in terms of mean value and variability; (5) “phase margin” (i.e., a measure of the driver's reserve capacity to respond safely to particular conditions that might arise); and (6) headlights and windshield wipers may be monitored since they are indications of poor visibility and road conditions. The steering profile may be generated by monitoring the median frequency shifts, in other words, the variations in lane position. The frequency and amplitude of steering changes, correlated to the vehicle speed, may provide a simplistic means for determining lane position. Lane position is usually an important profile in determining driver fitness. The steering profile may be generated by monitoring median frequency shifts. Other more sophisticated methods may also be used. For example, the relative position and motion of other vehicles detected by the radar system


1001


may be used.




As viewed in

FIG. 4

, the various profiles may be used in conjunction with the various driving environments. Thus, when the vehicle


100


is stopped, the controller


1000


and/or the ERA


1005


may assess the throttle position, the number of times the driver


1


blinks his eyes, and duration of each such blink. Turn signals and the secondary tasks may not be included in the assessment when the vehicle


100


is not moving. However, the turn signals may be included when the vehicle


100


is stopped. The speed, rate of closure, distance, phase margin and steering may not be applicable when the vehicle


100


is stopped.




At the other extreme, when the vehicle


100


is determined to be in a highway environment, all of the profiles listed in the table of

FIG. 4

may be applicable. The urban and suburban environments may utilize selected ones of the profiles to the exclusion of others, as shown in the table.




If the vehicle


100


is determined to be in a highway environment, secondary task performance may be assessed. Lapses in response, such as substantial decreases in reaction time, are considered by the present invention to indicate drowsiness on the part of the driver.




The eye blink duration of the driver


1


is also assessed by the apparatus


10


. This may, for example, be accomplished by covert digitized video scanning for eye blinks longer than 200 msec in duration, as discussed above. This assessment may be used in all of the driving environments. Long duration eye blinks are usually interpreted as indicating a state of drowsiness on the part of the driver.




A performance distribution curve may be generated which indicates the level of a driver's performance at any one time with relation to his performance at another time. The driver's recent driving history may be used to generate short term profiles and to evaluate current secondary task performance. Driver patterns that show a driver's recent performance to be at the less desirable ends of that particular driver's performance distribution curve indicate a need for caution by the driver


1


.




The recent history of the driver


1


is updated. This updating is accomplished using new data derived from earlier steps.




As viewed in

FIG. 6

, one or more of the possible consequences of the data evaluation are then selected. The possible consequences include alerting the driver


1


, a remote person (along with specific health condition information and vehicle operation information), shutting down or limiting the operation of the vehicle


100


, and event recording. Upon determining that the driver


1


is operating below the personalized standard associated with that driver, the controller


1000


indicates that determination to the driver. Having been alerted to the fact that the driver's performance is below the calculated standard, the driver


1


has a predetermined amount of time to raise the level of performance to the level of the calculated standard.




If the driver


1


is not performing at the required level at the end of the predetermined period, the controller


1000


transmits a message to the remote person at the remote location who is responsible for ensuring the safety of the driver and vehicle


100


. If the driver's performance does not improve a required amount within a predetermined amount of time after the message is transmitted, a warning is presented to the driver indicating that a shut-down of the vehicle


100


is imminent after a predetermined time. The amount of time until the shut-down will occur is communicated to the driver


1


. Additionally, both strong visual and audio warnings may be given to the driver


1


to ensure that the driver is aware of the impending shut-down. The shut-down can be implemented as a gradually increasing inability to maintain speed, thus allowing the driver


1


to find a safe location to park the vehicle


100


. A remote shut-down disable may be provided which permits the remote person, responsible for the safety of the driver


1


and vehicle


100


to override the shut-down for limited periods to afford the driver additional time to find an appropriate place to park the vehicle. Each action taken in accordance with the fitness algorithm is recorded on the ERA


1005


, along with the continuing stream of information from the sensors


11


,


12


,


40


and the radar system


1001


.




As another example, in order to enforce mandatory rest stops, the controller


1000


could be programmed to independently disable the vehicle


100


for a fixed period of time after a stop or until an authorization code is provided by the remote person (such a code could be provided to the controller


1000


by means of a 10-key keypad). Also, the remote person may have the capability to immediately shut down the vehicle


100


at any time.




It should be understood that the apparatus


10


may be used in conjunction with any microcontroller-based or microcomputer-based automotive electronic system that gathers data about various vehicle performance and environment factors and can control the loading of such information into a memory device. It will be understood that various modifications may be made without departing from the spirit and scope of the invention. For example, the number of sensors that are used to collect information regarding the vehicle, driver, and environmental conditions may be far less than those that have been cited herein. Also, the invention is not limited to only those sensors that have been listed herein. Furthermore, the number and type of responses to a driver's failure to meet the personal standard established for that driver are not limited to those cited herein. Nor are the particular responses cited herein required as a part of the present invention. Further, the standard may be determined by a method other than the method recited herein. For example, a system in which a standard that applies equally to all drivers would be within the scope of the present invention. Still further, any method for recording the events and conditions could be used in the present invention. Thus, the ERA described herein is provided as an example and need not be present in the form described. No radar system is required in the present invention, but is disclosed as an example of a means for collecting information regarding the environment in which the vehicle and driver are operating. Accordingly, it is to be understood that the inventive apparatus


10


is limited only by the scope of the appended claims.




Once the vehicle


100


is shut down, the remote person may utilize the health condition and vehicle operation information from the controller


1000


to respond in other suitable ways, such as sending a tow truck, EMS unit, fire truck, coroner, and/or police unit to the location of the vehicle. A known Global Positioning System (GPS) may be used for communicating the position of the vehicle


100


to the remote person at any given time.




In accordance with the present invention, a method for helping to protect the driver


1


of the vehicle


100


may include following steps: sensing at least one health condition of the driver


1


; producing a first output signal


110


indicative of the health condition of the driver


1


; sensing operational characteristics of the vehicle


100


over time; producing a second output signal


120


indicative of the operation of the vehicle


100


over time; and transmitting a health condition signal derived from the first output signal


110


and a vehicle operation signal derived from the second output signal


120


to a person at a location remote from the vehicle


100


to convey health condition and vehicle operation information to the person and to enable the person to determine a suitable type of response.




The method may further include the following steps: communicating the health condition signal derived from the first output signal


110


to the vehicle


100


; communicating the vehicle operation signal derived from the second output signal


120


to the vehicle


100


; and altering the operational characteristics of the vehicle


100


in response to the health condition signal and the vehicle operation signal.




The method may still further includes the following steps: communicating an alarm signal derived from the first output signal


110


to the driver


1


; and informing the driver


1


that the health condition of the driver


1


requires a change in conduct by the driver.




The method may still further yet include the following steps: communicating an alarm signal derived from the second output signal


120


to the driver


1


; and informing the driver


1


that the operation of the vehicle


100


over time requires a change in conduct by the driver


1


.




The health condition sensing step may include sensing audible characteristics driver


1


such as breathing characteristics, speech characteristics, and heart rate characteristics. The health condition sensing step may further include sensing the heat emission characteristics of the vehicle occupant by use of an infrared sensor. The method may also include the step of sensing eye blink duration of the driver


1


by use of a visual sensor.




From the above description of the invention, those skilled in the art will perceive improvements, changes and modifications. Such improvements, changes and modifications within the skill of the art are intended to be covered by the appended claims.



Claims
  • 1. An apparatus for helping to protect an occupant of a vehicle, the apparatus comprising:means for non-intrusively sensing at least one health condition of the occupant of the vehicle and for producing a first output signal indicative of the health condition of the vehicle occupant; a controller operatively connected to the means for non-intrusively sensing at least one health condition of the occupant and for receiving the first output signal, the controller analyzing the first output signal and outputting a health condition signal that indicates the at least one health condition of the occupant; transceiver means for transmitting the health condition signal to a person at a location remote from the vehicle to enable the person to determine a suitable response, the transceiver means further being adapted for receiving and communicating a response signal from the person at the remote location to the controller; and at least one control device connected to the controller so as to be responsive to both the health condition signal and the response signal for altering at least one operational characteristic of the vehicle.
  • 2. The apparatus as set forth in claim 1 wherein the at least one control device of the vehicle includes at least one of an ignition cut-off switch, an air bag actuation switch, a side curtain actuation switch, and a steering lock mechanism.
  • 3. The apparatus as set forth in claim 1 further including:means for communicating an alarm signal derived from the first output signal to the vehicle occupant for informing the vehicle occupant that the health condition of the vehicle occupant requires a change in conduct by the occupant.
  • 4. The apparatus as set forth in claim 1 wherein the means for non-intrusively sensing includes an audio sensor for sensing audible characteristics of the vehicle occupant.
  • 5. The apparatus as set forth in claim 4 wherein the sensed audible characteristics of the vehicle occupant include:breathing characteristics, speech characteristics, and heart rate characteristics.
  • 6. The apparatus as set forth in claim 1 wherein the means for non-intrusively sensing includes an infrared sensor for sensing a body temperature of the vehicle occupant.
  • 7. The apparatus as set forth in claim 1 wherein the means for non-intrusively sensing includes a visual sensor for sensing eye blink duration of the vehicle occupant.
  • 8. A method for helping to protect an occupant of a vehicle, the method comprising the steps of:sensing at least one health condition of the occupant of the vehicle; providing a first output signal indicative of the at least one health condition of the vehicle occupant to a controller; analyzing the first output signal in the controller; outputting a health condition signal from the controller; transmitting the health condition signal to a person at a location remote from the vehicle to enable the person to determine a suitable type of response; monitoring for a response signal from the person at the remote location and communicating the response signal to the controller; and altering at least one operational characteristic of the vehicle with at least one control device, the at least one control device being connected to the controller so as to be responsive to both the health condition signal and the response signal.
  • 9. The method as set forth in claim 8 further including the step of:communicating an alarm signal derived from the first output signal to the vehicle occupant for informing the vehicle occupant that the at least one health condition requires a change in conduct by the occupant.
  • 10. The method as set forth in claim 8 wherein the step of sensing at least one health condition further includes the step of sensing audible characteristics of the vehicle occupant.
  • 11. The apparatus as set forth in claim 10 wherein the step of sensing audible characteristics of the vehicle occupant further includes the step of sensing at least one of breathing characteristics, speech characteristics, and heart rate characteristics of the occupant with an audio sensor.
  • 12. The method as set forth in claim 8 wherein the step of sensing at least one health condition further includes the step of sensing a body temperature of the vehicle occupant with an infrared sensor.
  • 13. The method as set forth in claim 8 wherein the step of sensing at least one health condition further includes the step of sensing eye blink duration of the vehicle occupant by use of a visual sensor.
  • 14. The method as set forth in claim 8 further including the following steps:detecting obstacles external to the vehicle; and determining whether a collision by the vehicle with the obstacles is imminent.
  • 15. The method as set forth in claim 8 further including the following steps:recording the at least one operational characteristic of the vehicle; and developing a profile for defining a normal operating pattern the vehicle occupant.
  • 16. An apparatus for helping to protect an occupant of a vehicle, the apparatus comprising:means for non-intrusively sensing at least one health condition of the occupant of the vehicle and for producing a first output signal indicative of the health condition of the vehicle occupant; a controller operatively connected to the means for non-intrusively sensing at least one health condition of the occupant and for receiving the first output signal, the controller analyzing the first output signal and outputting a health condition signal that indicates the at least one health condition of the occupant; transceiver means for transmitting the health condition signal to a person at a location remote from the vehicle to enable the person to determine a suitable type of response, the transceiver means further being adapted for receiving and communicating a response signal from the person at the remote location to the controller; at least one control device connected to the controller so as to be responsive to both the health condition signal and the response signal for altering at least one operational characteristic of the vehicle; means for sensing the at least one operational characteristic of the vehicle and for producing a second output signal indicative of the at least one operation characteristic of the vehicle; and means for communicating a vehicle operation signal, which is derived in the controller from the second output signal, to the at least one control device, the at least one control device, in response to the vehicle operation signal, altering the at least one operational characteristic of the vehicle.
  • 17. The apparatus as set forth in claim 16 further including:means for transmitting the vehicle operation signal to the person at the location remote from the vehicle to enable the person to determine a suitable type of response, the means for transmitting the vehicle operation signal being operatively connected to the controller.
  • 18. The apparatus as set forth in claim 16 further including:means for communicating an alarm signal derived from the second output signal to the vehicle occupant for informing the vehicle occupant that the operation of the vehicle requires a change in conduct by the occupant.
  • 19. A method for helping to protect an occupant of a vehicle, the method comprising the steps of:sensing at least one health condition of the occupant of the vehicle; providing a first output signal indicative of the at least one health condition of the vehicle occupant to a controller; analyzing the first output signal in the controller; outputting a health condition signal from the controller; transmitting the health condition signal to a person at a location remote from the vehicle to enable the person to determine a suitable type of response; monitoring for a response signal from the person at the remote location and communicating the response signal to the controller; altering at least one operational characteristic of the vehicle with at least one control device, the at least one control device be connected to the controller so as to be responsive to both the health condition signal and the response signal; sensing the at least one operational characteristic of the vehicle; providing a second output signal indicative of the at least one operational characteristic to the controller; analyzing the second output signal in the controller; providing a vehicle operation signal from the controller to the at least one control device; and altering the at least one operational characteristic of the vehicle in response to the vehicle operation signal.
  • 20. The method as set forth in claim 19 further including the step of:transmitting the vehicle operation signal to the person at the location remote from the vehicle to convey the at least one operational characteristic to the person and to enable the person to determine a suitable type of response.
  • 21. The method as set forth in claim 19 further including the step of:communicating an alarm signal derived from the second output signal to the vehicle occupant for informing the vehicle occupant that the at least one operational characteristic of the vehicle requires a change in conduct by the occupant.
US Referenced Citations (19)
Number Name Date Kind
4439824 Mayer Mar 1984 A
4665385 Henderson May 1987 A
4909260 Salem et al. Mar 1990 A
5033000 Littlejohn et al. Jul 1991 A
5465079 Bouchard et al. Nov 1995 A
5488353 Kawakami et al. Jan 1996 A
5499182 Ousborne Mar 1996 A
5521580 Kaneko et al. May 1996 A
5574426 Shisgal et al. Nov 1996 A
5574641 Kawakami et al. Nov 1996 A
5653462 Breed et al. Aug 1997 A
5758299 Sandborg et al. May 1998 A
5801763 Suzuki Sep 1998 A
5805079 Lemelson Sep 1998 A
RE35920 Sorden et al. Oct 1998 E
5829782 Breed et al. Nov 1998 A
5901978 Breed et al. May 1999 A
5942979 Luppino Aug 1999 A
6060989 Gehlot May 2000 A