Patent Grant
9848814
The present disclosure relates to a vehicle seat, and particular to a vehicle seat including a sensor. More particularly, the present disclosure relates to a vehicle seat including one or more sensors configured to sense a physiological attribute, condition, and/or state of an occupant sitting on the vehicle seat.
A vehicle seat in accordance with the present disclosure includes a seat bottom and a seat back. The seat back is coupled to the seat bottom and arranged to extend upwardly away from the seat bottom. The vehicle seat further includes an electronics system coupled to the vehicle seat.
In illustrative embodiments, the electronics system is configured to provide means for sensing a physiological attribute of an occupant sitting on the vehicle seat through impeding barriers, such as clothing worn by the occupant, so that a predetermined action may be taken in response to the physiological attribute detected by the electronics system.
In illustrative embodiments, the electronics system includes an electrocardiogram (ECG) system. The ECG system is coupled to the vehicle seat to sense electrical signals in the occupant through impeding barriers, such as the occupant's clothing, and covert the electrical signals to a heart rate of the occupant.
In illustrative embodiments, the electronics system includes an oximetry system. The oximetry system is coupled to the seat bottom to sense oxygen in the occupant's blood through impeding barriers, such as the occupant's clothing, and convert the sensed oxygen content into a respiration rate.
In illustrative embodiments, a vehicle seat sensor system for detecting and processing physiological parameters is disclosed, where the system comprises a vehicle seat, configured to accommodate an occupant, at least one oxymetry sensor integrated into a first portion of the seat, wherein the oxymetry sensor is configured to switch between, or select from, multiple wavelengths of light for transmission to an occupant area above a surface of the vehicle seat. The system also comprises a control system operatively coupled to the oxymetry sensor, wherein the control system processes signals produced by the at least one oxymetry sensor to determine a level of oxygen saturation for the occupant. The system may be configured such that the level of oxygen saturation is processed to determine at least one of a pulse transit time, blood pressure, respiration, respiration rate and respiration depth of the occupant. The vehicle sensor system may further include at least one electrocardiogram (ECG) sensor integrated into a second portion of the vehicle seat, wherein the ECG sensor is operatively coupled to the control system. The control system may be configured to processes signals produced by the ECG sensor to determine at least one of heart rate, heart rate variability, stress level, a pulse-transit time and blood pressure of the occupant.
In illustrative embodiments, a method is disclosed for detecting and processing physiological parameters from a vehicle seat sensor system, where the method includes the steps of configuring at least one oxymetry sensor, integrated into a first portion of a vehicle seat to switch between, or select from, multiple wavelengths of light for transmission to an occupant area above a surface of the vehicle seat. After receiving signals from the at least one oxymetry sensor, a level of oxygen saturation is detected in a control system for the occupant in the vehicle seat. The method may further include the steps of processing the detected levels of oxygen saturation in a control system to determine at least one of a pulse transit time, blood pressure, respiration, respiration rate and respiration depth of the occupant. At least one electrocardiogram (ECG) sensor may also be integrated into a second portion of the vehicle seat to receive electrical signals from the occupant, wherein the control system processes the ECG signals to determine at least one of a heart rate, heart rate variability, stress level, a pulse-transit time and blood pressure of the occupant.
Additional features of the present disclosure will become apparent to those skilled in the art upon consideration of illustrative embodiments exemplifying the best mode of carrying out the disclosure as presently perceived.
The detailed description particularly refers to the accompanying figures in which:
A vehicle seat 10, in accordance with the present disclosure, includes a seat bottom 12, a seat back 14, and an electronics system 16 as shown
As shown in
ECG sensor system 18 of
First and second ECG receivers 24, 26 and ECG mat 28 cooperate to provide an ECG sensor 34. ECG sensor 34 is coupled to a seat cushion 36 and surrounded by trim 38 as shown in
Oximetry sensor system 20 includes a first oximetry sensor 31 and a second oximetry sensor 32 as shown in
With regard to oximetry sensors 31, 32, and for purposes of background, oxygen saturation refers to oxygenation, or when oxygen molecules (O2) enter the tissues of the human body. In the human body, blood is oxygenated in the lungs, where oxygen molecules travel from the air and into the blood. Oxygen saturation, also called O2 sats, is a measure of the percentage of hemoglobin binding sites in the bloodstream occupied by oxygen. Measurement of a subject's oxygen saturation provides one indication of the subject's overall health and, more particularly, the subject's pulmonary and cardiovascular health as both the pulmonary and cardio-vascular systems cooperate with each other and other systems of the human body to perform oxygenation. Arterial oxygenation is measured typically using pulse oximetry, which is a non-invasive technology for monitoring the saturation of a subject's hemoglobin.
In transmissive pulse oximetry techniques, a sensor is placed on a thin part of a subject's body, for example, a fingertip or earlobe, or in the case of an infant, across a foot. Light of two different wavelengths is passed through the subject's tissue to a photodetector. The changing absorbance at each of the wavelengths is measured, allowing determination of the absorbances due to the pulsing arterial blood alone, excluding venous blood, skin, bone, muscle, and fat. Another type of pulse oximetry is reflectance pulse oximetry. Reflectance pulse oximetry may be used as an alternative to transmissive pulse oximetry described above. Reflectance pulse oximetry does not require a thin section of a subject's body. Therefore, reflectance pulse oximetry is better suited to more universal application such as measurement of blood oxygen concentration in the feet, forehead, and chest. However, reflectance pulse oximetry also has some limitations.
Pulse oximetry is based on the principal that oxy- and deoxy-hemoglobin have different light absorption spectra. Reflective pulse oximetry measures the light absorption of light of two different wavelengths via reflectivity; that is, by knowing the amount of light transmitted and detecting the amount of light reflected using a photodector or similar sensor, one is able to determine the amount of light absorbed by the subject's body, i.e., the light absorption. However, the efficacy of non-contact pulse oximetry through intervening materials is subject to the absorption spectra of those materials.
In one embodiment, oximetry sensors 31, 32 are oximetry sensors, also called PulseOx sensors, which are configured to determine blood oxygenation through a variable makeup of intervening materials, and are configured with the ability to switch between or select from multiple wavelengths of light to be transmitted at the subject's body. Based on the reflected amount of light resulting from the various wavelengths, the sensor assembly is able to select one or more optimum wavelengths of light to be transmitted at the subject's body to determine the oxygen saturation for the subject via reflective pulse oximetry. One exemplary oximetry sensor is disclosed in U.S. Provisional Patent Application Ser. No. 61/730,374 filed Nov. 27, 2012, the contents of which is incorporated by reference in its entirety herein.
The teachings of U.S. Pat. No. 5,348,004, entitled “Electronic Processor for Pulse Oximeter” and U.S. Pat. No. 6,839,580, entitled “Adaptive Calibration for Pulse Oximetry” are both hereby incorporated by reference herein in their entirety. Each of those patents disclose various equipment, components, and methodology that may be used to implement the disclosed embodiments for sensing and monitoring blood oxygen in a seating environment.
The output of photodetector stage 405 is coupled to the input/output and processing stage 415 so as to enable analysis of the signal detected by the photodetector to perform calibration of the sensor assembly and detection and monitoring of the subject's blood oxygen content. The input/output and processing stage 415 includes a communication bus 420 that couples the sensor assembly components of stages 405 and 430 with the processor 425. This coupling and associated bidirectional communication enables the processor 425 to control emission of light via the light emission stage 430 and receive reflected signals from the photodetector stage 405 to perform processing for calibration, detection, and monitoring of the subject's blood oxygen content.
Light emission stage 430 includes one or two banks of LEDs, 435, 440. The LED banks may be optimized to use off-the-shelf LEDs at, for example, 850 nm and 950 nm light that penetrate a wide range of materials well. The light emission stage 430 may use additional or alternative banks of LEDs, for example, at additional wavelengths between 600 nm and 1100 nm for greater robustness of signal to noise determination. In implementation, the stages illustrated in
Embodiments disclosed herein provide the ability to perform noninvasive, non-distracting monitoring of blood oxygen contact through multiple layers of material. A calibration sub-routine for sensor and sensor assembly learns the best light components for a particular subject being monitored. This is because the light components used for reflective monitoring change depending on the amount, type, and number of impeding barriers, such as clothing layers discussed herein, for a particular subject. Thus, disclosed embodiments may use custom designed circuitry developed to read PulseOx (also known as photoplesythmography, or PPG) signals through variable layers of intervening clothing worn by a subject. Thus, disclosed embodiments enable sensor assembly calibration cycling through multiple wavelengths of light to enable a spectral analysis of materials and oxy/deoxy-hemoglobin absorption to ascertain optimal wavelengths for material penetration and determination of oxygen saturation curves while maximally identifying movement and other artifacts.
Disclosed embodiments of the sensor assembly may also be configured to perform auto-calibration, which enables the ability to penetrate an unknown makeup of intervening material to read changes in reflected light that accompany fluctuations in oxy- and deoxy-hemoglobin accompanying each heartbeat. Because some of the relevant aspects of PulseOx signals change at very slow time-scales (e.g., respiration changes 10+ seconds), simply using high-pass filtering of the signal merely creates substantial distortions and delays. To avoid the problems of high-pass filters, custom circuitry and algorithms were developed, and are disclosed in U.S. Provisional Patent Application Ser. No. 61/730,374, which is expressly incorporated by reference herein.
Referring back to
Oximetry sensors 31, 32 are coupled to a seat cushion 44 included in seat bottom 12 and surrounded by trim 46 as shown in
Control system 22 includes an analog to digital converter 48, a computer 54, and an output 56 as shown in
Processors and processor platforms for computer 54, as well as for any processor-based device disclosed herein, may be embodied as microcontrollers (MCUs). In certain illustrative embodiments, MCUs may be equipped with on-chip embedded Flash memory in which to store and execute programs for performing any suitable function described herein. By storing at least some of the programs, the MCU may advantageously have a very short start-up period and can be executing code very quickly. They may also utilize external memory to provide program and data storage.
An ECG-signal acquisition process 70 is shown, for example, in
Obtaining step 71 obtains electrical signals from occupant 50 as shown in
An oximetry signal acquisition process 80 is shown, for example, in
Obtaining step 81 obtains oximetry signals from occupant 50 as shown in
Heart rate 61 is calculated by computer 54 using heart-rate determination process 90 as shown in
Once heart rate 61 is determined by computer 54 in heart-rate determination process 90, computer 54 may then proceed to a heart-rate variability determination process 100 as shown in
Determining step 103 includes calculating a ratio of high frequencies to all frequencies. As an example, LF is the power contained in low frequencies (0.05-0.125 Hz) and HF is the power contained in high frequencies (0.2-0.3 Hz).
In this example, as the value approaches zero percent, an occupant's stress level is the lowest. As the value approaches 100 percent, the occupant's stress level is the highest.
Computer (54) may combine ECG signal 58 and oximetry signal 60 to obtain pulse-transit time 66 and blood pressure 62 as shown in
Blood-pressure determination process 130 may be further improved by adding an occupant's anthropomorphic data into the calculation. Specifically, knowledge about a distance between an occupant's heart and the location on the occupant's leg where one of the oximetry sensors is taking a measurement could improve accuracy. Faurecia's SMARTFIT® technology may be used to provide such anthropomorphic data to computer 54.
Computer 54 may use only oximetry signal 60 to determine respiration rate 68 and respiration depth 69 as shown, for example, in
Computer 54 executes the various processes described above using a processor 541 included in computer 54 as shown in
In one example, computer 54 is located in vehicle seat 10 and coupled to a controller area network included in the vehicle. In another example, computer 54 is located in spaced-apart relation to vehicle seat 10 and may be a computer which controls other equipment in the vehicle. In either example, output 56 may be used to provide audio, visual, or tactile feedback.
In one example, output 56 may be a video screen located in the vehicle which provides output from computer 54 and receives input from the occupant. Such input may be captured through one of inputs 543 and communicated to processor 541 for further processing. In another example, output 56 may also be an instrument panel included in the vehicle. In another example, output 56 may be a personal computer, a mobile device or smart phone, or communication device which sends data provided by processors 541 remotely. Data may be sent remotely to a doctor, a vehicle manufacturer, or any other suitable alternative. In the example of a doctor, the data may be used to prescribe treatments which may be performed with or without the vehicle seat. In another example, output 56 may be an actuator included in vehicle seat 10 which moves portions of vehicle seat 10. In this example, the actuator may be use to adjust an angle at which seat back 14 extends upwardly away from seat bottom 12.
Electronics system 16 obtains sensor data from signals obtained and computer 54 processes the signals to obtain information related to occupant 50. Electronics system 16 may cooperate with seat bottom 12, seat back 14, other vehicle systems, and systems separate from the vehicle to maximize occupant comfort, maximize occupant capacity to control the vehicle, maximize occupant health, and maximize the emotional well being of the occupant.
Additional information relating electronics systems in accordance with the present disclosure may be found in U.S. Provisional Patent Application Ser. No. 61/846,871 filed Jul. 16, 2013, U.S. Provisional Patent Application Ser. No. 61/730,349 filed Nov. 27, 2012, and International (PCT) Patent Application Serial No. PCT/US2013/071620 filed Nov. 25, 2013, all of which are expressly incorporated by reference herein
Occupant comfort may be maximized according to several exemplary modes such as an auto-fit mode, a smart-memory mode, a pro-active comfort mode, a pro-active thermal-adjustment mode, a next-position mode, a comfort-validator mode, a smart-massage mode, a targeted heating and cooling treatment mode, a recommended break-activity mode, a better circulation mode, a tension relief mode, an energize mode, and an arrival coach mode.
An auto-fit mode may use sensor data collected by electronics system 16 and other data communicated to computer 54 via input 543 to change the position and orientation of vehicle seat 10 and other components in the vehicle automatically. As a result, the occupant's comfort is maximized according their physiological data.
A smart-memory mode may use sensor data collected by electronics system 16 to determine an identity of the occupant and save settings of vehicle seat 10 according to the identity of the occupant. As a result, the electronics system 16 may position vehicle seat 10 and vehicle equipment according to the stored profile of the occupant associated with the identified identity.
A pro-active comfort mode may use sensor data collected by electronics system 16 to predict physical or thermal discomfort and make changes in response. Changes may occur before the occupant recognizes physical or thermal discomfort. The sensor data may be processed by computer 54 and compared with known or learned trends to predict physical or thermal discomfort. Computer 54 may learn that when certain sensor data occurs, an occupant manually performs an action such as turn down a blower included in the vehicle's HVAC system.
The pro-active thermal-adjustment mode may use sensor data collected by electronics system 16 to predict thermal discomfort and make changes in response. In one example, electronics system 16 may sense of thermal discomfort on an occupant's face and command via output 56 the vehicle's Heating, Ventilation, and Air Conditioning (HVAC) system to provide reduced heating or cooling only to the occupant's face.
A next-position mode may use sensor data collected by electronics system 16 to calculate a new arrangement of the vehicle seat based on known physiological data such as the dimensions of an occupant's body parts. As a result, computer 54 through output 56 commands vehicle seat 10 to make adjustments in position and orientation to further maximize patient comfort according to real-time sensor data.
A comfort-validator mode may use sensor data collected by electronics system 16 to determine if changes made by computer 54 via output 56 have resulted in objective measures of improved comfort. As a result, an occupant may determine if their comfort has actually improved as compared to whether they think it has improved.
A smart-massage mode may use sensor data collected by electronics system 16 and output 56 to provide constantly improving treatments to a specific occupant's stress and fatigue. In one example, a first massage algorithm may be established to treat an occupant. During the trip, the electronics system 16 may determine that a second different massage algorithm should be established to further mitigate the occupant's stress and fatigue.
A targeted heating and cooling treatment mode may use sensor data collected by electronics system 16 and output 56 to command the vehicle's Heating, Ventilation, and Air Conditioning (HVAC) system to provide localized heating or cooling to the occupant. As a result, energy used to provide thermal comfort to the occupant is minimized while occupant comfort is maximized.
A recommended break-activity mode may use sensor data collected by electronics system 16 before a break from travel is taken by the occupant and after a break is taken from travel by the occupant to determine the most effective break activities for use by the occupant. As an example, computer 54 may learn over time that when the occupant drives for at least two hours, the most effective break activity for the occupant is a specific stretching routing by comparing sensor data obtained before and after other break activities. In addition, computer 54 may determine that the previously performed break activities were insufficient and prescribe new break activities by monitoring post-break sensor data.
A better circulation mode may use sensor data collected by the electronics system 16 to determine that blood flow in one or more locations of an occupant is or may soon be poor. In one example, the oximetry sensors in the seat may be used by computer 54 to determine trends relating to blood flow. As a result, computer 54 may command through outputs 56 various features of the vehicle and vehicle seat to engage and maximize circulation in the occupant. In one example, computer 54 may command massage to be provided by the vehicle seat. In another example, computer 54 may command the vehicle seat to actuate changing and orientation of the vehicle seat to promote increased circulation. In yet another example, computer 54 may command heat to be applied to the occupant by the vehicle seat. In yet another example, computer 54 may suggest that a break be taken by the occupant and one or more break activities (e.g., stretching, walking, etc.) by the occupant.
A tension relief mode may use sensor data collected by the electronics system 16 to determine a tension level of an occupant. In one example, tension may be characterized as a measure of muscle tension of the occupant. Muscle tension may be determined from inputs such as stress, posture, and pressure exerted on the occupant. In one illustrative scenario, computer 54 may determine that an occupant is experiencing high tension. As a result, computer 54 may ask the occupant if the occupant wants to decrease sensed tension through use of one or more features. In another example, computer 54 may detect increased tension and automatically engage one or more features to minimize the occupant's tension.
In one example, computer 54, via output 56, may command massage to be provided by the vehicle seat. Various characteristics of massage may be varied by computer 54 to minimize tension such as frequency, intensity, location, and patterns of application to the occupant.
In another example, computer 54 may command application of heat or cooling to the occupant using the vehicle seat and or the vehicle heating and cooling systems to minimize tension. Various characteristics of heating and cooling include location of application, temperatures applied, duration, and patterns of application to the occupant. Patterns of application may include alternating hot and cold or slowly increasing hot or cold intensity.
In yet another example, computer 54 may command air flow in the cabin of the vehicle to be altered to minimize tension. In one example, cabin windows may be lowered to permit air from outside the vehicle to blow into the cabin. In another example, computer 54 may command pressurized air to be blown onto specific locations of the occupant with varying amounts of pressure, volume, and temperature.
In yet another example, computer 54 may command one or more characteristics of lighting in the vehicle to change to minimize tension. Various characteristics of lighting including location, color, wavelength, intensity, and duration of lighting.
In still yet another example, computer 54 may use music to minimize tension. Specifically, computer 54 may over time monitor how various music types influence tension in the occupant. As a result, computer 54 may determine that various music types minimize tension and play those types of music when tension is found to be high in the occupant.
In another example, computer 54 may engage various scents to be deployed to the cabin of the vehicle. The scents may be tied to known aroma therapies which are believed to minimize tension when applied to an occupant.
In still yet another example, computer 54 may provide commands to the occupant regarding suggested movements to minimize tension. In one illustrative example, computer 54 may detect increased tension and provide commands to the occupant to perform one or more stretching routines to minimize tension.
A tension ease mode may use various combinations of functions discussed above in tension relief mode. In one example, computer 54 may combine massage which is robust and intense in both the seat cushion and the seat back to be combined with lower levels of heat to be applied to the area having increased tension.
An energize mode may use sensor data collected by the electronics system 16 to determine an energy level of an occupant. In one example, computer 54 may use several inputs to determine the occupant's energy level. These inputs include: vehicle-based measures, behavioral measures, and physiological measures. Vehicle-based measures include counting a number of deviations from desired lane position and monitoring for changes in movement of a steering wheel and pressure on an accelerator pedal or brake pedal that deviate significantly from previously monitored normal use. Behavioral measures may be monitored through a camera in the cabin and include, for example, yawning, eye closure, eye blinking, and head position. Physiological measures include correlations between ECG signal, Electromyogram (EMG), eletrooculogram (EoG), and EEG may be used to determine drowsiness or low energy level of the occupant.
In one illustrative scenario, computer 54 may determine that an occupant has low energy. As a result, computer 54 may ask the occupant if the occupant wants to increase sensed energy through use of one or more features. In another example, computer 54 may detect decreased energy and automatically engage one or more features to increase the occupant's energy based on the occupant's location or schedule.
In one example, computer 54 via output 56 command massage to be provided by the vehicle seat. Various characteristics of massage may be varied by computer 54 to maximize energy of the occupant such as frequency, intensity, location, and patterns of application to the occupant. In addition, computer via output 56 may also simulate various yoga-like postures through changing an arrangement of the vehicle seat to support and suggest the yoga-like posture.
In another example, computer 54 may command application of heat or cooling to the occupant using the vehicle seat and or the vehicle heating and cooling systems to maximize energy of the occupant. Various characteristics of heating and cooling include location of application, temperatures applied, duration, and patterns of application to the occupant. Patterns of application may include alternating hot and cold or slowly increasing hot or cold intensity.
In yet another example, computer 54 may command air flow in the cabin of the vehicle to be altered to maximize energy of the occupant. In one example, cabin windows may be lowered to permit air from outside the vehicle to blow into the cabin. In another example, computer 54 may command pressurized air to be blown onto specific locations of the occupant with varying amounts of pressure, volume, and temperature.
In yet another example, computer 54 may command one or more characteristics of lighting in the vehicle to change to maximize energy of the occupant. Various characteristics of lighting including location, color, wavelength, intensity, and duration of lighting.
In still yet another example, computer 54 may use music to maximize energy of the occupant. Specifically, computer 54 may over time monitor how various music types influence energy level in the occupant. As a result, computer 54 may determine that various music types maximize energy of the occupant and play those types of music when energy level is found to be low in the occupant.
In another example, computer 54 may engage various scents to be deployed to the cabin of the vehicle. The scents may be tied to known aroma therapies which are believed to maximize energy of the occupant when applied to an occupant.
In still yet another example, computer 54 may provide commands to the occupant regarding suggested movements to maximize energy of the occupant. In one illustrative example, computer 54 may detect decreased energy and provide commands to the occupant to perform one or more stretching routines to maximize energy.
A blood flow mode may use sensor data collected by electronics system 16 to determine whether blood flow is being inhibited or is likely to be inhibited during a trip. In one example, sensor data may indicate that blood flow is currently sufficient, but computer 54 may examine route information and determine that blood flow is likely to be problematic at some time in the future due to limited opportunities to exit the interstate and walk around increasing blood flow. As a result, computer 54 may command for gentle heat to be applied form the cushion and for gentle massage to be applied to promote increased blood flow.
An arrival coach mode may use sensor data collected by the electronics system 16 to determine what state of mind the occupant should be at for a specific location or time of day. In one example, electronics system 16 may use Global Positioning System (GPS) data to determine a location of a vehicle and automatically engage one or more of the above mentioned modes so that the occupant is in the appropriate state of mind for the location. In one scenario, the electronics system 16 may determine the vehicle is approaching the occupant's home at the end of the day and that the occupant has high tension. As a result, computer 54 may engage the tension relief mode to minimize tension of the occupant. In another example, electronics system 16 may determine from an occupant's calendar that a work meeting is coming up shortly and the occupant's energy level is low. As a result, computer 54 may engage the energize mode to cause the occupant's energy level to increase in preparation for attending the meeting.
In one example, specific locations and meeting types may be programmed by the occupant for use with the arrival coach mode. In another example, the computer 54 may automatically determine through various factors that certain locations lead to increase tension and other locations lead to decreased tension. As a result, computer 54 may attempt to automatically raise the energy level of the occupant when entering high tension locations and decrease tension of the occupant when entering low tension locations.
Occupant capacity for operating the vehicle may be maximized according to several exemplary modes. Those modes include a driver-capability assessment mode, a behavior-coach mode, a check-in on mode, a time to see doctor mode, an attack alert mode, an attach-coach mode, and a right responder mode.
A driver-capability assessment mode may use sensor data collected by electronics system 16 to determine if the driver's capability to operate the vehicle is impaired due to overload, fatigue, drowsiness, stress, and alcohol or drug impairment. As a result, computer 54 may command via output 56 various equipment in the vehicle to communicate to the driver that their capability is impaired. Computer 54 may also take command of the vehicle to slow the vehicles speed or call for assistance.
A behavior-coach mode may use sensor data collected by electronics system 16 to determine an impact of the occupant's behavior of their capacity to operate the vehicle. As an example, computer 54 may log an incoming phone call followed by a spike in heart rate because the occupant was distracted by the phone call and surprised by changing road conditions. Thus, computer 54 may remind the occupant that various activities have caused distraction before.
A check-in on mode may use sensor data collected by electronics system 16 to determine that the occupant is operating at full capacity. In one example, computer 54 may communicate sensor data via output 56 to a remote person showing the remote person that the occupant is operating at a sufficient capacity. In this example, the occupant may be an elderly occupant the remote person may be a family member.
A time-to-see-doctor mode may use sensor data collected by electronics system 16 to determine that sensed data is indicative that a visit to the doctor is warranted. As an example, the computer 54 may determine that the occupant's blood pressure has been sufficiently high for several days. As a result, computer 54 may via output 56 communicate a suggestion to the occupant to visit with their doctor.
An attack alert mode may use sensor data collected by electronics system 16 to determine that the occupant is suffering from a medical attack such as a heart attack. As a result, computer 54 may command via output 56 that medical personnel or a family member contacted. Computer 54 may also cause the vehicle to be slowed and stopped and the hazard lights to be turned on.
An attach-coach mode may use sensor data collected by electronics system 16 to determine that the occupant is suffering from a medical attack such as a heart attack. As a result, computer 54 may communicate instructions via output 56 to the occupant which causes the occupant to respond to the attack in an optimal way. In one example, computer 54 may communicate to the occupant the need to slow down, pull over, and call for assistance.
A right responder mode may use sensor data collected by electronics system 16 to determine that the occupant's biometric data at the time of and after an accident. The occupant's actual biometric data may then be communicated by electronics system 16 to first responders so that the first responders are better prepared to treat the occupant. In another illustrative example, the electronics system 16 may store the occupant's biometric data over time. Once an accident occurs, the electronics system 16 may send both the historical biometric data and the biometric data from and after the accident to the first responders. In this example, the first responders are able to determine what biometric data is related to the accident rather than typical of the occupant. In yet another example, electronics system 16 gathers known medical data about the occupant and sends the known medical data to first responders along with the biometric data from the crash. In this example, first responders may be notified of an allergy or other medical information relevant to the occupant.
The occupant's emotional well being may be maximized according to several exemplary modes. Those modes include an alter-environment mode, a stress-mapper mode, a task-manager mode, an emotional-geotagging mode, and a mood-optimized playlist mode.
An alter-environment mode may use sensor data collected by electronics system 16 to change the environment of the occupant to maximize emotional well being. In one example, computer 54 may analyze collected sensor data to determine that a change in sound emitted from the vehicle's sound system would improve the emotional well being of the occupant.
A stress-mapper mode may use sensor data collected by electronics system 16 as well as other data collected by the vehicle to determine whether geographical locations and/or routes caused increased stress. As a result, computer 54 may be able to correlate specific locations, traffic patterns, and routes with increased stress and recommend alternatives to minimize stress.
A task-manager mode may use sensor data collected by electronics system 16, other data available from vehicle systems, and data provided by smart devices to determine an optimal arrangement of tasks to be completed. As a result, computer 54 may via output 56 suggest changes to the occupant's schedule, route, media, and phone to maximize productivity while minimizing stress.
An emotional-geotagging mode may use sensor data collected by electronics system 16 and other data, such as location data, provided by the vehicle to tie location with emotional state. In addition, the computer 54 may combine emotional data with communications received and recorded by the vehicle along with location. As a result, computer 54 may learn that various factors which influence the emotional state of the occupant.
A mood-optimized playlist mode may use sensor data collected by electronics system 16 to change the music playlist provided by the sound system of the vehicle. Computer 54 may map emotional state with songs played to determine a response which organizes songs to provide a therapy which minimizes stress. Computer 54 may monitor sensor data to confirm that the mood-optimized playlist is having the intended function and make changes in response to the sensor data obtained.
An occupant's health may be maximized according to several exemplary modes. Those modes include a health-metric gathering mode, a health-metric tracking mode, a health-metric sharing mode, a workout-optimizer mode, a destination-prep mode, and a posture coach mode.
A health-metric gathering mode may use sensor data collected by electronics system 16 to gather and store various health metrics like heart rate, blood pressure, and respiration rate. As a result, computer 54 may provide upon request stored or real-time health metrics about the occupant.
A health-metric tracking mode may use sensor data collected by electronics system 16 to track changes in health metrics over time by storing processed sensor data in memory 542 of computer 54 or communicating processed sensor data to a party remote from vehicle seat. As a result, health metrics may be viewed over a period of time.
A health-metric sharing mode may use sensor data collected by electronics system 16 to provide health metrics which may be shared intermittently or continuously with a third party. Computer 54 may via output 56 communicate to a doctor, for example, heart rate information collected over a period of time.
A workout-optimizer mode may use sensor data collected by electronics system 16 to determine a workout routine which arranges a workout to accomplish the occupants goals. In one example, the occupant may wish to maximize muscle gain and computer 54 may arrange a workout which maximizes muscle gain by sensing which muscles will benefit most from a workout and providing exercises which accomplish this result. Computer 54 also may analyze pre-workout sensor data and post-workout sensor data to determine if the workout was optimal. Computer 54 may also optimize an occupant's workout to maximize the occupant's metabolism.
A destination-prep mode may use sensor data collected by electronics system 16 and other data provided to computer 54 to prepare the occupant for their arrival at their destination. As a result, the occupant may be able to take steps which allow them to be in the best position to arrive at their destination. As an example, computer 54 may determine from sensor data that the occupant is drowsy and suggest that coffee or food may be beneficial prior to arrival so that the occupant is awake.
A posture coach mode may use sensor data collected by electronics system 16 to determine that the occupant's current posture while sitting on vehicle seat 10 could be improved. Computer 54 may provide via output 56 suggestions to the occupant of how to improve the occupant's posture along with benefits that may come from changes in posture such as improved mood, increased blood flow to certain areas of the back, reduced back pain, and better visibility.
A breathing coach mode may use sensor data collected by electronics system 16 other data provided to computer 54 to coordinate breathing of an occupant so that a desired outcome is achieved such as reduction in stress, increased calmness, increased oxygen content in the body, improved alertness, etc. In one example, computer 54 may cause the vehicle seat to define a breathing rhythm for the occupant by inflating a lumbar air bladder to suggest inhaling and deflating the lumbar air bladder to suggest inhaling. In another example, computer 54 may cause the vehicle seat to define a breathing depth by coordinating inflation of multiple bladders included in a seat back of the vehicle seat. Bladders may inflate in sequence from a bottom of the seat back to a top of the seat back to indicate depth and length of inhale. Similarly, bladders may deflate in sequence from top to bottom to indicate exhale. In another example, other seat functions such as linear or mechanical actuators may be used to communicate to the occupant how to breathe. In still yet another example, motor pulsing and massage may be used to communicate to the occupant how to breathe.
Usability and value of the vehicle may be maximized according to several exemplary modes. Those modes include an identification mode and an insight mode.
An identification mode may use sensor data collected by electronics system 16 to determine an occupant's identity. Computer 54 may examine various signals collected by electronics system 16 and use features of those signals to identify an occupant. In one example, time domain features may be extracted from the ECG signal and used to identify an occupant. In one example, computer 54 may collect data such as heart rate and breath rate and associate that data with a specific occupant based on features of the ECG signal currently being received by computer 54. As a result, the data collected by the computer 54 is associated and stored with the appropriate user. As a result, biometric history stored and transferred to a healthcare provider or first responder is confirmed to belong to the occupant.
Once the identification of the occupant is known, computer 54 may perform various activities. In one example, computer 54 tracks an occupant's behaviors such as selecting various modes of operation along with times and location. In addition, computer 54 also tracks an occupant's biological response to those behaviors and actions to determine if more appropriate actions should be recommended next time or changes to the modes of operation should be made to obtain more desirable effects.
In another example, computer 54, when the occupant's identification is known, may also begin customizing modes of operation according to a specific occupant's preferences and known responses to modes of operation begins to track behavior of the occupant. In addition, computer 54 may communicate with an external device (e.g., FuelBand™, FitBit™ mobile phones, tablet computers, personal computers medical devices) to add additional information to an occupant's stored profile.
One example of operation is when an occupant is wearing an activity monitoring device and has been sitting at his or her desk with little activity for the previous eight hours. Once the occupant sits on the vehicle seat, computer 54 begins communicating with the activity monitoring device and understands the occupant has had little activity all day. As a result, the suggested mode of operation is customized (e.g., upright seat and vigorous massage) to the previous activity.
In a comparative example of operation, the occupant is wearing an activity monitor and has just completed a strenuous workout at the gym. Once the occupant sits on the vehicle seat, computer 54 begins communicating with the activity monitoring device and understands the occupant has just been very energetic. As a result, the suggested mode of operation is customized (e.g., reclined seat back, light massage, and low heat) to the previous activity.
In yet another example of operation, computer 54, when the occupant's identity is known to computer 54, coordinates music selection and play back with a computer included in the vehicle associated with music play back. Computer 54 may use ECG sensors, Pulse Ox sensors, and GSR sensors to determine an emotional state (e.g., stress) of the occupant when listening to different songs. As a result, computer 54 may automatically determine an occupant's music preference without affirmative interaction with the occupant. In addition, computer 54 may coordinate emotional responses to locations, situations, time of day, upcoming actions, and previous actions to improve suggestions for better music in the future.
In still yet another example, computer 54 may track an occupant's health over time when computer 54 knows the occupant's identity. In this example, an occupant's mood (determined through stress and other indicators), blood pressure, and circulation, among other health attributes, may be tracked over time and in response to use of various modes of operation or routines. In addition, computer 54 may determine that various patterns exist such as low energy each Friday morning. As a result, computer 54 may suggest various actions that the occupant may take outside the vehicle, inside the vehicle, modes of operation that may be performed by the vehicle and the vehicle seat, actions taken solely by the vehicle seat. Computer 54 may also notice certain biological responses of the occupant to various meetings, locations, weather, in-vehicle activities (e.g., firm braking, evasive maneuvers), out-of-vehicle activities (e.g., coming from the gym, coming from a long meeting, returning from a trip at the airport).
In some embodiments, the computer 54 may collect data from the sensors and/or portable devices over time and tag physiological conditions as they become known (e.g., restful state, sleepy state, active state, moderate stress state, etc.). Over time, computer 54 may perform normalization and/or averaging processing to establish baseline data for each condition. In an illustrative embodiment, sensor data from an external device may be normalized and transmitted to computer 54, where computer 54 may merge the normalized data together. In an illustrative embodiment, predetermined actions within a vehicle (e.g., seat adjustment, heating, cooling, etc.) may be tailored to modify an occupant's physiological state such that it approaches or approximates a baseline state (e.g., from moderately stressed state to relaxed state, from moderately fatigued state to moderately alert state, etc.).
In another example, computer 54 may obtain ECG signal 58 as shown in
In another example, computer 54 may obtain a photoplethysmographic (PPG) pulse 59 as shown in
In another example, certain vehicle features may be enabled or disabled based on the identity of the occupant. As an example, the computer 54 may detect that an owner's son who is sixteen is driving the vehicle. The computer 54 may also detect that an occupant other than one of the parents is in the passenger seat. As a result, the computer 54 may not allow the vehicle to be started due to pre-programmed restrictions put in place by the owner.
An insight mode may be used by the occupant to determine trends and changes in health, comfort, and state of mind over time. In one example, the electronics system 16 may determine an initial tension level of the occupant each day as the occupant returns home after work. Over time, the computer 54 may show that the tension relief, mode, for example, has reduced a tension level of the occupant over time so that the occupant is more relaxed when the occupant arrives at home. The computer 54 may communicate this information to the occupant via an in-vehicle display, an application used on a smart phone, tablet, or mobile computing device, or via a web browser. As a result, the occupant is able to see the changes over time caused by the electronics system 16.
Electronics system 16 includes ECG sensor system 18, oximetry sensor system 20, and control system 22 as shown in
As discussed previously, ECG sensor system 18 includes first and second ECG sensor 24, 26, ECG mat 28, and ECG unit 30 as shown in
In another illustrative embodiment, ECG sensor 34 is coupled to a seat cushion 36 and positioned to lie below trim 38 which extends around seat cushion 36 as shown in
In another illustrative embodiment, oximetry sensors 31, 32 are coupled to a seat cushion 44 included in seat bottom 12 and arranged to lie below trim 46 and extend around seat cushion 44 as shown in
In another example, electronics system 16 may further include a thermal sensor system. The thermal sensor system may be coupled to control system 22 and be configured to provide information relating to temperature and humidity distribution around an occupant, information relating to injured areas of an occupant, and information relating to temperature gradients around an occupant.
In the example where information relating to temperature and humidity distribution around the occupant is provided, personalized and automatic adjustments to heating and cooling of the occupant may be provided by computer 54 using the vehicle's HVAC system to target portions of the occupant for treatment. As a result of knowing specific hot and cold spots on the occupant's body, adjustments to heating and cooling of the occupant may occur in real time without occupant direction or control.
In the example where information relating to injured areas of the occupant is provided, increased blood flow to injured muscle areas may indicate to computer 54 the need for cooling in the area to minimize swelling, to decrease support in the are so that pressure is minimized on the damage area, or provide massage to promote increased blood flow to the area. In the example where information relating to temperature gradients around the occupant is provided, cooperation with other anthropometric data may be useful to target responses of the vehicle and vehicle seat.
The thermal sensor system may include a hydrothermal mat that includes heat-sensitive layers or an array of temperature sensors. The hydrothermal mat may be positioned to lie below the trim of the vehicle seat and be configured to sense heat through the trim whether the trim is cloth or leather. The hydrothermal mat would obtain heat information about a back side of the occupant. The thermal sensor system may also include an infrared camera coupled to the vehicle in such a position as to scan the occupant while seated in the vehicle seat. In another example, the infrared camera may be coupled to the vehicle in such a location so as to scan the occupant prior to being seated on the vehicle seat. An interface for providing such a scan and orienting the occupant during the scan may be the Faurecia SMARTFIT® technology.
Automobile sensor systems may be used to sense and monitor vehicle performance, including engine performance and diagnostics, tire pressure and security. Additional interest has developed in using other types of automobile sensor systems to monitor and enhance certain aspects of the end-user automobile driving experience. For example, automobile seat sensor technology has been deployed to enable such systems to identify automobile drivers, provide automobile security, enhance child safety, and the like.
With regard to automobile seat sensor systems, many systems provide limited information regarding (i) environmental and/or physiological parameters of occupants, and (ii) occupant seating environment and/or automobile cabin environment. Furthermore, certain sensors within such systems may be limiting, in that many sensors are cumbersome to integrate into the seating system, and awkward to deploy on the person of the occupant in the seat. For example, certain systems may require that sensors be physically attached to the skin of the occupant in order to detect physiological states or conditions. Other systems require occupants to wear custom-made clothing containing the sensors necessary for physiological detection. Moreover, the physiological datasets produced by conventional sensor systems do not adequately take into consideration the data produced from multiple, and sometimes different, types of sensors that may be part of a seat sensor system.
Accordingly, there is a need in to have a seat sensor system that is flexible to use and is capable of accommodating different kinds of occupants. The seat sensor system should be capable of detecting certain physiological parameters through one or more layers of clothing. The seat sensor system should also combine data produced from multiple sensors to provide more robust occupant physiological measurement.
Another seat sensor system 600 in accordance with the present disclosure is shown, for example, in
Processing apparatus 611 is configured to communicate with one or more portable devices 609 and a remote processing and/or storage facility 610. A portable device 609 may include a cell phone, tablet, laptop, wearable processor (e.g., FuelBand™, FitBit™) or any other suitable device, and be further configured to communicate with facility 610. Facility 610 is configured to provide larger-scale storage for processing apparatus 611, and further provide additional processing capabilities that may be offloaded from processing apparatus 611.
A GSR sensor 601 may be used to obtain data related to body tissue conductance. Body tissue conductance sensors can potentially give you a wide array of information from electrodermal activity (EDA) to the level of hydration and the fat percentage of an occupant's body tissue. An illustrative GSR sensor 601 includes two electrodes 703, 704 placed on different portions of the body and a small current is passed between them to assess the resistance of the body's tissue.
As shown in
In one illustrative example of use, GSR sensor 601 may be used to determine emotional responses of an occupant resting on a vehicle seat. Design of GSR sensor 601 models an occupant's skin as a resistor and the clothing as a capacitor in an RC circuit as suggested in
ECG sensor(s) 603 are configured to provide an ECG signal 618 to sensor processing 612 as suggested in
Filtered signal 641 then proceeds to operation 624 where peak cleaning and reliability of the signal is determined as suggested in
During operation 624, several sub-operations occur. As shown in
Next, operation 624 proceeds to sub-operation 644 in which Inter-Beat Intervals (IBI) are calculated using the peaks detected in sub-operation 643. In one example, IBI is the time elapsed between two consecutive detected peaks. In another example, some peaks may be either undetected (in which case the IBI would be too large) or noise artifacts (in which case the IBI would be too short). As a result, further processing is needed to obtain the desired IBI's.
Operation 624 then proceeds to a sub-operation 645 in which short IBI's are removed so as to remove noise artifacts. In one example, IBI's that are less about 300 milliseconds are removed. Once the short IBI's are removed, operation 624 proceeds to a sub-operation 646 in which the last several IBI's are buffered to provide a data set distribution of IBI's which is evaluated during sub-operation 653 as shown in
During sub-operation 653, the data set distribution of buffered IBI's is evaluated by calculating various statistics related to the data set. Sub-operation 653 includes several operations which include a delta reliability operation 647 in which a calculation is performed to determine how much the current IBI deviates from the median IBI (denoted as delta reliability). Sub-operation 653 further includes a distribution reliability operation 649 in which a calculation is performed to determine the Median Absolute Deviation (MAD) of the data set distribution. In one example, 1.5 multiplied by the MAD is used as a proxy for standard deviation of the data set distribution. Once delta reliability and the MAD are determined, sigmoid transfer function operations 648, 650 are applied using the inputs of delta reliability and (1.5*MAD). The lower the delta reliability (normalized by the standard deviation), the higher the reliability and vise versa, with the reliability falls off sharply after a certain threshold (depending on the parameters of the sigmoid function).
Once the operations 648, 650 are complete, sup-operation proceeds to a geometric average operation 651 in which a calculation of a ratio of MAD of IBI distribution to MAD of a uniform distribution on the range of +/−80*log(n) around the median of IBI distribution (where n is the size of the IBI buffer). This measure is used to assess the general non-uniformity of the IBI distribution, with the idea that the more uniform and wider the distribution, the less it is trustworthy. The ratio is identified for future use as H. The reliability of the distribution is then linearly decreasing with this measure: 1−min(H,1). The total reliability of the peak/IBI is calculated as a geometric average of the delta reliability and the distribution reliability, namely, sqrt(r(delta)*r(distribution)). Those IBI for which the total reliability is above a certain threshold (50% by default) are retained for the HRV spectrum calculation. A reliability score 652 is then output.
Pulse Ox sensors 602 are configured to provide a Pulse Ox signal(s) 619 to sensor processing 612 as suggested in
Depending on which biological data is being determined from the Pulse Ox signal 619, sensor processing 612 may handle Pulse Ox signal 619 differently. In the example of where Pulse Ox signal 619 is used to determine average heart rate 629, pulse transit time 630, respiration 631, and pulse ox best 632, filtered signal 641 goes through a similar set of operations 642-651 to provide a reliability of filtered signal 641. In the example where Pulse Ox signal 619 is used to determine respiration 631, Pulse Ox signal 619 is passed through operation 626 in which peaks and valleys are both detected.
Once sensor processing 612 is complete, the signals are then provided for biometric processing 613 in which biological data is calculated. In a first example, an ECG signal from each ECG receiver 24, 26 is then used to calculate Heart Rate (HR). HR is calculated as 60 seconds divided by IBI. In one example, each ECG receiver 24, 26 is used to calculate an associated HR 654-657 as shown in
During time-dependent weighting operations 655, 658, a decay of each HR 654, 657 is determined. The concept being that the older the HR, the less relevant it should be for the current calculation. The decay may be an exponential of the time difference between the time of the HR and now (the time of the calculation), scaled by an appropriate constant as shown in the formula below:
decayi=exp(−(timeNow−timei)/scale)
Average HR is then the weighted average of the HR signal with weights given by decay multiplied by reliability. Reliability may be calculated in a similar manner as discussed previously with operations 642-651:
The average reliability is the weighted average of the reliabilities with weights given by decay. In addition, reliability may be punished by the time passed between the last signal and now because we want reliability to fall when the signal becomes stale. Therefore, the weighted average is multiplied by the last decay:
In another example, Heart Rate Variability (HRV) 628 along with reliability of HRV may be determined as shown in
In another example, Pulse Arrival Time (PAT) 630, also called Pulse Transit Time (PTT) 630, is calculated along with blood pressure 634 as shown in
Blood pressure 634 is then calculated during blood pressure calculation operation 677 as shown in
Accuracy of blood pressure 634 may be increased through calibration of seat sensor system 600 to a known blood pressure value for an occupant. In one example, an occupant has their blood pressure obtained using a blood pressure cuff and then enters the data into seat sensor system 600. In another example, an electronic blood pressure cuff is coupled to an occupant while the occupant is resting on a vehicle seat including seat sensor system 600. The electronic blood pressure cuff them communicates with seat sensor system 600 to calibrate seat sensor system 600 while seat sensor system 600 is calculating blood pressure from pulse transit time so that the determined pulse transit time is calibrated to a known blood pressure reading in real time.
Seat sensor system 600 includes a communication module for communicating with other devices (e.g., smart phones, tablets, computers, activity trackers, medical devices), networks (e.g., the internet, a private network, the cloud), and other modules included in the vehicle. Such a communication module may be included in the vehicle seat, included in the vehicle and part of the vehicle equipment separate from the vehicle seat, or any other suitable alternative.
In one example, the communication module allows seat sensor system 600 to communicate health information or any other biological data to an occupant's physician. In another example, the communication module allows seat sensor system 600 to communicate an occupant's mood to friends and family via a social application.
In a further example, seat sensor system 600 may receive information from other seat sensor systems 600 included in other vehicles. This crowdsourcing of data may allow other occupant's experiences and to suggest routines and modes of operation for the occupant. The crowdsourcing data may also suggest that other occupants are experiencing increased stress due to problems with their travel route causing seat sensor system 600 to suggest an alternate route and/or modes of operation which minimize such increase in stress or tension.
Data may also come from other occupants riding within the vehicle to provide feedback to the driver occupant. In one illustrative example, a seat sensor system included in a passenger seat may determine that a chauffeur's driving style is scaring the passenger. As a result, seat sensor system 600 may suggest ways to alter the driving style to minimize the passenger's fear and anxiety.
Another embodiment of a vehicle seat 810, in accordance with the present disclosure, includes a seat bottom 12, a seat back 14, and an electronics system 816 as shown
As shown in
ECG sensor system 818 includes, for example, a first ECG receiver 24, a second ECG receiver 26, a third ECG receiver 25, a fourth ECG receiver 27, an ECG Drive Right Leg (DRL) unit 828, and an ECG unit 30 as suggested in
In one example, ECG receivers 24, 25, 26, 27 are use two at a time and may be aligned as suggested in
ECG receivers 24, 25, 26, 27 and ECG DRL 828 cooperate to provide an ECG sensor. ECG sensor is coupled to a seat cushion 36 and surrounded by trim 837, which may be cloth or leather, as shown in
In one example, trim 837 is perforated leather. Perforated leather is leather trim in which a plurality of small holes are formed in the leather so as to maximize ventilation of air between the occupant's skin and the leather. In another example, the various holes may be filled with material which has a higher conductivity than leather such a synthetic leather, a synthetic leather impregnated with conductive particles, an elastomeric material, an elastomeric material impregnated with conductive materials, or any other suitable alternative.
Oximetry sensor system 820 includes a first oximetry sensor 831 and a second oximetry sensor 832 as shown in
As a result of both oximetry sensors 831, 832 being located along the same leg of an occupant, determination of pulse arrival time 630 and blood pressure 634 may be simplified. As discussed previously, pulse arrival time 630 is the time elapsed between a heartbeat observed by first oximetry sensor 831 and the corresponding heartbeat observed by the second oximetry sensor 832. These values are calculated beginning with inputs pulse ox peaks and associated reliability scores for both pulse ox sensors 831, 832. Distance between pulse ox sensors 831, 832 is known and fixed, thus a time between detected peaks provides for a velocity of blood flowing in the area of the occupant's leg and PTT. Blood pressure 634 is related to the velocity of blood flow in that higher velocity indicates higher blood pressure and lower velocity indicates lower blood pressure. In one example, diastolic blood pressure (DBP) is estimated as 75−0.01*PTT and systolic blood pressure (SBP) is estimated as 200−(0.3*PTT).
Both oximetry sensors 831, 832 may be arranged along the right leg of an occupant. The right leg may be chosen as the driver of the vehicle uses the right leg to control the accelerator of the vehicle. As a result, contact with oximetry sensors 831, 832 is maintained and maximized.
As shown in
In an illustrative embodiment, a ballistocardiogram (BCG) sensor may also be embedded in a portion of vehicle seat 810, such as a backrest portion 839 to sense BCG data from an occupant and produce BCG signal 838. The BCG data and resultant signal 838 may comprise data relating to ballistic forces on the heart, and a BCG curve may be generated as a graphical representation of repetitive motions of the occupant's body arising from the sudden ejection of blood into the vessels with each heart beat. In an illustrative embodiment, the BCG sensor may comprise electromechanical film (EMFi) sensors such as a piezoelectric sensor or sensor pad embedded into seat portion 839 which transfer mechanical energy to electrical signal and vice versa.
In an illustrative embodiment, an accelerometer arrangement may be provided as part of BCG sensor 839 to sense acceleration BCG, which may be monitored by two MEMS accelerometers placed behind the BCG sensor. The accelerometers may be positioned towards a bottom portion of the BCG sensor 839 to minimize the effects of cervical and thoracic movements, and to ensure proximity to the trunk support, thus mitigating the effects of leg movement or lateral leaning. The accelerometer may output analog voltages representing each axis' acceleration with a sensitivity of 1 V/G. Such a configuration may be used to compensate for artifacts in the BCG sensing, and may also be used to detect the user's transfer from or into the seat 810.
In another illustrative embodiment, the BCG sensor may comprise optical sensors, where an optical interferometer may be configured to obtain signal that includes information about the heart activity. In another illustrative embodiment, the BCG signal 838 can be measured by radar system waves on very high frequencies as well.
The heart rate from the BCG signal can be detected by various techniques, such as signal segmentation with template beat wave model matching. Another illustrative technique comprises the use of adaptive beat to beat estimation based on component analyses. Neural network algorithms on a FPGA may also be used to detect heart beats from BCG. As BCG sensing may sometimes experience movement artifacts from the occupant, digital signal processing may be used, such as adaptive filters, fusion of complementary information by accelerometry or electromyography, as well as wavelet analysis, and empirical mode decomposition, to reduce such artifacts.
The terms algorithm or module as used herein do not limit the functionality to particular physical modules, but may include any number of tangible software and/or hardware components. In general, a computer program product in accordance with one embodiment comprises a tangible computer usable medium (e.g., standard RAM, an optical disc, a USB drive, or the like) having computer-readable program code embodied therein, wherein the computer-readable program code is adapted to be executed by a processor (working in connection with an operating system) to implement one or more functions and methods as described below. In this regard, the program code may be implemented in any desired language, and may be implemented as machine code, assembly code, byte code, interpretable source code or the like (e.g., via C, C++, C#, Java, Actionscript, Objective-C, Javascript, CSS, XML, etc.).
An exemplary vehicle system 3101 comprising various vehicle electronics subsystems and/or components including any of the sensor configurations discussed above is shown in
Radio/entertainment module 105 may provide data relating to audio/video media being played in vehicle 3101. Module 3105 may be integrated and/or communicatively coupled to an entertainment unit configured to play AM/FM radio, satellite radio, compact disks, DVDs, digital media, streaming media and the like. Communications module 3106 allows any of the modules in
Vehicle 3101 may further comprise a main processor 3107 that centrally processes and controls data communication throughout the system of
An exemplary embodiment is illustrated, where a vehicle 3101 (see
In some illustrative embodiments, sensor data and/or processed data from any of the sensors may be transmitted from vehicle 3101 to server 3205, which may be a stand-alone server, or part of a server group or cloud. Server 3205 may also collect data including sensor data and/or processed sensor from other vehicles similarly equipped as vehicle 3101. In one embodiment, server 3205 receives raw sensor data and performs any of the techniques described above to determine physiological attributes of users (i.e., occupants of a plurality of vehicles). In another embodiment, server 3205 receives processed sensor data that indicates a physiological attribute. Server 3205 may be further configured to process other vehicle sensor data (e.g., speed, acceleration, braking, etc.) and other vehicle characteristic data (e.g., seating position, activation of entertainment system, etc.) and location data (e.g., GPS coordinates) and combine such data to create vehicle and/or location profiles for use in seating feature adjustment.
For example, server 3205 may receive sensor data for multiple vehicles at a particular location and determine that users experience high stress in that location, which may be attributable to traffic congestion, poor road design, and the like. Determining that stress levels are generally high for the area, server 3205 may transmit control signals and/or algorithms to vehicles to activate or deactivate seat features (e.g., massage, heating/cooling), adjust seat positioning parameters, and/or activate other vehicle features (e.g., activate soothing music playlist on entertainment system) when vehicles approach the vicinity of the location. Server 3205 may process user profile data with the sensor data to make further determinations. For example, server 3205 may determine that users/occupants of a particular height, weight, age, etc. experience stress in a particular location. Accordingly, server 3205 may transmit control signals and/or algorithms to vehicles having occupants meeting the height, weight, age, etc. profile to activate or deactivate seat features, adjust seat positioning parameters, and/or activate other vehicle features when vehicles approach the vicinity of the location. Server 3205 may also make observations over time regarding one or more user physiological states as they relate to a vehicle use characteristic, and proactively provide adjustments via control signals and/or algorithms to the vehicle. For example, server 3205 may determine over time that a user is in a relaxed state when a seat is slightly declined from a normal seat position during slower driving speeds and experiences reduced stress when the seat is inclined slightly during faster driving speeds. By learning a user's physiological states under various driving/vehicle conditions, server 3205 may provide further improved adjustments to a user's seat and/or vehicle's features to better the user's driving experience.
Of course, certain features of server 3205 may be contained within computer 54 that may comprise processor 3107. Also, certain features of server may be performed by devices 3201. In one illustrative embodiment, computer 54 may batch sensor data and transmit it to a device (e.g., device 3202) for storage at predetermined times. The device may subsequently process the sensor data, or interact with server 3205, and provide feedback to a user via a software program or app regarding physiological states and their relationship to vehicle usage and/or vehicle locations. By providing a user interface with such software, users may manually adjust and customize actions performed for particular physiological events. In an illustrative embodiment, the device (e.g., device 3202) may be configured to generate an automated emergency call, and/or transmit the physiological condition data if physiological characteristics are outside predetermined parameters (e.g., attack alert). The vehicle communications 3106 may also be configured to provide these features as well.
The following numbered clauses include embodiments that are contemplated and non-limiting:
Clause 1. An occupant support system comprising an electronics system for a vehicle seat, the electronics system comprising
a sensor system configured to obtain sensor data from an occupant of the seat, wherein the sensor system is configured to obtain at least a portion of the sensor data from the occupant through at least one impeding barrier, the sensor data comprising occupant data associated with the occupant of the seat and
a computer coupled to the sensor system, the computer comprising processing means for processing the sensor data including occupant data received from the occupant and configured to perform a predetermined action using the occupant data.
Clause 2. A vehicle system, comprising
a vehicle sensor system for producing vehicle usage characteristic data;
an electronics system for a vehicle seat comprising a sensor system configured to obtain sensor data from an occupant of the seat, wherein the sensor system is configured to obtain at least a portion of the sensor data from the occupant through at least one impeding barrier, the sensor data comprising occupant data associated with the occupant of the seat and
a computer coupled to the sensor system and the vehicle sensor system, the computer comprising a processor to (i) process the sensor data to determine a physiological state of the occupant, and (ii) process the vehicle usage characteristic data to determine a vehicle usage characteristic, the computer being configured to generate one or more control signals to perform a predetermined action associated with the physiological state and vehicle usage characteristic.
Clause 3. The occupant support system of any other clause, wherein the sensor system comprises a sensor coupled to the vehicle seat, configured to sense a physiological attribute of the occupant, and configured to provide at least a portion of the occupant data using the physiological attribute.
Clause 4. The occupant support system of any other clause, wherein the sensor is located between a cushion of the seat and a trim layer of the seat, the sensor is further configured to sense the physiological attribute through the at least one impeding barrier comprising at least one of the trim layer and occupant's clothing and the trim layer.
Clause 5. The occupant support system of any other clause, wherein the sensor is one of an electrocardiogram (ECG) sensor, a pulse oxymetry sensor, and a galvanic skin response sensor.
Clause 6. The occupant support system of any other clause, wherein the sensor comprises a ballistocardiogram (BCG) sensor.
Clause 7. The occupant support system of any other clause, wherein the sensor system comprises
a first sensor coupled to the seat in a first location and configured to provide a first sensor signal and
a second sensor coupled to the seat in spaced-apart relation to the first sensor to provide a second sensor signal, the first and second sensors cooperate to sense at least one physiological attribute of the occupant through the at least one impeding barrier, and the first and second sensors are configured to communicate to the computer the first and second sensor signals.
Clause 8. The occupant support system of any other clause, wherein the computer is further configured to determine a reliability associated with each sensor signal, compare reliability of each sensor signal, and use one or more sensor signals having reliability greater than a predetermined value to provide at least the portion of the occupant data.
Clause 9. The occupant support system of any other clause, wherein the computer is further configured to compare the first and second sensor signals to provide derivative information included in the occupant data.
Clause 10. The occupant support system of any other clause, wherein the computer is further configured to determine a blood pressure of the occupant using the derivative information.
Clause 11. The occupant support system of any other clause, wherein the derivative information comprises a pulse transit time.
Clause 12. The occupant support system of any other clause, wherein the sensor system comprises a first sensor coupled to the seat in a fixed position relative to the seat to sense a physiological attribute of the occupant through the at least one impeding barrier to provide a first sensor signal associated with the physiological attribute.
Clause 13. The occupant support system of any other clause, wherein the computer is further configured to receive occupant profile data associated with the occupant and combine the occupant profile data with the occupant data, and performing the predetermined action using the occupant data and the occupant profile data.
Clause 14. The occupant support system of any other clause, wherein the computer is configured to perform the predetermined action by determining an identity of the occupant using at least one of the occupant data and the occupant profile data.
Clause 15. The occupant support system of any other clause, wherein the at least one of the occupant data and the occupant profile data comprises an electrocardiogram (ECG) wave form.
Clause 16. The occupant support system of any other clause, wherein the computer is configured to perform the predetermined action by determining a driver capability assessment using at least one of the occupant data and the occupant profile data.
Clause 17. The occupant support system of any other clause, wherein the computer is configured to determine the driver capability assessment by analyzing respiration rate and processing rate changes over time.
Clause 18. The occupant support system of any other clause, wherein the computer is configured to perform the predetermined action by determining a driver stress level using at least one of the occupant data and the occupant profile data.
Clause 19. The occupant support system of any other clause, wherein the computer is configured to determine the driver stress level by analyzing heart rate variability.
Clause 20. The occupant support system of any other clause, wherein the computer is configured to perform the predetermined action by determining a health metric using at least one of the occupant data and the occupant profile data.
Clause 21. The occupant support system of any other clause, wherein the computer is configured to determine the health metric by calculating at least one of blood pressure, resting heart rate, and recovery time, the computer being further configured to receive factors including at least age, gender, weight, and combine the at least one of blood pressure, resting heart rate, and recovery time with factors to determine the health metric.
Clause 22. The occupant support system of any other clause, wherein the computer is configured to perform the predetermined action by determining a blood-flow metric using at least one of the occupant data and the outside occupant data.
Clause 23. The occupant support system of any other clause, wherein the computer is configured to determine the blood-flow metric by calculating blood volume data.
Clause 24. The occupant support system of any other clause, wherein the computer is further configured to receive occupant profile data associated with the occupant, and to determine a baseline state associate with the occupant using the outside occupant data.
Clause 25. The occupant support system of any other clause, wherein the computer is further configured to determine a current state of the occupant using the occupant data, compare the current state with the baseline state, and perform the predetermined action using the comparison of the current state and the baseline state.
Clause 26. The occupant support system of any other clause, wherein the computer is further configured to perform the predetermined action by adjusting occupant comfort via adjusting the seat to cause at least some of current state parameters to approximate at least some of baseline state parameters.
Clause 27. The occupant support system of any other clause, wherein the computer is further configured to perform the predetermined action by adjusting thermal comfort of the occupant by adjusting a thermal device in the seat to cause at least some of current state parameters to approximate at least some of baseline state parameters.
Clause 28. The occupant support system of any other clause, wherein the computer is further configured to perform the predetermined action by reducing stress parameters of the occupant by performing at least one of engaging a massage system coupled to the seat, adjusting an arrangement of the seat, and engaging a thermal device in the seat to cause at least some of current state parameters to approximate at least some of baseline state parameters.
Clause 29. The occupant support system of any other clause, wherein the computer is further configured to perform the predetermined action by increasing energy parameters of the occupant by performing at least one of engaging a massage system coupled to the seat, adjusting the seat to assume an upright arrangement, and engaging a thermal device included in the seat to adjust a seat temperature for the occupant.
Clause 30. The occupant support system of any other clause, wherein the computer is further configured to perform the predetermined action by determining a driver stress level by analyzing heart rate variability using occupant data.
Clause 31. The occupant support system of any other clause, wherein the electronics system further includes a communication unit configured to transmit the driver stress level to a remote computer.
Clause 32. The occupant support system of any other clause, wherein the sensor system further includes a location sensor configured to provide location data indicative of a location of the occupant and the computer is further configured to receive the location data and merge the location data with the occupant data to cause a location-related stress level of the occupant to be determined.
Clause 33. The occupant support system of any other clause, wherein the computer is further configured to determine physiological conditions of the occupant using the occupant data and determining if at least one of the physiological conditions is below a predetermined value.
Clause 34. The occupant support system of any other clause, wherein the electronics system further includes a communication unit coupled to the computer to receive commands from the computer and configured to communicate the physiological conditions when the computer determines at least one physiological condition is below the predetermined value.
Clause 35. The occupant support system of any other clause, wherein the computer is further configured to determine physiological conditions of the occupant using the occupant data and store the physiological conditions over time to establish a collection of stored physiological conditions.
Clause 36. The occupant support system of any other clause, wherein the electronics system further includes a communication unit coupled to the computer to receive commands from the computer and configured to communicate the collection of stored physiological conditions to a remote computer.
Clause 37. The occupant support system of any other clause, wherein the physiological conditions includes blood pressure and wherein the computer is further configured to calculate a trend over time of physiological conditions and determine if the trend of vital signs exceeds a predetermined threshold.
Clause 38. The occupant support system of any other clause, wherein the electronics system further includes a communication unit coupled to the computer to receive commands from the computer and configured to communicate the collection of physiological conditions to a remote computer when the computer determines the trend of physiological conditions exceeds a predetermined threshold.
Clause 39. The occupant support system of any other clause, wherein the computer is further configured to receive occupant profile data, and wherein the computer processes and stores the sensor data over time and associates it with the profile data
Clause 40. The occupant support system of any other clause, wherein the computer is configured to perform a different predetermined action using the processed and stored sensor data over time.
Clause 41. The occupant support system of any other clause, wherein the computer is further configured to perform the different predetermined action by adjusting occupant comfort via adjusting the seat to cause at least some of current state parameters of the sensor data over time to approximate at least some of baseline state parameters.
Clause 42. The occupant support system of any other clause, wherein the computer is further configured to perform the different predetermined action by adjusting thermal comfort of the occupant by adjusting a thermal device in the seat to cause at least some of current state parameters of the sensor data over time to approximate at least some of baseline state parameters.
Clause 43. The occupant support system of any other clause, wherein the computer is further configured to perform the different predetermined action by reducing stress parameters of the occupant by performing at least one of engaging a massage system coupled to the seat, adjusting an arrangement of the seat, and engaging a thermal device in the seat to cause at least some of current state parameters of the sensor data over time to approximate at least some of baseline state parameters.
Clause 44. The occupant support system of any other clause, wherein the computer is further configured to perform the different predetermined action by increasing energy parameters of the occupant by performing at least one of engaging a massage system coupled to the seat, adjusting the seat to assume an upright arrangement, and engaging a thermal device included in the seat to adjust a seat temperature for the occupant.
Clause 45. The occupant support system of any other clause, further comprising one or more vehicle sensors coupled to the computer for producing one or more vehicle usage characteristic data, and wherein the computer is configured to process the sensor data including occupant data and vehicle usage characteristic data to perform the predetermined action.
Clause 46. The occupant support system of any other clause, further comprising a communications device, coupled to the computer, wherein the computer is configured to transmit the occupant data via the communications device when the processed vehicle usage characteristic determines a vehicle event has occurred.
Clause 47. The vehicle system of any other clause, wherein the predetermined action comprises at least one of (1) modifying a physical configuration of the vehicle seat, (2) transmitting a message for presentation on a vehicle display, (3) transmitting a message for presentation on a vehicle speaker, (4) modifying a temperature of the vehicle seat, (5) activating a massaging device in the vehicle seat, (6) deactivating a massaging device in the vehicle seat, (7) transmitting the sensor data via a communication device in the vehicle system, (8) transmitting the physiological state via the communication device in the vehicle system, (9) transmitting the vehicle characteristic data via the communication device in the vehicle system, and (10) transmitting the vehicle characteristic via the communication device in the vehicle system.
Clause 48. The occupant support system of any other clause, wherein the computer is further configured to calculate at least one of heart rate and respiration rate of the occupant using the occupant data before performing the predetermined action.
Clause 49. The occupant support system of any other clause, wherein the first and second sensors are coupled to the seat bottom of the vehicle seat and arranged to underlie a right let of the occupant.
This application is a U.S. national stage application of international application No. PCT/US2015/016803 filed Feb. 20, 2015, which claims priority to U.S. Provisional Application Ser. No. 61/942,543, filed Feb. 20, 2014, U.S. Provisional Application Ser. No. 61/942,513, filed Feb. 20, 2014, and U.S. Provisional Application Ser. No. 61/942,493, filed Feb. 20, 2014, The entire disclosures of PCT/US2015/016803, U.S. Ser. No. 61/942,543, 61/942,513, and 61/942,493 are hereby incorporated by reference.
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/US2015/016803 | 2/20/2015 | WO | 00 |
| Publishing Document | Publishing Date | Country | Kind |
|---|---|---|---|
| WO2015/127193 | 8/27/2015 | WO | A |
| Number | Name | Date | Kind |
|---|---|---|---|
| 5069214 | Samaras | Dec 1991 | A |
| 7206631 | Kawachi | Apr 2007 | B2 |
| 7239945 | Hiemer | Jul 2007 | B2 |
| 7774052 | Burton | Aug 2010 | B2 |
| 8430817 | Al-Ali et al. | Apr 2013 | B1 |
| 8616654 | Zenk | Dec 2013 | B2 |
| 9475389 | Fung | Oct 2016 | B1 |
| 20060068693 | Kono | Mar 2006 | A1 |
| 20100185068 | Park | Jul 2010 | A1 |
| 20110015468 | Aarts | Jan 2011 | A1 |
| 20120078123 | Futatsuyama et al. | Mar 2012 | A1 |
| 20130070043 | Geva et al. | Mar 2013 | A1 |
| 20140039330 | Sec Sang Man et al. | Feb 2014 | A1 |
| 20140240132 | Bychkov | Aug 2014 | A1 |
| 20140276112 | Fung | Sep 2014 | A1 |
| 20150313475 | Benson | Nov 2015 | A1 |
| 20160001781 | Fung | Jan 2016 | A1 |
| 20160029940 | Iizuka | Feb 2016 | A1 |
| 20170158202 | Yang | Jun 2017 | A1 |
| Number | Date | Country |
|---|---|---|
| 0104875744 | Sep 2015 | CN |
| 102005038289 | Mar 2007 | DE |
| 102007053119 | May 2009 | DE |
| 102009021532 | Nov 2010 | DE |
| 2010264092 | Nov 2010 | JP |
| 1020010061858 | Jul 2001 | KR |
| 1020140027641 | Mar 2014 | KR |
| 0101642697 | Aug 2016 | KR |
| 20130109154 | Jul 2013 | WO |
| 2014147828 | Sep 2014 | WO |
| 2015200224 | Dec 2015 | WO |
| Entry |
|---|
| PCT Search Report and Written Opinion completed by the ISA/EP dated May 21, 2015 and issued in connection with PCT/US2015/016803. |
| Chinese Office Action for Chinese App. No. 201380064313.2 dated Apr. 12, 2017, 3376 CN ||, 21 pages. |
| PCT International Search Report and Written Opinion completed by the ISA/US dated Apr. 22, 2014 and issued in connection with PCT/US2013/071620. |
| Chinese Office Action for Chinese App. No. 201380064313.2 sent on Sep. 28, 2017, 3376 CN ||, 19 pages. |
| Number | Date | Country | |
|---|---|---|---|
| 20160354027 A1 | Dec 2016 | US |
| Number | Date | Country | |
|---|---|---|---|
| 61942543 | Feb 2014 | US | |
| 61942513 | Feb 2014 | US | |
| 61942493 | Feb 2014 | US |
