Patent Application
20180055354
The present invention is directed to a non-intrusive method to assess drowsiness based on eye movements and blinking.
Sleep loss has reached epidemic proportions. It is estimated that 50-70 million Americans suffer from sleep disorders [1], and on average, one gets 20% less sleep than a century ago [2]. Sleep deprivation results in increased drowsiness, fatigue, and cognitive deficits, which can have a negative impact on health, safety and performance [3], and even deadly consequences. Nearly 3% of crash fatalities in 2014 involved drowsy driving on US roadways [4], with more than 80,000 sleep-related crashes each year. Accordingly, development of reliable real-time systems to identify impaired vigilance could reduce the risk of fatigue-related accidents.
Forming one aspect of the invention is a method for assessing drowsiness of a subject over a period of time. In the method, gaze and blink measurements of the subject are acquired over a period of time and statistically compared against a plurality of gaze and blink measurements, which have been correlated to alertness, in order to produce a value representative of alertness/drowsiness. The comparison can be based upon a Guassian mixture model (GMM). The assessment of drowsiness can use reaction times to visual stimuli during a psychomotor vigilance task as the objective determinant of alertness. The gaze and blink measurements used in the drowsiness assessment can be those collected in a predetermined period immediately preceding each PVT stimulus.
The embodiments discussed herein are merely illustrative of specific manners in which to make and use the invention and are not to be interpreted as limiting the scope.
While the invention has been described with a certain degree of particularity, it is to be noted that many modifications may be made in the details of the invention's construction and the arrangement of its components without departing from the scope of this disclosure. It is understood that the invention is not limited to the embodiments set forth herein for purposes of exemplification.
Experimental
The experimental methodology is based on learning a GMM [5] of the state of alertness and measuring the distance between the observed state and the reference model. Due to the variation within the alert state, i.e. existence of sub-clusters, a GMM estimator (with a flexible number of components) would be more intuitive. In a study, the reaction times to visual stimuli during a psychomotor vigilance task (PVT) [6] were used as the baseline. The experiment included 6 episodes of 10-min PVT, each consisting of 100 stimuli-response trials. Throughout the experiment, the subject was under surveillance using an infra-red-based eye tracking system continuously acquiring gaze and blink measurements. For each PVT stimulus, a 10-second window immediately preceding that stimulus and extracted a set of 25 features (Table 1) from the corresponding eye tracking data (i.e. 600 feature vectors per experiment) was considered. Each feature vector was then considered as an observation and linked to the reaction time to the corresponding stimulus. After splitting each subject's data into separate training and test sets, the training observations representing the alertness (based on the corresponding reaction times) were used to build the GMM for each subject. Moreover, dimensionality of the feature vector was reduced to 10 by Fisher's discriminant analysis after estimating a projection matrix using the training set. Finally, given an observation, the minimum Mahalanobis distance logarithm between that observation and centres of GMM components was computed as a raw index and then mapped into [−1,1], using a piece-wise-linear model with saturation, to calculate the drowsiness index.
Eye tracking data was acquired using the GazePoint GP3 Eye Tracker from 15 participants (age 22.9±3.3 years; 11 female) at the Brain and Mind Sleep Research Laboratory, Western University, Canada. Each subject participated in two sessions with different sleep requirements: normal sleep (NS) and sleep restriction (SR) sessions, spaced at least 72 hours apart. During the night prior to NS session, the subject was required to have extended sleep for 9 hours (12-9 am), while in case of SR session, the sleep was restricted to 5 hours (1:30-6:30 am). The subject's compliance with these requirements was verified using a sleep log and actigraphy.
The method was evaluated on the data acquired from each subject in every session (NS or SR) using a leave-one-out cross-validation approach; i.e., choosing one PVT episode for validation each time and using the remaining episodes for training. For evaluation purpose, the corresponding reaction times were also mapped into [−1,1] using a piece-wise-linear model with saturation. The normalized root-mean-square (RMS) error between the drowsiness index and the corresponding reaction time was then calculated to assess the performance. Furthermore, the performance of the proposed method was compared to a random estimator. Overall, the proposed method shows low normalized RMS errors for both NS and SR sessions, while outperforming the random estimator (
As an example at the individual level,
As shown in
On the other hand, the RMS error for the NS session is higher than SR (p<0.05), which is expected due to the sleep deprivation effect causing stronger discrimination between the alert and drowsiness states during the SR session.
Results of this preliminary study verify the potential of the proposed methodology as a reliable approach for non-intrusive assessment of drowsiness, based on eye movements and blinking.
Since the reaction time can also be influenced by other factors such as distraction or disengagement, in future studies, other biological measures, such as electroencephalogram (EEG) and electrocardiogram (ECG), might be utilized to have a more reliable baseline.
Several methodologies for evaluating human vigilance and fatigue have been developed in the recent past, e.g. for drivers [7]. However, major limitations of these techniques are that they may detect sleepiness too late to effectively prevent fatigue-related accidents, may not be robust under various environmental conditions, can be poorly evaluated, and/or can be intrusive.
The present invention is a non-intrusive drowsiness detection technique based which relies on features extracted from eye movements and blinking. The technique presents relatively high correspondence with reaction times. Importantly, the proposed methodology significantly outperforms a random estimator.
This invention poses the potential to lead development of non-intrusive real-time techniques to reliably assess the state of vigilance, which is useful for managing fatigue in people and reducing motor vehicle collisions and human fatalities.
Whereas, the invention has been described in relation to the drawings attached hereto, it should be understood that other and further modifications, apart from those shown or suggested herein, may be made within the scope of this invention.
This application claims the benefit of U.S. Provisional Patent Application Ser. No. 62/381,631, filed Aug. 31, 2016.
| Number | Date | Country | |
|---|---|---|---|
| 62381631 | Aug 2016 | US |
