The present disclosure concerns a method for classifying photoplethysmography (PPG) pulses. The present disclosure further concerns a method for detecting atrial fibrillation (AF), classifying arrhythmias and monitoring blood pressure, SpO2 and sleep and other heart rate variability (HRV) derived parameters. A computer program comprising instructions for implementing the method and an apparatus configured to run the computer program are also disclosed.
The monitoring of cardiac arrhythmias through PPG is a growing field of research. Interest in AF is high since it is the most common arrhythmia affecting millions of individuals worldwide.
Known monitoring methods and products based on PPG-dedicated algorithms are configured for distinguishing sinus (normal) rhythm episodes from AF ones. Typically, sinus and AF episodes are separated from each other by estimating electrocardiogram (ECG)-based and PPG-based RR intervals. The standard deviation of RR intervals is low during sinus rhythm or high during AF. The inverse is observed with average values of RR intervals which are high during sinus rhythm or low AF. For instance, A. G. Bonomi, et. al., “Atrial Fibrillation Detection Using a Novel Cardiac Ambulatory Monitor Based on Photo-Plethysmography at the Wrist”, Journal of the American Heart Association, August 7; 7(15) (2018), the describes AF detection using photo-plethysmography signals measured from a wrist-based wearable device.
Document US2018279891A1 discloses a method for event detection in a user-wearable device including receiving, from a first sensor implemented in the user-wearable device, PPG signals; processing, at a processor, the PPG signals to obtain PPG signal samples; detecting, at the processor, beats in the PPG signal samples; dividing the PPG signal samples into PPG signal segments; extracting at least one inter-beat interval feature in each PPG signal segment; classifying, at the processor, each PPG signal segment using the extracted IBI feature associated with the PPG signal segment and using a machine learning model; in response to the classifying, generating, at the processor, an event prediction result for the PPG signal segment based on the extracted IBI feature.
Document “IEEE Transactions on Biomedical Circuits and Systems, vol. 9, no. 5 (2015 October 01), pages 662-669”, discloses a method for detection of premature ventricular contractions in PPG. The method relies on 6 features, characterising PPG pulse power, and peak-to-peak intervals. A sliding window approach is applied to extract the features, which are later normalized with respect to an estimated heart rate. Artificial neural network with either linear and non-linear outputs is investigated as a feature classifier.
There is a need in a method that can further separate AF episodes from other cardiac arrhythmias, such as premature ventricular and atrial contractions, flutters, supraventricular and ventricular tachycardias, as well as cardiac dysfunctions such as left branch block and AV node reentry.
During recent AF-related studies on PPG signals performed by the present inventors, the analysis of the recorded data has pointed at the fact that the addition of features based on variation of PPG pulse morphologies might be necessary to achieve an improved performance to distinguish various types of cardiac arrhythmia. For example, it was observed that, for large number of AF epochs, pathological PPG pulse morphologies were recorded. It was hypothesized that AF leads to changes in hemodynamics such as reduced stroke volume (followed by a reduction in systemic blood pressure) and a pooling of venous blood, resulting in such pathological PPG pulse morphology. Moreover, variations of PPG pulse amplitudes and PPG baseline variations were observed on numerous episodes during sinus rhythm as well as during AF. The variations can reflect stroke volume variations caused by short and long recovery episodes (consecutive short and long RR intervals) combined with the compensation of the sympathetic vasoconstriction due to peripheral pressure increase. This phenomenon is expected to modulate PPG signals and create the observed low frequency component. Although false negative and false positive PPG pulse detections (pulse upstrokes) were observed during AF episodes, the PPG-based RR intervals were similar to ECG-based RR-intervals. Recent studies by the present inventors have shown a high accuracy (e.g. a mean absolute error <10 ms) when comparing PPG-based vs ECG-based RR intervals.
Following the above AF-related studies, the inventors have concluded that a method that can further separate AF episodes from other cardiac arrhythmias should be based on quantifying the morphology of the PPG pulses and on the classification of the PPG pulse in accordance with their morphologies.
The present disclosure concerns a method based on pulse wave analysis for monitoring cardiovascular vital signs, comprising:
measuring a PPG signal during a measurement time period such as to obtain a time series of PPG pulses; and
during said measurement time period, identifying individual PPG pulses in the PPG signal, each PPG pulse corresponding to a pulse cycle;
for each PPG pulse, using a pulse-wave analysis technique to determine, within the pulse cycle, at least one of: a time-related feature comprising a time duration and/or a normalized amplitude-related pulse-related feature and/or a signal-to-noise ratio (SNR)-related pulse-related feature;
wherein, for each PPG pulse, using a machine learning model in combination with the determined time-related normalized amplitude-related and SNR-related features to classify each PPG pulse in the PPG signal as “normal”, “pathological” or “non-physiological” such as to output a time series of pulse classes.
In an embodiment, the method comprises a step of training the machine learning model by using expert-labelled data.
The method disclosed herein allows for accurate classification of a measured PPG pulse and cardiac arrhythmia classification. The method disclosed herein allows for detecting atrial fibrillation (AF), classifying arrhythmias and monitoring blood pressure, SpO2 and sleep and other HRV-derived parameters.
The method disclosed herein can be used for the ambulatory monitoring of abnormal rhythm episodes and continuous monitoring of cardiac arrhythmia. The method can be used in any known PPG-based sensors.
The present disclosure concerns a non-transitory computer readable medium storing a program causing a computer to execute the method, and an apparatus configured to run the instructions of the computer program.
The invention will be better understood with the aid of the description of an embodiment given by way of example and illustrated by the figures, in which:
In describing and claiming the present disclosure, the following terminology will be used.
The expression “cardiac contraction” corresponds to the onsets of ventricular contraction of the heart, represented by R-wave peaks in the ECG waveform (black dots in
The expression “cardiac cycle” corresponds to the duration between the two successive cardiac contraction onsets (P-wave onsets) of the ECG signal (see
The expression “ECG-based RR intervals” corresponds to the resulting time series representing the time difference between successive cardiac contractions (dashed line in
The expression “ECG signal” corresponds to the time series of ECG samples.
The expression “PPG-based RR intervals” corresponds to the resulting time series representing the time difference between successive cardiac contractions (solid line in
The expression “pulse upstroke” corresponds to the systolic upstrokes in the PPG signals, represented by steep upstrokes (see white dots in
The expression “pulse cycle” corresponds to the duration between two successive pulse feet in the PPG signal (see
The expression “PPG pulse” corresponds to the PPG signal during a PPG pulse cycle.
The expression “pulse feet” corresponds to the local minima (see gray dots in
The expression “PPG signal” corresponds to the time series of PPG samples.
The expression “pulse class” corresponds to the resulting classification “normal” (N), “pathological” (P) or “non-physiological” (X) of the PPG pulse provided by a pulse classifier.
The expression “pulse classifier” corresponds to the trained classifying machine learning model.
The expression “time series of pulse classes” corresponds to the output of the pulse classifier which is a time series of PPG classes (N, P or X) each element of the series being associated with a PPG pulse and comprising the temporal occurrence of each pulse.
According to an embodiment, a method based on pulse wave analysis for monitoring cardiovascular vital signs, comprises the steps of:
measuring a PPG signal during a measurement time period such as to obtain a time series of PPG pulses;
during said measurement time period, identifying individual PPG pulses in the PPG signal, wherein each PPG pulse corresponds to the PPG signal during a pulse cycle;
for each PPG pulse, using a pulse-wave analysis technique to determine, within the pulse cycle, at least one of: a time-related feature comprising a time duration, and/or a normalized amplitude-related pulse-related feature, and/or a SNR-related feature; and
for each PPG pulse, using a classifying machine learning model in combination with the determined time-related, normalized amplitude-related and SNR-related features, to classify each PPG pulse in the PPG signal as “normal” (N), “pathological” (P) or “non-physiological” (X) such as to output a time series of pulse classes.
The present disclosure further concerns a computer program comprising instructions for implementing the method for classifying photoplethysmography (PPG) pulses.
In a desired embodiment, the computer program comprises instructions for implementing a method based on pulse wave analysis for monitoring cardiovascular vital signs. The method comprises the steps of:
measuring a PPG signal during a measurement time period such as to obtain a time series of PPG pulses;
during said measurement time period, identifying individual PPG pulses in the PPG signal, wherein each PPG pulse corresponds to the PPG signal during a pulse cycle;
for each PPG pulse, using a pulse-wave analysis technique to determine, within the pulse cycle, at least a time-related feature comprising a time duration within a pulse, at least a normalized amplitude-related feature comprising an amplitude value of the PPG signal and normalized by another amplitude-related feature, and at least a SNR-related feature related to the SNR characteristics of the PPG pulse; and
for each PPG pulse, using a classifying machine learning model in combination with said at least time-related feature, said at least normalized amplitude-related and said at least SNR-related feature, to classify each PPG pulse in the PPG signal as “normal” (N), “pathological” (P) or “non-physiological” (X) such as to output a time series of pulse classes.
The time series of pulse classes comprises the pulse classes “normal” (N), “pathological” (P) or “non-physiological” (X) attributed to each PPG pulse.
Here, the classification “normal” can include a PPG pulse that has been generated by a normal cardiac contraction (cardiac contraction resulting from sinus node depolarization). The classification “pathological” can include a PPG pulse that has been generated by an abnormal cardiac contraction (cardiac contraction not resulting from sinus node depolarization). The classification “non-physiological” can include a PPG pulse associated to a noisy or unidentified PPG pulse. The classification “non-physiological” can further include PPG pulses having a waveform that is not of purely physiological origin (including PPG pulses with motion artefact, electromagnetic perturbation, low SNR, ambient light perturbation). The classification “non-physiological” can further include PPG pulses with physiological sources that are not directly related to arterial pulsatility (e.g. venous pulsatility, ballistocardiographic effect).
The PPG sensor typically comprises a light source configured to emit a light signal destined to illuminate a vascularized tissue, and a light detector configured to detect the light signal that has illuminated the tissue. The PPG sensor can comprise transmission-based or reflective-based sensor. The light source may comprise any one of a single or multiple light emitting diodes (LED), single or multiple laser diodes (LD), micro-plasma emitters, thermal sources, organic LEDs or tunable lasers. The light detector can comprise any one of photodiodes, phototransistors or any other light sensitive element or a digital camera.
In one aspect shown in
The PPG-based RR intervals can be calculated as the difference between timings of consecutive fiducial points such as pulse upstrokes or pulse feet. Individual PPG pulses (see
At least one time-related feature (TF) is computed from each PPG pulse of the PPG signal, using a pulse-wave analysis technique (see
At least one normalized amplitude-related feature (NAF) is computed from each PPG pulse of the PPG signal, using a pulse-wave analysis technique (
The normalized amplitude-related feature can include normalized end-systolic pressure nESP=(ESP−DP)/PP calculated by the difference of the absolute end-systolic pressure ESP and the diastolic pressure DP divided or normalized by the pulse pressure PP. The normalized amplitude-related feature can further include a first augmentation index Alx=(P2−P1)/PP calculated by the difference of the pressure amplitude of the second peak P2 and the pressure amplitude of the first peak P1 divided or normalized by the pulse pressure PP. In one aspect, the normalized amplitude-related feature includes a second augmentation index Alp=(P2−DP)/(P1−DP) calculated by the difference of the pressure amplitude of the second peak P2 and the diastolic pressure amplitude DP divided or normalized by the difference of the pressure amplitude of the first peak P1 and the diastolic pressure amplitude DP. In another aspect, the normalized amplitude-related feature includes a normalized ejection area. The normalized ejection area can be calculated as the surface under the PPG pulse for the ejection duration ED, normalized by the area under the PPG pulse for the duration of this pulse. Other normalized amplitude-related features can also be considered.
At least one SNR-related feature (SNRF) is computed for each PPG pulse of the PPG signal. The SNR is computed for example by computing the number of zero-crossings of the first-time derivative of the PPG pulse. The SNR can be computed using any other suitable method.
In one aspect, time-related TF, normalized amplitude-related NAF and SNR-related features SNRF are determined for the PPG pulse being classified. The TF, NAF, SNRF are determined for the PPG pulse and are then inputted in the classifying machine learning model.
In an embodiment, the method comprises a step of training the classifying machine learning model by using expert-labelled data. The expert-labelled data are typically manually assigned labels by an expert based on an ECG signal. The expert-labelled data should not be confounded by the classes assigned to PPG pulses by classifying machine learning model.
As an example of a supervised learning model, a support vector machine (SVM) can be used to perform the separation between “normal”, “pathological”, and “non-physiological” pulses based on time-related feature TF, normalized amplitude feature NAF and SNR-related feature SNRF. The SVM defined in Gunn (S. R. Gunn, “Support vector machines for classification and regression,” tech. rep., University of Southampton, 1998) can be implemented using a linear kernel function. As mentioned before, the training set is composed of expert labelled pulses of the three classes (N, P, and X). The best training result between penalty coefficient values fixed at one and infinity can be used. The resulting hyperplanes can be applied to PPG-derived features of a single PPG pulse to obtain the mentioned pulse classifier with N, P, or X classes as an independent output for each pulse (see
A minimum set of specifications must be reached to guaranty a good pulse classifier, namely a minimum set of features and a minimum training set of pulses. For example, for the minimum set of features, the amplitude-related feature nESP (normalized end-systolic pressure) combined with the time-related feature TF (time to first peak T1) and the SNR-related feature SNRF (number of zero-crossings of the first-time derivative of the PPG pulse) can provide good results (see
As illustrated in
More generally, expert classification from the ECG signal can be used to assign a “non-physiological” label to PPG pulses which are not associated to a cardiac contraction. For instance, this situation can occur if a PPG pulse is mistakenly detected due to motion artefacts in the PPG signal. During a given period the number of detected pulse cycles can be higher than the number of detected cardiac cycles due to wrongly detected PPG pulses.
Moreover, a “non-physiological” label can be assigned to a PPG pulse that has low SNR characteristics. The “low SNR characteristics” is determined using the SNR-related features during the training of the classifying machine learning model (pulse classifier) using datasets including synchronous PPG and ECG signals (see below). Note that the SNR of a PPG pulse can be determined without requiring measuring an ECG signal.
The remaining non-labeled PPG pulses are either labelled as “normal” or “pathological” or are ignored.
By analyzing the shape of the ECG signal, an expert can identify normal cardiac contractions (originating from the sinoatrial node). Thus, the expert can assign the label “normal” to the PPG pulses that correspond to the ECG pulses analyzed as normal cardiac contractions.
By analyzing the shape of the ECG signal, an expert can identify abnormal, or pathological, cardiac contractions (not originating from the sinoatrial node). The expert can assign the label “pathological” to the PPG pulses that correspond to the ECG pulses analyzed as pathological.
In the case where the ECG signal comprises multiple cardiac contractions but only one single PPG pulse, no label is assigned to the PPG pulse (i.e. due to a missed detection of pulse upstrokes in the PPG or an extra detection of cardiac contractions in the ECG due to the presence of motion or other artifacts in the ECG signal). The PPG pulse is ignored in the training of the classifying machine learning algorithm.
Alternatively or in combination, the expert-labelled data can be obtained from an clinical device (for example a software) which automatically labels cardiac arrhythmia from ECG signals. In that case, the expression “expert” above can be read as “clinical device”.
Table 1 shows the different labels applied to the PPG pulses based on the ECG signal expert analysis.
The step of training the classifying machine learning model (pulse classifier) by using expert-labelled data can comprise building a dataset including synchronous PPG and ECG signals together with a label attributed to each PPG pulse. The dataset may further include the time-related TF, normalized amplitude-related NAF and SNR-related SNRF features determined from each PPG pulse. The labels, possibly in combination with the time-related TF, normalized amplitude-related NAF and SNR-related SNRF features can be used to train the pulse classifier. The training can use supervised learning models such as support vector machines, decision trees, etc.
The resulting pulse classifier can then be used to classify each PPG pulse based on the time-related TF, normalized amplitude-related NAF and SNR-related SNRF features of the PPG pulse being classified. The pulse classifier further makes use of the statistical distribution of class features (TF, NAF, SNRF) of the preceding PPG pulses to provide an enhanced PPG pulse classification (to manage overlapping between N and P feature spaces).
For each pulse inputted in the pulse classifier, the latter outputs a pulse class. If a time series of PPG pulses is inputted in the pulse classifier, the latter outputs a time series of pulse classes, i.e., a series of individual pulse classes together with the temporal occurrence of each pulse. Each PPG pulse is classified individually as “normal”, “pathological” or “non-physiological”.
Conventional arrythmia detection can have strong limitations in terms of arrhythmia classifications. For example, conventional arrythmia detection based on PPG-based RR-intervals does not necessarily manage to separate AF episodes from sinus (normal) rhythm episodes with the presence of extrasystoles because both episodes will be characterized by large variations of RR interval values.
The time series of pulse classes, outputted from the pulse classifier, can be used to detect various cardiac arrhythmias and to improve the classification of cardiac arrhythmia.
In an embodiment, the method comprises classifying AF. To that end, the classifications “normal” and “pathological” in the time series of classified PPG waveform can be represented as “0” for “normal” and “1” for “pathological”. By doing so, one can obtain a time series of digitalized pulse classes (time series comprising the “0” and “1”).
In conventional AF detection, a feature extraction algorithm processes RR intervals over time windows of a given duration (e.g. 30 seconds) to estimate features such as: 1) mean value of the RR intervals; 2) minimum value of the RR intervals; 3) maximum value of the RR intervals; 4) median value of the RR intervals and 5) interquartile range of the RR intervals.
The time series of digitalized pulse classes further allows for estimating additional features such as: 6) standard deviation of the digitalized pulse classes and 7) mean value of the digitalized pulse class values.
The set of features can be generated from known episodes of AF and sinus rhythm and can be used to train a classifier (e.g. a support vector machine) to separate set of features values related to AF from set of features values related to sinus rhythm. The trained classifier can be applied to any unknown portion of the PPG signal to detect the presence of AF.
In this example, features 6) and 7) allows for avoiding numerous episodes of false positives (e.g. episodes with extrasystoles).
In another embodiment, the method comprises classifying cardiac arrhythmias by using the PPG pulses classified as “normal” and “pathological”, and not the PPG pulses classified as “non-physiological”. Cardiac arrhythmias may include AF, premature ventricular and atrial contractions, flutters, supraventricular and ventricular tachycardias as well as cardiac dysfunctions such as left branch block and AV node reentry.
In one aspect, the method uses the following set of features: time-related features and/or normalized amplitude-related features and/or the SNR-related features and/or the classifications “normal” and “pathological” in the time series of pulse classes. The set of features can be generated from known episodes of cardiac arrhythmias and can be used to train a classifier (e.g. a support vector machine) to separate set of features values related to specific cardiac arrhythmias. The trained classifier can be applied to any unknown portion of the PPG signal to classify cardiac rhythms.
Classifying cardiac arrhythmias can be performed for each PPG pulse individually (e.g. for single occurrences of extrasystoles) or for a succession of multiple pulses (e.g. for an episode of AF or trigeminy).
For example, AF episodes are characterized by the presence of pulses classified as “pathological” which appear randomly in between PPG pulses classified as “normal”. In opposition, bigeminy, trigeminy episodes are characterized by a regular pattern of PPG pulses classified as “normal” and “pathological” (e.g. for bigeminy, the time series of pulse classes is characterized by a repetition of alternating N and P labels like N, Px+1, Nx+2, Px+3, Nx+4, . . . ). Classifying AF can thus comprise identifying random occurrence of the PPG pulses classified as “pathological” in the time series of pulse classes. In one aspect, an episode of AF can be distinguished from a trigeminy event by quantifying the random appearance of the pulses classified as “pathological”. Such quantifying can be performed by testing if the distribution of P-to-P intervals is normal (t-test) or not. Here, a p-value of 0.05 can be used as a discriminator.
In another embodiment, the method comprises normalizing each PPG pulses to obtain normalized PPG pulses. The method further comprises averaging normalized PPG pulses classified as “normal” to obtain enhanced averaged normalized PPG pulses. The enhanced averaged normalized PPG pulses can then be used to estimate a blood pressure value or an SpO2 value.
In an embodiment, the method comprises determining HRV features by using the PPG pulses classified as “normal” and not the PPG pulses classified as “pathological” and “non-physiological”.
The method uses the timing of a given periodic fiducial point in the PPG signal (e.g. pulse upstroke or pulse foot) associated to PPG pulses classified as “normal”. The detected timings of the fiducial points classified as “non-physiological” and “pathological” are removed and replaced by interpolated detected timings of neighboring fiducial points classified as “normal”. The resulting time series are denoted as enhanced PPG-based NN intervals which represent and indirect measure of the ECG-based NN intervals. In contrast to RR intervals, NN intervals exclude outliers such as ectopic beats and thus only include “normal” RR intervals.
From the ECG-based NN intervals, one can apply classic HRV feature formulas to extract time- and frequency-based features such as the SDNN (standard deviation of all NN intervals), SDANN (standard deviation of the averages of NN intervals in all segments of the entire recording), pNN50 (NN50 count divided by the total number of all NN intervals), VLF (power in the very low frequency range ≤0.04 Hz of NN intervals), LF (power in low frequency range (0.04<f≤0.15 Hz) of NN intervals) and HF (power in high frequency range (0.15<f≤0.4 Hz) of NN intervals). The same or any other suitable technique can be applied to the enhanced PPG-based NN intervals leading to enhanced time-based features and enhanced frequency-based HRV features.
In another embodiment, the method comprises determining enhanced time-based features and enhanced frequency-based HRV features from the enhanced PPG-based NN intervals. The method further comprises determining any one of stress level, sleep stages, fatigue/recovery, respiration, circadian cycle, sleep apnoea or other sleep disorders by using the determining enhanced time- and enhanced frequency-based HRV features.
The present disclosure further concerns an apparatus configured to run the computer program. The apparatus is configured to measure a PPG signal during a measurement time period such as to obtain a time series of PPG pulses and for classifying the PPG pulses.
The pulsatility signal device 21 can comprise pulsatility sensor for measuring the pulsatility signal of a user. The pulsatility signal device 21 can be adapted to be in contact with the user's body. For example, the pulsatility signal device 21 can comprise a wearable device (smartwatch, fitness tracker, smart t-shirt). Alternatively, the pulsatility signal device 21 can comprise an implantable device to be implanted into user's body, such as an implant including a PPG sensor. Alternatively, the pulsatility signal device 21 can comprise a remotely sensing device (not shown), such as a camera (including RGB or NIR cameras) performing remote PPG (rPPG) measurements.
The processing device 23 can comprise a single processor 231 or a plurality of processors 231. At least one processor 231 can be comprised (or embedded, for example integrated) in the apparatus 20. Alternatively, or in combination, at least one processor 231 can be remote from the apparatus 20. For example, at least one processor 231 can be comprised in in a remote device 230, such as a cloud computing platform, a smartphone, a personal computer, or any other suitable remote device. In the exampled illustrated in
In one aspect, the different calculating steps of identifying individual PPG pulses; determining said at least: a time-related feature, a normalized amplitude-related feature, and a SNR-related feature; and using a machine learning model to classify each PPG pulse can be performed in a distributed manner over the plurality of processors 231.
In another aspect, the steps of identifying individual PPG pulses; determining said at least: a time-related feature, a normalized amplitude-related feature, and a SNR-related feature; can be performed in at least one processor 231 comprised in the apparatus 20, and the step of using a machine learning model to classify each PPG pulse can be performed at least one processor 231 remote from the apparatus 20.
Performing the calculating steps in a distributed manned over the plurality of processors 231 can improve the energy consumption which is of importance for embedded wearable devices.
Number | Date | Country | Kind |
---|---|---|---|
20177900.6 | Jun 2020 | EP | regional |