The present invention relates to a method and system for the assessment of the risk of the development of disseminated intravascular coagulation (DIC), in patients showing systemic inflammatory response syndrome (SIRS), or sepsis. Specifically, the invention provides a method for early DIC assessment and preventive treatment planning, which has the potential for significantly decreasing mortality rate as well as the rate of DIC related sequelae in the SIRS/sepsis patient population and thereby improving quality of life. The risk assessment method is based on features of vital signs and/or biomarker measurements, and provides solutions for assessing the risk of DIC development 24 hours in advance or within 72 hours after ICU admittance. Optimal sets of measurements for each model implementation are selected.
Developed models obtaining an area under the ROC (receiving operation curve) curve (AUC) equal to 0.85 and 0.83, for the risk assessment 24 hours in advance and within 72 hours from ICU admittance, are described.
The system provides an improved process of integrative analysis of a patient's characteristics and demographics, vital signs and in-vitro diagnostic data for effective treatment planning.
DIC is a pathological process characterized by a systemic activation of the blood coagulation system, leading to subsequent clot formation, blood vessel obstruction and organ dysfunction. The large consumption of platelets and coagulation factors in this process may in turn cause bleeding, which further worsens the patient's condition and decreases the chances of survival (Di Nisio, M., et al., “Diagnosis and treatment of disseminated intravascular coagulation: guidelines of the Italian Society for Haemostasis and Thrombosis (SISET),” Thrombosis research, vol. 129, pp. e177-e184, 2012.)
DIC is usually secondary to an underlying condition such as systemic inflammatory response syndrome (SIRS), sepsis, trauma, malignancy, heat stroke and hyperthermia. SIRS and sepsis are among the most common causes of DIC, whose mortality ranges between 10-50%. Between 30% and 50% of sepsis patients develop DIC. Sepsis severity positively correlates with DIC incidence and therefore mortality (Levi. M., et al., “Disseminated intravascular coagulation,” New England Journal of Medicine, vol. 341, pp. 586-592, 1999). DIC incidence ranges between 7% (mild sepsis) and 73% (septic shock) (see Kinasewitz, G. T., et al., “Prognostic value of a simple evolving disseminated intravascular coagulation score in patients with severe sepsis,” Critical Care Medicine, vol. 33, pp. 2214-2221, 2005), and DIC mortality ranges between 10% and 50%.
Several diagnostic scores based on general coagulation tests such as prothrombin time (PT), fibrinogen, d-dimer and platelet counts have been proposed to objectify the subjective clinical diagnosis of DIC based on the clinical signs and symptoms of the patient. See, e.g., Kobayashi, N., et al., “Criteria for diagnosis of DIC based on the analysis of clinical and laboratory findings in 345 DIC patients collected by the Research Committee on DIC in Japan,” Disseminated Intravascular Coagulation, ed: Karger Publishers, 1983, pp. 265-275. Although some of those scores seem to reflect the clinical diagnosis of DIC by experts quite well, this also means that these scores are unsuitable as a tool for the risk assessment and prevention of DIC.
The high mortality of SIRS/sepsis associated DIC has driven us to develop methods for assessing the risk of DIC development following the diagnosis of SIRS, using both vital signs and standardly available laboratory measurements. These methods allow for improving the prevention of DIC in SIRS patients, which in turn improves patient outcomes.
This invention assesses the risk of the development of DIC in SIRS patients. While available diagnostic DIC scores only allow for therapeutic treatment of DIC, the within invention allows for early and preventative intervention that should decrease DIC incidence and reduce mortality. Currently no risk assessment algorithms are available for DIC despite its high mortality rate.
Accordingly, the within invention provides a method based on biomarkers (lactate, bilirubin and creatinine) and/or statistical features (e.g., average, standard deviation, kurtosis, skewness and quantile values) extracted from vital signs (heart rate, respiration rate and oxygen saturation) that assesses the risk of developing DIC 24 hours in advance. In addition, the invention provides a method based on biomarkers (lactate, bilirubin and creatinine) and/or statistical features (e.g., average, standard deviation, kurtosis, skewness and quantile values) extracted from vital signs (heart rate, respiration rate and oxygen saturation), that assesses the risk of developing DIC within the first 72 hours after ICU admittance.
The optimal system requires all mentioned biomarker measurements on at least a daily basis and continuous monitoring of all mentioned vital signs. More practical, but still high performing implementations are based on continuous screening of sepsis/SIRS patients using one or more of the vital signs (high sensitivity, low specificity) and subsequent measurement of one or more of the biomarkers to increase the specificity of the risk assessment at the moment the vital signs indicate an increased risk of DIC development.
In general terms, our invention uses the combination of vital signs monitoring for the detection of clinical deterioration of sepsis/SIRS patients, with biomarker measurements that reflect organ damage likely caused by the DIC. One skilled in the art could imagine solutions that combine vital signs monitoring data with other and/or earlier markers of organ damage, and/or more direct biomarkers of systemic activation of the coagulation system.
It is an object of the present invention to provide a method and system for assessing the risk of development of DIC in patients showing SIRS or sepsis. In particular, it is an object of the present invention to provide a system and method that solves the above-mentioned problems of the prior art by providing a method and system for assessing the risk of DIC development. This invention proposes two different implementations of the system, the first one allows for predicting the onset of DIC 24 hours in advance, while the second one allows for predicting the risk of DIC at ICU admittance, more specifically in the first 72 hours from ICU admittance, before DIC is being diagnosed.
It is also an object of the present invention to provide a system and method for assessing the risk of developing DIC based on features of vital signs and/or biomarker measurements. It is a further object of the present invention to provide a method and system for decreasing the mortality rate for patients developing DIC by early assessment and preventative treatment planning for DIC. It is also an object of the present invention to provide an alternative to the prior art.
Thus, the above-described object and several other objects are intended to be obtained in a first aspect of the invention by providing a system and method for providing relevant patient-specific DIC risk information, such system and method comprising:
diagnosing said patient for SIRS and, if positive, inputting the patient-specific diagnostic data onto a processor configured to receive said patient-specific data, and storing said data on a non-transitory computer readable storage medium;
acquiring initial vital signs and biomarker measurement data from said patient and inputting and storing said vital signs and biomarker measurement data on said non-transitory computer readable storage medium;
monitoring said vital signs of said patient and continuously inputting and storing said vital signs and biomarker measurement data on said non-transitory computer readable storage medium;
pre-processing said vital sign data, including assessing the quality of said data and removing outliers from said data. The pre-processing consists of discarding samples which are outside the physiological range. Physiological range for both biomarkers and vital signs are shown in Table 1 and Table 2;
windowing of said vital signs data; vital signs are segmented in sliding windows 120 minutes long with an overlap of 60 minutes. The statistic of interest is extracted from each window and the final feature is obtained by averaging the statistics extracted over all the windows (see
extracting specific features from said patient-specific data;
calculation of statistical features from said vital signs windows;
A description of the statistical features is provided in Table 3.
Table 3 Description of statistical features extracted from vital signs
analyzing said patient data with respect to a predictive model that is stored on said non-transitory computer readable storage medium; and determining whether a value derived from said patient-specific data by the predictive model meets a DIC probability threshold, wherein said probability threshold is predictive of the likely development of DIC.
The methods and system according to the invention will now be described in more detail with regard to the accompanying figures. The figures show ways of implementing the present invention and are not to be construed as being limiting to other possible embodiments falling within the scope of the attached claims.
The present invention provides a method and system for early risk assessment of DIC using biomarker measurements, vital signs monitoring and the combination of vital signs monitoring for the detection of clinical deterioration of sepsis/SIRS patients, with biomarker measurements that reflect organ damage likely caused by the DIC. The present invention is described in further detail below with reference made to
This invention arises from the analysis of intensive care unit (ICU) data collected from SIRS patients that did not receive anti-coagulant treatment before DIC diagnosis. The selected patients were divided into training and test sets, 70% and 30%, respectively. The training set has been used for determining the model parameters, whereas the test set to evaluate the model performance. Descriptions of the training and test sets are provided in Table 4. Data from patient subgroups have been used to develop the models of this invention since not all data was always available for all selected SIRS patients.
The discriminative power of different standalone factors (features) and their combinations were evaluated in order to define the optimal combination of features for DIC prediction. Such factors include biomarkers, features extracted from vital signs, subjects' characteristics and Apache score. Referring now to the figures,
The ROC curve illustrates the performance of a binary classifier for different operating points. The curve is drawn by plotting the true positive rate (TPR) against the false positive rate (FPR) calculated for the different operating points. The ‘optimal cutoff’ (see Table 5, Opt th) is defined in this document as the value which provides the highest achievable average or sum of the TPR (sensitivity) and specificity (1—false positive rate FPR) and aims to give an indication of the sensitivity and specificity that the models are capable of. Note that the cut-off that is optimal in a real world sense depends on the specific application, and this invention does not aim to propose an optimal cut-off. A further (widely used) parameter extracted from the ROC curve and used for models comparison is the Area Under the Curve (AUC), which can be interpreted as the probability that the classifier will assign a higher score to a randomly chosen positive example than to a randomly chosen negative example.
In order to select the optimal feature set, and therefore the best model architecture, a feature selection procedure was implemented. First, all features that had an AUC below 0.55 were excluded and n features were kept. Afterwards n single feature logistic regression models were trained (where feature is either vital sign extracted statistic or a biomarkers level, maximum biomarker level where multiple measurements are available). The DIC score was calculated by combining the output of the multiple univariate logistic models with a weighted average, with the weight being proportional to the univariate logistic model AUC calculated on the training set. The schema of this architecture is depicted in
Considering the output of each logistic model P(Y|Xi) as the likelihood of getting DIC given a predictor Xi and AUCi, the area under the ROC curve achieved by Xi calculated on the training set, the weight assigned to each predictor was calculated as follows:
The risk of getting DIC (P(Y)) is finally calculated as:
In order to select the optimal set of models (X, features) included in the ensemble classifier described above, the performance of different model combinations was evaluated. To reduce the number of combinations we have constrained the maximum number of items for combination to three. We have computed the best configuration using only vital signs, only biomarkers and their combination.
The combinations which provided the highest AUC for only biomarkers, only vital signs features and their combination have been selected and tested on the independent test set (see Table 4).
The results of the selection process and therefore the best model configurations are shown in Table 5.
The combination of bilirubin, lactate and creatinine was shown to be largely discriminative, achieving an AUC of 0.79 and 0.82 for the 24 hours model and 72 ICU admittance hours model, respectively. The lower accuracy obtained by the 24 hours model was probably related to the constraint of considering data collected at least 24 hours before DIC diagnosis. The assumption is that the closer to the diagnosis, the higher the increase and therefore the higher the predictability. According to literature the increase of such biomarkers is in most cases related to organ failure. The obtained results suggest that multiple organs are starting to fail, possibly due to lower perfusion caused by micro-vascular thromboses that could represent a first clinical sign of DIC occurrence. A further unexpected result of this work was the discovery that the coupling of vital signs with total bilirubin and lactate provides for a more accurate prediction. In fact, the largest accuracy was achieved by the combination of lactate, total bilirubin and respiration energy for the 24 hours model, which obtained an AUC curve of 0.85 and lactate, total bilirubin and heart rate skewness for 72 ICU admittance hours model, which obtained an AUC of 0.83.
Given the results obtained by the feature selection, three possible implementations are indicated: a model based on biomarkers, a model based on vital signs features and a model composed by the combination of biomarkers and vital signs features. The description of the general DIC risk assessment framework and the three implementation versions are show in
(a) Vital signs monitoring: continuous signals recording;
(b) Pre-processing: outliers removal based on physiological range;
(c) Windowing: 2 hours signal segmentation with 1 hour overlap; and
(d) Feature extraction: calculation of statistical features from vital signs windows;
The implementation version based on biomarkers requires at least a one-time, but preferably regular, e.g. daily biomarkers tests (green block,
In the example shown, a logistic function is used to estimate the probability of DIC given a selected single feature; feature based probabilities are then combined in a weighted average to obtain the final DIC prediction score expressed in terms of probability. The weights depend on the predictive accuracy of the separate estimator 8. Each of the algorithms (i.e. logistic function and weighted averaging) may be replaced by other methods known in the field (e.g., artificial neural networks, decision trees, etc.). Alternatively, the scheme below may be treated as a Bayesian network with probability tables estimated from the train data (naive Bayes) or from a priori knowledge (if available). Different blocks of the scheme could be combined in different ways and independently used to assess DIC risk probability.
The description of the general DIC risk assessment system is shown in
In the current application example, the scheme of the implemented model is shown in
The weights depend on the predictive accuracy of the separate estimators calculated over the training set. Note that each of the algorithms may be replaced by other machine learning methods known in the field (e.g., artificial neural networks, decision trees, etc.). Alternatively, the scheme below may be treated as a Bayesian network with probability tables estimated from the train data (naïve Bayes) or from a priori knowledge (if available). Different blocks of the scheme could be combined in different ways and independently used to assess DIC risk probability.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2018/065412 | 6/12/2018 | WO | 00 |
Number | Date | Country | |
---|---|---|---|
62518064 | Jun 2017 | US |