The present invention relates to a diagnosis assistance apparatus and a diagnosis assistance method for assisting a doctor in making a diagnosis of a cardiac disease, and further relates to a computer readable recording medium in which a program for realizing these apparatus and method has been recorded.
An electrocardiogram is a recording of the condition of the electrical activity of the heart of a patient as a graph. A doctor reads waveforms recorded on the electrocardiogram, and makes a diagnosis of a cardiac disease of the patient from the waveforms.
However, it is not easy to find an abnormality from the electrocardiogram, and the finding also depends on the doctors’ skills, which gives rise to the possibility that there are differences in the diagnosis results. In view of this, patent document 1 discloses an analysis apparatus that analyzes an electrocardiogram and outputs the result of the analysis.
Specifically, the analysis apparatus disclosed in patent document 1 obtains electrocardiogram data of a patient, and then divides the obtained electrocardiogram data into pieces of waveform data on a per-heartbeat basis. Next, the analysis apparatus disclosed in patent document 1 categorizes the individual pieces of waveform data based on a pre-set categorization condition, and generates groups of waveforms with similar features. Thereafter, the analysis apparatus disclosed in patent document 1 performs statistical processing with respect to the groups of waveforms, derives such statistical values as the number of abnormal heartbeats, the ratio of this number to the total number of heartbeats, and the maximum and minimum heart rates for each group of waveforms, adds information of the patient to the obtained statistical values, and outputs the result of the addition as the result of the analysis.
Patent document 1: Japanese Patent Laid-Open Publication No. 2007-20799
However, the analysis apparatus disclosed in patent document 1 does not present the possibility of a cardiac disease in view of information of the patient. Therefore, even if doctors made a diagnosis of cardiac diseases using the results of the analysis provided by this apparatus, there is a possibility that there are differences in the diagnosis results.
An example object of the present invention is to provide a diagnosis assistance apparatus, a diagnosis assistance method, and a computer-readable recording medium that solve the aforementioned problem, and present diagnostic materials based on information of a patient to be diagnosed in diagnosing a cardiac disease of a patient.
In order to achieve the above-described object, a diagnosis assistance apparatus includes:
In addition, in order to achieve the above-described object, a diagnosis assistance method includes:
Furthermore, in order to achieve the above-described object, a first computer readable recording medium according to an example aspect of the invention is a computer readable recording medium that includes recorded thereon a program, the program including instructions that cause a computer to carry out:
As described above, according to the invention, it is possible to present diagnostic materials based on information of a patient to be diagnosed in diagnosing a cardiac disease of a patient.
The following describes a diagnosis assistance apparatus, a diagnosis assistance method, and a program according to the present example embodiment with reference to
First, a schematic configuration of the diagnosis assistance apparatus according to the example embodiment will be described using
A diagnosis assistance apparatus 10 according to the example embodiment shown in
The learning model selection unit 11 selects a first learning model that indicates a relationship between waveforms of an electrocardiogram and a disease in accordance with a patient who is to be diagnosed. In the example embodiment, the learning model selection unit 11 selects any of a plurality of trained models/estimation models as the first learning model based on information of the patient to be diagnosed. The first learning model is, for example, a machine-trained model related to a relationship between electrocardiogram data and a disease, which has been generated in accordance with the attributes of the patient. Hereinafter, the first learning model is referred to as a “disease estimation model”. Examples of the information of the patient include personal information of the patient, such as medical record data, biological data, and attribute information.
Using the disease estimation model selected by the learning model selection unit 11, the estimation unit 12 estimates the possibility of a disease of the patient to be diagnosed based on electrocardiogram data of that patient. The presentation unit 13 presents the estimation result achieved by the estimation unit 12 and the evidence based on which the estimation result was derived.
As described above, the diagnosis assistance apparatus 10 selects a learning model appropriate for a patient to be diagnosed from information of that patient, such as the age, sex, previous medical history, family history, and smoking history, and estimates the possibility of a disease by applying electrocardiogram data of that patient to the selected learning model. That is to say, in diagnosing a cardiac disease of a patient, the diagnosis assistance apparatus 10 can present diagnostic materials based on information of a patient to be diagnosed.
Using
In contrast, when the diagnosis assistance apparatus 10 is used, the possibility of a disease in view of information (the medical record) of a patient to be diagnosed, as well as the evidence thereof, is presented based on electrocardiogram data with use of an analysis model that has been selected in accordance with that patient. This reduces the possibility that differences arise in the results of diagnoses made by doctors.
Next, the configuration and functions of the diagnosis assistance apparatus 10 according to the example embodiment will be described specifically using
As shown in
Furthermore, although not shown in
The learning model generation unit 14 generates disease estimation models 17 by performing machine learning with use of the training data 30. The method of machine learning is not limited in particular. Examples of the method of machine learning include deep learning.
Examples of the training data include information of patients, electrocardiogram data of patients, and labels indicating the diseases corresponding to the electrocardiogram data (hereinafter referred to as “ground truth labels”) that have been obtained in advance. Note that “patients” associated with the training data are patients from whom the training data has been obtained. Furthermore, examples of the information of patients to be used as the training data include the medical record data shown in
Examples of the ground truth labels indicating the diseases corresponding to electrocardiogram data include labels that are respectively added to sections of electrocardiogram data as shown in
Furthermore, in the example embodiment, the learning model generation unit 14 first inputs electrocardiogram data of patients included in the training data 30 to the disease estimation models 17, and obtains the output results. Then, the learning model generation unit 14 performs machine learning while using the obtained output results, information of the patients, and the ground truth labels indicating the diseases corresponding to the electrocardiogram data as training data, and generates a second learning model 16 indicating a correspondence relationship between the information (medical record data) of the patients and the disease estimation models.
As will be described later, the second learning model 16 is used by the learning model selection unit 11 in selecting a disease estimation model 17. Hereinafter, the second learning model is referred to as a “selection model”. The method of machine learning in this case, too, is not limited in particular. Examples of the method of machine learning include deep learning.
Furthermore, the learning model generation unit 14 can update the disease estimation model 17 using the selection model 16. Specifically, the learning model generation unit 14 first inputs information of individuals to be used as the training data to the selection model 16, and specifies a corresponding disease estimation model for each individual. Then, the learning model generation unit 14 selects electrocardiogram data and a ground truth label that correspond to the specified disease estimation model from among electrocardiogram data of patients and the ground truth labels indicating the diseases corresponding to the electrocardiogram data, which are used as the training data. Thereafter, the learning model generation unit 14 updates the disease estimation model using the selected electrocardiogram data and ground truth label.
Specifically, once the learning model generation unit 14 has specified a disease estimation model for each patient from whom training data has been obtained, it allocates electrocardiogram data and a ground truth label to be used as the training data for each patient. Then, for each patient, the learning model generation unit 14 inputs the allocated electrocardiogram data to the specified disease estimation model, compares the output results with the ground truth label, and updates the disease estimation model based on the comparison result.
In the example embodiment, using the above-described selection model, the learning model selection unit 11 selects a disease estimation model that fits a patient to be diagnosed from among the disease estimation models that have been generated in advance based on information of the patient to be diagnosed.
In the example embodiment, the estimation unit 12 analyzes the possibility of a disease of the patient to be diagnosed based on the output results of the disease estimation model that respectively correspond to pieces of partial electrocardiogram data obtained by dividing the electrocardiogram data of the patient to be diagnosed at the predetermined time interval. Specifically, the estimation unit 12 inputs each piece of partial electrocardiogram data to the disease estimation model, and obtains the output results. Then, using the output results that respectively correspond to the pieces of partial electrocardiogram data, the estimation unit 12 estimates the possibility of a disease of the patient to be diagnosed.
In the example embodiment, the presentation unit 13 presents the estimation result and the evidence based on which the estimation result was derived on a screen of the display apparatus 20. Examples of the estimation result that is presented at this time include information of a disease that has a possibility of being present in the patient to be diagnosed. Also, examples of the evidence that is presented at this time include the reason for specification of the disease that has a possibility of being present in the patient to be diagnosed.
Furthermore, the evidence may be at least one of a partial electrocardiogram data (a specific portion) and the attributes of the patient. Moreover, examples of the attributes include the attributes of the patient corresponding to the selected disease estimation model. In addition, after presenting the evidence, the presentation unit 13 can also present the estimation result in accordance with a request for presenting the estimation result in connection with the presented evidence. Also, the evidence may be at least one of pieces of data that have been input to the disease estimation model. Examples of the evidence also include a partial waveform included in electrocardiogram waveform data, the attributes of the patient to be diagnosed, and so forth.
Using
First, processing for generating learning models, which is performed by the diagnosis assistance apparatus 10, will be described using
The example embodiment is based on the precondition that, beforehand, medical record data is generated by taking a history from a patient to be diagnosed, and furthermore, electrocardiogram data is obtained by taking an electrocardiogram of the patient to be diagnosed, in order to obtain training data 30. In addition, a doctor makes a diagnosis with respect to the electrocardiogram data, and a ground truth label is set for each section (see
As shown in
Next, the learning model generation unit 14 executes machine learning with respect to the selection model indicating a correspondence relationship between medical record data and the disease estimation models (step A2). Specifically, the learning model generation unit 14 inputs electrocardiogram data included in the training data 30 to the disease estimation models 17, and obtains the output results. Then, the learning model generation unit 14 updates the parameters of the selection model 16 by executing machine learning while using the obtained output results and the ground truth labels included in the training data 30 as training data.
Next, the learning model generation unit 14 executes machine learning in order to generate the disease estimation models 17 that indicate the relationships between waveforms of electrocardiograms and diseases in accordance with patients (step A3). Specifically, the learning model generation unit 14 updates the parameters of the disease estimation models 17 by executing machine learning while using medical record data of the patients, electrocardiogram data of the patients, and the ground truth labels as training data.
Next, the learning model generation unit 14 determines whether the number of times steps A2 and A3 have been executed has reached a predetermined number of iterations (step A4). In a case where the result of the determination in step A4 shows that the number of times steps A2 and A3 have been executed has not reached the predetermined number of iterations, the learning model generation unit 14 executes step A2 again. On the other hand, in a case where the number of times steps A2 and A3 have been executed has reached the predetermined number of iterations, the learning model generation unit 14 ends the machine learning processing.
Next, processing of step A2 shown in
As shown in
For example, as shown in
Also, in
Next, for each patient from whom training data has been obtained, the learning model generation unit 14 decides on an appropriate disease estimation model 17 based on the output results (step A22).
Specifically, in step A22, for each patient from whom training data has been obtained, the learning model generation unit 14 specifies a disease estimation model that includes a large number of sections with a correct estimation result from among all disease estimation models 17. Then, the learning model generation unit 14 decides the specified disease estimation model as a disease estimation model appropriate for that patient.
A description is now given of an example of processing of step A22. As shown in
Next, the learning model generation unit 14 uses the disease estimation model of each patient that was decided on in step A22 as ground truth data, and updates parameters of the selection model 16 by performing machine learning while using this ground truth data and medical record data as training data (step A23). As a result, the selection model 16 is generated.
Next, processing of step A3 shown in
As shown in
Next, for each patient from whom training data has been obtained, the learning model generation unit 14 decides on a disease estimation model 17 appropriate for that patient based on the output results from the selection model 16 (step A32).
Next, for each patient from whom training data has been obtained, the learning model generation unit 14 assigns electrocardiogram data of that patient as learning data corresponding to the disease estimation model that has been decided on (step A33).
Specifically, in the example of
Next, the learning model generation unit 14 updates parameters of the disease estimation models 17 by performing machine learning for each disease estimation model while using medical record data of corresponding patients, as well as electrocardiogram data assigned in step A33, as training data (step A34). As a result, the disease estimation models 17 are generated.
The diagnosis assistance processing performed by the diagnosis assistance apparatus 10 will be described using
As shown in
Next, based on the information 40 of the patient obtained in step B1, the learning model selection unit 11 selects a disease estimation model 16 for estimating the possibility of a disease from electrocardiogram data of the patient to be diagnosed. Specifically, based on the output results of step B1, the learning model selection unit 11 selects a disease estimation model 17 corresponding to the patient from among the disease estimation models 17 that have been generated in advance (step B2).
Also, in step B2, the learning model selection unit 11 outputs the selected disease estimation model 17 and information that serves as the evidence for the selection to the estimation unit 12. As shown in
Next, the estimation unit 12 inputs electrocardiogram data 50 of the patient to be diagnosed to the disease estimation model 17 selected in step B2, and estimates the possibility of a disease of the patient (step B3). Also, the electrocardiogram data to be diagnosed is input in a state where it has been divided into, for example, Kn sections (see
For example, in step B3, the estimation unit 12 sets the sections by dividing the electrocardiogram data 50 at the predetermined time interval. Then, as shown in
In the example of
Furthermore, using the certainty degrees of respective diseases in each section, the estimation unit 12 calculates an overall certainty degree with respect to each disease as the possibility of the disease for the patient. Specifically, the estimation unit 12 may use the highest certainty degree among the certainty degrees in the respective sections as the overall certainty degree, or may use an average value of the certainty degrees in respective sections as the overall certainty degree. Furthermore, in a case where the average value is calculated as the overall certainty degree, only several high certainty degrees with large values may be used. The method of calculating the overall certainty degree, too, is not limited in particular.
Next, the estimation unit 12 specifies an evidence for the estimation of the disease in step B3 based on the information that serves as the evidence for the selection, which was output from the learning model selection unit 11 (step B4). Specifically, in connection with a cardiac disease for which the certainty degree is equal to or higher than a threshold, the estimation unit 12 specifies a section in which the certainty degree is equal to or higher than a certain value as the evidence.
Next, the estimation unit 12 outputs the possibility of the disease estimated in step B3, as well as the evidence specified in step B4, to the presentation unit 13 (step B5). Specifically, the estimation unit 12 outputs the name of the cardiac disease for which the certainty degree is equal to or higher than the threshold, as well as the section ID of the section in which the certainty degree indicating the possibility of that cardiac disease is equal to or higher than the certain value, to the presentation unit 13.
Next, the presentation unit 13 presents the estimation result output in step B3 and the evidence on the screen of the display apparatus 20 (step B6). Furthermore, the presentation unit 13 can also present “the information that serves as the evidence for the selection”, which was output to the estimation unit 12 in step B2, on the screen of the display apparatus 20.
For example, as shown in the example of
Also, in the example of
Note that the displayed evidences are not limited to the ones described above. For example, the evidences may be the names of items included in medical record data of a target patient, biological information of a target patient, and the like; the evidences may be other than these and not limited to these as long as they are information used in estimating a disease.
As described above, according to the example embodiment, the estimation is performed using the medical record and electrocardiogram of a patient, and the possibility of a cardiac disease is presented as the estimation result. Furthermore, according to the example embodiment, the evidence based on which the estimation result has been derived, as well as the related portion of the medical record of the patient, is also presented. Therefore, according to the example embodiment, in diagnosis of a cardiac disease of a patient using an electrocardiogram, diagnostic materials based on the medical record of the patient can be presented, and differences in the results of diagnoses of cardiac diseases are reduced.
It suffices for a program in the example embodiment to be a program that causes a computer to carry out steps A1 to A4 shown in
In the example embodiment, the storage unit 15 may be realized by storing data files constituting these in a storage device such as a hard disk provided in the compute. The computer includes general-purpose PC, smartphone and tablet-type terminal device.
Furthermore, the program according to the example embodiment may be executed by a computer system constructed with a plurality of computers. In this case, for example, each computer may function as one of the learning model selection unit 11, the estimation unit 12, the presentation unit 13, and the learning model generation unit 14.
Using
As shown in
The computer 110 may include a GPU (Graphics Processing Unit) or an FPGA (Field-Programmable Gate Array) in addition to the CPU 111, or in place of the CPU 111. In this case, the GPU or the FPGA can execute the programs according to the example embodiment.
The CPU 111 deploys the program (codes) according to the example embodiment, which is composed of a code group stored in the storage device 113 to the main memory 112, and carries out various types of calculation by executing the codes in a predetermined order. The main memory 112 is typically a volatile storage device, such as a DRAM (dynamic random-access memory).
Also, the program according to the example embodiment is provided in a state where it is stored in a computer-readable recording medium 120. Note that the program according to the present example embodiment may be distributed over the Internet connected via the communication interface 117.
Also, specific examples of the storage device 113 include a hard disk drive and a semiconductor storage device, such as a flash memory. The input interface 114 mediates data transmission between the CPU 111 and an input device 118, such as a keyboard and a mouse. The display controller 115 is connected to a display device 119, and controls display on the display device 119.
The data reader/writer 116 mediates data transmission between the CPU 111 and the recording medium 120, reads out the program from the recording medium 120, and writes the result of processing in the computer 110 to the recording medium 120. The communication interface 117 mediates data transmission between the CPU 111 and another computer.
Specific examples of the recording medium 120 include: a general-purpose semiconductor storage device, such as CF (CompactFlash®) and SD (Secure Digital); a magnetic recording medium, such as a flexible disk; and an optical recording medium, such as a CD-ROM (Compact Disk Read Only Memory).
Note that the diagnosis assistance apparatus 10 according to the can also be realized by using items of hardware that respectively correspond to the components, such as a circuit, rather than the computer in which the program is installed. Furthermore, a part of the diagnosis assistance apparatus 10 according to the example embodiment may be realized by the program, and the remaining part of the diagnosis assistance apparatus 10 may be realized by hardware.
A part or an entirety of the above-described example embodiment can be represented by (Supplementary Note 1) to (Supplementary Note 36) described below but is not limited to the description below.
A diagnosis assistance apparatus, comprising:
The diagnosis assistance apparatus according to Supplementary Note 1, wherein
using a second learning model indicating a correspondence relationship between information of patients and first learning models, the learning model selection unit selects one of the first learning models based on information of the patient to be diagnosed.
The diagnosis assistance apparatus according to Supplementary Note 1 or 2, wherein
the estimation unit estimates the possibility of the disease of the patient to be diagnosed based on output results of the first learning model that respectively correspond to pieces of partial electrocardiogram data obtained by dividing the electrocardiogram data of the patient to be diagnosed at a predetermined time interval.
The diagnosis assistance apparatus according to Supplementary Note 3, wherein
the estimation unit analyzes the possibility of the disease of the patient to be diagnosed based on results of analyzing the respective pieces of partial electrocardiogram data.
The diagnosis assistance apparatus according to any one of Supplementary Notes 1 to 4, wherein
the result of the estimation includes the disease.
The diagnosis assistance apparatus according to any one of Supplementary Notes 1 to 5, wherein
the evidence includes a ground based on which the disease has been specified.
The diagnosis assistance apparatus according to Supplementary Note 6, wherein
the evidence is at least one of the electrocardiogram data and attributes of the patient to be diagnosed.
The diagnosis assistance apparatus according to Supplementary Note 7, wherein
The diagnosis assistance apparatus according to any one of Supplementary Notes 1 to 8, wherein
the presentation unit presents the evidence, and presents the result of the estimation in accordance with a request for presenting the result of the estimation with respect to the presented evidence.
The diagnosis assistance apparatus according to any one of Supplementary Notes 1 to 9, further comprising
a learning model generation unit that generates the first learning model through machine learning while using information of individuals, pieces of electrocardiogram data of the individuals, and labels indicating diseases corresponding to the pieces of electrocardiogram data as training data.
The diagnosis assistance apparatus according to Supplementary Note 10, wherein
the learning model generation unit generates a second learning model through machine learning while using an output result from the first learning model corresponding to the pieces of electrocardiogram data of the individuals, the information of the individuals, and the labels indicating the diseases corresponding to the pieces of electrocardiogram data as training data.
The diagnosis assistance apparatus according to Supplementary Note 11, wherein
A diagnosis assistance method, comprising:
The diagnosis assistance method according to Supplementary Note 13, wherein
in the first learning model selection step, using a second learning model indicating a correspondence relationship between information of patients and first learning models, one of the first learning models is selected based on information of the patient to be diagnosed.
The diagnosis assistance method according to Supplementary Note 13 or 14, wherein
in the estimating step, the possibility of the disease of the patient to be diagnosed is estimated based on output results of the first learning model that respectively correspond to pieces of partial electrocardiogram data obtained by dividing the electrocardiogram data of the patient to be diagnosed at a predetermined time interval.
The diagnosis assistance method according to Supplementary Note 15, wherein
in the estimating step, the possibility of the disease of the patient to be diagnosed is analyzed based on results of analyzing the respective pieces of partial electrocardiogram data.
The diagnosis assistance method according to any one of Supplementary Notes 13 to 16, wherein
the result of the estimation includes the disease.
The diagnosis assistance method according to any one of Supplementary Notes 13 to 17, wherein
the evidence includes a ground based on which the disease has been specified.
The diagnosis assistance method according to Supplementary Note 18, wherein
the evidence is at least one of the electrocardiogram data and attributes of the patient to be diagnosed.
The diagnosis assistance method according to Supplementary Note 19, wherein
The diagnosis assistance method according to any one of Supplementary Notes 13 to 20, wherein
in the presenting step, the evidence is presented, and the result of the estimation is presented in accordance with a request for presenting the result of the estimation with respect to the presented evidence.
The diagnosis assistance method according to any one of Supplementary Notes 13 to 21, further comprising
a learning model generation step of generating the first learning model through machine learning while using information of individuals, pieces of electrocardiogram data of the individuals, and labels indicating diseases corresponding to the pieces of electrocardiogram data as training data.
The diagnosis assistance method according to Supplementary Note 22, wherein
in the generation of the learning model, a second learning model is generated through machine learning while using an output result from the first learning model corresponding to the pieces of electrocardiogram data of the individuals, the information of the individuals, and the labels indicating the diseases corresponding to the pieces of electrocardiogram data as training data.
The diagnosis assistance method according to Supplementary Note 23, wherein
A computer readable recording medium that includes a program recorded thereon, the program including instructions that cause a computer to carry out:
The computer readable recording medium according to Supplementary Note 25, wherein
in the first learning model selection step, using a second learning model indicating a correspondence relationship between information of patients and first learning models, one of the first learning models is selected based on information of the patient to be diagnosed.
The computer readable recording medium according to Supplementary Note 25 or 26, wherein
in the estimating step, the possibility of the disease of the patient to be diagnosed is estimated based on output results of the first learning model that respectively correspond to pieces of partial electrocardiogram data obtained by dividing the electrocardiogram data of the patient to be diagnosed at a predetermined time interval.
The computer readable recording medium according to Supplementary Note 27, wherein
in the estimating step, the possibility of the disease of the patient to be diagnosed is analyzed based on results of analyzing the respective pieces of partial electrocardiogram data.
The computer readable recording medium according to any one of Supplementary Notes 25 to 28, wherein
the result of the estimation includes the disease.
The computer readable recording medium according to any one of Supplementary Notes 25 to 29, wherein
the evidence includes a ground based on which the disease has been specified.
The computer readable recording medium according to Supplementary Note 30, wherein
the evidence is at least one of the electrocardiogram data and attributes of the patient to be diagnosed.
The computer readable recording medium according to Supplementary Note 31, wherein
The computer readable recording medium according to any one of Supplementary Notes 25 to 32, wherein
in the presenting step, the evidence is presented, and the result of the estimation is presented in accordance with a request for presenting the result of the estimation with respect to the presented evidence.
The computer readable recording medium according to any one of Supplementary Notes 25 to 33, wherein the program further including instructions that cause the computer to carry out:
a learning moder generation step of generating the first learning model through machine learning while using information of individuals, pieces of electrocardiogram data of the individuals, and labels indicating diseases corresponding to the pieces of electrocardiogram data as training data.
The computer readable recording medium according to Supplementary Note 34, wherein
in the learning model generation step, a second learning model is generated through machine learning while using an output result from the first learning model corresponding to the pieces of electrocardiogram data of the individuals, the information of the individuals, and the labels indicating the diseases corresponding to the pieces of electrocardiogram data as training data.
The computer readable recording medium according to Supplementary Note 35, wherein
Although the invention of the present application has been described above with reference to the example embodiment, the invention of the present application is not limited to the above-described example embodiment. Various changes that can be understood by a person skilled in the art within the scope of the invention of the present application can be made to the configuration and the details of the invention of the present application.
As described above, according to the invention, it is possible to shorten a time period required for machine learning in machine learning of a parameter of a score function used in binary classification. The invention is useful in a variety of systems where binary classification is performed.
10
11
12
13
14
15
16
17
20
30
40
50
110
111
112
113
114
115
116
117
118
119
120
121
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2020/036695 | 9/28/2020 | WO |