The present invention relates to a medical care support device, an operation method and non-transitory computer readable recording medium storing an operation program thereof, and a medical care support system.
In the medical field, integrated medical care support devices and medical care support systems that share medical care processes and medical care results between medical staff or medical departments so that the medical staff such as doctors and laboratory technicians can smoothly proceed with medical examinations and tests are being used. The medical care support device supports medical care by providing the medical staff with, for example, displaying a list of medical care processes and medical care results for a plurality of patients (JP2016-143204A).
On the other hand, in the medical field as well, the work of medical staff is streamlined by using machine learning, and for example, in an information processing apparatus described in JP5151913B, an operation history performed at the time of the past medical examination is analyzed and learned on an operation screen of an electronic medical record or the like. Then, for the medication or disease name input and operated by the medical staff, the next operation is predicted based on the learning result. The predicted operation is proposed as the next operation candidate.
Data including personal information of patients is handled in such a manner that the medical care support device and medical care support system described in JP2016-143204A display medical care information and medical care results, and the information processing apparatus described in JP5151913B performs analysis and learning from an operation screen of an electronic medical record. Therefore, in order to avoid a risk of leakage of personal information or the like of patients, each hospital facility is often operated only by the network inside the facility.
Further, in a case where the medical care support device and the medical care support system as described in JP2016-143204A are allowed to analyze and learn the operation history as in the information processing apparatus described in JP5151913B, the following problems occur. For example, in machine learning about a device that recognizes a lesion arear or the like with respect to a medical image, many medical images can be accumulated and learned in advance. However, in a case where the operation history is learned in the medical care support device and the medical care support system, it is necessary to accumulate and learn the operation history in the case of being operated by the same device, the same system, and at least the medical staff of the same job type as the medical care support device and medical care support system used in a predetermined hospital facility. That is, in the case of learning results generated based on operation histories in which even any one of the device, the system, and the job type is different, it is difficult to obtain a high learning effect.
Further, in machine learning, prediction accuracy can be improved by accumulating more samples and continuing learning appropriately, but considering the leakage of personal information or the like of patients, it is not possible to collect operation histories related to a large number of various users only by learning with a medical care support device and a medical care support system in one hospital facility, and thus it is not possible to improve the prediction accuracy.
Therefore, an object of the present invention is to provide a medical care support device, an operation method and a non-transitory computer readable recording medium storing an operation program thereof, and a medical care support system capable of collecting operation histories of many users and improving prediction accuracy while avoiding the risk of leakage of patient information.
According to an aspect of the present invention, there is provided a medical care support device comprising an operation history acquisition unit, a prediction execution unit, and an operation proposal unit. The operation history acquisition unit acquires an operation history in a case where a terminal device installed in a medical facility is operated, from the terminal device. The prediction execution unit predicts a next operation candidate in a case where the terminal device is input and operated by using a trained model generated by an external server learning the acquired operation history, the external server being installed outside the medical facility. The operation proposal unit makes a proposal to the terminal device from the next operation candidate predicted by the prediction execution unit.
It is preferable that user identification information for specifying the user who uses the terminal device is attached to the operation history.
It is preferable that the trained model is generated by the external server learning the operation history, and in a case where personal information is included in the operation history and the operation history is transmitted to the external server, the personal information is deleted.
It is preferable that the trained model is generated by the external server learning the operation history, and in a case where personal information is included in the operation history and the operation history is transmitted to the external server, the personal information is deleted, and a portion of the personal information part in the operation history is accumulated in an internal storage device installed in the same medical facility as the terminal device.
It is preferable that the operation history includes at least examination data, as an operation target.
It is preferable that the operation history includes at least one of an order of examination data referred to by the user, a change of a display layout input and operated by the user, or a display magnification, as an operation target.
It is preferable that the operation history includes at least one of a type of created document created by the user, an order in which the created document is created, or a creation time of the created document, as an operation target.
It is preferable that the operation history includes at least one of a function used by the user or an order in which the function is used, as an operation target.
It is preferable that the operation history includes at least a type of examination or treatment ordered by the user through the terminal device.
It is preferable that the operation history includes at least an order time indicating a time point or a time slot at which the user ordered an examination or treatment through the terminal device.
It is preferable that the operation proposal unit displays examination data on the terminal device as the proposal.
It is preferable that the operation proposal unit changes a layout of examination data displayed on the terminal device as the proposal.
It is preferable that the operation proposal unit performs, as the proposal, a display of a created document to be created by the user, or a display prompting creation of the created document by using the terminal device.
It is preferable that the operation proposal unit displays, as the proposal, an operation content to be input and operated by the user by using the terminal device.
It is preferable that the operation proposal unit performs, as the proposal, a display of an examination or treatment to be ordered by the user, or a display prompting the user to order by using the terminal device.
It is preferable that the operation proposal unit makes the proposal according to a time point or a time slot.
According to another aspect of the present invention, there is provided a medical care support system comprising a medical care support device, a terminal device, and an external server.
According to another aspect of the present invention, there is provided an operation method of a medical care support device, the operation method comprising: an operation history acquisition step of acquiring an operation history in a case where a terminal device installed in a medical facility is operated, from the terminal device; a prediction execution step of predicting a next operation candidate in a case where the terminal device is input and operated by using a trained model generated by an external server learning the acquired operation history, the external server being installed outside the medical facility; and an operation proposal step of making a proposal to the terminal device from the predicted next operation candidate.
According to another aspect of the present invention, there is provided a non-transitory computer readable recording medium storing an operation program of a medical care support device, the operation program comprising: an operation history acquisition step of acquiring an operation history in a case where a terminal device installed in a medical facility is operated, from the terminal device; a prediction execution step of predicting a next operation candidate in a case where the terminal device is input and operated by using a trained model generated by an external server learning the acquired operation history, the external server being installed outside the medical facility; and an operation proposal step of making a proposal to the terminal device from the predicted next operation candidate.
According to the aspects of the present invention, it is possible to collect the operation histories of many users and improve the prediction accuracy while avoiding the risk of leakage of patient information.
As shown in
The network 14 is a wide area network (WAN) that widely connects the medical care support device 11 placed in the plurality of medical facilities A, B, . . . , X and the learning device 13 via a public line network such as the Internet or a dedicated line network.
As shown in
The medical information system 17 comprises the medical care support device 11, the client terminal 12, and a server group 18, and is configured to be able to transmit and receive data to and from each other via a network 16. The network 16 is a local area network (LAN), and it is desirable to use a communication cable such as an optical fiber so that medical image data can be transmitted at high speed.
The client terminal 12 (terminal device) is a terminal for receiving a service (a function of the medical care support device 11) from the medical care support device 11, and is a computer directly operated by a medical staff such as a doctor, a laboratory technician, or a nurse (including the case of a tablet terminal, etc.), or the like. The client terminal 12 is installed in a medical department such as an internal medicine or a surgery, various examination departments such as a radiological examination department or a clinical examination department, a nurse center, or other necessary places. Further, the client terminal 12 can be provided for each medical staff, and can be shared by a plurality of medical staff. Therefore, as shown in
The medical care support device 11 provides the client terminal 12 with a display screen including medical care data (for example, an image or the like itself) and/or information indicating the location of the medical care data (for example, a link to an image or the like), for example, in response to a request from the client terminal 12. Medical care data is images, reports, examination results, and other medical care processes acquired or created in medical examinations, tests, surgeries, and the like, or is data obtained as a result of medical care or information indicating the location of these (so-called links (aliases), etc.). The medical care support device 11 acquires medical care data to be used on the display screen from the server group 18.
A display screen provided by the medical care support device 11 to the client terminal 12 refers to data used by the client terminal 12 to form a screen of a display unit 36 (see
Specifically, the display screens provided by the medical care support device 11 to the client terminal 12 include an initial screen 71 (see
The medical care support device 11 provides a display screen to the client terminal 12 in a description format using a markup language such as extensible markup language (XML) data, for example. The client terminal 12 displays an XML format display screen using a web browser. The medical care support device 11 can provide a display screen to the client terminal 12 in another format such as JavaScript (registered trademark) object notation (JSON) instead of XML.
The server group 18 searches for medical care data in response to the request from the medical care support device 11, and provides the medical care data corresponding to the request to the medical care support device 11. The server group 18 includes an electronic medical record server 21, an image server 22, a report server 23, and the like.
The electronic medical record server 21 has a medical record database 21A for storing electronic medical records. An electronic medical record is a collection of one or a plurality of pieces of medical care data. Specifically, the electronic medical record includes, for example, medical care data such as a medical examination record, a result of a specimen test, a patient's vital sign, an order for examinations, a treatment record, or accounting data. The electronic medical record can be input and viewed using the client terminal 12.
A medical examination record is a record of the contents and results of the interview or palpation, the disease name, or the like. A specimen is blood or tissue collected from a patient, or the like, and a specimen test is a blood test, a biochemical test, or the like. A vital sign is data indicating a patient's condition such as a patient's pulse, blood pressure, or body temperature. An order for examinations is a request for examinations such as a specimen test, photography using various modality, report creation, treatment or surgery, medication, or the like. A treatment record is a record of treatment, surgery, medication, prescription, or the like. Accounting data is data related to consultation fees, drug fees, hospitalization fees, and the like.
The image server 22 is a so-called PACS (picture archiving and communication system) server, and has an image database 22A in which examination images are stored. An examination image is an image obtained by various image examinations such as computed tomography (CT) examination, magnetic resonance imaging (MRI) examination, X-ray examination, ultrasonography, and endoscopy. These examination images are recorded in a format conforming to, for example, the digital imaging and communications in medicine (DICOM) standard. The examination image can be viewed using the client terminal 12.
The report server 23 has a report database 23A for storing an interpretation report. An interpretation report (hereinafter simply referred to as a report) is a report that summarizes the interpretation results of the examination image obtained by the image examination. The interpretation of the examination image is performed by a radiologist. The report can be created and/or viewed using the client terminal 12.
A patient ID is attached to each of the above electronic medical records, examination images, and reports. In addition to the patient ID, information that identifies the medical staff who input the medical care data for each piece of medical care data is attached to the electronic medical record. In addition to the patient ID, information that identifies the medical staff (specifically, the laboratory technician) who performed the examination is attached to the examination image. Information that identifies the medical staff (specifically, the radiologist) that created the report is attached to the report. Information that identifies the medical staff is an ID such as the name of the medical staff or a unique number and/or symbol given to each medical staff (hereinafter referred to as a medical staff ID).
The medical care support device 11, the client terminal 12, the learning device 13, and the servers 21 to 23 constituting the server group 18 are configured by installing an operating system program and an application program such as a server program or a client program based on a computer such as a server computer, a personal computer, or a workstation. That is, the basic configurations of the medical care support device 11, the client terminal 12, the learning device 13, and the servers 21 to 23 constituting the server group 18 are the same, and a central processing unit (CPU), a memory, a storage, a communication unit, etc., and a connection circuit for connecting these are provided. The communication unit is a communication interface (modem, router, LAN interface board, or the like) for connecting to the network 14 or the network 16. The connection circuit is, for example, a motherboard that provides a system bus and/or a data bus and the like.
As shown in
The client terminal 12 stores an operation program 39 in addition to the operating system program and the like in the storage 33. The operation program 39 is an application program for receiving the function of the medical care support device 11 by using the client terminal 12. In the present embodiment, the operation program 39 is a web browser program. Here, the operation program 39 can be a dedicated application program for receiving the function of the medical care support device 11. The operation program 39 may include one or a plurality of gadget engines for controlling a part or all of the display screen provided by the medical care support device 11. A gadget engine is a subprogram that exhibits various functions by operating alongside a web browser or the like.
In a case where the operation program 39 is activated in the client terminal 12, as shown in
The GUI control unit 41 displays the display screen provided by the medical care support device 11 on the web browser in the display unit 36. The GUI control unit 41 controls the client terminal 12 in response to an operation instruction input using the operation unit 37, such as a button click operation with a pointer.
The request issuing unit 42 issues various processing requests (hereinafter referred to as processing requests) to the medical care support device 11 in response to the operation instruction of the operation unit 37. The processing request issued by the request issuing unit 42 is, for example, a distribution request for the display screen, an edit request for the display screen, or the like. The request issuing unit 42 transmits the processing request to the medical care support device 11 via the communication unit 34 and the network 16.
The distribution request for the display screen is for requesting the medical care support device 11 to distribute a display screen having a specific configuration. For example, the distribution can be received by designating any one of the clinical flow screen 81, the layout display screen 101, and the like, depending on the distribution request for the display screen.
The edit request for the display screen is for requesting the medical care support device 11 to edit the contents of the medical care data and the like to be displayed on the display screen after receiving the distribution of the display screen having a specific configuration from the medical care support device 11. For example, in a case where the distribution of the clinical flow screen 81 is received, the edit request for the display screen is a request for designating or changing a list of patients to be displayed, designating or changing a display target period of the medical care process, designating or changing the medical care process to be displayed, or sorting the display contents.
The distribution request and/or edit request for the display screen includes information such as a medical staff ID and an address on the network of the client terminal 12. The medical staff ID is entered on a login screen (not shown) for the medical care support system 10 (or the medical care support device 11).
As shown in
The medical care support device 11 stores an operation program 59 in addition to the operating system and the like in the storage 53. The operation program 59 is an application program for causing the computer constituting the medical care support device 11 to function as the medical care support device 11. In a case where the operation program 59 is activated, as shown in
The request reception unit 61 receives various processing requests such as a distribution request and an edit request for the display screen from the client terminal 12. In a case where the request reception unit 61 receives various processing requests, the request reception unit 61 inputs a processing instruction to each unit that executes the corresponding processing according to the content of the requested processing. For example, in a case where there is a distribution request for the display screen from the client terminal 12, the request reception unit 61 inputs a generation instruction of the corresponding display screen to the display screen generation unit 62. Similarly, in a case where there is an edit request for the display screen from the client terminal 12, the request reception unit 61 inputs an edit instruction of the corresponding display screen to the display screen generation unit 62. The request reception unit 61 also receives a request to log in to the medical care support device 11, and a login processing unit (not shown) executes login processing such as confirmation of the medical staff ID and password.
The display screen generation unit 62 generates or edits various display screens such as the clinical flow screen 81. The display screen generation unit 62 also functions as an operation proposal unit. In the present embodiment, in a case where there is a new distribution request for the display screen, the display screen generation unit 62 generates XML data representing the display screen, and in a case where there is an edit request for the display screen, the display screen generation unit 62 edits the XML data created earlier according to the request content.
The display screen generation unit 62 accesses the server group 18 as necessary, and acquires information regarding a medical care process or the like used for generating or editing the display screen. The display screen generation unit 62 can hold a part or all of the information regarding the medical care process or the like acquired from the server group 18 in order to reduce the access frequency to the server group 18. In a case where the login processing unit normally completes the login processing, the display screen generation unit 62 generates an initial screen 71 (see
The operation history acquisition unit 63 extracts, for example, information related to the input operation of the client terminal 12 by the medical staff who is the user among various processing requests from the client terminal 12 received by the request reception unit 61 and acquires an operation history. User identification information for specifying a user who uses the client terminal 12 is attached to this operation history. The operation in which the operation history acquisition unit 63 extracts information related to the user's input operation of the client terminal 12 and acquires an operation history constitutes an operation history acquisition step.
The medical facility information is information about a medical facility in which the medical care support device 11 is installed, and includes information on a facility ID, a facility name, and a medical department, and the like. In addition, the present invention is not limited thereto, and the medical facility information may include the number of registered users, an address, contact information, and the like. For example, the medical facility information may be stored in advance in the storage 53 of the medical care support device 11, or may be acquired from the client terminal 12 or the server group 18.
The operation information is information related to an operation in a case where the medical staff who is a user inputs and operates the client terminal 12, and includes, for example, a function name, an operation target, an operation content, an operation attribute, and the like. Specifically, the function name includes examination data viewing, the operation target includes a file name of the endoscopic image, and the operation content includes instructions such as image OPEN of the endoscopic image (opening the endoscopic image file), image movement, and image enlargement. Furthermore, in a case where the operation content is image movement, the numerical value of the coordinates for the image movement is included as the operation attribute, and in a case where the operation content is image enlargement, the numerical value of the magnification ratio (display magnification) for the image enlargement is included as the operation attribute. In addition, the present invention is not limited thereto, in addition to endoscopic images, medical images such as X-ray images, examination results such as blood tests and pathological tests, and examination data such as examination reports may be used as operation targets, and the operation contents may include the order in which the operation targets are referred to, the change of the display layout input and operated by the user, and the like.
The user identification information attached to the operation history specifies the user who uses the client terminal 12, and includes a user ID, a job type, a gender, an age, and the like. The user ID is, for example, a number or the like entered in the case of logging in to the client terminal 12, and information such as a job type, a gender, and an age may be stored in advance in the storage 53 of the medical care support device 11 in association with the user ID, for example, or may be acquired from the client terminal 12 or the server group 18. The user identification information attached to the operation history may include personal information of the user (name of the medical staff who is the user, etc.), and in that case, as will be described later, in a case of transmitting the operation history to the external server, it is preferable to delete the portion of the user's personal information before transmitting. In the present embodiment, the user identification information does not include the user's personal information. Further, the user identification information may include years of experience and the like.
Further, the reference patient identification information attached to the operation history is patient identification information included in a display screen such as the layout display screen 101 displayed in a case where the client terminal 12 is used, that is, a patient ID associated with an electronic medical record edited by the client terminal 12, an examination image, and a report, or the like. Further, the disease name, gender, age, etc. other than the patient ID may be acquired from the client terminal 12 or the server group 18. In addition, the reference patient identification information may include the length of hospitalization and the like. The reference patient identification information attached to the operation history may include personal information of the patient (name of the patient, etc.), and in that case, as will be described later, in a case of transmitting the operation history to the external server, it is preferable to delete the portion of the patient's personal information before transmitting. In the present embodiment, the patient identification information does not include the patient's personal information.
As described above, the operation history acquisition unit 63 transmits the operation history with the user identification information and the like to the learning device 13 via the network 14. Like the medical care support device 11, the learning device 13 is a high-performance computer having a well-known hardware configuration such as the CPU 51, the memory 52, the storage 53, the communication unit 54, and the connection circuit 55, and a well-known operation system and the like installed therein, and further having a server function.
As shown in
The control unit 69 controls the processing flow of the acquisition unit 65, the registration unit 66, and the learning unit 68. The registration unit 66 registers the operation history acquired by the acquisition unit 65 and the user identification information attached to the operation history in the storage unit 67. The storage unit 67 may be, for example, a part of the storage device provided in the learning device 13, or may be a storage device connected via the network 14.
The registration unit 66 registers an operation history as a sample for machine learning or the like by the learning unit 68. The registration unit 66 repeats the registration of the operation history from the medical care support device 11 while the medical care support system 10 is in operation.
The learning unit 68 performs machine learning for generating a trained model that outputs the next operation candidate in a case where any input operation is performed on the client terminal 12 by using a plurality of operation histories registered in the storage unit 67. In the present embodiment, the learning unit 68 specifically extracts the data as the operation target, the operation content (function) used as the input operation, or the order of the operation content used, and performs machine learning. The learning unit 68 reads the operation history registered in the storage unit 67 and the user identification information attached thereto, and generates a trained model from, for example, a plurality of operation histories having the same user ID or from a plurality of operation histories of users having the same attributes. Users having the same attributes refer to users having the same job type, medical department, patient's disease name, etc. included in the user identification information. Alternatively, in a case where a trained model is initially generated from the operation history of a user having the same attribute, and a predetermined number of operation histories having the same user ID are accumulated, a trained model may be generated from a plurality of operation histories having the same user ID. In a case where a trained model is generated from an operation history having the same user ID, it is possible to make a prediction optimized for each individual user, while in a case where a trained model is generated from an operation history of a user having the same attribute, there is an advantage that the operation history as a larger sample can be collected.
The learning device 13 transmits the trained model generated from the operation history to the medical care support device 11 via the network 14. In this case, the trained model is transmitted to the medical care support device 11 of the transmission source to which the operation history is transmitted by referring to the user ID attached to the operation history as a sample of the trained model.
The prediction execution unit 64 predicts the next operation in a case where the client terminal 12 is input and operated. The prediction execution unit 64 can be configured by using a trained model (so-called artificial intelligence (AI) program) generated by the learning device 13 described above.
The prediction execution unit 64 configured by using the trained model outputs the next operation candidate in a case where any input operation is performed on the client terminal 12. The operation of predicting the next operation candidate in a case where the prediction execution unit 64 inputs and operates the client terminal 12 constitutes a prediction execution step. The input operation of the client terminal 12 is acquired from the request reception unit 61 or the like, as in the case where the operation history acquisition unit 63 acquires the operation history. For example, in a case where a trained model is generated from the example of the operation history as shown in
In the present embodiment, the display screen generation unit 62 makes a proposal to the client terminal 12 from the next operation candidate predicted by the prediction execution unit 64. Specifically, the display screen generation unit 62 generates or edits XML data representing the display screen by using the next operation candidate predicted by the prediction execution unit 64, and transmits the XML data to the client terminal 12. The operation in which the display screen generation unit 62 makes a proposal to the client terminal 12 from the next operation candidate predicted by the prediction execution unit 64 constitutes an operation proposal step.
The medical care support system 10 configured as described above operates as follows. First, in a case where the medical staff logs in to the medical care support system 10 using the client terminal 12, the display screen generation unit 62 generates the initial screen 71 shown in
The initial screen 71 has, for example, three display fields of a schedule display field 72, a mail display field 73, and a list display field 74. The display contents of the schedule display field 72 and the mail display field 73 are generated by a gadget engine, which is a part of the operation program 39 of the client terminal 12, by obtaining information from the client terminal 12 or other devices or systems. Further, in the present embodiment, the list display field 74 displays at least a part of the clinical flow screen 81. Therefore, the display screen generation unit 62 generates the initial screen 71 including the schedule display field 72 and the mail display field 73 that do not include the contents, and the list display field 74 that includes the contents of the clinical flow screen 81. The client terminal 12 uses a gadget engine to display the initial screen 71 supplemented with the contents of the schedule display field 72 and the mail display field 73 on the screen of the display unit 36.
In a case where all the contents to be displayed do not fit in the list display field 74, a scroll bar 78 and a scroll bar 79 for transitioning (so-called scrolling) the display contents of the list display field 74 are displayed in the list display field 74 or in the vicinity of the list display field 74. The scroll bar 78 is a GUI that is operated in a case where the display content of the list display field 74 is changed in the horizontal direction and a non-display portion is displayed. The scroll bar 79 is a GUI that is operated in a case where the display content of the list display field 74 is changed in the vertical direction and a non-display portion is displayed. The GUI control unit 41 performs such GUI display and control.
On the above initial screen 71, for example, in a case where a predetermined menu or the like is operated using a GUI such as a pointer (not shown), the request issuing unit 42 issues a distribution request for the display screen. In the present embodiment, in order to display the layout display screen 101 that is not displayed on the initial screen 71, an operation for displaying the layout display screen 101, for example, an input operation for selecting one of the patients displayed in the list display field 74 is executed by using the GUI. Thereby, the request issuing unit 42 issues a distribution request for the layout display screen 101.
In a case where the request issuing unit 42 issues a distribution request for the display screen, in the medical care support device 11, the request reception unit 61 receives the distribution request for the display screen, and the display screen generation unit 62 generates the display screen related to the distribution request for the display screen. In the present embodiment, the display screen generation unit 62 refers to the patient identification information (for example, the patient ID) included in the list display field 74, and acquires the information related to the patient. Specifically, an electronic medical record, an examination image, a report, and the like to which the same patient identification information as the patient identification information included in the list display field 74 is attached are appropriately acquired from the server group 18 or the like. Then, the layout display screen 101 is generated by using the information related to the patient acquired by referring to the patient identification information.
The GUI control unit 41 of the client terminal 12 receives the distribution of the display screen generated as described above, and the distributed screen is displayed on the screen of the display unit 36 instead of the initial screen 71, or is superimposed while leaving the initial screen 71 and displayed in another window or the like.
As described above, in a case where the display screen generation unit 62 generates the display screen related to the distribution request, before the generation of the display screen, at the same time as the generation of the display screen (in parallel with the generation of the display screen), or after the display screen is generated, the prediction execution unit 64 outputs the next operation candidate in response to the input operation. That is, the prediction execution unit 64 outputs the next operation candidate in response to the input operation of displaying the layout display screen 101 (see
Next, the display screen generation unit 62 makes a proposal to the client terminal 12 based on the next operation candidate predicted by the prediction execution unit 64. That is, in response to the input operation of displaying the layout display screen 101 shown in
In a case where the endoscopic image 102 is included from the beginning as the information for creating the layout display screen 101, instead of displaying the endoscopic image 102, the display screen in which the layout is changed, that is, the endoscopic image 102 is moved or the endoscopic image 102 is enlarged may be edited. Then, the display screen generation unit 62 distributes the edited display screen to the client terminal 12. Further, in this case, it is preferable that the prediction execution unit 64 predicts the movement amount and the magnification ratio of the endoscopic image 102, and the display screen generation unit 62 moves the endoscopic image 102 by the movement amount predicted by the prediction execution unit 64, and enlarges the endoscopic image 102 by the similarly predicted magnification ratio.
After that, the GUI control unit 41 of the client terminal 12 receives the distribution of the display screen edited as described above, and the distributed screen is displayed on the screen of the display unit 36 instead of the layout display screen 101 initially displayed.
As described above, since the operation history is transmitted to the learning device 13 as an external server to generate a trained model in the medical care support system 10 and the medical care support device 11 of the present embodiment, it is possible to collect a sufficient number of operation histories as a sample, and it is possible to improve the prediction accuracy of the trained model and the prediction execution unit 64. Further, in a case where the operation history is transmitted to the learning device 13 as an external server, a user ID or the like that does not include personal information is attached to the operation history as user identification information, and it is thus possible to avoid a risk of leakage of personal information.
The editing of the display screen based on the next operation candidate predicted by the prediction execution unit 64, which is performed by the display screen generation unit 62, is not limited to the above operation, and for example, as shown in
In the example shown in
Further, as another display based on the next operation candidate predicted by the prediction execution unit 64, which is performed by the display screen generation unit 62, the operation content (function) to be input and operated by the user may be displayed. For example, in a case where the next operation candidate predicted by the prediction execution unit 64 is the movement of the endoscopic image or the enlargement of the endoscopic image, the content may be displayed as the operation content 103 (see
In the first embodiment, the learning unit 68 performs machine learning by extracting the data as the operation target in the operation history, the function used as the input operation, and the order of the input operations, but the content of machine learning from the operation history is not limited thereto, and in the second embodiment, the learning unit 68 may use the symptom, disease name, and examination name of the patient who has been treated by the user in the operation history as the operation target, and machine-learn what kind of examination data was referred to in the case of a predetermined symptom, disease name, and examination name. The configuration of the medical care support system 10 and the medical care support device 11 is the same as that of the first embodiment.
In the operation history shown in
In the present embodiment, the learning unit 68 of the learning device 13 uses the symptom, disease name, and examination name of the patient who has been treated by the user as an operation target, and machine-learns what kind of examination data was referred to in the case of a predetermined symptom, disease name, and examination name. Specifically, the learning unit 68 generates a trained model that outputs examination data names with high reference frequency for each job type of the user for a predetermined symptom, disease name, and examination name. The trained model generated by the learning unit 68 is transmitted to the medical care support device 11, and constitutes the prediction execution unit 64 of the medical care support device 11 as in the first embodiment.
In a case where the trained model is generated as described above, the medical care support system 10 operates as follows. Note that, the process is the same as in the first embodiment from the time when the medical staff logs in to the medical care support system 10 using the client terminal 12 until the layout display screen 101 is displayed. Then, the prediction execution unit 64 extracts the symptom, the disease name, and the examination name as the operation target from the data such as the electronic medical record, the examination image, and the report included in the layout display screen 101.
Then, the prediction execution unit 64 outputs the examination data name to be referred to next by the user from the extracted symptom, disease name, and examination name. For example, in a case where a trained model is generated from the example of the operation history as shown in
The display screen generation unit 62 makes a proposal to the client terminal 12 from the next operation candidate predicted by the prediction execution unit 64. That is, in response to the input operation of displaying the layout display screen 101, the display screen of the examination data (for example, the endoscopic image) to be referred to next is replaced with the layout display screen 101, or the display screen superimposed and displayed on the layout display screen 101 is edited. Then, the display screen generation unit 62 distributes the edited display screen to the client terminal 12. The GUI control unit 41 of the client terminal 12 receives the distribution of the display screen edited as described above, and the distributed screen is displayed on the screen of the display unit 36 instead of the layout display screen 101 initially displayed. By the above operation, it is possible to avoid the risk of leakage of personal information as in the first embodiment, and it is possible to improve the prediction accuracy of the trained model and the prediction execution unit 64.
The example of the operation history that the learning unit 68 performs machine learning is not limited to the one shown in the first and second embodiments, and for example, the created document created by the user may be used as the operation target in the operation history, and a trained model may be created by extracting, from the operation history, the type and frequency of creation of the created document as the operation target, or in what order the created documents were created. The configuration of the medical care support system 10 and the medical care support device 11 is the same as that of the first embodiment.
In the present embodiment, the learning unit 68 of the learning device 13 uses the name of the created document created by the user as an operation target, and machine-learns the type and frequency of creation of the created document, or the order in which the created document is created. Specifically, the learning unit 68 generates a trained model that outputs the name of the created document with high creation frequency for each job type of the user by machine learning. The trained model generated by the learning unit 68 is transmitted to the medical care support device 11 and used in the prediction execution unit 64 of the medical care support device 11 as in the first embodiment.
In a case where the trained model is generated as described above, the medical care support system 10 operates as follows. Note that, the process is the same as in the first embodiment from the time when the medical staff logs in to the medical care support system 10 using the client terminal 12 until the layout display screen 101 is displayed. Then, the prediction execution unit 64 extracts the job type of the user from various processing requests from the logged-in user ID. Then, the prediction execution unit 64 outputs the name of the created document that is likely to be created next by the user from the extracted job types of the user. For example, in a case where a trained model is generated from the example of the operation history as shown in
The display screen generation unit 62 makes a proposal to the client terminal 12 from the next operation candidate predicted by the prediction execution unit 64. That is, in response to the input operation that a user of a predetermined job type has logged in, a created document (for example, a general X-ray interpretation report) that is likely to be created next is set as the created document to be created next, and the display screen is replaced with the layout display screen 101, or the display screen superimposed and displayed on the layout display screen 101 is edited. Then, the display screen generation unit 62 distributes the edited display screen to the client terminal 12.
The GUI control unit 41 of the client terminal 12 receives the distribution of the display screen edited as described above, and the distributed screen is displayed on the screen of the display unit 36 instead of the layout display screen 101 initially displayed. In a case where the user has already created the document set by the display screen generation unit 62 as the created document to be created next, the created document may not be displayed. By the above operation, it is possible to avoid the risk of leakage of personal information as in the first embodiment, and it is possible to improve the prediction accuracy of the trained model and the prediction execution unit 64.
In the third embodiment, the prediction execution unit 64 predicts the name of the created document that is likely to be created next for each job type of the user, but the prediction of the prediction execution unit 64 is not limited thereto, and a proposal may be made by predicting the name of the created document that is likely to be created according to the examination implementation status and the document creation status for each user or user's job type.
In the present embodiment, the learning unit 68 of the learning device 13 uses the name of the created document created by the user as an operation target, and machine-learns the creation time of the created document. Specifically, the learning unit 68 generates a trained model that outputs the creation time at which the created document is frequently created for each job type of the user. The trained model generated by the learning unit 68 is transmitted to the medical care support device 11, and constitutes the prediction execution unit 64 of the medical care support device 11 as in the first embodiment.
In a case where the trained model is generated as described above, the medical care support system 10 operates as follows. The prediction execution unit 64 outputs a created document that is likely to be created and a creation time at which there is a high possibility of creating a created document for each job type of the user extracted from various processing requests. For example, in a case where a trained model is generated from the example of the operation history as shown in
The display screen generation unit 62 makes a proposal to the client terminal 12 from the next operation candidate predicted by the prediction execution unit 64. In this case, the display screen generation unit 62 accesses the server group 18 after acquiring the prediction by the prediction execution unit 64, and also acquires the creation status of whether the predicted created document has been created or has not been created. As shown in
Further, the proposal made by the display screen generation unit 62 may be made at a time later than the creation time predicted by the prediction execution unit 64, and for example, in a case where the created document to be created when a predetermined time has elapsed from the predicted creation time has not been created, the display 105 prompting the creation of the created document may be performed.
In each of the above embodiments, as the contents to be machine-learned from the operation history, the machine learning is performed on the user-centered timing, such as the order of user's input operations, the frequency of creating created documents, the creation time at which created documents are created, and the creation status of created documents. However, the present invention is not limited thereto, and the creation time according to the medical care schedule of the patient in charge of the user may be machine-learned and predicted by the prediction execution unit 64. The configuration of the medical care support system 10 and the medical care support device 11 is the same as that of the first embodiment.
In the present embodiment, the learning unit 68 of the learning device 13 uses the created document name corresponding to each medical care item for the medical care item of the patient in charge of the user as an operation target, and machine-learns the creation time according to the medical care schedule of the patient. That is, the learning unit 68 generates a trained model that outputs the creation time at which the created document is frequently created according to the medical care schedule of the patient. The trained model generated by the learning unit 68 is transmitted to the medical care support device 11, and constitutes the prediction execution unit 64 of the medical care support device 11 as in the first embodiment.
In a case where the trained model is generated as described above, the medical care support system 10 operates as follows. The prediction execution unit 64 outputs, for the medical care items of the patient in charge of the user extracted from various processing requests, the created document corresponding to each medical care item and the creation time at which the created document is frequently created in the medical care schedule. For example, in a case where a trained model is generated from the example of the operation history as shown in
The display screen generation unit 62 makes a proposal to the client terminal 12 from the next operation candidate predicted by the prediction execution unit 64. In this case, the display screen generation unit 62 sets a creation time that is likely to be created, which is predicted by the prediction execution unit 64, (for example, after a predetermined time of endoscopy), as the creation time at which the user should create the created document, and edits the display screen of which the created document to be created next (for example, the endoscope report) is replaced with the display screen being displayed, or is superimposed and displayed on the display screen being displayed at the creation time. In this case, the created document that is likely to be created next is set as the created document to be created next. Then, the display screen generation unit 62 distributes the edited display screen to the client terminal 12.
The GUI control unit 41 of the client terminal 12 receives the distribution of the display screen edited as described above, and the distributed screen is displayed on the screen of the display unit 36. In a case where the user has already created the name of the created document to be created next, which is predicted by the prediction execution unit 64, the display of the created document may not be performed.
Alternatively, in a case where the prediction execution unit 64 predicts the creation time, a display prompting the creation may be performed as in the fourth embodiment. In addition, the creation time referred to here is not limited to after any medical care, before medical care, etc., and is not limited to the time point such as hour and minute, but also includes the time slot such as morning and afternoon, the date, the day of the week, and the like. As the display 105 prompting the creation, a sentence “General X-ray interpretation report has not been created.” and a frame line 105A surrounding the sentence are thickened, and the color of the frame line 105A is different from the surrounding color. In this case, in a case where the user has already created the name of the created document to be created next, which is predicted by the prediction execution unit 64, the display 105 prompting the creation may not be performed. By the above operation, it is possible to avoid the risk of leakage of personal information as in the first embodiment, and it is possible to improve the prediction accuracy of the trained model and the prediction execution unit 64.
In the fourth and fifth embodiments described above, machine learning is performed on the creation time at which the user created the created document, and the display of the created document or the display prompting the creation is performed at the creation time predicted by the prediction execution unit 64, but the present invention is not limited thereto. For example, after machine learning about the type of examination or treatment (including surgery or treatment) ordered by the user and the order time at which the user ordered the examination or treatment from the operation history of the user, the prediction execution unit 64 makes a prediction in the same manner as in each of the above embodiments. Then, from the prediction of the prediction execution unit 64, the display screen generation unit 62 may perform the display of the examination or treatment to be ordered or display the user to prompt the user to order the examination or treatment (for example, a sentence such as “MRI examination order has not been issued.” is displayed on the display screen.) at the order time at which the user should order. In addition, the order time referred to here is not limited to after any medical care, before medical care, etc., and is not limited to the time point such as hour and minute, but also includes the time slot such as morning and afternoon, the date, the day of the week, and the like. In this way, in the case of predicting the order time at which the user should order, in the operation history, the time point or time slot at which the user ordered may be acquired as the order time regardless of the medical care items such as after the examination and after the medical care. Thereby, it possible to learn the exact tendency of the user, such as, for example, ordering examinations at the time slot during the morning hours since it takes time to process pathological tests, or performing necessary examinations and document creation by then since the day of the week for surgery is determined by the medical facility.
In each of the above embodiments, in a case where the operation history is transmitted to the learning device 13, a user ID or the like that does not include personal information is attached to the operation history. However, as shown in
Further, as shown in
In each of the above embodiments, hardware structures of the processing units that execute various processes such as the GUI control unit 41, the request issuing unit 42, the request reception unit 61, the display screen generation unit 62, the operation history acquisition unit 63, the prediction execution unit 64, the acquisition unit 65, the registration unit 66, the storage unit 67, the learning unit 68, and the control unit 69 are various processors as shown below. The various processors include a central processing unit (CPU) as a general-purpose processor functioning as various processing units by executing software (program), a programmable logic device (PLD) as a processor of which the circuit configuration can be changed after manufacturing such as a field programmable gate array (FPGA), a dedicated electrical circuit as a processor having a circuit configuration designed exclusively for executing various kinds of processing, and a graphical processing unit (GPU), and the like.
One processing unit may be configured by one of various processors, or may be configured by a combination of the same or different kinds of two or more processors (for example, a combination of a plurality of FPGAs, a combination of a CPU and an FPGA, or a combination of a GPU and a CPU). In addition, a plurality of processing units may be configured by one processor. As an example of configuring a plurality of processing units by one processor, first, as represented by a computer, such as a client or a server, there is a form in which one processor is configured by a combination of one or more CPUs and software and this processor functions as a plurality of processing units. Second, as represented by a system on chip (SoC) or the like, there is a form of using a processor for realizing the function of the entire system including a plurality of processing units with one integrated circuit (IC) chip. Thus, various processing units are configured by using one or more of the above-described various processors as hardware structures.
More specifically, the hardware structure of these various processors is an electrical circuit (circuitry) in the form of a combination of circuit elements, such as semiconductor elements. According to another aspect of the present invention, there is provided a medical care support device comprising a processor configured to acquire operation histories in a case where a plurality of terminal devices installed in a plurality of medical facilities are operated, from the terminal devices, predict next operation candidates in a case where the terminal devices are input and operated by using a trained model generated by learning the acquired operation histories by an external server installed outside the medical facilities, and make proposals to the terminal devices from the next operation candidates.
It goes without saying that the present invention is not limited to the above-described embodiment, and various configurations can be adopted as long as the gist of the present invention is not deviated. Further, the present invention is employed to a storage medium for storing the program in addition to the program.
From the above description, a medical care support device according to the following Additional Item 1 can be grasped.
[Additional Item 1]
A medical care support device comprising a processor, in which the processor is configured to acquire an operation history in a case where a user operates a terminal device installed in a medical facility, from the terminal device, predict a next operation candidate in a case where the terminal device is input and operated by using a trained model generated by an external server learning the acquired operation history, the external server being installed outside the medical facility, and make a proposal to the terminal device from the predicted next operation candidate.
10: medical care support system
11: medical care support device
12: client terminal
13: learning device
14, 16: network
17: medical information system
18: server group
21: electronic medical record server
21A: medical record database
22: image server
22A: image database
23: report server
23A: report database
31, 51: central processing unit (CPU)
32, 52: memory
33, 53: storage
34, 54: communication unit
35, 55: connection circuit
36: display unit
37: operation unit
39, 59: operation program
41: graphical user interface (GUI) control unit
42: request issuing unit
61: request reception unit
62: display screen generation unit
63: operation history acquisition unit
64: prediction execution unit
65: acquisition unit
66: registration unit
67: storage unit
68: learning unit
69: control unit
71: initial screen
72: schedule display field
73: mail display field
74: list display field
78, 79 scroll bar
81: clinical flow screen
101: layout display screen
102: endoscopic image
102A, 105A: frame line
103: operation content
105: display
A1, A2, B1: doctor
G1, G2, G19: group
N1: technician
Number | Date | Country | Kind |
---|---|---|---|
2019-177805 | Sep 2019 | JP | national |
This application is a Continuation of PCT International Application No. PCT/JP2020/030784 filed on Aug. 13, 2020, which claims priority under 35 U.S.C § 119(a) to Japanese Patent Application No. 2019-177805 filed on Sep. 27, 2019. Each of the above application(s) is hereby expressly incorporated by reference, in its entirety, into the present application.
Number | Date | Country | |
---|---|---|---|
Parent | PCT/JP2020/030784 | Aug 2020 | US |
Child | 17695867 | US |