This application is based upon and claims the benefit of priority from Japanese Patent Application No. 2018-200529, filed on Oct. 25, 2018; the entire contents of which are incorporated herein by reference.
Embodiments described herein relate generally to a medical information processing apparatus and a medical information processing method.
In recent years, as the medical technology becomes more advanced, the types and the number of pieces of diagnosis and/or treatment data (hereinafter, simply “diagnosis/treatment data”) acquired in diagnosis and treatment processes on a daily basis are increasing. Also, methods used by medical doctors for determining diagnoses and treatment plans with reference to diagnosis/treatment data are becoming more complicated. For these reasons, in the actual medical workplaces, systems are known by which various types of diagnosis/treatment data necessary when a medical doctor evaluates diagnoses and treatment plans are displayed on a single screen.
A medical information processing apparatus according to an embodiment includes a specifying unit, an obtaining unit, a determining unit, and a display controlling unit. The specifying unit is configured to specify principal data from among a plurality of types of diagnosis/treatment data. The obtaining unit is configured to obtain peripheral data that is diagnosis/treatment data having a high degree of relevance to the principal data, by using the principal data as a reference. The determining unit is configured to determine a screen configuration indicating positional arrangements of the principal data and the peripheral data to be used at the time of displaying the principal data and the peripheral data, in accordance with an attribute of the peripheral data with respect to the principal data. The display controlling unit is configured to display the principal data and the peripheral data on a display screen of a display by using the screen configuration.
Exemplary embodiments of a medical information processing apparatus and a medical information processing method will be explained in detail, with reference to the accompanying drawings.
For example, as illustrated in
The electronic medical record system 300 is configured to generate diagnosis/treatment data related to prescriptions and nursing records provided for an examined subject (hereinafter “patient”) and to store the generated data into a storage within the system. Further, the electronic medical record system 300 is configured to transmit any of the diagnosis/treatment data stored in the storage to the medical information processing apparatus 100, in response to a request from the medical information processing apparatus 100.
The radiation department system 400 is configured to generate diagnosis/treatment data related to a vital test or an image examination performed on the patient and to store the generated data into a storage within the system. In this situation, examples of the image examination include: an examination using a Computed Tomography (CT) image taken by an X-ray Computed Tomography (CT) apparatus; an examination using a Magnetic Resonance (MR) image taken by a Magnetic Resonance Imaging (MRI) apparatus; an examination using an ultrasound image taken by an ultrasound diagnosis apparatus, and an examination using an X-ray image taken by an X-ray diagnosis apparatus. For example, the radiation department system 400 includes a Picture Archiving and Communication System (PACS) or the like and is configured to store medical images such as CT images, MR images, ultrasound images, X-ray images, and the like into a database, by using a format compliant with a Digital Imaging and Communications in Medicine (DICOM) scheme. Further, the radiation department system 400 is configured to transmit any of the diagnosis/treatment data stored in the storage to the medical information processing apparatus 100 in response to a request from the medical information processing apparatus 100.
The specimen testing system 500 is configured to generate diagnosis/treatment data related to a specimen test performed on the patient and store the generated data into a storage within the system. Further, the specimen testing system 500 is configured to transmit any of the diagnosis/treatment data stored in the storage to the medical information processing apparatus 100 in response to a request from the medical information processing apparatus 100.
The medical information processing apparatus 100 is configured to obtain any of the various types of diagnosis/treatment data from the electronic medical record system 300, the radiation department system 400, and the specimen testing system 500, via the network 200 and to perform various types of information processing processes by using the obtained diagnosis/treatment data. For example, the medical information processing apparatus 100 may be realized by using a computer device such as a workstation, a personal computer, or a tablet terminal.
More specifically, the medical information processing apparatus 100 includes a network (NW) interface 110, a storage 120, an input interface 130, a display 140, and processing circuitry 150.
The NW interface 110 is connected to the processing circuitry 150 and is configured to control transfer of various types of data and communication performed between the medical information processing apparatus 100 and the systems. More specifically, the NW interface 110 is configured to receive the diagnosis/treatment data from the systems and to output the received diagnosis/treatment data to the processing circuitry 150. For example, the NW interface 110 may be realized by using a network card, a network adaptor, a Network Interface Controller (NIC), or the like.
The storage 120 is connected to the processing circuitry 150 and is configured to store therein various types of data. More specifically, the storage 120 is configured to store therein the diagnosis/treatment data received from the systems. For example, the storage 120 may be realized by using a semiconductor memory element such as a Random Access Memory (RAM) or a flash memory, or a hard disk, an optical disk, or the like. The storage 120 is an example of the storage.
The input interface 130 is connected to the processing circuitry 150 and is configured to receive input operations of various types of instructions and various types of information from an operator. More specifically, the input interface 130 is configured to convert the input operations received from the operator into electrical signals and to output the electrical signals to the processing circuitry 150. For example, the input interface 130 may be realized by using a trackball, a switch button, a mouse, a keyboard, a touchpad on which an input operation is performed by touching the operation surface thereof, a touch screen in which a display screen and a touchpad are integrally formed, a contactless input circuit using an optical sensor, an audio input circuit, and/or the like. In the present disclosure, the input interface 130 does not necessarily have to include one or more physical operation component parts such as a mouse and a keyboard. For instance, possible examples of the input interface 130 include an electrical signal processing circuitry configured to receive an electrical signal corresponding to an input operation from an external input device provided separately from the apparatus and to output the electrical signal to a controlling circuit.
The display 140 is connected to the processing circuitry 150 and is configured to display various types of information and various types of images. More specifically, the display 140 is configured to convert data of the various types of information and the various types of images sent thereto from the processing circuitry 150 into display-purpose electrical signals and to output the electrical signals. For example, the display 140 may be realized by using a liquid crystal monitor, a Cathode Ray Tube (CRT) monitor, a touch panel, or the like.
The processing circuitry 150 is configured to control constituent elements of the medical information processing apparatus 100 in response to an input operation received from the operator via the input interface 130. More specifically, the processing circuitry 150 is configured to store the diagnosis/treatment data output from the NW interface 110 into the storage 120. Further, the processing circuitry 150 is configured to read any of the diagnosis/treatment data from the storage 120 and to display the read data on the display 140.
An exemplary configuration of the medical information processing apparatus 100 according to the present embodiment has thus been explained. The medical information processing apparatus 100 structured as described above is configured to cause the various types of diagnosis/treatment data obtained from the electronic medical record system 300, the radiation department system 400, and the specimen testing system 500 to be accumulated in an integrated diagnosis/treatment database (DB) constructed by the storage 120.
Further, the medical information processing apparatus 100 has a function of displaying, on a single screen, various types of diagnosis/treatment data that are necessary when a medical doctor evaluates diagnoses and treatment plans, by using the diagnosis/treatment data accumulated in the integrated diagnosis/treatment DB. For example, the medical information processing apparatus 100 divides a display screen of the display 140 into a plurality of regions and displays mutually-different types of diagnosis/treatment data in the regions.
In this situation, in the present embodiment, the medical information processing apparatus 100 is configured so that the operator is able to compare the various types of diagnosis/treatment data with one another from multiple aspects.
More specifically, in the present embodiment, the processing circuitry 150 includes a specifying function 151, an obtaining function 152, a determining function 153, and a display controlling function 154. The specifying function 151 is an example of the specifying unit. The obtaining function 152 is an example of the obtaining unit. The determining function 153 is an example of the determining unit. The display controlling function 154 is an example of the display controlling unit.
Processing functions of the processing circuitry 150 will be explained in detail below, with reference to
The specifying function 151 is configured to specify principal data from among a plurality of types of diagnosis/treatment data.
More specifically, the specifying function 151 is configured to detect diagnosis/treatment data focused on by the operator from among the plurality of types of diagnosis/treatment data being displayed on the display 140 and to specify the detected diagnosis/treatment data as the principal data.
In this situation, the specifying function 151 is configured to specify the principal data on the basis of a line of sight of the operator. For example, by using line-of-sight tracking technology such as eye tracking, the specifying function 151 is configured to successively detect gaze positions indicating the positions gazed upon by the operator on the display screen of the display 140 and to measure a time period during which a gaze position is continuously detected, for each of the regions in which the pieces of diagnosis/treatment data are displayed on the display screen. Further, when there is a region in which the gaze position is continuously detected for a predetermined time period, the specifying function 151 specifies the diagnosis/treatment data displayed in the region as the principal data.
For instance, as illustrated in
Alternatively, the specifying function 151 may specify principal data on the basis of an operation history of the operator. For example, among the pieces of diagnosis/treatment data that are currently displayed on the display screen 141 of the display 140, the specifying function 151 specifies diagnosis/treatment data that has been referenced by the same operator the largest number of times in the past, as the principal data.
For instance, let us discuss an example in which, as illustrated in
In another example, from among the various types of diagnosis/treatment data displayed on the display screen 141, the specifying function 151 may specify a type that has been referenced by the same operator the largest number of times in the past and may specify the most recent piece of diagnosis/treatment data among the specified type of diagnosis/treatment data, as principal data. For example, when image data 21 has been referenced the largest number of times, the specifying function 151 specifies the most recent piece of image data among the image data 21 as the principal data.
In yet another example, the specifying function 151 may speculate diagnosis/treatment data to be referenced next by the operator on the basis of an operation history of the operator by using a machine learning method, to specify the speculated diagnosis/treatment data as principal data. In that situation, for example, the specifying function 151 uses a trained model generated by a machine learning process for which the operation history and the diagnosis/treatment data from the past of the operator are used as learning-purpose data. Further, the specifying function 151 exercises control so that, by inputting the operation history of the operator to the trained model, the diagnosis/treatment data to be referenced next by the operator is output.
In the present example, the situations were explained in which the specifying function 151 detects the diagnosis/treatment data focused on by the operator, on the basis of one of: the line of sight of the operator; and the operation history of the operator. However, possible embodiments are not limited to this example. For instance, the specifying function 151 may detect the diagnosis/treatment data focused on by the operator, by receiving, from the operator, an operation to designate a piece of diagnosis/treatment data from among the plurality of types of diagnosis/treatment data displayed on the display 140, via the input interface 130.
By using the principal data specified by the specifying function 151 as a reference, the obtaining function 152 is configured to obtain peripheral data that is diagnosis/treatment data having a high degree of relevance to the principal data.
More specifically, the obtaining function 152 is configured to derive a degree of relevance for each piece of diagnosis/treatment data by using the principal data as a reference and to obtain a piece of diagnosis/treatment data having a high degree of relevance as the peripheral data.
In this situation, on the basis of identification information contained in the diagnosis/treatment data, the obtaining function 152 categorizes the peripheral data as one of: information of the same type as the principal data; information explaining the principal data; and information having a high possibility of being compared with the principal data. After that, the obtaining function 152 derives the degree of relevance on the basis of which of the following the peripheral data is: the information of the same type as the principal data; the information explaining the principal data; and the information having a high possibility of being compared with the principal data.
More specifically, the obtaining function 152 obtains peripheral data to be categorized as the information of the same type as the principal data, on the basis of an “SOP Class UID” in a DICOM tag (0008,0016) contained in diagnosis/treatment data.
For example, as illustrated in
For example, the obtaining function 152 extracts the value of the “SOP Class UID” from the DICOM tag (0008,0016) contained in the principal data and obtains, from among the pieces of diagnosis/treatment data stored in the integrated diagnosis/treatment DB, a piece of diagnosis/treatment data that has the “SOP Class UID” of the same value as the extracted value. Subsequently, with respect to the obtained piece of diagnosis/treatment data, the obtaining function 152 derives a degree of relevance to the principal data on the basis of the acquisition time (the date, the time, or the like) of each of the pieces of peripheral data. In this situation, the obtaining function 152 derives the degree of relevance of each of the pieces of peripheral data in such a manner that the closer the acquisition time of a piece of peripheral data is to the acquisition time of the principal data, the higher is the degree of relevance. After that, the obtaining function 152 obtains such diagnosis/treatment data of which the derived degree of relevance is equal to or higher than a threshold value as the peripheral data from the integrated diagnosis/treatment DB and categorizes the peripheral data as the information that is of the same type as the principal data.
Further, on the basis of identification information identifying reference data written in a format of DICOM Structured Report (SR) and contained in the diagnosis/treatment data, the obtaining function 152 obtains peripheral data to be categorized as the information explaining the principal data.
For example, as illustrated in
Further, on the basis of relevance degree information stored in the storage 120, the obtaining function 152 obtains peripheral data to be categorized as the information having a high possibility of being compared with the principal data.
In this situation, on the basis of a DICOM tag or the like contained in the diagnosis/treatment data, a plurality of pieces of diagnosis/treatment data that can serve as pieces of peripheral data are defined in advance for each principal data.
For example, as illustrated in
Further, for each piece of diagnosis/treatment data defined in the manner described above, the storage 120 stores therein the relevance degree information in which the number of times the piece of diagnosis/treatment data has been browsed or operated together with the principal data is set as a degree of relevance.
For example, as illustrated in
The degrees of relevance set in the relevance degree information do not each necessarily have to be the number of times the data has been browsed or operated together with the principal data and may be, for example, an index value defined by the operator.
Further, by referring to the relevance degree information stored in the storage 120, the obtaining function 152 derives a degree of relevance for each piece of diagnosis/treatment data, obtains such diagnosis/treatment data of which the degree of relevance is equal to or higher than the threshold value as the peripheral data from the integrated management DB, and categorizes the peripheral data as the information having a high possibility of being compared with the principal data. In this situation, deriving the degrees of relevance denotes obtaining the degrees of relevance from the relevance degree information.
In accordance with attributes of the peripheral data with respect to the principal data that were obtained by the obtaining function 152, the determining function 153 is configured to determine a screen configuration indicating positional arrangements of the principal data and the peripheral data to be used at the time of displaying these pieces of data.
More specifically, the determining function 153 is configured to detect the type of the display 140 and to determine the screen configuration in accordance with the type.
For example, the determining function 153 detects whether the display 140 is an HMD or a high resolution display, by using an Application Programming Interface (API) of an Operating System (OS) installed in the medical information processing apparatus 100. Further, the determining function 153 obtains the resolution of the display 140 determined as one of an HMD and a high resolution display. After that, the determining function 153 determines arrangement positions of the principal data and the peripheral data, on the basis of screen configuration information stored in the storage 120.
In this situation, the determining function 153 determines the screen configuration on the basis of the screen configuration information stored in the storage 120.
For example, as illustrated in
Further, the determining function 153 determines the screen configuration so that the principal data is arranged in one of the following manners: in a straight-on position of the line of sight of the operator; and at the center of the display screen.
For example, as illustrated in
Further, the determining function 153 determines the screen configuration so that the peripheral data categorized as the information of the same type as the principal data is arranged in a time series in a horizontal direction.
For example, as illustrated in
In this situation, the determining function 153 arranges the pieces of peripheral data 41 acquired earlier than the principal data 31 to be positioned side by side on the left-hand side of the principal data 31, according to the order of acquisition times, starting with the closest one to that of the principal data 31. Further, the determining function 153 arranges the pieces of peripheral data 41 acquired later than the principal data 31 to be positioned side by side on the right-hand side of the principal data 31, according to the order of acquisition times starting with the closest one to that of the principal data 31. Further for example, the determining function 153 displays information indicating the acquisition times of the pieces of data so as to be superimposed on the principal data 31 and the pieces of peripheral data 41 (e.g., “2017/10/01”, “2017/10/07”, “2017/10/11”, “2017/10/20”, and “2017/11/01” in
In this situation, the determining function 153 may arrange the time axis set in the horizontal direction to be on an equal scale or on mutually-different scales between the left-hand side and the right-hand side of the principal data 31. Further, for example, while the pieces of peripheral data 41 are evenly arranged in the horizontal direction, the determining function 153 may set the scale of the time axis to fit the acquisition times of the pieces of peripheral data 41.
Further, the determining function 153 is configured to determine the screen configuration so that the peripheral data categorized as the information explaining the principal data is arranged on the upper side of the principal data.
For example, as illustrated in
In this situation, for example, when there is more than one piece of peripheral data 51 categorized as the information explaining the principal data 31, the determining function 153 arranges the pieces of peripheral data 51 to be positioned side by side on the upper side of the principal data 31, according to the order of levels of detail, starting with the closest one to the level of detail of the principal data 31.
Further, the determining function 153 determines the screen configuration so that the peripheral data categorized as the information having a high possibility of being compared with the principal data is arranged on the lower side of the principal data, in descending order of the degrees of relevance.
For example, as illustrated in
In this situation, the determining function 153 arranges the different type of image data 61 and the medication data 71 to be positioned on the lower side of the principal data 31, in the descending order of the degrees of relevance to the principal data 31. For example, when the different type of image data 61 has a higher degree of relevance than the medication data 71 does, the determining function 153 arranges the different type of image data 61 to be positioned below the principal data 31 and arranges the medication data 71 to be positioned further below.
In this situation, for example, when a plurality of pieces of peripheral data having mutually-different acquisition times have been obtained as the pieces of peripheral data categorized as the information having a high possibility of being compared with the principal data 31, the determining function 153 arranges the pieces of peripheral data to be positioned side by side in the horizontal direction along the same time axis as that of the principal data 31. For example, as illustrated in
The display controlling function 154 is configured to display the principal data and the peripheral data on the display screen of the display 140 by using the screen configuration determined by the determining function 153.
More specifically, the display controlling function 154 arranges the principal data specified by the specifying function 151 and the peripheral data obtained by the obtaining function 152 to be positioned according to the screen configuration determined by the determining function 153 and to be displayed on the display screen of the display 140.
For example, as illustrated in
Alternatively, for example, as illustrated in
When the display is realized in this manner, the left-and-right direction of the display screen expresses time, while the upper side of the display screen serves as a space expressing the levels of detail of the data, and the lower side of the display screen serves as a space expressing the range (the types) of the data. More specifically, degrees of clinical changes in the diagnosis/treatment data over the course of time is indicated along the horizontal direction of the display screen. Further, levels of clinical details of the diagnosis/treatment data are indicated on the upper side of the display screen. Also, degrees of clinical changes in the other diagnosis/treatment data over the course of time and degrees of effects of diagnosis/treatment actions are indicated on the lower side of the display screen.
The processing functions of the processing circuitry 150 have thus been explained. In the present example, for instance, the processing circuitry 150 is realized by using a processor. In this situation, the processing functions of the processing circuitry 150 are stored in the storage 120 in the form of computer-executable programs. Further, by reading and executing the programs from the storage 120, the processing circuitry 150 realizes the functions corresponding to the programs. In other words, the processing circuitry 150 that has read the programs has the functions indicated within the processing circuitry 150 in
For example, as illustrated in
Subsequently, by using the principal data specified by the specifying function 151 as a reference, the obtaining function 152 obtains peripheral data that is diagnosis/treatment data having a high degree of relevance to the principal data, from the integrated diagnosis/treatment DB structured by the storage 120 (step S12). This process is realized, for example, as a result of the processing circuitry 150 reading and executing the predetermined program corresponding to the obtaining function 152 from the storage 120.
After that, the determining function 153 determines a screen configuration indicating positional arrangements of the principal data and the peripheral data to be used at the time of displaying these pieces of data, in accordance with attributes of the peripheral data with respect to the principal data obtained by the obtaining function 152 (step S13). This process is realized, for example, as a result of the processing circuitry 150 reading and executing the predetermined program corresponding to the determining function 153 from the storage 120.
Subsequently, by using the screen configuration determined by the determining function 153, the display controlling function 154 displays the principal data and the peripheral data on the display screen of the display 140 (step S14). This process is realized, for example, as a result of the processing circuitry 150 reading and executing the predetermined program corresponding to the display controlling function 154 from the storage 120.
Further, for example, unless the operator instructs that observation of the principal data be ended (step S15: No), the processing circuitry 150 exercises control so that the abovementioned series of processes is repeatedly performed. Further, when the operator instructs that the observation of the principal data be ended (step S15: Yes), the processing circuitry 150 ends the processes performed by the processing functions.
For example, as illustrated in
Subsequently, the determining function 153 determines the screen configuration so as to arrange the principal data to be positioned in one of the following manners: in a straight-on position of the line of sight of the operator; and at the center of the display screen (step S132).
After that, the determining function 153 determines the screen configuration so that the peripheral data categorized as the information of the same type as the principal data is arranged in a time series in the horizontal direction (step S133).
Further, the determining function 153 determines the screen configuration so that the peripheral data categorized as the information explaining the principal data is arranged on the upper side of the principal data (step S134).
Furthermore, the determining function 153 determines the screen configuration so that the peripheral data categorized as the information having a high possibility of being compared with the principal data is arranged on the lower side of the principal data in descending order of the degrees of relevance (step S135).
In the present example, the process at step S133, the process at step S134, and the process at step S135 described above may be performed in a different order or may be performed in parallel to one another.
As explained above, in the first embodiment, the specifying function 151 is configured to specify the principal data from among the plurality of types of diagnosis/treatment data. Further, the obtaining function 152 is configured to obtain the peripheral data that is the diagnosis/treatment data having a high degree of relevance to the principal data, by using the principal data specified by the specifying function 151 as a reference. Further, in accordance with the attributes of the peripheral data with respect to the principal data obtained by the obtaining function 152, the determining function 153 is configured to determine the screen configuration indicating the positional arrangements of the principal data and the peripheral data to be used at the time of displaying these pieces of data. Further, the display controlling function 154 is configured to display the principal data and the peripheral data on the display screen of the display 140 by using the screen configuration determined by the determining function 153.
In this configuration, the peripheral data having a high degree of relevance to the specific principal data is displayed on the display screen of the display 140 while being arranged appropriately in accordance with the attribute thereof with respect to the principal data. Consequently, the operator is able to compare the various types of diagnosis/treatment data with one another from multiple aspects.
Further, in the embodiment described above, the determining function 153 is configured to determine the screen configuration so that the principal data is arranged one of the following manners: in a straight-on position of the line of sight of the operator; and at the center of the display screen, while the peripheral data categorized as the information of the same type as the principal data is arranged in a time series in the horizontal direction; the peripheral data categorized as the information explaining the principal data is arranged on the upper side of the principal data; and the peripheral data categorized as the information having a high possibility of being compared with the principal data is arranged on the lower side of the principal data in the descending order of the degrees of relevance.
In this configuration, along the left-and-right direction of the display screen, the degrees of clinical changes in the diagnosis/treatment data over the course of time are indicated. On the upper side of the display screen, the levels of clinical details of the diagnosis/treatment data are indicated. On the lower side of the display screen, the degrees of clinical changes in the other diagnosis/treatment data over the course of time and the degrees of effects of the diagnosis/treatment actions are indicated. Further, the operator is thereby able to compare the mutually-different groups of data in a wide variety with one another, from multiple aspects without the need to adjust the arrangement positions of the pieces of data. Consequently, the operator is able to concentrate on diagnosing processes and treatment plans without having the train of through interrupted.
Further, in the embodiment described above, the determining function 153 is configured to detect the type of the display 140 and to determine the screen configuration in accordance with the type.
With this configuration, by using any of various types of displays such as HMDs and high resolution displays, it is possible to display the principal data and the peripheral data while using an optimal display format for each type. Consequently, it is possible to present the pieces of diagnosis/treatment data more effectively to enable the operator to compare the various types of diagnosis/treatment data with one another from multiple aspects.
For example, possible methods for displaying various types of diagnosis/treatment data on a single screen include a method by which display axes (a diagnosis/treatment data space) are brought into correspondence with pieces of diagnosis/treatment data, so that each piece of diagnosis/treatment data is displayed on an arbitrary one of the axes. According to this method, however, each piece of diagnosis/treatment data would be displayed as being projected onto a two-dimensional space on the arbitrary one of the axes. In contrast, according to the embodiment described above, it is possible to three-dimensionally display the various types of diagnosis/treatment data by using the HMD. The operator is therefore able to compare the various types of diagnosis/treatment data in a more intuitive manner.
Further, for example, as one of the methods for displaying various types of diagnosis/treatment data on a single screen, a method is known by which it is possible to gain a comprehensive understanding of a plurality of pieces of time-series data, by three-dimensionally expressing the time-series data with a perspective projection. According to this method, however, because the diagnosis/treatment data would be displayed along the single time axis on which the present is closer to the viewer and the past is farther from the viewer, it would be impossible, for example, to compare pieces of diagnosis/treatment data at two mutually-different times with each other, while having a comprehensive understanding of the data. In contrast, in the embodiment described above, the various types of diagnosis/treatment data are displayed while being kept in correspondence with one another, according to the levels of detail of the data and the range (the types) of the data, in addition to the time thereof. Consequently, the operator is able to compare the various types of diagnosis/treatment data with one another, while having a more comprehensive understanding of the data.
In the first embodiment described above, for example, another arrangement is also acceptable in which the operator is able to arbitrarily change the amount of the peripheral data to be displayed on the display screen. In the following sections, this example will be explained as a second embodiment. The second embodiment will be explained while a focus is placed on differences from the first embodiment. Detailed explanations of some of the configurations that are the same as those in the first embodiment will be omitted.
In the second embodiment, the determining function 153 is configured to determine a screen configuration so that the amount of the peripheral data changes on the display screen, in response to one of: the operator moving in a depth direction; and an operation performed by the operator.
For example, when the display 140 is an HMD, the determining function 153 determines the screen configuration so that the amount of the peripheral data changes on the display screen in response to the operator moving in a depth direction.
For example, as illustrated in
In contrast, when the display 140 is a high resolution display, the determining function 153 determines the screen configuration so that the amount of the peripheral data changes on the display screen, in response to an operation performed by the operator and received via the input interface 130. For example, in accordance with the operation amount of the operation received via the input interface 130, the determining function 153 increases or decreases the amount of the peripheral data, similarly to the example in which the display 140 is an HMD.
As explained above, in the second embodiment, the determining function 153 is configured to determine the screen configuration so that the amount of the peripheral data changes on the display screen of the display 140, in response to one of: the operator moving in a depth direction; and the operation performed by the operator. With this arrangement, the operator is able to arbitrarily switch the display of the diagnosis/treatment data on the display screen between the display in a comprehensive view and the display in a detailed view. Consequently, the operator is able to compare the pieces of diagnosis/treatment data with one another more efficiently.
In the first embodiment, the example was explained in which the obtaining function 152 is configured to derive the degree of relevance for each piece of diagnosis/treatment data by referring to the relevance degree information stored in the storage 120 and to further obtain such diagnosis/treatment data of which the degree of relevance is equal to or higher than the threshold value as the peripheral data categorized as the information having a high possibility of being compared with the principal data; however, possible methods for obtaining the peripheral data is not limited to the method in this example.
For instance, in the example described above, the peripheral data is obtained on the basis of the degree of relevance of each piece of diagnosis/treatment data. Accordingly, depending on the degrees of relevance set in the relevance degree information, there is a possibility that, when the principal data is changed due to moving of the line of sight of the operator or the like, diagnosis/treatment data of a different type from the peripheral data displayed immediately prior may be displayed as peripheral data related to the new principal data.
In this regard, depending on the purpose or the status of use of the medical information processing apparatus 100, when the new principal data and the immediately-prior principal data are diagnosis/treatment data of mutually the same type, there may be some situations where it is desirable to have diagnosis/treatment data of the same type displayed as the peripheral data.
In this situation, examples of the types of diagnosis/treatment data include: diagnosis/treatment data related to an image examination using the same modality; diagnosis/treatment data related to an image examination using another modality; diagnosis/treatment data related to medication administration (diagnosis/treatment data related prescription orders (diagnosis/treatment data related to medication A, diagnosis/treatment data related to medication B, etc.), diagnosis/treatment data related to intravenous drips, diagnosis/treatment data related to injections); and diagnosis/treatment data related to specimen tests.
Accordingly, for example, it is also acceptable to configure the obtaining function 152 to obtain peripheral data by using the type of the principal data as a reference. This example will be explained as a third embodiment. The third embodiment will be explained while a focus is placed on differences from the first embodiment. Detailed explanations of some of the configurations that are the same as those in the first embodiment will be omitted. The third embodiment described below may be carried out in combination with the second embodiment.
More specifically, in the present embodiment, the obtaining function 152 is configured to derive a degree of relevance for each type of diagnosis/treatment data by using the type of the principal data specified by the specifying function 151 as a reference and to further obtain the diagnosis/treatment data of a type having a high degree of relevance, as peripheral data.
For example, when the specifying function 151 has specified new principal data, the obtaining function 152 compares the type of the new principal data with the type of the principal data that was displayed immediately prior and, when the types are the same as each other, derives a degree of relevance to the type of the principal data for each type of diagnosis/treatment data and further obtains such diagnosis/treatment data of the type having a high degree of relevance as peripheral data. In this situation, for example, among the diagnosis/treatment data of the type having a high degree of relevance to the type of the principal data, the obtaining function 152 obtains such diagnosis/treatment data that has a high degree of relevance to the new principal data as the peripheral data.
In the present embodiment, as the relevance degree information, a degree of relevance to the principal data is set for each piece of diagnosis/treatment data, and further, the storage 120 stores therein information categorizing the principal data and the diagnosis/treatment data according to the types thereof. In other words, in the present embodiment, although in the relevance degree information being used a degree of relevance to the principal data is set for each piece of diagnosis/treatment data similarly to the first embodiment, the relevance degree information is different from that illustrated in
In this situation, similarly to the first embodiment, the degree of relevance of each piece of diagnosis/treatment data may be the number of times the piece of diagnosis/treatment data has been browsed or operated together with the principal data or may be an index value defined by the operator. When the degree of relevance indicates the number of times each piece of diagnosis/treatment data has been browsed or operated together with the principal data, the degree of relevance is updated every time the operator browses or operates on the piece of diagnosis/treatment data, similarly to the first embodiment.
For example, as illustrated in
Further, in the present embodiment, when new principal data has been specified by the specifying function 151, the obtaining function 152, at first, refers to the relevance degree information stored in the storage 120 to specify the type of the new principal data and the type of the principal data that was displayed immediately prior and to compare the types with each other.
In this situation, when the type of the new principal data is the same as the type of the immediately-prior principal data, the obtaining function 152 refers to the relevance degree information and, for each types of diagnosis/treatment data, derives an average value of degrees of relevance of the pieces of diagnosis/treatment data belonging to the type. After that, the obtaining function 152 specifies a type of which the calculated average value of degrees of relevance is the largest and further obtains, from among the pieces of diagnosis/treatment data of the specified type, such pieces of diagnosis/treatment data of which the degree of relevance to the new principal data is equal to or higher than a threshold value as pieces of peripheral data, from the integrated management DB.
In the present example, the average value of the degrees of relevance of the diagnosis/treatment data is used as a degree of relevance between the type of the diagnosis/treatment data and the type of the principal data. Further, the average value of the degrees of relevance of the diagnosis/treatment data may be derived every time the process is performed as described above. Alternatively, the average value may be derived at the time when the operator sets an index value serving as a degree of relevance or at the time when the degree of relevance is updated every time the operator browses or operates on any piece of diagnosis/treatment data, so that the derived average value is registered into the relevance degree information.
In contrast, when the type of the new principal data is different from the type of the immediately-prior principal data, the obtaining function 152 derives a degree of relevance for each piece of diagnosis/treatment data by referring to the relevance degree information and further obtains such diagnosis/treatment data of which the degree of relevance is equal to or higher than a threshold value as peripheral data, similarly to the first embodiment.
With this configuration, in the situation where the principal data has been changed due to moving of the line of sight of the operator or the like, when the new principal data and the immediately-prior principal data are pieces of diagnosis/treatment data of the same type as each other, a diagnosis/treatment data of the same type will be displayed as the peripheral data.
For instance, let us discuss an example in which the relevance degree information is set as illustrated in
In that situation, when the principal data is “XR1”, for example, the diagnosis/treatment data “CT1” (the degree of relevance: 24) and the diagnosis/treatment data “CT2” (the degree of relevance: 22) both of which the degrees of relevance to “XR1” are each equal to or higher than the threshold value are displayed as peripheral data related to “XR1”.
In that state, when the principal data is changed from “XR1” to “XR2”, for example, according to the method explained in the first embodiment, the diagnosis/treatment data “XR3” (the degree of relevance: 28) and the diagnosis/treatment data “CT3” (the degree of relevance: 21) both of which the degrees of relevance to “XR2” are each equal to or higher than the threshold value are displayed as peripheral data related to “XR2”.
In contrast, in the present embodiment, when the principal data is changed from “XR1” to “XR2”, at first, “image examination in another modality” of which the average value (of degrees of relevance) calculated for each type of diagnosis/treatment data is “18”, which is the largest, is specified. Further, among the pieces of diagnosis/treatment data belonging to the specified type “image examination in another modality”, the diagnosis/treatment data “CT3” (the degree of relevance: 21) of which the degree of relevance to “XR2” is equal to or higher than the threshold value is specified and displayed as peripheral data related to “XR2”.
In other words, according to the method described in the first embodiment, when the principal data is changed from “XR1” to “XR2”, not only the diagnosis/treatment data “CT3” which belongs to the same type “image examination in another modality” as “CT1” and “CT2” displayed when the principal data was “XR1”, but also the diagnosis/treatment data “XR3” which belongs to the type “image examination in the same modality” and which was not displayed when the principal data was “XR1” will be displayed as peripheral data related to “XR2”.
In contrast, in the present embodiment, when the principal data is changed from “XR1” to “XR2”, only the diagnosis/treatment data “CT3” which belongs to the same type “image examination in another modality” as “CT1” and “CT2” displayed when the principal data was “XR1” will be displayed as peripheral data related to “XR2”.
As explained above, in the third embodiment, the obtaining function 152 is configured to derive the degree of relevance for each type of diagnosis/treatment data, by using the type of the principal data specified by the specifying function 151 as a reference and to further obtain such diagnosis/treatment data of the type having a high degree of relevance as the peripheral data. With this arrangement, for example, when the new principal data and the immediately-prior principal data are pieces of diagnosis/treatment data of the same type, it is possible to display a piece of diagnosis/treatment data of the same type as the peripheral data. Consequently, it is possible to enhance convenience at the time when the operator compares the various types of diagnosis/treatment data with one another from multiple aspects.
In the embodiments described above, the examples were explained in which an HMD or a high resolution display is used as the display 140; however, possible embodiments are not limited to this example.
For instance, at a conference where a plurality of doctors or the like evaluate diagnoses and/or treatment plans, there may be some situations where both a plurality of personal computers that enable the participants of the conference to view diagnosis/treatment data and a high resolution display that enables all the participants to view the same diagnosis/treatment data are used. In those situations also, the medical information processing apparatus 100 in the present disclosure is applicable.
In those situations, for example, the medical information processing apparatus 100 is connected to the personal computers via the network 200. Further, for example, the display controlling function 154 displays various types of diagnosis/treatment data on a single screen, in response to a request from any of the personal computers. Further, the specifying function 151 detects diagnosis/treatment data focused on by an operator from among a plurality of types of diagnosis/treatment data displayed on the displays of the personal computers and further specifies the detected diagnosis/treatment data as principal data. Further, for each of the personal computers, the obtaining function 152 obtains peripheral data that is diagnosis/treatment data having a high degree of relevance to the principal data, by using the principal data specified by the specifying function 151 as a reference. Further, for each of the personal computers, the determining function 153 determines a screen configuration in accordance with the type of the respective display. Further, for each of the personal computers, the display controlling function 154 displays the principal data and the peripheral data on the display screen of the display, by using the screen configuration determined by the determining function 153.
Further, in that situation, for example, the determining function 153 receives an operation to designate either one of the personal computers or one of the participants, via the input interface 130 or any of the personal computers. After that, when having received the operation, the determining function 153 switches the screen configuration of the principal data and the peripheral data displayed on the display screen of the designated personal computer or participant, to a screen configuration for the high resolution display. Subsequently, by using the screen configuration resulting from the switching by the determining function 153, the display controlling function 154 displays, on the high resolution display, the principal data and the peripheral data displayed on the display screen of the designated personal computer or participant.
In the embodiments described above, the example was explained in which the specifying unit, the obtaining unit, the determining unit, and the display controlling unit of the present disclosure are realized by the specifying function 151, the obtaining function 152, the determining function 153, and the display controlling function 154 included in the processing circuitry 150, respectively; however, possible embodiments are not limited to this example. For instance, instead of being realized by the specifying function 151, the obtaining function 152, the determining function 153, and the display controlling function 154 described in the embodiments, the functions of the specifying unit, the obtaining unit, the determining unit, and the display controlling unit of the present disclosure may be realized by using only hardware or using a combination of hardware and software.
The term “processor” used in the above explanation denotes, for example, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), or a circuit such as an Application Specific Integrated Circuit (ASIC) or a programmable logic device (e.g., a Simple Programmable Logic Device [SPLD], a Complex Programmable Logic Device [CPLD], or a Field Programmable Gate Array [FPGA]). The one or more processors realize the functions by reading and executing the programs saved in the storage 120. In this situation, instead of saving the programs in the storage 120, it is also acceptable to directly incorporate the programs in the circuits of the one or more processors. In that situation, the one or more processors realize the functions by reading and executing the programs incorporated in the circuits thereof. Further, the processors in the present embodiments do not each necessarily have to be structured as a single circuit. It is also acceptable to structure one processor by combining together a plurality of independent circuits so as to realize the functions thereof.
In this regard, the programs executed by the one or more processors are each provided as being incorporated in advance in a Read-Only Memory (ROM), a storage, or the like. The programs may be provided as being recorded in a computer-readable storage medium such as a Compact Disk Read-Only Memory (CD-ROM), a Flexible Disk (FD), a Compact Disk Recordable (CD-R), a Digital Versatile Disk (DVD), or the like, in a file in an installable format or in an executable format for the devices. Further, the programs may be stored in a computer connected to a network such as the Internet, so as to be provided or distributed as being downloaded via the network. For example, the programs are structured with modules including the functional units described above. In the actual hardware, as a result of a CPU reading and executing the programs from a storage medium such as a ROM, the modules are loaded into a main storage device so as to be generated in the main storage device.
According to at least one aspect of the embodiments described above, the operator is able to compare the various types of diagnosis/treatment data with one another from multiple aspects.
While certain embodiments have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the inventions. Indeed, the novel embodiments described herein may be embodied in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the embodiments described herein may be made without departing from the spirit of the inventions. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and spirit of the inventions.
Number | Date | Country | Kind |
---|---|---|---|
2018-200529 | Oct 2018 | JP | national |