Patent Application
20150227703
The present invention relates to a display apparatus and an image display system which display a view of simplified images of a patient.
A display apparatus, which is connected to a server via Network and displays images based on medical data stored in the server, has been described in, for example, Japanese Unexamined Patent Publication No. 2010-182018.
The medical data stored in the server are data of medical images such as X-ray CT images captured by an X-ray CT (Computed Tomography) apparatus, MRI images captured by an MRI (Magnetic Resonance Imaging) system, etc. for example.
In addition to the above, the medical data include those or the like in which documents of paper used in hospitals, such as a patient referral document, etc. are scanned and brought into data form.
Meanwhile, there is a case where quite a number of medical images and documents have been created and stored with respect to patients that visit a hospital. It is thus required that necessary data are to be capable of being easily found out of lots of their data.
The invention of one aspect made to solve the above problems provides a display apparatus including a display controller for displaying a view of simplified images based on medical data having accompanying information of a plurality of attributes as metadata, wherein said view of simplified images being a matrix-like view in which the simplified images of the same patient are arranged by accompanying information of one attribute in a mw direction and arranged by accompanying information of another attribute in a column direction; and an input unit in which an operator performs input of changing the attribute in at least one of the row and column directions, wherein the display controller rearranges the simplified images by accompanying information of the attribute that the operator changed using the input unit.
The invention of another aspect provides the display apparatus in which in the invention of the one aspect, wherein the input unit is capable of performing the input of selecting the accompanying information by the operator, and wherein the display controller causes the view to be displayed includes only simplified images having the accompanying information selected by the operator using the input unit.
The invention of a further aspect provides the display apparatus in which in the invention of the above aspect, wherein the display controller causes the view to be displayed includes only simplified images having accompanying information of different attributes selected before and after the attribute change by the operator using the input unit.
The invention of yet another aspect provides a display apparatus including a display controller for displaying a view of simplified images based on medical data having accompanying information of a plurality of attributes as metadata, wherein said view of simplified images is a matrix-like view in which the simplified images of the same patient are arranged by accompanying information of one attribute in a row direction and arranged by accompanying information of another attribute in a column direction; and an input unit which performs the input of changing the attribute in at least one of the column and row directions by selecting a desired attribute by an operator out of the plurality of attributes displayed in the display unit and the input of selecting desired accompanying information from the view displayed in the display unit; wherein the display controller rearranges the simplified images by accompanying information of the attribute changed by the input unit and causes a view to be displayed includes only simplified images having the accompanying information selected by the input unit.
The invention of a still further aspect provides the display apparatus in which in the invention of the one aspect, wherein the input unit is capable of performing the input of selecting accompanying information of the attribute changed using the input unit by the operator, and wherein the display controller causes the view to be displayed includes only simplified images having the accompanying information selected using the input unit by the operator.
The invention of a still further aspect provides the display apparatus in which in the invention of the above aspect, wherein, the input unit is capable of performing the input of changing the attribute of the accompanying information selected using the input unit by the operator, and wherein when the input of changing the attribute of the accompanying information selected using the input unit by the operator is performed, the display controller rearranges the simplified images by accompanying information of the post-change attribute.
According to the invention of the above aspect, since the attributes can be changed, a view can be displayed in such a manner that necessary simplified images can easily be found out.
According to the invention of another aspect described above, when the operator performs the input of selecting the accompanying information at the input unit, a view includes only simplified images having the selected accompanying information is displayed. It is thus possible to display a view in which only simplified images necessary for the operator have been extracted.
According to the invention of yet another aspect described above, a view includes only simplified images having accompanying information of different attributes selected before and after the attribute change by the operator using the input unit is displayed, thereby making it possible to display simplified images necessary for the operator.
According to the invention of the further aspect described above, the alternation of each attribute and the selection of accompanying information are performed at the display unit, thereby making it possible to display a view in which only simplified images necessary for the operator have been extracted by a simple operation on the screen.
According to the invention of the still further aspect described above, when the operator performs the input of changing each attribute using the input unit and selecting accompanying information of the changed attribute, a view includes only simplified images having the selected accompanying information is displayed. It is thus possible to extract only simplified images necessary for the operator easier.
According to the invention of the still further aspect described above, when the operator performs the input of selecting accompanying information using the input unit and changing the attribute of the selected accompanying information, simplified images rearranged for every accompanying information of the post-change attribute are displayed. It is thus possible to extract only simplified images necessary for the operator easier.
A more complete appreciation of the disclosed embodiments of the invention and many of the attendant advantages thereof will be readily obtained as the same becomes better understood by reference to the following detailed description when considered in connection with the accompanying drawings, wherein:
Embodiments of the present invention will hereinafter be described. A first embodiment will first be described based on
The server 2 has a storage unit 21 and a medical data output unit 22. The storage unit 21 is, for example, an HDD (Hard Disk Drive) or the like. Medical data or the like inputted from each department system 4 to the server 2 via the network N have been stored in the storage unit 21. The server 2 is one example illustrative of an embodiment of a server in the present invention. The storage unit 21 is one example illustrative of a storage unit in the present invention.
The medical data stored in the storage unit 21 are data related to patients, which are generated in a medical provision facility, an inspection facility for performing the inspection of a specimen, etc. The data include medical image data, document data, numeric data, etc. The medical image data are data acquired by the modality or the like of the department system 4, e.g., image data such as an X-ray CT image, an MRI image, an ultrasound image, etc. The document data are data about, for example, a radiographic interpretation report, a patient referral document, informed consent forms such as a surgery consent form, an inspection consent form, a medical questionnaire, an application blank, a result of inspection, etc. The document data include PDF (Portable Document Format) data set in the form of data by scanning each paper document, etc. The numeric data are data of numeric values related to patients, for example, numeric data indicative of inspection results such as a blood test, etc.
The medical data also include data or the like about a progress note of patient's biological information such as an electrocardiogram, etc., other records related to patients in addition to the medical image data and the document data listed above.
The medical data include metadata in addition to the body of data. The metadata includes accompanying information of a plurality of attributes such as the name of a patient, a date, a document class, a type code, a practice setting, etc. Here, the term of “accompanying information” means a specific name, a date, a document class, a type code and a practice setting. The attributes means the attributes associated with these accompanying information. For example, the accompanying information about the attribute of “document class” is “CT”, “MRI” or the like. The accompanying information about the attribute of “practice setting” is “radiology department”, “cardiovascular department” or the like. The metadata is a concept that includes information (e.g., information referred to as “document class”) about an attribute, and specific information (i.e., accompanying information, e.g., information referred to as “CT”) about the attribute.
The metadata includes one automatically applied to each of the department systems 4, and one applied by performing an input from an operator, such as a modality of an X-ray CT apparatus or the like, etc.
The date for the metadata corresponds to the creation date of medical data, for example. The date for the metadata may include the year, the time and so on as well as the day. If medical image data is used, then the date of image shooting or capturing may be set as a creation date. If document data is used, then the created date of a document may be a creation date. Alternatively, the date when a document was scanned and brought into data form may be a creation date.
The document class for the metadata is of information indicative of the type of medical data, e.g., information indicative of the type of medical images of MRI (Magnetic Resonance Imaging), US (Ultrasound) and the like, and the type of documents such as a hospitalization consent form, an application blank for hospitalization, a medical questionnaire for hospitalization, an inspection consent form, a surgery consent form, etc. The type code for the metadata is information indicative of a superordinate concept of a document class, for example, a consent form or the like.
The practice setting for the metadata is information indicative of a department to which a request to generate medical data is made, such as the radiology department, the cardiovascular department or the like.
The attributes for the metadata may be determined in advance. Even when they are determined in advance, the attributes may be supposed to be able to perform their addition and deletion.
The medical data output unit 22 outputs the medical data stored in the storage unit 21 to the display terminal 3 according to a request from the display terminal 3.
The display terminal 3 is a general-purpose personal computer. The display terminal 3 has a display unit 31, a display controller 32, an input unit 33, a data request unit 34 and a memory 35.
The display unit 31 is an LCD (Liquid Crystal Display), a CRT (Cathode Ray Tube) or the like.
As shown in
The view X includes display sections C1 and C2 for accompanying information and a display section C3 for each simplified image. These display sections C1 and C2 and C3 are made up of cells. The display section C1 for the accompanying information includes cells that configure the top mw arranged in a row direction (lateral direction) in the view X. The display section C2 for the accompanying information includes cells that configure the leftmost column arranged in a column direction (lengthwise direction) in the view X.
The display controller 32 causes the display section C1 for the accompanying information to display accompanying information of the same attribute. The display controller 32 causes even the display section C2 for the accompanying information to display accompanying information of the same attribute. Accompanying information of different attributes is displayed in the display sections C1 and C2. In
It is possible to change the attributes of the display sections C1 and C2 for the accompanying information. An attribute change icon (icon) I is displayed on the left side of the display section C1 and the upper side of the display section C2. An operator clicks the attribute change icon I to thereby make it possible to change the attributes of the display sections C1 and C2. The details thereof will be described later.
Simplified images M based on medical data are displayed in the display section C3. The simplified image M is a thumbnail image or the like. A description will be made of the generation of the simplified images M. When each simplified image M displayed in the display section C3 is of a medical image based on the medical image data, a sheet of medical image data (data acquired from the server 2) selected out of a plurality of sheets of medical image data generated at one inspection is selected. Of the plurality of sheets of medical image data generated at one inspection, the first data or intermediate data may automatically be selected. Then, the selected one sheet of medical data is converted to a suitable size to display it in the view X. This size is a size of such an extent that it can be arranged on the display screen 31a in a state in which a view property has been maintained (e.g., 64×64 pixels, 96×96 pixels, etc.). The simplified images M based on the so-converted medical image data are displayed in the display section C3. When the simplified images M are images based on document data, e.g., data about a sheet of document is selected if the document data is data about a plurality of sheets of documents. The selected data is converted to a suitable size as with the above. Then, each simplified image M based on the converted data is displayed in the display section C3.
When the medical data displayed as the simplified image M is numeric data, an image indicative of the contents of the numeric data is generated and displayed as a simplified image M. For example, the image indicative of the contents of the numeric data is an image including characters indicative of the contents of the numeric data. As to numeric data about a blood test, to take one example, an image including characters of “blood test” is displayed as the simplified image M.
By causing the operator to click each simplified image M displayed in the display section C3 using the input unit 33, the display controller 32 may allow the enlarged simplified image M to be displayed.
Accompanying information in the lengthwise direction (column direction) of the display section C3 are displayed in the display section C1. Accompanying information in the lateral direction (row direction) of the display section C3 are displayed in the display section C2. Simplified images M are arranged in matrix form in the display section C3. Simplified images M having the accompanying information displayed in the display section C1 are arranged in the display section C3 as viewed in the column direction. Simplified images M having the accompanying information displayed in the display section C2 are arranged in the same display section as viewed in the mw direction. In the view X, the corresponding simplified image M is placed in a position specified from the two accompanying information of the display sections C1 and C2.
Specifically, in
When the attributes of the display sections C1 and C2 for the accompanying information are changed, the display controller 32 rearranges the simplified images M in accordance with their alterations. The details thereof will be described later.
The view X can be scrolled by scrolling a longitudinal scroll bar SB and a transverse scroll bar (not shown).
The display controller 32 causes the display unit 31 to display a period image T and various buttons B in addition to the view X. The period image T has a bar Ba and an acquisition time indication block Bl. The bar Ba indicates a period from the oldest date of the dates of the accompanying information about the medical data stored in the storage unit 21 of the server 2 to the present (present in which the view Xis being displayed) with respect to a patient with a view X displayed in the display unit 31.
A period indication image Ti is displayed on the bar Ba. The period indication image Ti is displayed in a color different from another part at the bar Ba. The period indication image Ti shows a period from the oldest date of the dates of the accompanying information about the simplified images M displayed in the display unit 31 to the latest date. When the view Xis scrolled in the vertical direction, the period indication image Ti moves on the bar B with its scrolling.
The acquisition time indication block B1 shows the date of the accompanying information about the medical data during a period indicated by the period image T. Owing to the acquisition time indication block B1, it is possible to know when the medical data has been generated.
The input unit 33 is made up of a keyboard, a mouse or the like. The input unit 33 is one example illustrative of an embodiment of an input unit in the present invention. The data request unit 34 outputs a signal for requesting medical data to the server 2, based on an operator's input in the input unit 33.
The department system 4 is a department system in a hospital, such as an RIS (Radiology Information System) including modalities of an X-ray CT apparatus, an MRI system and the like.
The operation of the image display system 1 of the present embodiment will next be described based on a flowchart of
The display controller 32 causes the display unit 31 to display the view X based on the medical data inputted from the server 2. Also the display controller 32 causes the display unit 31 to display the period image T, the buttons B and the like in addition to the view X. The display controller 32 causes the period image T to be displayed using the date information in the accompanying information.
Next, at Step S2, the operator performs the input of changing each attribute of the display section C1 for the accompanying information through the input unit 33. Concretely, the operator first moves a cursor CU onto the attribute change icon I using the input unit 33 as shown in
The attribute selection image S includes a list 1 of attributes of accompanying information. In
Incidentally, the attributes of the accompanying information displayed in the attribute selection image S are not limited to the above three. Other attributes may be displayed in the attribute selection image S. The operator may become able to edit (add or delete) each attribute displayed in the attribute selection image S through the use of the input unit 33.
Next, the operator puts the cursor CU on a desired attribute in the list 1 to click it as shown in
At Step S2, when the cursor CU is placed and clicked in the list 1 as an input for changing the attribute, the display controller 32 causes a view X with the simplified images M rearranged for every accompanying information of the selected attribute to be displayed as shown in
Since the attributes can be changed in this manner, the view X can be displayed in such a manner that the operator is able to easily find out and select the simplified image necessary for the operator.
Here, when simplified images M specified from the two accompanying information corresponding to the accompanying information displayed in the display section C1 and the accompanying information displayed in the display section C2 exist in plural form, the simplified images M to be displayed in one cell in the display section C3 exist in plural form. In this case, the display controller 32 causes only any one M of the simplified images M to be displayed in one cell and causes a numerical representation F indicative of how many simplified images exit to be displayed. The numerical representation F is one example illustrative of an embodiment of a numerical representation in the present invention.
Specifically, in
Next, at Step S4, the operator selects desired accompanying information from the view X. Specifically, as shown in
The cursor CU is however moved to the display section C3 other than the display section C1 to click, whereby accompanying information in a clicked column may be selected.
Next, at Step S5, the operator causes a view X in which only simplified images M having the accompanying information selected at Step S4 has been displayed, to be displayed. Specifically, as shown in
Next, at Step S6, the operator performs an operation similar to Step S2 to conduct again the input of changing the attribute of the display section C1. Here, as shown in
When the “Document Class” is selected at Step S6, at Step S7 as shown in
Next, at Step S8, the operator performs an operation similar to Step S4 at the view X displayed at Step S7 to select desired accompanying information again. Here, as shown in
Next, at Step S9, the operator clicks the narrow-down display button B1 as with Step S5 to display, as shown in
As explained above, as shown in
The operation at Step S10 will concretely be explained. First, the operator moves the cursor CU onto a metadata display button B2 using the input unit 33 as shown in
Incidentally, in the metadata display image MD, a check mark CM (tick) has been displayed in a check box CB placed on the left side of the column of “Document Class”. The attributes in the view X displayed when the narrow-down conditions are registered, are attributes in which only simplified images M that the operator desires to finally display are displayed, i.e., attributes in which only simplified images M necessary for the operator are displayed. The display controller 32 causes the check mark CM to be displayed with respect to each of the attributes displayed upon registration of the narrow-down conditions in the metadata display image MD.
When the operator puts the cursor CU on a Save button B3 displayed in the metadata display image MD to click it as shown in
When the registration of the name is completed, the registered name is displayed in a name display section Cn2 of the metadata display image MD as shown in
Incidentally, there are provided a plurality of the search buttons B4 (five in the drawing), which enable a plurality of narrow-down conditions to be registered.
According to the present embodiment described above, the alteration of the attributes and the selection of the accompanying information are repeated on the display screen 31 a of the display unit 31, thereby making it possible to display the view X in which only the simplified images M necessary for the operator have been extracted from within many simplified images M, by the simple operation on the screen.
The narrow-down conditions for the simplified images M are stored and the search buttons B4 are displayed, thereby making it possible to simply display the view X having the simplified images M necessary for the operator only by pressing the search buttons B without changing the attribute of the display section C1 and selecting the accompanying information.
A second embodiment will next be described based on
In
Next, at Step S12, an operator performs the input of changing the attribute of the display section C1 at the input unit 33. At Step S12, the attribute is changed to the type code. A concrete operation therefor is similar to Step S2. As shown in
Here, as shown in partly enlarged form in
Any of the above “hospitalization consent form”, “difference of room charge payment consent form”, “inspection consent form”, “surgery consent form”, and “specific biological products use consent form” is a “consent form” in the type code. Thus, the respective consent forms described above are combined into one as a consent form in the view X after the attributes have been changed. Characters of “5items” are displayed as the numerical representation F in the display section C3 of the simplified images corresponding to the “consent form” and “15 Jan 2012”. Thus, the operator is able to grasp that the five consent forms exist.
Next, at Step S14, the operator selects the “consent form”, “application blank” and “medical questionnaire” in the view X by the cursor CU as shown in
Next, at Step S16, the operator performs again the input of changing each attribute of the display section C1. Here, as shown in
Next, at Step S18, the operator performs the operation of storing the narrow-down conditions for the simplified images M as with above Step S10 in
According to the present embodiment, in addition to having the same advantages as the first embodiment, the plural consent forms can be collectively displayed as shown in
Although the present invention has been explained by the embodiments as described above, it is needless to say that the present invention can be changed in various ways within the scope that does not change the gist of the invention. For example, the attribute of the display section C2 for the accompanying information rather than the attribute of the display section C1 for the accompanying information may be changed.
The respective attributes of the display section C1 and the display section C2 may be changed. In this case, as shown in
“Creating Date” is displayed in lists 1 of attributes at the first and second attribute selection images Si and S2 in addition to “Document Class”, “Practice Setting” and “Type Code”. This “Creation Date” means the date of generation of medical data. In
When the respective attributes of the display sections C1 and C2 are supposed to be able to change in this manner, the accompanying information selected respectively from the display sections C1 and C2 or the accompanying information displayed in the view X can be stored as narrow-down conditions for simplified images M, for displaying again later, a view X in which the same simplified images M have been displayed.
Specifically, when the metadata display button B2 is clicked, the display controller 32 causes a metadata display image MD' to be displayed as shown in
While the disclosed embodiments of the subject matter described herein have been shown in the drawings and fully described above with particularity and detail in connection with several exemplary embodiments, it will be apparent to those of ordinary skill in the art that many modifications, changes, and omissions are possible without materially departing from the novel teachings, the principles and concepts set forth herein, and advantages of the subject matter recited in the appended claims. Hence, the proper scope of the disclosed innovations should be determined only by the broadest interpretation of the appended claims so as to encompass all such modifications, changes, and omissions.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2012-165819 | Jul 2012 | JP | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/US2013/051859 | 7/24/2013 | WO | 00 |
