This application is based upon and claims the benefit of priority from prior Japanese Patent Application Nos. P2004-152723, filed on May 24, 2004 and P2005-144882, filed on May 18, 2005, the entire contents of which are incorporated herein by reference.
1. Field of the Invention
The present invention relates to a medical image display apparatus for and a method of displaying a medical image, particularly, displaying an original image corresponding to one selected from a plurality of images displayed in a smaller size than the original image.
2. Discussion of the Background
A medical image system has been introduced, for example, to store and display medical information. The medical information results from a medical imaging apparatus such as, for example, an X-ray diagnosis apparatus, an X-ray computed tomography apparatus, a magnetic resonance imaging apparatus, a nuclear medicine diagnosis apparatus, an ultrasound diagnosis apparatus, an endoscope apparatus, or the like. The medical information includes image information and may also include its accompanying information. The image information is typically stored with its accompanying information in an image storage apparatus such as an image filing server. The image information and its accompanying information may also be stored in an image display apparatus, for example, temporarily.
When the image information and the accompanying information is stored in those apparatuses, the image information and the accompanying information is often stored hierarchically. The accompanying information may include patient information and examination information. For example, the patient information such as a patient name and a patient identification number may be stored as the first layer. Under the first layer, the examination information such as an examination date may be stored as the second layer. In other words, the examination information may relate to examinations which have been conducted on the patient identified by the patient information. In the third layer, the image information is provided including, for example, image data, size-reduced image data prepared based on the image data before or after the reception of the medical information, an imaging condition, and imaging time. The size-reduced image data may be so-called thumbnail image data.
When an operator such as a doctor desires to observe medical images based on the image data in an image display apparatus, the operator typically operates to display a patient list showing the patient information of a plurality of patients. The operator then operates to select one of the patients from the patient list so that an examination list is displayed based on the examination information of a plurality of examinations with respect to the patient selected from the patient list. The operator operates to select one of the examinations from the examination list so that one or more size-reduced images are displayed based on the medical image data with respect to the examination selected from the examination list.
The operator then usually observes the size-reduced images and selects one of the size-reduced images. In response to the selection, an image corresponding to the selected size-reduced image is displayed in a larger size. If the displayed image is desired one, the operator may observe the displayed image for, for example, the diagnosis. If, however, there is no image (or no size-reduced image) desired by the operator in the selected examination, the operator needs to operate to return to the examination list and display the examination list again. The operator may select a different examination from the examination list and repeat the above operations. The above-described operation work is described, for example, in Japanese Patent Application Publication No. PH07-168845.
Since the above-described operation work requires the operator to return to the examination list which is displayed in a display window different from the size-reduced images, the operator may be required to repeatedly change the display windows one from another unless the desired image is found. The examination list may include only information of an examination date and time. In this case, it is difficult for the operator to find the desired image and may result in forcing the operator to select an examination and observe size-reduced images with respect to nearly every examination. As a result, it may take time for the operator to find and observe the desired image.
Further, imaged parts of the patient and the imaging conditions are typically similar among the examinations. Since the size-reduced images usually have less information than their original images, it is not easy to recognize the difference among them, particularly when they are displayed by changing back and forth the examination list window and the size-reduced image window with respect to a plurality of examinations.
According to the first aspect of the present invention, there is provided a medical image display apparatus including a storage unit, a display unit, and an input unit. The storage unit is configured to store examination information of a plurality of examinations and image data resulting from the plurality of examinations. The display unit is configured to display a plurality of selectable icons corresponding to the plurality of examinations along one of a vertical direction and a horizontal direction in a screen. The display unit is also configured to display one or more selectable thumbnail images along the other one of the vertical direction and the horizontal direction. The display unit is still further configured to display an original image based on the image data. Each of the one or more selectable thumbnail images is displayed in a smaller size than the original image. The input unit is configured to select a first of the plurality of selectable icons and a first of the one or more selectable thumbnail images. The one or more selectable thumbnail images belong to a first of the plurality of examinations which corresponds to the first selectable icon. The original image corresponds to the first selectable thumbnail image.
According to the second aspect of the present invention, there is provided a medical image display apparatus including a storage unit, a display unit, and an input unit. The storage unit is configured to store examination information of a plurality of examinations and image data resulting from the plurality of-examinations. The display unit is configured to display a plurality of icons corresponding to the plurality of examinations along one of a vertical direction and a horizontal direction in a screen. The display unit is further configured to display one or more selectable thumbnail images for each of the plurality of icons along the other one of the vertical direction and the horizontal direction. The display unit is still further configured to display at least one original image based on the image data. Each of the one or more selectable thumbnail images is displayed in a smaller size than each of the at least one original image. The input unit is configured to select at least one of the one or more selectable thumbnail images. The at least one original image corresponds to the selected at least one of the one or more selectable thumbnail images.
According to the third aspect of the present invention, there is provided a medical image display apparatus including a storage unit, a display unit, and an input unit. The storage unit is configured to store imaging information of a plurality of imaging operations and a plurality of image data sets resulting from the plurality of imaging operations, respectively. Each of the image data sets includes a series of images. The display unit is configured to display a plurality of selectable icons corresponding to the plurality of imaging operations along one of a vertical direction and a horizontal direction in a screen. The display unit is further configured to display one or more selectable thumbnail images along the other one of the vertical direction and the horizontal direction. The display unit is still further configured to display at least one of the series of images based on the image data set. Each of the one or more selectable thumbnail images is displayed in a smaller size than each of the at least one of the series of images. The input unit is configured to select one of the plurality of selectable icons and one of the one or more selectable thumbnail images. The one or more selectable thumbnail images belong to a first of the plurality of imaging operations which corresponds to the selected one selectable icon. The at least one of the series of images corresponds to the selected one selectable thumbnail image.
According to the fourth aspect of the present invention, there is provided a method of displaying a medical image. The method begins by storing examination information of a plurality of examinations and image data resulting from the plurality of examinations and displaying a plurality of selectable icons corresponding to the plurality of examinations along one of a vertical direction and a horizontal direction in a screen. The method continues by selecting a first of the plurality of selectable icons and displaying the one or more selectable thumbnail images along the other one of the vertical direction and the horizontal direction. The one or more selectable thumbnail images belong to a first of the plurality of examinations which corresponds to the first selectable icon. The method still continues by selecting a first of the one or more selectable thumbnail images and displaying an original image based on the image data. The original image is displayed in a larger size than the first selectable thumbnail image. The original image corresponds to the first selectable thumbnail image.
According to the fifth aspect of the present invention, there is provided a method of displaying a medical image. The method begins by storing examination information of a plurality of examinations and image data resulting from the plurality of examinations. The method continues by displaying a plurality of icons corresponding to the plurality of examinations along one of a vertical direction and a horizontal direction in a screen and displaying one or more selectable thumbnail images for each of the plurality of icons along the other one of the vertical direction and the horizontal direction. The method still continues by selecting at least one of the one or more selectable thumbnail images and displaying at least one original image based on the image data. The at least one original image is displayed in a larger size than each of the one or more selectable thumbnail images. The at least one original image corresponds to the selected at least one of the one or more selectable thumbnail images.
According to the sixth aspect of the present invention, there is provided a method of displaying a medical image. The method begins by storing examination information of a plurality of examinations and image data resulting from the plurality of examinations displaying a plurality of selectable icons corresponding to the plurality of examinations along one of a vertical direction and a horizontal direction in a screen. The method continues by selecting a first of the plurality of selectable icons and displaying a first set of one or more selectable thumbnail images along the other one of the vertical direction and the horizontal direction. The first set belongs to a first of the plurality of examinations which corresponds to the first selectable icon. The method still continues by selecting a second of the plurality of selectable icons and switching to display the first set to a second set of one or more selectable thumbnail images. The second set belongs to a second of the plurality of examinations which corresponds to the second selectable icon. The method further continues by selecting a first selectable thumbnail image from the second set and displaying an original image corresponding to the first selectable thumbnail image based on the image data. The original image is displayed in a larger size than the first selectable thumbnail image.
A more complete appreciation of embodiments of the present invention and many of its attendant advantages will be readily obtained by reference to the following detailed description considered in connection with the accompanying drawings, in which:
Embodiments of the present invention will be described with reference to the accompanying drawings.
A medical image display apparatus according to the embodiments may be used to display medical images resulting from medical imaging apparatuses such as, for example, an X-ray diagnosis apparatus, an X-ray computed tomography apparatus, a magnetic resonance imaging apparatus, a nuclear medicine diagnosis apparatus, an ultrasound diagnosis apparatus, an endoscope apparatus, and/or the like. The feature of the medical image display apparatus to be described below may also be implemented in other apparatuses such as, for example, the medical imaging apparatuses.
The interface 1 is connected to a medical imaging apparatus 20 through a network and receives medical information including image information and its accompanying information from the medical imaging apparatus 20. The medical imaging apparatus 20 may be one or more of the above-mentioned medical imaging apparatuses. The image information may include image data and imaging condition information including imaging time information. The image data may be two-dimensional image data, three-dimensional image data, motion image data, and/or the like, which result in one or more two-dimensional images, one or more three-dimensional images, one or more motion images, and/or the like. Each motion image includes a series of images (a plurality of images), that is, for example, a series of frame images or slice images. When the interface 1 is operative as a disk drive, the interface 1 may receive the medical information stored in a memory medium such as a CD-R, DVD, or the like. The received medical information may be provided to the medical information memory unit 2.
The medical information memory unit 2 stores the medical information received by the interface 1. The medical information memory unit 2 may include a memory device such as, for example, a magnetic disk. The buffer memory unit 3 includes an examination list memory section 31 and an image list memory section 32. The examination list memory section 31 stores the examination information with respect to specific patient information included in the accompanying information. The examination information may be extracted from the medical information (or the accompanying information) stored in the medical information memory unit 2. The image list memory section 32 stores the image information with respect to the specific patient information. The image information may be extracted from the medical information stored in the medical information memory unit 2.
The processor 4 prepares reference image data to be displayed as reference images in a smaller size than original images based on the image data included in the medical information. The reference images may be, for example, thumbnail images, size-reduced images, or the like and are hereinafter referred to as thumbnail images. The reference image data are also hereinafter referred to as thumbnail image data. The thumbnail image data are stored as part of the image information in the medical information memory unit 2. The thumbnail image data with respect to the specific patient information are also stored in the image list memory section 32. The processor 4 also prepares icon data with respect to the examination information. Details of the icon data will be described later. The prepared icon data are stored as part of the examination information in the medical information memory unit 2. The icon data with respect to the specific examination information are also stored in the examination list memory section 31.
The processor 4 extracts the icon data stored in the examination list memory section 31 and the thumbnail image data stored in the image list memory station 32. The extracted icon data and thumbnail image data are transferred to the display unit 5. The display unit 5 may include a cathode ray tube (CRT) display or a liquid crystal display (LCD) and display the patient information, the examination information, and the image information stored in the medical information memory unit 2. The display unit 5 also displays icons based on the icon data transferred from the processor 4 and thumbnail images based on the thumbnail image data transferred from the processor 4.
The operation unit 6 may include one or more input devices such as, for example, a keyboard, a trackball, a mouse, and a joystick. The operation unit 6 may also include a touch panel and/or various switches (buttons). The operation unit 6 is used to input information for designation, instruction, and selection and may be operative as an interactive interface.
The control unit 7 includes a central processing unit (CPU) and memory circuitry and controls over the medical image display apparatus 10. Particularly, the control unit 7 receives the information input from the operation unit 6, temporarily stores the input information in the memory circuitry, and controls the interface 1, the medical information memory unit 2, the buffer memory unit 3, the processor 4, and the display unit 5 based on the input information.
The examination information (A-a) to (A-h) may be stored in a time-series order from the earliest (A-a) to the latest (A-h).
One icon to be displayed based on the icon data represents one examination when the icon is displayed in the display unit 5. Therefore, each of the examination information (A-a) to (A-h) includes icon data. The icon data can be prepared in various ways. For example, when the image data pertains to a motion image or to a plurality of images resulting from the examination A-a, the icon data may be prepared to show an icon showing one image included in the motion image or one of the plurality of images as shown in
In
Taking the image information (A-a-1) as an example, the image information (A-a-1) includes, for example, image identification information, imaging condition information including imaging time information, image data, thumbnail image data, electrocardiography information, and any other necessary information with respect to an image A-a-1.
The image information (A-a-1) to (A-a-8) may be stored in a time-series order from the earliest (A-a-1) to the latest (A-a-8).
In response to the selection of the patient information (A), the examination information (A-a) to (A-h) stored in the second layer 23 in the medical information memory unit 2 is transferred to and temporarily stored in the examination list memory section 31. Also the image information with respect to the examinations A-a to A-h of the patient A such as the image information (A-a-1) to (A-h-40) stored in the third layer 24 in the medical information memory unit 2 is transferred to and temporarily stored in the image list memory section 32. The processor 4 extracts icon data included in the examination information (A-a) to (A-h) stored in the examination list memory section 31. The extracted icon data are transferred to the display unit 5. The display unit 5 displays icons as an examination list of the patient A based on the extracted icon data (step S3). The processor 4 also extracts thumbnail image data included, for example, in the image information (A-a-1) to (A-a-8) stored in the image list memory section 32. The extracted thumbnail image data are transferred to the display unit 5. The display unit 5 may display thumbnail images as an initial image list of the patient A based on the extracted thumbnail image data (step S4).
Since the thumbnail images A-a-1 to A-a-8 have been determined as the initial thumbnail images to be displayed in the image list display field 62, the icon A-a is highlighted or displayed in a distinguishable manner from other icons. If the initial thumbnail images have not been determined in advance, none of the icons 64 in the examination list display field 61 is highlighted only when the operator selects the icon A-a, using the operation unit 6, the icon A-a may be highlighted. Also, when the initial thumbnail images have not been determined in advance, no thumbnail image may initially be displayed in the image list display field 62. Only when the operator selects the icon A-a, using with the operation unit 6, the icons A-a-1 to A-a-7 may be displayed in the image list display field 62.
When the examination list display field 61 is limited in space, the icons 64 may be given priorities and displayed in accordance with the priorities or in a priority order. One example of priority conditions is an examination date (and time). In this example, an icon corresponding to the latest examination may be given a top priority and placed, for example, at the bottom of the examination list display field 61 while an icon corresponding to the earliest examination may be given the lowest priority and placed, for example, at the top of the examination list display field 61 or scrolled down to be displayed in the end. Therefore, the icon corresponding to the examination A-h may be displayed at the bottom of the examination list display field 61. The icon A-a may not initially be displayed in the examination list display field 61 and only displayed when scrolled down. Another example of the priority conditions is the number of selection times. An icon which has been most often selected in the past or in the last predetermined period may be given a top priority. Alternatively, the number of image reference times may be used as a priority condition. A top priority may be given to an icon corresponding to the examination including original images which have been most often referred to through their icons in the past or in the last predetermined period. Still alternatively, the icons 64 may be displayed in an order as these icons 64 were displayed in the examination list display field 61 in the last use of the medical image display apparatus 10 (i.e., just before terminating the display).
Giving the priorities may be advantageous since the operator can recognize an icon 64 most often used or likely to be used at a predetermined top priority position. In addition, even when all the icons 64 cannot be displayed in parallel in the examination list display field 61, the operator can find icons 64 given high priorities without the scrolling operation.
Similar display techniques may also be applied to the display of the thumbnail images 65 in the image list display field 62. When the image list display field 62 is limited in space, the thumbnail images 65 may be given priorities and displayed in accordance with the priorities or in a priority order. One example of priority conditions is an imaging date (and time). In this example, a thumbnail image corresponding to the latest image in a series of or a plurality of images may be given a top priority and placed, for example, on the left side of the image list display field 62 while a thumbnail image corresponding to the earliest image in the series of or a plurality of images may be given the lowest priority and placed, for example, on the right side of the image list display field 62 or scrolled to be displayed in the end. Therefore, the thumbnail image A-a-8 may be displayed on the left side of the image list display field 62. The thumbnail image A-a-1 may not initially be displayed in the image list display field 62 and only be displayed when scrolled towards the left. Since a series of images are typically displayed in an imaged order, that is, in an order from the earliest to the latest, the above priority results in a reverse order display, compared to the typical display.
Another example of the priority conditions is the number of image reference times. A top priority may be given to a thumbnail image corresponding to the original image which has been most often referred to in the past or in the last predetermined period. Still alternatively, the thumbnail images 65 may be displayed in an order as these thumbnail images 65 were displayed in the image list display field 62 in the last use of the medical image display apparatus 10 (i.e., just before terminating the display).
Returning to
When the operator determines that there is a thumbnail image corresponding to the desired image in the image list display field 62, the operator operates the operation unit 6 to select the thumbnail image (step S6).
The operator observes the original image displayed in the image display field 63 and determines whether it is really the desired image or not (step S8). If it is the desired image, the operator continues to observe the original image displayed in the image display field 63 (step S9). The operator may interpret or diagnose the original image according to the necessity.
In step S5, when the operator has not determined that the currently displayed thumbnail images seem to include a thumbnail image corresponding to the desired image, the operator operates the operation unit 6 to select another icon from among the icons A-b to A-f and icons corresponding to the examination A-g and A-h so as to change the thumbnail images 65 displayed in the image list display field 62 (step S10). Accordingly, thumbnail images corresponding to a newly selected icon are displayed in the image list display field 62 in step S4. Also, in step S8, when the operator has not determined that the displayed original image is the desired image, the operator operates the operation unit 6 in the same manner as described above (step S10) although the operator may select another one or more thumbnail images and see if it is the desired image before selecting another icon. Accordingly, thumbnail images corresponding to a newly selected icon are displayed in the image list display field 62 in step S4.
According to the first embodiment described above, the icons 64 representing the examination information, the thumbnail images 65 with respect to one selected from the icons 64, and the original image corresponding to one selected from the thumbnail images 65 are displayed in parallel in the display unit 5. Therefore, the operator is not required to change the display screens (or windows) back and forth in order to select examination information one after another, display thumbnail images, and see if there is a desired image. Accordingly, the operator may be able to obtain the desired image without changing the display screen (or window), which may reduce load of the operator and image observation time. This may lead to improving image observation (or diagnosis) efficiency.
The first embodiment may be modified in the following ways.
The examination list display field 61 may be provided along the horizontal direction in the screen 60 while the image list display field 62 may be provided along the vertical direction in the screen 60 as shown in
As shown in
As shown in
The configuration of the medical image display apparatus 10 shown in
As similar to
As similar to the first embodiment, when the operator determines that there is a thumbnail image corresponding to the desired image in the image list display field 82, the operator operates the operation unit 6 to select the thumbnail image 85. The operator may select more than one thumbnail image 85. In this case, the operator may select two or more thumbnail images 85 with respect to specific one of the icons 84. Alternatively, the operator may select thumbnail images 85 with respect to two or more icons 84. In response to the selection of the thumbnail image(s) 85, original image(s) corresponding to the selected thumbnail image(s) 85 may be displayed in a full size of the screen 90. During the display of the original image(s), the icons 84 and the thumbnail images 85 may disappear from the screen 90.
When the display unit 5 includes, for example, two display screens, the original image(s) may be displayed in one of the display screens (a display screen 100) while the icons 84 and the thumbnail images 85 are displayed in the other display screen 90 as shown in
The first modification to the display of the thumbnail images 85 is shown in
When the number of the thumbnail images 85 with respect to one icon 84 is even, one of two central thumbnail images may automatically be chosen as an initial central thumbnail image at random or in accordance with a predetermined rule. The operator may, however, not prefer to the one chosen and displayed as the initial central thumbnail image. In this case, the operator may designate the other one of the two central thumbnail images, using the operation unit 6. For example, the operator may designate thumbnail images marked with a triangle as central thumbnail images with respect to specific icons 110 and 111. In response to designation of each or both of the thumbnail images 85 marked with a triangle using the operation unit 6, an instruction input using the operation unit 6 after the designation, or an elapse of a predetermined time after the designation, the thumbnail images 85 marked with a triangle are displayed in alignment with other central thumbnail images 85 marked with a circle as shown in
The second modification to the display of the thumbnail images 85 will be described with reference to
According to the second embodiment, the icons 84 representing the examination information and the thumbnail images 85 with respect to the icons 84 are displayed in parallel in the display unit 5, corresponding to each other. Therefore, the operator may not be required to change the display screens (or windows) back and forth in order to select examination information one after another, display thumbnail images, and see if there is a desired image. Further, the operator may be able to compare the thumbnail images with respect to different examinations without changing the display screen (or window). This may be helpful to make it easier for the operator to select thumbnail images corresponding to one or more desired images. Therefore, it may result in improving image observation (or diagnosis) efficiency.
In the embodiments described above, the icons have been prepared to represent examinations based on the examination information. Icons may, however, be prepared to represent sets of a series of images resulting from an X-ray computed tomography apparatus (hereinafter referred to as CT images). For example, the first icon may represent the first set of a series of CT images. The series of images included in the first set may be one hundred (100) slice images. In this case, the thumbnail images may be prepared based on the one hundred slice images included in the first set. Similarly, the second icon may represent the second set of a series of CT images. The series of images included in the second set may be fifty (50) slice images. In this case, the thumbnail images may be prepared based on the fifty slice images included in the second set.
The thumbnail images may alternatively be prepared, for example, every four-slice image of the one hundred slice images included in the first set. In this case, when the operator selects one of the thumbnail images, one original image corresponding to the selected thumbnail image and subsequent three original images may be displayed in parallel.
Icons and/or thumbnail images may also be prepared for ultrasound images resulting from an ultrasound diagnosis apparatus in a similar manner.
In the above embodiments, the icons may mean not only so-called icons but also any other possible pieces each of which showing information including at least information other than characters. As long as the information other than characters is shown in the piece, the piece may also show characters.
The embodiments of the present invention described above are examples described only for making it easier to understand the present invention, and are not described for the limitation of the present invention. Consequently, each component and element disclosed in the embodiments of the present invention may be redesigned or modified to its equivalent within a scope of the present invention. Furthermore, any possible combination of such components and elements may be included in a scope of the present invention as long as an advantage similar to those obtained according to the above disclosure in the embodiments of the present invention is obtained.
Numerous modifications and variations of the present invention are possible in light of the above teachings. It is therefore to be understood that within the scope of the appended claims, the invention may be practiced otherwise than as specifically described herein.
Number | Date | Country | Kind |
---|---|---|---|
P2004-152723 | May 2004 | JP | national |
P2005-144882 | May 2005 | JP | national |