Patent Application
20220405992
The present disclosure relates to a display control apparatus, a display control method, and a display control program.
In recent years, image-based diagnosis has been performed using a three-dimensional medical image captured with imaging apparatuses such as a computed tomography (CT) apparatus and a magnetic resonance imaging (MRI) apparatus. Such a three-dimensional image includes tomographic images at a plurality of tomographic positions different from each other. In image-based diagnosis performed by a doctor using the three-dimensional image, the plurality of tomographic images are switched between and displayed.
A technique for displaying a slider bar for designating a tomographic position corresponding to each of a plurality of tomographic images has been proposed (see JP2004-173910A) as a technique for switching between and displaying the plurality of tomographic images. In this technique, a slider is displayed on the slider bar. A user moves the slider to designate a tomographic position. Then, a tomographic image corresponding to the designated tomographic position is displayed. In this technique, for example, at a tomographic position corresponding to a tomographic image that includes a result (hereinafter, referred to as a “computer diagnosis result”) of image-based diagnosis performed by a computer such as an abnormal shadow candidate, a marking indicating inclusion of the computer diagnosis result is also displayed.
A technique for displaying all tomographic images included in a set tomographic position range in a forward order one by one has also been proposed (see WO2014/203438A).
In a method for designating the tomographic position using the slider bar as in the technique described in JP2004-173910A, a user may have difficulty in observing a tomographic image with additional information such as the computer diagnosis result. Such an issue is problematic particularly when there are many tomographic images with the additional information. The reason for this is that when there are many tomographic images with the additional information, a plurality of markings corresponding to the respective tomographic images may be close to each other over the slider bar. In this case, if the position for a tomographic image without any marking is included between the markings that are close to each other, the user may mistakenly designate the position of the tomographic image without any marking, despite an intention to designate a position of a tomographic image with the marking using the slider bar. Thus, in the method for designating the tomographic position using the slider bar, the user may have difficulty in observing the tomographic image with the additional information.
The technique described in WO2014/203438A is merely a technique for displaying all tomographic images in a forward order regardless of whether or not the additional information is present, and thus does not give any consideration to a method for observing a tomographic image with the additional information.
The present disclosure is made in view of the circumstances described above, and provides a display control apparatus, a display control method, and a display control program capable of making it easier to observe a tomographic image with additional information.
A display control apparatus according to a first aspect of the present disclosure is a display control apparatus including at least one processor. The processor performs control to display a designation object for designating a tomographic position corresponding to each of a plurality of tomographic images for medical use obtained through imaging of a subject; display a tomographic image corresponding to a tomographic position designated by the designation object; display, for each of one or more specific tomographic images with additional information that is set to be added on a tomographic-image by tomographic-image basis, a marking representing the additional information at a position corresponding to a tomographic position of the specific tomographic image in a depth direction of the designation object; receive a specific display instruction to display, among the plurality of tomographic images, only the specific tomographic images that are on either side of the designation object in the depth direction with respect to a reference that is a current position designated by the designation object; display, in response to receipt of the specific display instruction, only the specific tomographic images in an order according to the depth direction; and display, in response to only the specific tomographic images being displayed in the order according to the depth direction, the markings representing the additional information added to the respective specific tomographic images in an emphasized manner in the order according to the depth direction.
In addition, a display control apparatus according to a second aspect of the present disclosure is the display control apparatus according to the first aspect in which the designation object includes a slider bar.
In addition, a display control apparatus according to a third aspect of the present disclosure is the display control apparatus according to the first aspect in which the designation object includes a schema.
In addition, a display control apparatus according to a fourth aspect of the present disclosure is the display control apparatus according to any one of the first to third aspects in which the additional information includes a plurality of kinds of additional information, and the processor is capable of receiving, as the specific display instruction, a specific display instruction including designation of a kind of the additional information, and performs control to display, in response to receipt of the specific display instruction in which the kind of the additional information is designated, only the specific tomographic images with the additional information of the designated kind in the order according to the depth direction.
In addition, a display control apparatus according to a fifth aspect of the present disclosure is the display control apparatus according to the fourth aspect in which the plurality of kinds include at least one of user-added additional information added by a user or computer-added additional information added by a computer.
In addition, a display control apparatus according to a sixth aspect of the present disclosure is the display control apparatus according to the fourth or fifth aspect in which the processor is capable of receiving, as the specific display instruction, a specific display instruction not including designation of a kind of the additional information, and performs control to display, in response to receipt of the specific display instruction, all the specific tomographic images with the additional information in the order according to the depth direction irrespective of the kinds.
In addition, a display control apparatus according to a seventh aspect of the present disclosure is the display control apparatus according to any one of the first to sixth aspects in which the order according to the depth direction includes a first order corresponding to a forward direction set in advance in the depth direction and a second order corresponding to a reverse direction opposite to the forward direction, and the processor is capable of receiving, as the specific display instruction, a specific display instruction in which either the first order or the second order is designated.
In addition, a display control apparatus according to an eighth aspect of the present disclosure is the display control apparatus according to any one of the first to seventh aspects in which the processor performs control to display an instruction button for giving the specific display instruction.
In addition, a display control apparatus according to a ninth aspect of the present disclosure is the display control apparatus according to any one of the first to eighth aspects in which the processor receives the specific display instruction input by an instruction input device.
In addition, the display control apparatus according to a tenth aspect of the present disclosure is the display control apparatus according to any one of the first to ninth aspects in which the processor performs control to display the total number of specific tomographic images at a position different from a position of the designation object.
In addition, a display control apparatus according to an eleventh aspect of the present disclosure is the display control apparatus according to any one of the first to tenth aspects in which the processor performs control to display the total number of specific tomographic images included in the plurality of tomographic images and order information indicating what number, in the order according to the depth direction, one of the specific tomographic images that is currently displayed based on the specific display instruction is.
In addition, a display control apparatus according to a twelfth aspect of the present disclosure is the display control apparatus according to the eleventh aspect in which the additional information includes a plurality of kinds of additional information, and the processor performs control to display the total number and the order information for each of the plurality of kinds.
In addition, a display control apparatus according to a thirteenth aspect of the present disclosure is the display control apparatus according to the twelfth aspect in which the processor is capable of receiving, as the specific display instruction, a specific display instruction including designation of a kind of the additional information, and performs control to selectively display the total number and the order information in accordance with the designated kind.
In addition, a display control apparatus according to a fourteenth aspect of the present disclosure is the display control apparatus according to any one of the first to thirteenth aspects in which the additional information includes computer-added additional information added by a computer, and the processor receives an input for switching between displaying and hiding of the computer-added additional information, and performs control to switch between displaying and hiding of a marking representing the computer-added additional information in accordance with the received input.
In addition, a display control apparatus according to a fifteenth aspect of the present disclosure is the display control apparatus according to the fourteenth aspect in which the processor performs control to display, for a tomographic image with the computer-added additional information, the computer-added additional information over the tomographic image, and performs control to switch between displaying and hiding of both the marking representing the computer-added additional information and the computer-added additional information over the tomographic image in accordance with the received input.
In addition, a display control apparatus according to a sixteenth aspect of the present disclosure is the display control apparatus according to any one of the first to fifteenth aspects in which the additional information includes an outline of a region of interest in the tomographic image, and the processor performs control to display, in a case where the outline of the region of interest is added to the tomographic image corresponding to the designated tomographic position, the outline of the region of interest over the tomographic image, and performs control to further display an outline of the region of interest added to any of other tomographic images in which a region of interest identical to the region of interest being displayed is detected.
In addition, a display control apparatus according to a seventeenth aspect of the present disclosure is the display control apparatus according to the sixteenth aspect in which the processor performs control to display a largest outline among outlines of the region of interest added to the other tomographic images.
In addition, a display control method according to an eighteenth aspect of the present disclosure is a display control method in which a processor, which a display control apparatus includes, performs a process of performing control to display a designation object for designating a tomographic position corresponding to each of a plurality of tomographic images for medical use obtained through imaging of a subject; display a tomographic image corresponding to a tomographic position designated by the designation object; display, for each of one or more specific tomographic images with additional information that is set to be added on a tomographic-image by tomographic-image basis, a marking representing the additional information at a position corresponding to a tomographic position of the specific tomographic image in a depth direction of the designation object; receive a specific display instruction to display, among the plurality of tomographic images, only the specific tomographic images that are on either side of the designation object in the depth direction with respect to a reference that is a current position designated by the designation object; display, in response to receipt of the specific display instruction, only the specific tomographic images in an order according to the depth direction; and display, in response to only the specific tomographic images being displayed in the order according to the depth direction, the markings representing the additional information added to the respective specific tomographic images in an emphasized manner in the order according to the depth direction.
In addition, a display control program according to a nineteenth aspect of the present disclosure causes a processor, which a display control apparatus includes, to perform a process for performing control to display a designation object for designating a tomographic position corresponding to each of a plurality of tomographic images for medical use obtained through imaging of a subject; display a tomographic image corresponding to a tomographic position designated by the designation object; display, for each of one or more specific tomographic images with additional information that is set to be added on a tomographic-image by tomographic-image basis, a marking representing the additional information at a position corresponding to a tomographic position of the specific tomographic image in a depth direction of the designation object; receive a specific display instruction to display, among the plurality of tomographic images, only the specific tomographic images that are on either side of the designation object in the depth direction with respect to a reference that is a current position designated by the designation object; display, in response to receipt of the specific display instruction, only the specific tomographic images in an order according to the depth direction; and display, in response to only the specific tomographic images being displayed in the order according to the depth direction, the markings representing the additional information added to the respective specific tomographic images in an emphasized manner in the order according to the depth direction.
The present disclosure can make it easier to observe a tomographic image with additional information.
Exemplary embodiments according to the technique of the present disclosure will be described in detail based on the following figures, wherein:
An embodiment for implementing a technique of the present disclosure will be described in detail below with reference to the drawings.
First, a configuration of a diagnosis assistance system 10 according to the present embodiment will be described with reference to
The imaging apparatus 14 is an apparatus that images a diagnosis-target part of a subject to generate a three-dimensional medical image representing the part. The three-dimensional medical image captured by the imaging apparatus 14 includes a plurality of tomographic images. In the present embodiment, an example will be described in which a CT apparatus is used as the imaging apparatus 14. However, the imaging apparatus 14 is not limited to this. For example, an apparatus that generates a three-dimensional medical image other than a CT apparatus, such as an MRI apparatus or a positron emission tomography (PET) apparatus, may be used as the imaging apparatus 14. In the present embodiment, an example will be described in which tomographic images of axial cross-sections are used as the tomographic images constituting the three-dimensional medical image. However, the tomographic images are not limited to these. As the tomographic images constituting the three-dimensional medical image, tomographic images of cross-sections other than the axial cross-sections, such as sagittal cross-sections and coronal cross-sections, may be used.
The image storage apparatus 16 is a computer that stores and manages a medical image, and includes a storage device or the like in which the medical image is stored. The image storage apparatus 16 transmits and receives a medical image generated by the imaging apparatus 14 to and from the display control apparatus 12 and the imaging apparatus 14, respectively, via the network N. A storage format of the medical image and communication performed between the apparatuses via the network N are based on a predetermined protocol such as Digital Imaging and Communication in Medicine (DICOM).
A hardware configuration of the display control apparatus 12 according to the present embodiment will be described next with reference to
As illustrated in
The storage unit 22 is implemented by a hard disk drive (HDD), a solid state drive (SSD), a flash memory, or the like. A display control program 30 is stored in the storage unit 22 that serves as a storage medium. The CPU 20 reads out the display control program 30 from the storage unit 22, loads the display control program 30 into the memory 21, and executes the loaded display control program 30.
A functional configuration of the display control apparatus 12 according to the present embodiment will be described next with reference to
The reception unit 40 receives various instructions input by a user via the input unit 24. Details of the various instructions given by the user will be described later.
As illustrated in
As illustrated in
In the present embodiment, additional information is set to be added on a tomographic-image by tomographic-image basis. A plurality of kinds of additional information can be added to a single tomographic image. Specifically, user-added additional information added by a user and computer-added additional information added by a computer can be added as the plurality of kinds of additional information. Hereinafter, when the user-added additional information and the computer-added additional information are collectively referred to without being distinguished from each other, that is, when the user-added additional information and the computer-added additional information are collectively referred to without the kinds thereof being distinguished from each other, they are referred to as “additional information”. When a tomographic image with the additional information is distinguished from a tomographic image without any additional information, the tomographic image with the additional information is referred to as a “specific tomographic image”. In the present embodiment, the additional information is additional information unique to each specific tomographic image. The additional information added to each specific tomographic image and a marking (described later) corresponding to the additional information are associated with each other on a one-to-one basis. Examples of the user-added additional information include a bookmark added as a mark for a tomographic image which the user desires to observe later, and an annotation such as information on a region of interest (ROI) included in a tomographic image. Examples of the computer-added additional information include information on a region of interest detected through computer-aided diagnosis (CAD) or information on a region of interest detected through artificial intelligence (AI) image-based diagnosis. The region of interest used herein refers to a region to which the user pays attention, such as a region of a lesion such as a tumor. Examples of the information on a region of interest include an outline, a position, and an area of the region of interest. The computer that adds the computer-added additional information is not limited particularly. For example, one or more computers may add the computer-added additional information. For example, the computer that adds the computer-added additional information may be the display control apparatus 12, a control device included in the imaging apparatus 14, or the image storage apparatus 16. For example, the computer that adds the computer-added additional information may be a computer such as an image processing apparatus external to the diagnosis assistance system 10.
The display control unit 42 performs control to display, for a specific tomographic image with the additional information, a single marking that represents the additional information and with which a single tomographic image can be identified, at a position corresponding to the tomographic position of the tomographic image with the additional information on the slider bar SB.
Specifically, the display control unit 42 performs control to display, for a tomographic image with a bookmark, a marking BM representing the bookmark at a position corresponding to the tomographic position of the tomographic image with the bookmark on the slider bar SB. The display control unit 42 also performs control to display, for a tomographic image with an annotation, a marking AN representing the annotation at a position corresponding to the tomographic position of the tomographic image with the annotation on the slider bar SB. The display control unit 42 also performs control to display, for a specific tomographic image with computer-added additional information, a marking CD representing the computer-added additional information at a position corresponding to the tomographic position of the tomographic image with the computer-added additional information on the slider bar SB.
The display control unit 42 performs control to display the markings at respective positions corresponding to the tomographic position on the slider bar SB such that the markings are shifted from each other in a direction orthogonal to a longitudinal direction of the slider bar SB (that is, in a longitudinal direction of the slider SD). Thus, even if a plurality of markings are present for the same tomographic position, the markings do not overlap.
The display control unit 42 also performs control to display a button BT for receiving a user input for switching between displaying and hiding of the computer-added additional information.
Via the input unit 24, the user designates a tomographic position of a tomographic image desired to be displayed. For example, the user drags the slider SD to the tomographic position, on the slider bar SB, of the tomographic image desired to be displayed to designate the tomographic position. For example, the user scrolls a mouse wheel to designate the tomographic position, on the slider bar SB, of the tomographic image desired to be displayed.
On the other hand,
The display information WN is information indicating what number the tomographic image displayed in the display region A1 is. In the example illustrated in
In one example, the display information WN in the present embodiment includes display information WNp for display-target tomographic images, display information WNb for specific tomographic images with the bookmark, display information WNa for specific tomographic images with the annotation, and display information WNau for specific tomographic images with the computer-added additional information. The display information WNp is information indicating what number the displayed tomographic image is with respect to the total number of tomographic images set as the display target.
On the other hand, the scroll buttons B include forward buttons FB with which the user gives an instruction to forward the displayed tomographic image, and reverse buttons RB with which the user gives an instruction to reverse the displayed tomographic image. Note that in the present embodiment, the case of switching the displayed tomographic image in an order from a position closest to the head side of the subject toward a position closest to the foot side of the subject is referred to as “to forward”. Conversely, in the present embodiment, the case of switching the displayed tomographic image in an order from the position closest to the foot side of the subject toward the position closest to the head side of the subject is referred to as “to reverse”. Specifically, in response to the user clicking any of the scroll buttons B, an instruction to forward or reverse the displayed tomographic image is given. In response to any of the scroll buttons B being clicked, the reception unit 40 receives a specific display instruction. Note that a direction along the slider bar SB in the present embodiment is an example of a depth direction in the present disclosure. The forward order that is the order from the position closest to the head side of the subject toward the position closest to the foot side of the subject in the present embodiment is an example of a first order corresponding to a forward direction in the present disclosure. The reverse order that is the order from the position closest to the foot side of the subject toward the position closest to the head side of the subject in the present embodiment is an example of a second order corresponding to a reverse direction in the present disclosure.
In the present embodiment, a configuration will be described in which the user clicks any of the scroll buttons B to give an instruction to forward or reverse the displayed tomographic image. However, the way in which the user gives an instruction to forward or reverse is not limited to this configuration. For example, the user may operate a cursor-control key of a keyboard to give an instruction to forward or reverse. In a specific example of this case, the user may operate an up or right arrow cursor-control key to give an instruction to forward and may operate a down or left arrow cursor-control key to give an instruction to reverse.
In the present embodiment, as illustrated in
As described above, in response to the user clicking the scroll button B, that is, in response to the reception unit 40 receiving the specific display instruction, the display control unit 42 according to the present embodiment performs control to display, for each kind of the added additional information, only the specific tomographic images with the additional information in the forward or reverse order. In the present embodiment, in response to the user clicking the forward button FB or the reverse button RB corresponding to the display information WNb, the display control unit 42 performs control to display, in the display region A3, only the specific tomographic images with the bookmark in the forward or reverse order. In this case, even if a specific tomographic image with the additional information of another kind or a tomographic image without any additional information is present between an n-th specific tomographic image with the bookmark and an (n+1)-th specific tomographic image with the bookmark, such a tomographic image is not displayed in the display region A3. Likewise, in response to the user clicking the forward button FB or the reverse button RB corresponding to the display information WNa, the display control unit 42 performs control to display, in the display region A3, only the specific tomographic images with the annotation in the forward or reverse order. In this case, even if a specific tomographic image with the additional information of another kind or a tomographic image without any additional information is present between an n-th specific tomographic image with the annotation and an (n+1)-th specific tomographic image with the annotation, such a tomographic image is not displayed in the display region A3. In response to the user clicking the forward button FB or the reverse button RB corresponding to the display information WNau, the display control unit 42 performs control to display, in the display region A3, only the specific tomographic images with the computer-added additional information in the forward or reverse order. In this case, even if a specific tomographic image with the additional information of another kind or a tomographic image without any additional information is present between an n-th specific tomographic image with the computer-added additional information and an (n+1)-th specific tomographic image with the computer-added additional information, such a tomographic image is not displayed in the display region A3.
As described above, in response to the user clicking the forward button FB corresponding to the display information WNb for the specific tomographic images with the bookmark, the display control unit 42 performs control to increment the order information of the display information WNb. On the other hand, in response to the user clicking the reverse button RB corresponding to the display information WNb for the specific tomographic images with the bookmark, the display control unit 42 performs control to decrement the order information of the display information WNb. In response to the user clicking the forward button FB corresponding to the display information WNa for the specific tomographic images with the annotation, the display control unit 42 performs control to increment the order information of the display information WNa. In response to the user clicking the reverse button RB corresponding to the display information WNa for the specific tomographic images with the annotation, the display control unit 42 performs control to decrement the order information of the display information WNa. In response to the user clicking the forward button FB corresponding to the display information WNau for the specific tomographic images with the computer-added additional information, the display control unit 42 performs control to increment the order information of the display information WNau. In response to the user clicking the reverse button RB corresponding to the display information WNau for the specific tomographic images with the computer-added additional information, the display control unit 42 performs control to decrement the order information of the display information WNau.
As illustrated in
Displaying the marking provided at the position corresponding to the tomographic position of the displayed specific tomographic image on the slider bar SB, in the color different from the color of the other markings in the present embodiment is an example of emphasized display in the present disclosure. The method of emphasized display is not limited to that of the present embodiment. Any method for emphasizing the marking provided at the position corresponding to the tomographic position of the displayed specific tomographic image on the slider bar SB may be used. For example, instead of making the color of the entire marking different as described above, emphasized display may be performed by making the color of the outline of the marking different. For example, emphasized display may be performed by displaying only the marking corresponding to the designated tomographic position to blink.
As illustrated in
As illustrated in
In detection by a computer, many regions of interest may be detected. Accordingly, before performing image-based diagnosis, the user may desire to hide the computer-added additional information. When the user desires to switch between displaying and hiding of the computer-added additional information, the user designates the button BT via the input unit 24.
In response to the reception unit 40 receiving an input for switching between displaying and hiding of the computer-added additional information, the display control unit 42 performs control to switch between displaying and hiding of the marking CD representing the computer-added additional information in accordance with the received input, as illustrated in
An operation of the display control apparatus 12 according to the present embodiment will be described next with reference to
In step S10 in
As described above, the display control unit 42 performs control to display, for a specific tomographic image with the additional information among the tomographic images in the group, the marking representing the additional information at the position corresponding to the tomographic position of the tomographic image with the additional information on the slider bar SB. The display control unit 42 also performs control to display the button BT for receiving a user input for switching between displaying and hiding of the computer-added additional information. As a result of the processing of step S10, the screen illustrated in
In step S12, the reception unit 40 waits until the reception unit 40 receives an instruction input by the user via the input unit 24. In response to the instruction being input by the user via the input unit 24, the determination in step S12 is positive and thus the process proceeds to step S14. In step S14, the reception unit 40 determines whether or not the instruction received in step S12 is an instruction to end the display. If this determination is negative, the process proceeds to step S16. In step S16, the display control unit 42 performs control to switch the display in accordance with the instruction received in step S12. In response to the end of the processing of step S16, the process returns to step S12. On the other hand, if the determination in step S14 is positive, the display control process ends. The display state of the display objects displayed in the respective display regions A1, A2, and A3 at the time when this display control process ends is stored in the image storage apparatus 16 in association with the group of tomographic images, for example, so that the display state is inherited when step S10 is performed for the second and subsequent times.
If the instruction received in step S12 is an instruction to designate a tomographic position through a drag operation on the slider SD, a scroll operation on a mouse wheel, or the like, or is an instruction to forward or reverse the tomographic image via the scroll button B, a processing routine illustrated in
In step S100 in
In step S102, the display control unit 42 determines whether or not the instruction received in step S12 above is the specific display instruction received as a result of clicking of the forward button FB or the reverse button RB corresponding to the display information WNb for the specific tomographic images with the bookmark. If the specific display instruction resulting from clicking of the forward button FB or the reverse button RB corresponding to the display information WNb is received, the determination in step S102 is positive and thus the process proceeds to step S104.
In step S104, the display control unit 42 determines whether or not the instruction received in step S12 above is the specific display instruction received as a result of clicking of the forward button FB. If the specific display instruction resulting from clicking of the forward button FB is received, the determination in step S104 is positive and thus the process proceeds to step S106.
In step S106, the display control unit 42 performs control to display, in the display region A3, the next specific tomographic image with the bookmark in the forward direction. Specifically, in the case of a state in which an n-th specific tomographic image among the specific tomographic images with the bookmark is displayed in the display region A3, the display control unit 42 performs control to display an (n+1)-th specific tomographic image in the display region A3. If the user clicks the forward button FB corresponding to the display information WNb in a state in which a tomographic image without any bookmark is displayed in the display region A3, the display control unit 42 performs control to display, in the display region A3, the specific tomographic image with the bookmark that is at the tomographic position closest to the tomographic position of the tomographic image currently in the display region A3 in the forward direction. The display control unit 42 also performs control to move the slider SD to the position, on the slider bar SB, corresponding to the tomographic position of the specific tomographic image displayed in the display region A3.
If the user clicks the forward button FB corresponding to the display information WNb in a state in which the tomographic image at the tomographic position closest to the foot side of the subject is displayed in the display region A3, there is no tomographic image of which the tomographic position is in the forward direction relative to the tomographic image currently displayed in the display region A3. In this case, the display control unit 42 may perform control to keep displaying the tomographic image currently displayed in the display region A3 as it is. In this case, the display control unit 42 may skip this step. In such a case, the display control unit 42 preferably performs control to display, on the display 23, information indicating that there is no specific tomographic image to be displayed.
In next step S108, the display control unit 42 increments the order information of the display information WNb. In response to the end of the processing of step S108, the process proceeds to step S142.
On the other hand, if the specific display instruction resulting from clicking of the forward button FB is not received in step S104 above, that is, if the specific display instruction resulting from clicking of the reverse button RB is received, the determination is negative and thus the process proceeds to step S110.
In step S110, the display control unit 42 performs control to display, in the display region A3, the next specific tomographic image with the bookmark in the reverse direction. Specifically, in the case of a state in which an n-th specific tomographic image among the specific tomographic images with the bookmark is displayed in the display region A3, the display control unit 42 performs control to display an (n−1)-th specific tomographic image in the display region A3. If the user clicks the reverse button RB corresponding to the display information WNb in a state in which a tomographic image without any bookmark is displayed in the display region A3, the display control unit 42 performs control to display, in the display region A3, the specific tomographic image with the bookmark that is at the tomographic position closest to the tomographic position of the tomographic image currently displayed in the display region A3 in the reverse direction. The display control unit 42 also performs control to move the slider SD to the position, on the slider bar SB, corresponding to the tomographic position of the specific tomographic image displayed in the display region A3.
If the user clicks the reverse button RB corresponding to the display information WNb in a state in which the tomographic image at the tomographic position closest to the head side of the subject is displayed in the display region A3, there is no tomographic image of which the tomographic position is in the reverse direction relative to the tomographic image currently displayed in the display region A3. In this case, the display control unit 42 may perform control to keep displaying the tomographic image currently displayed in the display region A3 as it is. In this case, the display control unit 42 may skip this step. In such a case, the display control unit 42 preferably performs control to display, on the display 23, information indicating that there is no specific tomographic image to be displayed.
In next step S112, the display control unit 42 decrements the order information of the display information WNb. In response to the end of the processing of step S112, the process proceeds to step S142.
On the other hand, if the instruction received in step S12 above is not the specific display instruction resulting from clicking of the forward button FB or the reverse button RB corresponding to the display information WNb for the specific tomographic images with the bookmark in step S102 above, the determination in step S102 is negative and thus the process proceeds to step S114.
In step S114, the display control unit 42 determines whether or not the instruction received in step S12 above is the specific display instruction received as a result of clicking of the forward button FB or the reverse button RB corresponding to the display information WNa for the specific tomographic image with the annotation. If the specific display instruction resulting from clicking of the forward button FB or the reverse button RB corresponding to the display information WNa is received, the determination in step S114 is positive and thus the process proceeds to step S116.
In step S116, the display control unit 42 determines whether or not the instruction received in step S12 above is the specific display instruction received as a result of clicking of the forward button FB. If the specific display instruction resulting from clicking of the forward button FB is received, the determination in step S116 is positive and thus the process proceeds to step S118.
In step S118, the display control unit 42 performs control to display, in the display region A3, the next specific tomographic image with the annotation in the forward direction. Specifically, in the case of a state in which an n-th specific tomographic image among the specific tomographic images with the annotation is displayed in the display region A3, the display control unit 42 performs control to display an (n+1)-th specific tomographic image in the display region A3. If the user clicks the forward button FB corresponding to the display information WNa in a state in which a tomographic image without any annotation is displayed in the display region A3, the display control unit 42 performs control to display, in the display region A3, the specific tomographic image with the annotation that is at the tomographic position closest to the tomographic position of the tomographic image currently in the display region A3 in the forward direction. The display control unit 42 also performs control to move the slider SD to the position, on the slider bar SB, corresponding to the tomographic position of the specific tomographic image displayed in the display region A3.
If the user clicks the forward button FB corresponding to the display information WNa in a state in which the tomographic image at the tomographic position closest to the foot side of the subject is displayed in the display region A3, there is no tomographic image of which the tomographic position is in the forward direction relative to the tomographic image currently in the display region A3. In this case, the display control unit 42 may perform control to keep displaying the tomographic image currently displayed in the display region A3 as it is. In this case, the display control unit 42 may skip this step. In such a case, the display control unit 42 preferably performs control to display, on the display 23, information indicating that there is no specific tomographic image to be displayed.
In next step S120, the display control unit 42 increments the order information of the display information WNa. In response to the end of the processing of step S120, the process proceeds to step S142.
On the other hand, if the specific display instruction resulting from clicking of the forward button FB is not received in step S116 above, that is, if the specific display instruction resulting from clicking of the reverse button RB is received, the determination is negative and thus the process proceeds to step S122.
In step S122, the display control unit 42 performs control to display, in the display region A3, the next specific tomographic image with the annotation in the reverse direction. Specifically, in the case of a state in which an n-th specific tomographic image among the specific tomographic images with the annotation is displayed in the display region A3, the display control unit 42 performs control to display an (n−1)-th specific tomographic image in the display region A3. In response to the user clicking the reverse button RB corresponding to the display information WNa in a state in which a tomographic image without any annotation is displayed in the display region A3, the display control unit 42 performs control to display, in the display region A3, the specific tomographic image with the annotation that is at the tomographic position closest to the tomographic position of the tomographic image currently in the display region A3 in the reverse direction. The display control unit 42 also performs control to move the slider SD to the position, on the slider bar SB, corresponding to the tomographic position of the specific tomographic image displayed in the display region A3.
If the user clicks the reverse button RB corresponding to the display information WNa in a state in which the tomographic image at the tomographic position closest to the head side of the subject is displayed in the display region A3, there is no tomographic image of which the tomographic position is in the reverse direction relative to the tomographic image currently in the display region A3. In this case, the display control unit 42 may perform control to keep displaying the tomographic image currently displayed in the display region A3 as it is. In this case, the display control unit 42 may skip this step. In such a case, the display control unit 42 preferably performs control to display, on the display 23, information indicating that there is no specific tomographic image to be displayed.
In next step S124, the display control unit 42 decrements the order information of the display information WNa. In response to the end of the processing of step S124, the process proceeds to step S142.
On the other hand, if the instruction received in step S12 above is not the specific display instruction as a result of clicking of the forward button FB or the reverse button RB corresponding to the display information WNa for the specific tomographic images with the annotation in step S114 above, the determination in step S114 is negative and thus the process proceeds to step S126.
In step S126, the display control unit 42 determines whether or not the instruction received in step S12 above is the specific display instruction received as a result of clicking of the forward button FB or the reverse button RB corresponding to the display information WNau for the specific tomographic images with the computer-added additional information. If the specific display instruction resulting from clicking of the forward button FB or the reverse button RB corresponding to the display information WNau is received, the determination in step S126 is positive and thus the process proceeds to step S128.
In step S128, the display control unit 42 determines whether or not the instruction received in step S12 above is the specific display instruction received as a result of clicking of the forward button FB. If the specific display instruction resulting from clicking of the forward button FB is received, the determination in step S128 is positive and thus the process proceeds to step S130.
In step S130, the display control unit 42 performs control to display, in the display region A3, the next specific tomographic image with the computer-added additional information in the forward direction. Specifically, in the case of a state in which an n-th specific tomographic image among the specific tomographic images with the computer-added additional information is displayed in the display region A3, the display control unit 42 performs control to display an (n+1)-th specific tomographic image in the display region A3. If the user clicks the forward button FB corresponding to the display information WNau in a state in which a tomographic image without any computer-added additional information is displayed in the display region A3, the display control unit 42 performs control to display, in the display region A3, the specific tomographic image with the computer-added additional information that is at the tomographic position closest to the tomographic position of the tomographic image currently in the display region A3 in the forward direction. The display control unit 42 also performs control to move the slider SD to the position, on the slider bar SB, corresponding to the tomographic position of the specific tomographic image displayed in the display region A3.
If the user clicks the forward button FB corresponding to the display information WNau in a state in which the tomographic image at the tomographic position closest to the foot side of the subject is displayed in the display region A3, there is no tomographic image of which the tomographic position is in the forward direction relative to the tomographic image currently in the display region A3. In this case, the display control unit 42 may perform control to keep displaying the current tomographic image in the display region A3 as it is. In this case, the display control unit 42 may skip this step. In such a case, the display control unit 42 preferably performs control to display, on the display 23, information indicating that there is no specific tomographic image to be displayed.
In next step S132, the display control unit 42 increments the order information of the display information WNau. In response to the end of the processing of step S132, the process proceeds to step S142.
On the other hand, if the specific display instruction resulting from clicking of the forward button FB is not received in step S128 above, that is, if the specific display instruction resulting from clicking of the reverse button RB is received, the determination is negative and thus the process proceeds to step S134.
In step S134, the display control unit 42 performs control to display, in the display region A3, the next specific tomographic image with the computer-added additional information in the reverse direction. Specifically, in the case of a state in which an n-th specific tomographic image among the specific tomographic images with the computer-added additional information is displayed in the display region A3, the display control unit 42 performs control to display an (n−1)-th specific tomographic image in the display region A3. If the user clicks the reverse button RB corresponding to the display information WNau in a state in which a tomographic image without any computer-added additional information is displayed in the display region A3, the display control unit 42 performs control to display, in the display region A3, the specific tomographic image with the computer-added additional information that is at the tomographic position closest to the tomographic position of the tomographic image currently in the display region A3 in the reverse direction. The display control unit 42 also performs control to move the slider SD to the position, on the slider bar SB, corresponding to the tomographic position of the specific tomographic image displayed in the display region A3.
If the user clicks the reverse button RB corresponding to the display information WNau in a state in which the tomographic image at the tomographic position closest to the head side of the subject is displayed in the display region A3, there is no tomographic image of which the tomographic position is in the reverse direction relative to the tomographic image currently in the display region A3. In this case, the display control unit 42 may perform control to keep displaying the current tomographic image in the display region A3 as it is. In this case, the display control unit 42 may skip this step. In such a case, the display control unit 42 preferably performs control to display, on the display 23, information indicating that there is no specific tomographic image to be displayed.
In next step S136, the display control unit 42 decrements the order information of the display information WNa. In response to the end of the processing of step S136, the process proceeds to step S142.
In step S142, the display control unit 42 performs control to move the slider SD to the position, on the slider bar SB, corresponding to the tomographic position of the tomographic image displayed in the display region A3 in the processing of any of steps S106, S110, S118, S122, S130, and S134 above.
On the other hand, if the received instruction is an instruction to move the slider SD resulting from a drag operation on the slider SD, a scroll operation on the mouse wheel, or the like in step S100 above, the determination is positive and thus the process proceeds to step S138.
In step S138, the display control unit 42 performs control to move the slider SD to the position, on the slider bar SB, corresponding to the tomographic position designated through the user operation. In next step S140, the display control unit 42 performs control to switch the tomographic image in the display region A3 to the tomographic image at the designated tomographic position. In response to the end of the processing of step S140, the process proceeds to step S144.
In step S144, the display control unit 42 changes the order information of the display information WNp to a value corresponding to the order of the tomographic image displayed in the display region A3 in the processing of any of steps S106, S110, S118, S122, S130, S134, and S140.
In response to the end of the processing of step S144, the processing routine illustrated in
If the instruction received in step S12 is an instruction to switch between displaying and hiding of the computer-added additional information as a result of designation of the button BT, a processing routine illustrated in
In step S160 in
In step S162, the display control unit 42 performs control to display the marking CD representing the computer-added additional information and to display the computer-added additional information over the tomographic image as described above. In response to the end of the processing of step S162, the processing routine illustrated in
As described above, the display control apparatus 12 according to the present embodiment is the display control apparatus 12 including the CPU 20 as at least one processor. The CPU 20 displays the slider bar SB and the slider SD for designating a tomographic position corresponding to each of a plurality of tomographic images for medical use obtained through imaging of a subject. The CPU 20 also displays a tomographic image corresponding to the tomographic position designated by the slider SD. For each of one or more specific tomographic images with additional information, which is set to be added on a tomographic-image by tomographic-image basis, the CPU 20 also displays a marking representing the additional information at a position corresponding to a tomographic position of the tomographic image in a depth direction of the slider bar SB. The CPU 20 receives a specific display instruction to display, among the plurality of tomographic images, only the specific tomographic images that are on either side of the slider bar SB in the depth direction with respect to a reference that is a current position designated by the slider SD. In response to receiving the specific display instruction, the CPU 20 displays only the specific tomographic images in an order according to the depth direction. In response to only the specific tomographic images being displayed in the order according to the depth direction, the CPU 20 displays the marking representing the additional information added to the respective specific tomographic images in an emphasized manner in the order according to the depth direction.
As described above, according to the present embodiment, in response to the instruction from the user, control is performed to display only the specific tomographic images with the additional information in the order according to the depth direction of the plurality of tomographic images. Thus, for example, even if the user does not perform an operation such as dragging the slider SD to a position of a specific tomographic image with a marking indicating that the additional information is added on the slider bar SB, only the specific tomographic images with the additional information can be displayed in the order according to the depth direction. The display control apparatus 12 according to the present embodiment allows the user to consecutively observe only the specific tomographic images with the additional information while skipping the tomographic images that are without any additional information and thus are less likely to be observed by the user than the specific tomographic images with the additional information.
Thus, the display control apparatus 12 according to the present embodiment can make it easier to observe the specific tomographic image with the additional information.
Note that the display manner and the display method of the display information WN and the scroll buttons B are not limited to the manner and the method described above. For example, first and second modifications below may be employed.
In the above, the configuration has been described in which the display information WN and the scroll buttons B are displayed adjacently in combination for each kind of the additional information. Specifically, the configuration has been described in which the display control unit 42 simultaneously displays three kinds of display information WN for the bookmark WNb, the annotation WNa, and the computer-added additional information WNau, and the scroll buttons B corresponding to the respective kinds of display information WN in the display region A2. By contrast, in the present modification, a configuration will be described in which the display control unit 42 performs control to display, in the display region A2, only the display information WN and the scroll buttons B corresponding to the additional information of the kind selected by the user from among the plurality of kinds of additional information.
In one example, in the present modification, as illustrated in
On the other hand, if the user designates, through clicking, the marking corresponding to the additional information at the position of the slider bar SB, the display control unit 42 performs control to display, in the display region A2, the display information WN and the scroll buttons B corresponding to the additional information of the kind indicated by the designated marking. That is, the user can cause the display information WN and the scroll buttons B to be displayed in the display region A2 for the desired kind of additional information by designating the marking corresponding to the additional information at the position of the slider bar SB.
In one example, a right-side diagram of
An operation of the display control apparatus 12 according to the present modification will be described next with reference to
In the display control process (see
In step S200 in
In step S202, the display control unit 42 determines whether or not the instruction received in step S12 above is an instruction resulting from designation (clicking) of the marking representing the additional information at the slider SD. If the determination in step S202 is positive, the process proceeds to step S204.
In step S204, the display control unit 42 performs control to display, in the display region A2, the display information WN and the scroll buttons B corresponding to the additional information of the kind corresponding to the designated marking. For example, as described above, if the user clicks the marking CD representing the computer-added additional information, the display control unit 42 performs control to display, in the display region A2, the display information WNau as the display information WN and the scroll buttons B as illustrated in the right-side diagram of
In step S206, the display control unit 42 performs control to move the slider SD to the position, on the slider bar SB, corresponding to the tomographic position according to the position of the marking designated by the user on the slider bar SB. In next step S208, the display control unit 42 performs control to switch the tomographic image in the display region A3 to the specific tomographic image at the tomographic position indicated by the slider SD. In response to the end of the processing of step S208, the processing routine illustrated in
On the other hand, if a negative determination is obtained in step S202 above, the process proceeds to step S210. In step S210, the display control unit 42 determines whether or not the instruction received in step S12 above is the specific display instruction received as a result of clicking of the forward button FB. If the specific display instruction resulting from clicking of the forward button FB is received, the determination in step S210 is positive and thus the process proceeds to step S212.
In step S212, the display control unit 42 performs control to display, in the display region A3, the next specific tomographic image with the additional information of the designated kind in the forward direction. For example, suppose a state in which the display information WNau and the scroll buttons B for the computer-added additional information are displayed in the display region A2 and an n-th specific tomographic image among the specific tomographic images with the computer-added additional information is displayed in the display region A3. In the case, in response to the user clicking the marking CD representing the computer-added additional information, the display control unit 42 performs control to display an (n+1)-th specific tomographic image in the display region A3. The display control unit 42 also performs control to move the slider SD to the position, on the slider bar SB, corresponding to the tomographic position of the specific tomographic image displayed in the display region A3.
If the user clicks the forward button FB in a state in which the tomographic image at the tomographic position closest to the foot side of the subject is displayed in the display region A3, there is no tomographic image of which the tomographic position is in the forward direction relative to the tomographic image currently in the display region A3. In this case, the display control unit 42 may perform control to keep displaying the tomographic image currently displayed in the display region A3 as it is. In this case, the display control unit 42 may skip this step. In such a case, the display control unit 42 preferably performs control to display, on the display 23, information indicating that there is no specific tomographic image to be displayed.
In next step S214, the display control unit 42 increments the order information of the display information WN. In response to the end of the processing of step S214, the processing routine illustrated in
On the other hand, if the specific display instruction resulting from clicking of the forward button FB is not received in step S210 above, that is, if the specific display instruction resulting from clicking of the reverse button RB is received, the determination is negative and thus the process proceeds to step S216.
In step S216, the display control unit 42 determines whether or not the instruction received in step S12 above is the specific display instruction received as a result of clicking of the reverse button RB. If the specific display instruction resulting from clicking of the reverse button RB is received, the determination in step S216 is positive and thus the process proceeds to step S218.
In step S218, the display control unit 42 performs control to display, in the display region A3, the next specific tomographic image with the additional information of the designated kind in the reverse direction. For example, suppose a state in which the display information WNau and the scroll buttons B for the computer-added additional information are displayed in the display region A2 and an n-th specific tomographic image among the specific tomographic images with the computer-added additional information is displayed in the display region A3. In the case, in response to the user clicking the marking CD representing the computer-added additional information, the display control unit 42 performs control to display an (n−1)-th specific tomographic image in the display region A3. The display control unit 42 also performs control to move the slider SD to the position, on the slider bar SB, corresponding to the tomographic position of the specific tomographic image displayed in the display region A3.
In response to the user clicking the reverse button RB in a state in which the tomographic image at the tomographic position closest to the head side of the subject is displayed in the display region A3, there is no tomographic image of which the tomographic position is in the reverse direction relative to the tomographic image currently in the display region A3. In this case, the display control unit 42 may perform control to keep displaying the tomographic image currently displayed in the display region A3 as it is. In this case, the display control unit 42 may skip this step. In such a case, the display control unit 42 preferably performs control to display, on the display 23, information indicating that there is no specific tomographic image to be displayed.
In next step S230, the display control unit 42 decrements the order information of the display information WN. In response to the end of the processing of step S230, the processing routine illustrated in
On the other hand, if the received instruction is an instruction to move the slider SD resulting from a drag operation on the slider SD, a scroll operation on the mouse wheel, or the like in step S200 above, the determination is positive and thus the process proceeds to step S232.
In step S232, the display control unit 42 determines whether or not the display information WN is displayed in the display region A2. Specifically, the display control unit 42 determines whether or not the display information WN and the scroll buttons B are displayed in the display region A2. If the display information WN is not displayed in the display region A2, the determination in step S232 is negative and thus the process proceeds to step S236. On the other hand, if the display information WN is displayed in the display region A2, the determination in step S232 is positive and thus the process proceeds to step S234.
In step S234, the display control unit 42 performs control to hide the display information WN and the scroll buttons B that are displayed in the display region A2. This control results in a state in which nothing is displayed in the display region A2 as illustrated in the left-side diagram of
In next step S236, the display control unit 42 performs control to move the slider SD to the position, on the slider bar SB, corresponding to the tomographic position designated through the user operation. In next step S238, the display control unit 42 performs control to switch the tomographic image in the display region A3 to the tomographic image at the designated tomographic position. In response to the end of the processing of step S238, the processing routine illustrated in
As described above, in the present modification, the display control unit 42 performs control to display, in the display region A2, the display information WN and the scroll buttons B corresponding to the additional information of the kind selected by the user. Thus, similarly to the embodiment described above, the display control apparatus 12 according to the present modification can make it easier to observe the specific tomographic image with the additional information.
In the configurations described above, the configuration has been described in which the display control unit 42 displays the display information WN and the scroll buttons B for each kind of the additional information. Specifically,
By contrast, as in the present modification illustrated in
In the example illustrated in
As described above, in the present modification, the display control unit 42 performs control to display, in the display region A2, the combination of the display information WN and the scroll buttons B corresponding to the total number of tomographic images with the additional information regardless of the kinds of the additional information. Thus, as in the configurations described above, the display control apparatus 12 of the present modification enables only the tomographic images with the additional information to be consecutively observed while skipping tomographic images without any additional information and thus can make it easier to observe the specific tomographic images with the additional information.
Note that the technique of the present disclosure is not limited by the first and second modifications described above. For example, instead of giving an instruction to forward through clicking of the forward button FB of the scroll buttons B and giving an instruction to reverse through clicking of the reverse button RB of the scroll buttons B, the user may place the cursor over the display information WN and move the mouse wheel to give the instruction to forward or the instruction to reverse according to the direction of the movement.
In the embodiment described above, for a tomographic image with the computer-added additional information, the display control unit 42 may perform control to further display, in addition to an outline O1 of a region of interest represented by the computer-added additional information added to the tomographic image, an outline O2 of the region of interest as illustrated in
In the embodiment described above, the case has been described where the computer adds the computer-added additional information to all the tomographic images in which the region of interest is detected. However, the configuration is not limited to this. As illustrated in
The processing performed by the computer to select the tomographic image to which the additional information is to be added in this case may be performed in the same manner by the user via the input unit 24. The user-added additional information in this case is information added by the user to the representative tomographic image of the group of tomographic images including the same target among the plurality of tomographic images.
In the embodiment described above, the case has been described where the slider bar SB and the slider SD are used as a designation object for designating a tomographic position corresponding to each of a plurality of tomographic images. However, the designation object is not limited to this. For example, as illustrated in
Both the slider SD and the slider bar SB illustrated in
In the embodiment described above, for example, various processors mentioned below can be used as a hardware structure of processing units such as the reception unit 40 and the display control unit 42 that perform various processes. The aforementioned various processors include, in addition to a CPU which is a general-purpose processor that executes software (program) to function as the various processing units as described above, a programmable logic device (PLD), such as a field programmable gate array (FPGA), which is a processor whose circuitry is changeable after production; a dedicated electric circuit, such as an application specific integrated circuit (ASIC), which is a processor having circuitry designed exclusively for executing specific processing; and the like.
A single processing unit may be constituted by one of these various processors, or by a combination of two or more processors of the same kind or different kinds (for example, a combination of a plurality of FPGAs or a combination of a CPU and an FPGA). In addition, a plurality of processing units may be constituted by a single processor.
Examples in which the plurality of processing units are constituted by a single processor include a first configuration, as exemplified by computers such as a server and a client, in which a combination of one or more CPUs and software constitutes the single processor and this processor functions as the plurality of processing units. The examples also include a second configuration, as exemplified by a System On Chip (SoC) or the like, in which the processor that implements functions of the entire system including the plurality of processing units on a single integrated circuit (IC) chip is used. As described above, the various processing units are constituted using one or more of the various processors above in terms of the hardware structure.
More specifically, electric circuitry in which circuit elements such as semiconductor elements are combined can be used in terms of the hardware structure of these various processors.
In the embodiment above, the configuration has been described in which the display control program 30 is stored (installed) in the storage unit 22 in advance. However, the configuration is not limited to this. The display control program 30 may be provided in a form of a recording medium, such as a compact disc read-only memory (CD-ROM), a digital versatile disc read-only memory (DVD-ROM), or a Universal Serial Bus (USB) memory, on which the display control program 30 is recorded. The display control program 30 may also be downloaded from an external apparatus via a network.
In addition, the configurations of the diagnosis assistance system 10, the display control apparatus 12, and the like; the display control method; and the like described in the embodiment and modifications above are merely an example. Thus, it is needless to say that the configurations, the method, and the like can be changed in accordance with a circumstance within a scope not departing from the gist of the present invention.
The disclosure of JP2020-040358 filed Mar. 9, 2020 is incorporated herein by reference in its entirety.
All the documents, patent applications, and technical standards mentioned in this specification are incorporated herein by reference to the same extent as if the individual documents, patent applications, and technical standards were specifically and individually described to be incorporated by reference.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2020-040358 | Mar 2020 | JP | national |
This application is a continuation application of International Application No. PCT/JP2021/006421, filed Feb. 19, 2021, the disclosure of which is incorporated herein by reference in its entirety. Further, this application claims priority from Japanese Patent Application No. 2020-040358 filed on Mar. 9, 2020, the disclosure of which is incorporated herein by reference in its entirety.
| Number | Date | Country | |
|---|---|---|---|
| Parent | PCT/JP2021/006421 | Feb 2021 | US |
| Child | 17822040 | US |
