This application is based upon and claims the benefit of priority from Japanese Patent Application No. 2022-200427, filed on Dec. 15, 2022; the entire contents of which are incorporated herein by reference.
Embodiments described herein relate generally to a medical image processing apparatus, a medical image processing method, and a recording medium.
A medical imaging diagnostic apparatus, for example, takes an image of a subject to generate a three-dimensional medical image including a plurality of slice images of the subject. For example, a physician (or “diagnostic imaging physician” or “radiologist”), who is a user, uses three-dimensional medical images for radiologic interpretations. The user often observes a three-dimensional medical image including a plurality of slice images such as computed tomography (CT) images and magnetic resonance imaging (MRI) images in diagnostic imaging. When the user observes a three-dimensional medical image, the user acquires arbitrary slice images included in the three-dimensional medical image by using a medical image display device, and controls a display to display the acquired slice images. Usually, when the user gives an instruction to change the positions of the slice images in the three-dimensional medical image (hereinafter, referred to as “slice positions”) as per the order of the slice images or in reverse order, the medical image display device sequentially acquires the slice images to be displayed on the display. Hereafter, moving the slice position by +1 is referred to as +1 slice feeding, moving the slice position by −1 is referred to as −1 slice feeding, and +1 slice feeding and −1 slice feeding are collectively referred to as ±1 slice feeding. For example, when the user gives an instruction for ±1 slice feeding to a medical image processing apparatus, the medical image display device changes each slice image included in the three-dimensional medical image to be displayed on the display in the same or reverse order of its sequence.
An instruction given by the user who wants to quickly observe the entire three-dimensional medical image may result in an instruction for slice feeding while skipping (thinning out) the slice positions of the slice images displayed on the display by regular intervals (referred to as n). Here, n is a predetermined integer of 2 or more. Hereafter, moving the slice position by +n is referred to as +n slice feeding, moving the slice position by −n is referred to as −n slice feeding, and +n slice feeding and −n slice feeding are collectively referred to as ±n slice feeding. For example, when the user inputs an instruction for +1 slice feeding in order to quickly observe the three-dimensional medical image, the display process of the medical image display device may not be completed in time, resulting in +n slice feeding. In such a case, since the medical image processing apparatus displays the acquired slice images on the display while skipping slice positions at regular intervals, the slice images at the skipped slice positions are not displayed on the display.
A medical image processing apparatus according to the present embodiment includes processing circuitry. The processing circuitry receives an instruction to move a slice position when a three-dimensional medical image including a plurality of slice images of a subject is displayed. The processing circuitry controls a display to display a slice image at a destination slice position as a first image when the received instruction is an instruction to move the slice position by less than a predetermined interval, and controls the display to display a second image reflecting information on a plurality of slice images including the slice image at the destination slice position when the received instruction is an instruction to move the slice position by more than the predetermined interval.
Embodiments of a medical image processing apparatus, a medical image processing method, and a computer program are described below in detail with reference to the drawings. The following is an example of a medical image processing system including the medical image processing apparatus.
The medical image diagnostic apparatus 2 is an X-ray diagnostic apparatus, an X-ray computed tomography (CT) apparatus, a magnetic resonance imaging (MRI) apparatus, an ultrasonic diagnostic apparatus, or a single photon emission computed tomography (SPECT) apparatus. The medical image diagnostic apparatus 2 is a positron emission computed tomography (PET) apparatus, a SPECT-CT apparatus in which a SPECT apparatus and an X-ray CT apparatus are integrated, a PET-CT apparatus in which a PET apparatus and an X-ray CT apparatus are integrated, a group of these apparatuses, or the like. The medical image diagnostic apparatus 2 can generate a two-dimensional medical image, a three-dimensional medical image (volume data), a time-series two-dimensional medical image, and a time-series three-dimensional medical image.
The medical image diagnostic apparatus 2 collects medical images by capturing an image of a subject. For example, an X-ray CT apparatus serving as the medical image diagnostic apparatus 2 moves an X-ray tube and an X-ray detector in a swiveling motion around a subject to which a contrast agent has been administered, detects X-rays transmitted through the subject, and collects projection data. On the basis of the collected projection data, the X-ray CT apparatus generates a two-dimensional CT image, a three-dimensional CT image (volume data), a time-series two-dimensional CT image, and a time-series three-dimensional CT image. Alternatively, on the basis of the collected projection data, the X-ray CT apparatus generates a plurality of two-dimensional CT images along predetermined directions. For example, the X-ray CT apparatus generates a two-dimensional CT image of a plurality of axial cross sections following a body axial direction.
The medical image diagnostic apparatus 2 transmits the generated medical images to the image storage apparatus 3. When transmitting the medical images to the image storage apparatus 3, the medical image diagnostic apparatus 2 transmits ancillary information such as a patient ID identifying a patient, an examination ID identifying an examination, a device ID identifying the medical image diagnostic apparatus 2, a series ID identifying one-time of imaging by the medical image diagnostic apparatus 2, and the like.
The image storage apparatus 3 is a database that stores the medical images. Specifically, the image storage apparatus 3 includes storage circuitry, and stores the medical images transmitted from the medical image diagnostic apparatus 2 in the storage circuitry, thereby storing the medical images. The storage circuitry of the image storage apparatus 3 is, for example, a semiconductor memory element such as a random access memory (RAM) and a flash memory, or a storage device such as a hard disk and an optical disk. The medical images stored in the image storage apparatus 3 are stored in association with the patient ID, the examination ID, the device ID, the series ID, and the like. Therefore, the medical image processing apparatus 100 can acquire necessary medical images from the image storage apparatus 3 by performing a search using the patient ID, the examination ID, the device ID, the series ID, and the like.
The medical image processing apparatus 100 is an image processing apparatus that performs image processing on medical images, such as a workstation, a picture archiving and communication system (PACS) image server or viewer, various apparatuses in an electronic medical record system, and the like. The medical image processing apparatus 100 performs various processes on medical images acquired from the medical image diagnostic apparatus 2 or the image storage apparatus 3. In the present embodiment, the medical image processing apparatus 100 is an apparatus used, for example, by a physician (or “diagnostic imaging physician” or “radiologist”) to observe or interpret medical images.
The input interface 110 has a pointing device such as a mouse, keyboard, and the like, receives input of various operations for the medical image processing apparatus 100 from a physician who is a user, and transmits information on instructions and settings received from the user to the processing circuitry 150.
The display 120 is a monitor referred to by the user. Under the control of the processing circuitry 150, the display 120 displays images to the user or displays a graphical user interface (GUI) for receiving various instructions, various settings, and the like from the user via the input interface 110. The communication interface 130 is a network interface card (NIC) or the like, and communicates with other devices. The display 120 is an example of a display.
The storage circuitry 140 is, for example, a semiconductor memory element such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk. The storage circuitry 140 stores three-dimensional medical images being the medical images acquired from the medical image diagnostic apparatus 2 or the image storage apparatus 3 and including a plurality of slice images of a subject.
The processing circuitry 150 controls the components of the medical image processing apparatus 100. For example, as illustrated in
The term “processor” used in the above description means, for example, circuitry such as a central processing unit (CPU), a graphics processing unit (GPU), or an application specific integrated circuit (ASIC). The term “processor” means circuitry such as a programmable logic device. Examples of the programmable logic device include a simple programmable logic device (SPLD) and a complex programmable logic device (CPLD). Examples of the programmable logic device include a field programmable gate array (FPGA). When the processor is, for example, a CPU, the processor reads out and executes the computer programs stored in the storage circuitry 140 to implement the functions. On the other hand, when the processor is, for example, an ASIC, the computer programs are directly incorporated in the circuitry of the processor instead of storing the computer programs in the storage circuitry 140. Each processor of the present embodiment is not limited to being configured as a single piece of circuitry for each processor, and one processor may be configured by combining a plurality of pieces of independent circuitry to implement the functions thereof. The plurality of components in
So far, the overall configuration of the medical image processing system 1 including the medical image processing apparatus 100 according to the present embodiment has been described. With such a configuration, the processing circuitry 150 of the medical image processing apparatus 100 includes the control function 151 and the display control function 152 to be able to assist in observing three-dimensional medical images, and performs the following processing.
When displaying a three-dimensional medical image including a plurality of slice images of a subject, the control function 151 receives an instruction to move a display position (slice position) through the input interface 110. The slice image is, for example, a two-dimensional CT image of an axial section. When the received instruction is an instruction to move the display position (slice position) by less than a predetermined interval (for example, by one position), the display control function 152 controls the display 120 to display a slice image at a next destination position (destination slice position) as a first image. When the received instruction is an instruction to move the display position (slice position) by more than the predetermined interval (for example, an instruction to skip one or more slice positions), the display control function 152 controls the display 120 to display a second image reflecting information on a plurality of slice images including the slice image at the next destination position (destination slice position).
In this way, in the medical image processing apparatus 100 according to the present embodiment, even when a user wants to quickly observe an entire three-dimensional medical image, information on all slice images included in the three-dimensional medical image is displayed on the display 120 to be able to assist the user in observing the three-dimensional medical image. Specifically, the medical image processing apparatus 100 according to the present embodiment can assist in observing the three-dimensional medical image by controlling the display 120 to collectively display information on a plurality of slice images included in the three-dimensional medical image at once, so that there are no omissions in the display of the slice images.
The second image is, for example, a slab image based on a group of slice images including adjacent slice images having a number corresponding to the amount of movement determined by the received instruction and including a slice image at a destination position determined by the amount of movement. The group of slice images from which the slab image is derived includes slice images between the slice image at the destination position and a slice image at a pre-movement position.
In the following, the slice image and the slab image may be collectively referred to as a planar image. In the following, the position of a slab image generated at the position of a slice image in the three-dimensional medical image (hereinafter, referred to as a slice position) is described as a slab position. In the following, moving the slice position by +1 is referred to as +1 slice feeding, moving the slice position by −1 is referred to as −1 slice feeding, and +1 slice feeding and −1 slice feeding are collectively referred to as ±1 slice feeding. In the following, moving the slice position by +n is referred to as +n slice feeding, moving the slice position by −n is referred to as −n slice feeding, and +n slice feeding and −n slice feeding are collectively referred to as ±n slice feeding. Here, n is a predetermined integer of 2 or more.
The control function 151 has a generation function of generating a slab image from a plurality of slice images. With such a generation function, the control function 151 can pre-generate a plurality of slab images each having a slab thickness. Specifically, for each slice image constituting the three-dimensional medical image, the control function 151 generates slab images including the slice image and having a plurality of different slab thicknesses, and stores a group of the generated slab images in the storage circuitry 140. More specifically, the control function 151 reads a plurality of slice images included in the three-dimensional medical image from the storage circuitry 140, and generates a plurality of slab images for each of the plurality of slab thicknesses. In this case, each slab image at one slab thickness is generated at each slice position of the plurality of slice images. Therefore, the number of slice images can be equal to the number of slab images at one slab thickness. The plurality of slab thicknesses refer to all slab thicknesses to be used in processes to be described below, and are all slab thicknesses that are twice or more the slice spacing of the slice image and up to a multiple determined in advance. In this case, the display control function 152 acquires a slab image to be subsequently displayed, corresponding to the second image, from the group of the slab images stored in the storage circuitry 140 and controls the display 120 to display the acquired slab image. Thus, when the display control function 152 requests a generated slab image, the control function 151 may simply read the generated slab image stored in the storage circuitry 140.
Alternatively, when the display control function 152 requests a slab image having a specific slab thickness and located at a specific slab position, the control function 151 may generate the requested slab image in real time (on demand). Specifically, the display control function 152 controls the control function 151 to generate a slab image to be subsequently displayed, corresponding to the second image, and controls the display 120 to display the slab image generated by the control function 151.
The slab image is generated from a plurality of mutually adjacent slice images. Specifically, the slab image is an image reflecting information on a plurality of slice images, including a slice image at a destination position. Each pixel value of the slab image is acquired by computing respective pixel values at corresponding pixel positions of the plurality of slice images. Examples of the method of computing each pixel value include calculating an average value, calculating a median value, acquiring a maximum value, and acquiring a minimum value. The method of acquiring each pixel value of the slab image by acquiring the maximum value of the respective pixel values of the plurality of slice images is called a maximum intensity projection (MIP) method. Similarly, the method of acquiring each pixel value of the slab image by acquiring the minimum value is called a minimum intensity projection (MinIP) method. In this way, the slab image is generated from a group of the slice images by the maximum intensity projection method, the minimum intensity projection method, or a statistical process such as calculating an average value or calculating a median value. The slab image may also be generated using other computation methods.
The slab position described above is predefined as one of a center slice position, a first slice position, or a last first slice position of the plurality of slice images used to generate the slab image. The first slice position means, for example, the position of a slice image that shows the most head side of the subject, and the last slice position means, for example, the position of a slice image that shows the most foot side of the subject. For example, the + direction of the slice feeding is, for example, the direction from a slice image showing the head side of the subject to a slice image showing the foot side of the subject, and the − direction of the slice feeding is, for example, the direction from the slice image showing the foot side of the subject to the slice image showing the head side of the subject.
For example, when the direction of the slice feeding is the + direction, the display control function 152 may use the slab position as the last slice position. When the direction of the slice feeding is the − direction, the display control function 152 may use the slab position as the first slice position. Thus, when the ±n slice feeding to be described below is performed, all slice images between a display position before update and a display position after the update can be included in a slab image to be displayed on the display 120. Alternatively, the slab position can be used as the center slice position regardless of the direction of the slice feeding. In this case, the slab image is once displayed at the display position before the update just before the display control function 152 starts slice feeding to be described below. Thus, all slice images between a display position before update and a display position after the update can be included in a slab image to be displayed on the display 120.
The display control function 152 acquires a planar image (slice image or slab image) located at a predetermined display position and displays the acquired planar image on the display 120. For example, immediately after the control function 151 reads the three-dimensional medical image and stores the three-dimensional medical image in the storage circuitry 140, the display control function 152 reads a slice image located at a first slice position of the three-dimensional medical image from the storage circuitry 140 and controls the display 120 to display the read slice image. For example, when the display position is updated by a user instruction for ±n slice feeding as described below, that is, when the control function 151 receives an instruction to move the display position by skipping one or more display positions, the display control function 152 acquires a slab image located at the updated display position from the storage circuitry 140 and controls the display 120 to display the acquired slab image. Alternatively, the control function 151 generates the slab image located at the updated display position in real time, and the display control function 152 controls the display 120 to display the generated slab image.
Each function of the medical image processing apparatus 100 is described below in detail with reference to
Steps S101 to S108 in
At step S101, the control function 151 receives input of user instructions via the input interface 110. The user can enter the instructions in a variety of ways.
For example, by performing an operation of moving a mouse, which is the input interface 110, while clicking a button of the mouse (what is called click and drag operation), the user can instruct the amount of movement of slice feeding according to the speed of mouse movement. An interface for instructing the amount of movement of slice feeding is described with reference to
For example, as illustrated in
For example, when the user performs a mouse operation (click and drag operation), the display control function 152 determines the amount of movement of slice feeding according to the speed of mouse movement. Specifically, as illustrated in
For example, the user can instruct ±1 slice feeding or ±n slice feeding by pressing a predetermined key such as arrow keys on the keyboard that is the input interface 110. To give a specific example, the user can give an instruction to move a display position by +1 (to send an image display position by +1) by pressing a downward arrow key “↓” on the keyboard, and give an instruction to move the display position by −1 (to send the image display position by −1) by pressing an upward arrow key “↑” on the keyboard. The user can also give an instruction to move the display position by +n (n is an integer of 2 or more) (to send the image display position by +n) by pressing a rightward arrow key “,” on the keyboard, and give an instruction to move the display position by −n (to send the image display position by −n) by pressing a leftward arrow key “←” on the keyboard.
For example, the user can instruct ±n slice feeding by pressing a predetermined auxiliary key such as a shift key “Shift”, a control key “Ctrl”, or an Alt key “Alt” on the keyboard, and a key other than the predetermined auxiliary key at the same time. To give a specific example, when the user presses the arrow key “↓” or “↑” on the keyboard, the display position can be moved by +1 or −1, and when the shift key “Shift” and the arrow key “↓” or “↑” are pressed simultaneously, the display position can be moved by +n or −n.
The values of n described above need to be predetermined, but for example, different values of n may be assigned to each auxiliary key such as n is 5 when the user presses the shift key “Shift”, n is 8 when the user presses the control key “Ctrl”, and n is 10 when the user presses the alt key “Alt”. As an example of assigning different values of n to the keys, fixed values “2”, “3”, “4”, “5” . . . may also be assigned to function keys “F2”, “F3”, “F4”, “F5” . . . on the keyboard.
The user may also be able to set the value of n to be assigned to each key or auxiliary key by using a text box or the like. For example, as illustrated in
Returning now back to
Although there are many other types of user instructions related to the control performed by the control function 151, user instructions not directly related to the embodiment are not described.
At step S103, the display control function 152 moves the display position of a planar image displayed on the display 120 by +1 or −1, depending on whether the amount of slice movement in the instruction for ±1 slice feeding is +1 or −1.
At step S104, the display control function 152 reads a slice image located at an updated display position from the storage circuitry 140.
At step S105, the display control function 152 controls the display 120 to display the read slice image (slice display). Subsequently, the procedure in
As illustrated in
Returning now back to
At step S107, the display control function 152 acquires, from the storage circuitry 140, a slab image (having a slab thickness) located at the updated display position and generated from n slices. At step S108, the display control function 152 controls the display 120 to display the acquired slab image (slab display). Subsequently, the procedure in
At step S107, the control function 151 may generate the slab image located at the updated display position in real time, and at step S108, the display control function 152 may control the display 120 to display the generated slab image.
As illustrated in
When displaying the slab image 300, the display control function 152 controls the display 120 to display the slab image 300 so that a slice image at a destination position determined by the amount of movement corresponding to n slice images serves as a slab center.
An example illustrated in
However, in the example illustrated in
After displaying a first slice image “slice 1” on the display 120 in
An example illustrated in
In an example illustrated in
The amount of movement may be different for each instruction. In an example illustrated in
In the examples illustrated in
In this way, in the medical image processing apparatus 100 according to the present embodiment, when a user gives an instruction to thin out a slice images in order to quickly observe a three-dimensional medical image, the thinned-out slice image is displayed as the slab image 300 and is observed by the user. Therefore, in accordance with the medical image processing apparatus 100 according to the present embodiment, even when a user wants to quickly observe an entire three-dimensional medical image, information on all slice images included in the three-dimensional medical image is displayed on the display 120 to be able to assist the user in observing the three-dimensional medical image.
The storage circuitry 140 may store a second three-dimensional medical image to be compared with a first three-dimensional medical image that is a three-dimensional medical image. The first three-dimensional medical image and the second three-dimensional medical image are medical images acquired from the medical image diagnostic apparatus 2 or the image storage apparatus 3. Specifically, the first three-dimensional medical image is a current image and the second three-dimensional medical image is a past image to be compared with the current image. Alternatively, the second three-dimensional medical image is a three-dimensional processed image generated by using the first three-dimensional medical image. For example, the second three-dimensional medical image is a three-dimensional processed image obtained by removing an area corresponding to a bone from the first three-dimensional medical image. Alternatively, the second three-dimensional medical image is a difference image between a current image and a past image to be compared with the current image. For example, when displaying the first three-dimensional medical image, the display control function 152 displays the second three-dimensional medical image in conjunction with the first three-dimensional medical image.
Specifically, when the display control function 152 displays different planar images (for example, slab images) in two or more different display areas of the display 120 and two or more planar images are images associated with to each other, the procedure in
As described above, in the medical image processing apparatus 100 according to the first embodiment, when a user gives an instruction for ±n slice feeding, a slab image generated from at least n slice images is displayed on the display 120. Thus, even when the user quickly performs slice feeding, a slab image including information on slice images having a number corresponding to the amount of slice movement is displayed on the display 120. Therefore, in accordance with the medical image processing apparatus 100 according to the present embodiment, even when a user wants to quickly observe an entire three-dimensional medical image, information on all slice images included in the three-dimensional medical image is displayed on the display 120 to be able to assist the user in observing the three-dimensional medical image.
The present embodiment describes an example in which a user sequentially gives instructions for slice feeding, but is not limited thereto. For example, the process in
Specifically, a process of displaying a slab image including a slice image skipped by ±n slice feeding can be performed in the same way as the procedure in
A user may also be able to instruct the display position update frequency N per unit time in the automatic slice feeding. In this case, the control function 151 may automatically perform ±1 slice feeding (slice display by ±1 slice feeding) when the display position update frequency N is approximately 1 times or less than a predetermined value (standard value of display position update frequency per unit time), and automatically perform ±n slice feeding (slab display by ±n slice feeding) when N is approximately n times the predetermined value. Alternatively, the control function 151 may automatically perform ±1 slice feeding (slice display by ±1 slice feeding) or ±n slice feeding (slab display by ±n slice feeding) depending on whether the display position update frequency N is approximately 1 times or less than or approximately n times the updatable frequency per unit time of the image display of the medical image processing apparatus 100. The value of the display position update frequency N may be calculated by obtaining an instruction of the total amount D (slices) of slice transitions and transition time s (seconds) from a user, and using N=D÷s.
Since the configuration diagram of a medical image processing apparatus according to a second embodiment is the same as the configuration diagram in
The second embodiment is different from the first embodiment in a procedure in which the processing circuitry 150 acquires a planar image (slice image or slab image) and displays the planar image on the display 120. A detailed processing procedure of the processing circuitry 150 is described below with reference to a flowchart in
At step S206, the display control function 152 puts the amount+n or −n of slice movement in the instruction for ±1 slice feeding into a variable n′.
At step S207, the display control function 152 updates a display position. Specifically, the display control function 152 updates the display position of a planar image displayed on the display 120 to a position moved by n′.
At step S208, the display control function 152 acquires, from the storage circuitry 140, a slab image (having a slab thickness) located at the updated display position and generated on the basis of slice images having a number equal to an absolute value of n′.
At step S209, the display control function 152 controls the display 120 to display the acquired slab image.
At step S210, the control function 151 starts an interrupt timer t. After starting the interrupt timer t, the control function 151 calls an interrupt process by the timer t after a certain time elapses. After the interrupt timer t is started, user instructions can be input at any time. Accordingly, after step S210 is performed, when no user instruction is input until the certain time elapses, the procedure in
At step S211, the interrupt timer t notifies the display control function 152 that the certain time has elapsed.
At step S212, the display control function 152 decreases the value of n′ by 1 when the value of the variable n′ is positive, and increases the value of n′ by 1 when the value of the variable n′ is negative. That is, a process is performed to gradually reduce a slab thickness over time after the ±n slice feeding. In this way, after the slab image is displayed on the display 120, the display control function 152 controls the slab thickness of the slab image to be reduced over time with the slab image including a slice image at a destination position during the period when no instruction to move the display position is received.
The time setting for interruptions at the present step may always be constant or may be changed according to the display status. For example, only when n′ is ±n (that is, immediately after the ±n slice feeding is performed), a relatively long time can be set so that the user can interpret the slab image, and when the absolute value of n′ is smaller than n in the process of step S212 to be described below (that is, when the slab image is being displayed while the slab thickness is gradually reduced), a relatively short time can be set.
At step S213, the display control function 152 determines whether the value of the variable n′ is +1 or −1. When the value of the variable n′ is +1 or −1 (Yes at step S213), the procedure in
On the other hand, when the value of the variable n′ is not +1 or −1 (No at step S213), the procedure in
At step S214, the control function 151 receives input of user instructions via the input interface 110.
At step S215, the control function 151 stops the interrupt timer t. After the interrupt timer t is stopped, the process of step S211 is not performed. Subsequently, the procedure in
When the display control function 152 displays different planar images in two or more different display areas of the display 120 and two or more planar images are images associated with each other, the control described in the first embodiment can be simultaneously applied to the two or more planar images. Accordingly, the display control function 152 can update the two or more planar images in conjunction with each other.
At step S208, the control function 151 may generate the slab image located at the updated display position in real time, and at step S209, the display control function 152 may control the display 120 to display the generated slab image.
As described above, in the medical image processing apparatus 100 according to the second embodiment, when a user gives an instruction for ±n slice feeding, a slab image generated from n slice images is displayed on the display. Subsequently, when no user instructions are input, a slab image having a smaller slab thickness is displayed on the display each time a predetermined time elapses, and finally a slice image is displayed on the display. As a result, when a physician as a user completes the instruction for ±n slice feeding and a predetermined time elapses, the display shifts from the slab display to the slice display. Thus, in accordance with the medical image processing apparatus 100 according to the second embodiment, when a user slowly performs slice feeding or performs no slice feeding, a slice image is displayed, thereby controlling the user to make detailed observations and assist in observing a three-dimensional medical image.
In the process of gradually reducing the slab thickness at step S212, the amount by which the slab thickness is reduced does not have to be one slice at a time, but may be a plurality of slices at a time. With such a configuration, the number of stages of switching from the slab display to the slice display can be controlled. For example, by setting the number of slices to be thinned to 2, the number of stages of switching from the slab display to the slice display can be reduced from 6 to 3.
The amount by which the slab thickness is reduced needs not be constant, but may change over time. Instead of gradually reducing the slab thickness, n′ may be set to 1 or −1 at step S212. With such a configuration, the slab display can be returned to the slice display immediately after the elapse of a predetermined time of ±n slice feeding.
Since the configuration diagram of a medical image processing apparatus according to a third embodiment is the same as the configuration diagram in
The third embodiment differs from the first and second embodiments in the following two points. The first is the difference in images read by the control function 151. The second is the difference in the procedure by which the processing circuitry 150 acquires a planar image and displays the planar image on the display 120. The two points different from the first and second embodiments are described below.
The third embodiment is an embodiment that can be performed when a first three-dimensional medical image that is a three-dimensional medical image and a second three-dimensional medical image to be described below are stored in the storage circuitry 140. The second three-dimensional medical image is a three-dimensional medical image of a subject taken including a captured part of the first three-dimensional medical image, and includes a slice image (thick slice image) having a slice thickness greater than a slice thickness of a slice image (thin slice images) constituting the first three-dimensional medical image.
The first three-dimensional medical image and the second three-dimensional medical image are medical images acquired from the medical image diagnostic apparatus 2 or the image storage apparatus 3. For example, the first three-dimensional medical image and the second three-dimensional medical image are three-dimensional X-ray CT images of the subject obtained in the same examination, and are images having different slice thicknesses from each other. In this case, when an instruction to move a display position by skipping one or more display positions is given, the display control function 152 controls the display 120 to display the slice image (thick slice images) constituting the second three-dimensional medical image as a second image.
For example, when a user instruction input from the input interface 110 is an instruction to read the above two three-dimensional medical images, the control function 151 reads the two three-dimensional medical images from the medical image diagnostic apparatus 2 or the image storage apparatus 3 and stores the read three-dimensional medical images in the storage circuitry 140. The control function 151 calculates the ratio a of a slice spacing of the first three-dimensional medical image and a slice spacing of the second three-dimensional medical image and stores the calculated ratio a in the storage circuitry 140. Thus, the process of the third embodiment to be described below can be performed.
When an instruction to read one three-dimensional medical image is received, the control function 151 may use the three-dimensional medical image as a first three-dimensional medical image and search whether another three-dimensional medical image corresponding to the second three-dimensional medical image is stored in the image storage apparatus 3. When the another three-dimensional medical image corresponding to the second three-dimensional medical image is stored, the control function 151 stores these two three-dimensional medical images in the storage circuitry 140. Thus, the process of the third embodiment to be described below can be performed.
At step S301, the control function 151 receives the input of user instructions via the input interface 110.
At step S302, the control function 151 determines a next process to be performed according to the user instruction. When the user instruction is an instruction for ±m slice feeding (m is a natural number), the procedure in
At step S303, the display control function 152 moves the display position of a slice image displayed on the display 120 by +m or −m, depending on whether the amount of slice movement in the instruction for ±m slice feeding is +m or −m. The display position is the slice position of a thin slice image.
At step S304, the display control function 152 reads the ratio a of the slice spacing from the storage circuitry 140, compares the ratio a with an absolute value m of the amount of slice movement in the instruction for ±m slice feeding, and determines whether m is less than a. When m is less than a, the procedure in
At step S305, the display control function 152 reads the thin slice image located at the display position updated at step S303 from the storage circuitry 140.
At step S306, the display control function 152 displays the read thin slice image on the display 120. Subsequently, the procedure in
At step S307, the display control function 152 reads, from the storage circuitry 140, a thick slice image located at a thick slice position corresponding to the updated display position (that is, thin slice position).
At step S308, the display control function 152 controls the display 120 to display the read thick slice image. Subsequently, the procedure in
Display examples when the storage circuitry 140 stores the first three-dimensional medical image and the second three-dimensional medical image having different slice thicknesses are described with reference to
As described above, the second three-dimensional medical image is the three-dimensional medical image of the subject taken including the captured part of the first three-dimensional medical image. For example, the first three-dimensional medical image and the second three-dimensional medical image are three-dimensional CT images obtained by capturing the same part of the same subject. The first three-dimensional medical image includes a two-dimensional CT image of a plurality of axial cross-section each having a slice thickness of 0.5 mm, and the second three-dimensional medical image includes a two-dimensional CT image of a plurality of axial cross-section each having a slice thickness of 1.5 mm.
In
In the example illustrated in
In the example illustrated in
In the example illustrated in
In the processes in
As described above, in the medical image processing apparatus 100 according to the third embodiment, when a user gives an instruction for ±m slice feeding and m is equal to or greater than the ratio a of a slice spacing of a thin slice and a slice spacing of a thick slice, a thick slice image is displayed on the display. Thus, when a user performs slice feeding more quickly than a certain degree, a thick slice image equivalent to a thin slice images is displayed on the display. Accordingly, in accordance with the medical image processing apparatus 100 according to the third embodiment, even when a user wants to quickly observe an entire three-dimensional medical image, information on all slice images included in the three-dimensional medical image is displayed on the display 120 to be able to assist the user in observing the three-dimensional medical image.
The first to third embodiments have described a planar image display procedure for updating a display position on the basis of only user instructions. The fourth embodiment describes a planar image display procedure in consideration of a time interval at which two consecutive user instructions are input and image display update capability of the medical image processing apparatus 100 (time required to update image display once) in addition to user instructions. The following display procedure makes it possible to display slab images having smaller slab thicknesses at as many display positions as possible (that is, more times) within the range in which the image display update capability of the medical image processing apparatus 100 is allowed.
Since the configuration diagram of a medical image processing apparatus according to a fourth embodiment is the same as the configuration diagram in
The fourth embodiment differs from the first to third embodiments in the procedure by which the processing circuitry 150 acquires a planar image and displays the planar image on the display 120. A detailed processing procedure of the processing circuitry 150 is described below with reference to a flowchart in
At step S401, the control function 151 receives the input of user instructions via the input interface 110.
At step S402, the control function 151 acquires a current time t0. When a previous time t0′ acquired when the previous step S402 was performed is stored in the storage circuitry 140, the control function 151 reads the time t0′ from the storage circuitry 140 and calculates an input elapsed time ti from Equation (1) below. The control function 151 stores the current time t0 in the storage circuitry 140 as t0′. When the input elapsed time ti can be calculated, the control function 151 stores the input elapsed time ti in the storage circuitry 140.
The control function 151 may store ti calculated each time step S402 is performed as ti1, ti2, . . . , tix (x is a natural number). After tix is stored up to a predetermined number, the input elapsed time ti may be acquired by calculating an average value of the plurality of tix or by acquiring a representative value such as a minimum value, and may be stored in the storage circuitry 140.
The input elapsed time ti described above is a time interval at which two consecutive user instructions are input. In order to complete the procedure in
At step S403, the control function 151 determines a next process to be performed according to a user instruction. When the user instruction is an instruction for ±m slice feeding (m is a natural number), the procedure in
An input form of the instruction for ±m slice feeding can employ various forms described in the first embodiment. For example, as illustrated in
At step S404, the display control function 152 calculates the number uc of display position updates (uc is an integer) from Equation (2) below when an image display update time tu to be described below is read from the storage circuitry 140.
In Equation (2) above, the display control function 152 takes, as “uc”, the value of “ti÷tu−b” rounded down to the decimal point.
On the other hand, when the display control function 152 fails to read the image display update time tu to be described below from the storage circuitry 140, the display control function 152 puts 1 into uc. The number uc of updates is the number of times the image display can be updated during the input elapsed time ti. The input elapsed time ti, the number uc of updates, and the image display update time tu to be described below are examples of indicators related to the image display update of the apparatus.
In Equation (2) above, b is a constant with a predetermined value equal to or greater than 0, and is usually set to 0. A larger value for the constant b results in a smaller value for the number uc of display position updates and a larger value for m′ to be described below. That is, when the constant b is set to a large value, the number of times the display position is automatically updated for one-time user instruction is reduced, and the slab thickness of a slab image displayed on the display 120 increases.
The display control function 152 puts the value “1” into uc when the calculation result of Equation (2) above is 0 or negative, and puts the value “m” into uc when the calculation result of Equation (2) above exceeds the absolute value m of the amount of slice movement in the instruction for ±m slice feeding. That is, uc is a natural number equal to or less than m.
The display control function 152 further calculates the number m′ of slice images (m′ is an integer) used to generate a slab image from Equation (3) below. In Equation (3) below, the display control function 152 takes, as “m′”, the value of “m÷uc” rounded down to the decimal point.
m′=m÷uc (3)
According to Equation (3) above, when uc is 1, one slab image based on m slice images (m is the absolute value of the amount of slice movement) is used for image display, and when uc is m, each of the m slice images is used for image display. On the other hand, when uc is 2 or more and smaller than m, m′ is smaller than m, and a slab image based on m′ slice images is acquired a plurality of times for image display, m′ being smaller than m indicating the absolute value of the amount of slice movement smaller than a user instruction. That is, when uc is 2 or more and smaller than m, a slab image having a slab thickness smaller than the slab thickness based on the amount of movement instructed by a user can be displayed.
The display control function 152 puts uc into a variable uc′. Subsequently, the display control function 152 stores each of uc, m′, and uc′ in the storage circuitry 140.
In this way, the display control function 152 determines the number m′ of slice images to be used for image display on the basis of the frequency with which a user instructs to move a display position and the indicators (the input elapsed time ti, the number uc of updates, and the image display update time tu to be described below) regarding the image display update of the apparatus.
The image display update time tu to be described below is the time required to update once image display determined by the image display update capability of the medical image processing apparatus 100. Since processes from step S405 to S414 to be described below need to be completed within the time required to update the image display once, the number uc of display position updates is determined in the manner described above in order to guarantee the completion.
At step S405, the display control function 152 moves the display position of the planar image displayed on the display 120 by +m′ or −m′ in the direction (+ direction or − direction) of slice movement in the instruction for ±m slice feeding.
At step S406, the display control function 152 determines whether the number m′ of slice images to be reflected in the slab image is 1, and determines a next process to be performed according to the result of the determination. When the number m′ of slice images to be reflected in the slab image is 1, the procedure in
At step S407, the display control function 152 reads a slice image located at the display position updated at step S405 from the storage circuitry 140.
At step S408, the display control function 152 displays the read slice image on the display 120.
At step S409, the display control function 152 acquires, from the storage circuitry 140, a slab image (having a slab thickness) located at the display position updated at step S405 and generated based on the m′ slice images.
At step S410, the display control function 152 displays the acquired slab image on the display 120.
At step S411, the display control function 152 reads the variable uc′ from the storage circuitry 140, determines whether the variable uc′ is 1, and determines a next process to be performed according to the result of the determination. When the variable uc′ is 1, the procedure in
At step S412, the display control function 152 reads the number uc of updates from the storage circuitry 140, determines whether the number uc of updates is 1, and determines a next process to be performed according to the result of the determination. When the number uc of updates is 1, the procedure in
At step S413, the display control function 152 acquires the current time t1. The control function 151 reads time t0′ from the storage circuitry 140 and calculates the image display update time tu from Equation (4) below. The control function 151 stores the image display update time tu in the storage circuitry 140. Subsequently, the procedure in
tu=t1−t0′ (4)
The control function 151 may separately store, as tu1, tu2, . . . , tux (x is a natural number), the image display update time tu calculated each time step S413 is performed. After tux is stored up to a predetermined number, the image display update time tu may be acquired by calculating an average value of the plurality of tux or by acquiring a representative value such as a maximum value, and may be stored in the storage circuitry 140.
At step S414, the display control function 152 reduces the value of the variable uc′ by 1. Subsequently, the procedure in
Each time the processes from steps S405 to S411 described above are repeated, the display position moves by m′. Subsequently, a slab image generated from the m′ slice images is displayed at each moved display position on the display 120.
As described above, the medical image processing apparatus 100 according to the fourth embodiment performs the following control when a user gives an instruction for ±m slice feeding. That is, a slab image having a predetermined slab thickness is repeatedly displayed on the display 120 while moving a display position a number of times determined based on a user instruction, the input elapsed time ti, and the image display update time tu. Thus, even when a user quickly performs slice feeding, a slab image including information on slice images having a number corresponding to the amount of movement of the display position is displayed on the display 120 while automatically moving the display position as many times as possible. Accordingly, in accordance with the medical image processing apparatus 100 according to the present embodiment, even when a user wants to quickly observe an entire three-dimensional medical image, information on all slice images included in the three-dimensional medical image is displayed on the display 120 to be able to assist the user in observing the three-dimensional medical image.
As an application example of the fourth embodiment, the display control function 152 may determine whether to display a slice image as a first image or a slab image as a second image depending on the status of a display position movement instruction that is waiting to be performed. In such a case, when determining to display the slab image, the display control function 152 determines the number m′ of slice images to be reflected in the slab image.
Specifically, assume a situation where a user has given an instruction to move the display position of, for example, five slice images, such as +1 slice feeding or −1 slice feeding, but the display position movement instruction is waiting to be performed by the processing capacity of a processor such as a CPU. In this case, the display control function 152 confirms the situation where the display position movement instruction for the five slice images is waiting to be performed by the processing capacity of the processor, acquires a slab image based on a group of five adjacent slice images from the storage circuitry 140 and controls the display 120 to display the acquired slab image. Alternatively, the control function 151 may generate a slab image in real time and the display control function 152 may control the display 120 to display the generated slab image.
That is, in the application example of the fourth embodiment, even when a user inputs an instruction for ±1 slice feeding, but a display process is not completed in time, resulting in the input of an instruction for ±n slice feeding, a slab thickness can be adaptively determined and a slab image can be displayed. According to the application example of the fourth embodiment described above, for example, as illustrated in
Each component of each apparatus illustrated in the present embodiment is functionally conceptual, and does not necessarily have to be physically configured as illustrated in the drawings. That is, the specific form of distribution or integration of each apparatus is not limited to those illustrated in the drawings, but can be configured by functionally or physically distributing or integrating all or part thereof in arbitrary units, depending on various loads, use conditions, and the like. Moreover, each processing function performed by each device can be implemented in whole or in part by a CPU and a computer program that is analyzed and executed by the CPU, or by hardware using wired logic.
The method described in the present embodiment can be implemented by executing a computer program prepared in advance on a computer such as a personal computer or a workstation. The computer program can be distributed via a network such as the Internet. The computer program can also be recorded on a non-transitory computer readable recording medium such as a hard disk, a flexible disk (FD), a CD-ROM, an MO, and a DVD, and can be executed by being read from the recording medium by a computer.
According to at least one embodiment described above, observation of medical images can be assisted.
While certain embodiments have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the inventions. Indeed, the novel embodiments described herein may be embodied in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the embodiments described herein may be made without departing from the spirit of the inventions. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and spirit of the inventions.
Number | Date | Country | Kind |
---|---|---|---|
2022-200427 | Dec 2022 | JP | national |