The present invention relates to a subject information acquisition device, a method for operating a subject information acquisition device, and a non-transitory computer readable medium that acquire subject information such as the proportion of muscle or the proportion of fat in a subject.
In the medical field, diagnosis using radiographic images is performed. In the diagnosis using the radiographic images, in addition to the radiographic images, subject information obtained from the radiographic images is used. For example, the proportion of fat in the subject or the proportion of muscle in the subject is used as the subject information.
For example, the proportion of fat is described in JP2018-153605A (corresponding to US2018/0263559A1). In JP2018-153605A, a soft part image is generated from a plurality of radiographic images by an energy subtraction process, and the body thickness distribution of the subject is estimated from the soft part image and the imaging conditions in a case in which the radiographic images are acquired. Then, an approximate body thickness distribution approximated by a model corresponding to the human body is calculated from the body thickness distribution, and the distribution of the proportion of fat in the subject is calculated from the approximate body thickness distribution.
Further, the proportion of fat and the proportion of muscle are described in JP2015-19789A. In JP2015-19789A, the proportion of fat and the proportion of muscle in a certain region, for example, the entire soft region are calculated by a dual X-ray absorptiometry (DXA) method.
However, it is required to calculate not the proportion of fat and the proportion of muscle in the entire soft region as in JP2015-19789A, but the proportion of fat and the proportion of muscle for each pixel of the soft region in order to make an accurate diagnosis on the basis of the proportion of fat and the proportion of muscle.
An object of the invention is to provide a subject information acquisition device, a method for operating a subject information acquisition device, and a non-transitory computer readable medium that can calculate the proportion of muscle and the proportion of fat in a subject for each pixel.
According to the invention, there is provided a subject information acquisition device comprising a processor. The processor acquires radiographic images obtained by capturing images of a subject including a soft part, calculates a body thickness distribution of the subject, specifies a soft region indicating a region of the soft part from the radiographic images, and calculates a proportion of muscle and a proportion of fat in the soft region for each pixel using the body thickness distribution and a pixel value of the soft region.
Preferably, the processor calculates the proportion of muscle and the proportion of fat from a predetermined specific relationship between the body thickness distribution and the pixel value of the soft region. Preferably, the specific relationship changes depending on imaging conditions at a timing when the images of the subject are captured. Preferably, the processor displays a distribution of the proportion of muscle and a distribution of the proportion of fat on a display.
Preferably, the radiographic images are first and second radiographic images having different energy distributions, and the soft region is specified by performing a calculation between corresponding pixels of the first and second radiographic images.
Preferably, the first and second radiographic images are obtained by detecting radiation transmitted through the subject with first and second radiation detectors that overlap each other while changing energy. Preferably, the first and second radiographic images are obtained by irradiating the subject with radiation having different energy distributions at different timings and detecting the radiation with one specific radiation detector. Preferably, the body thickness distribution is calculated by subtracting a source object distance (SOD) from a source image receptor distance (SID).
According to the invention, there is provided a method for operating a subject information acquisition device. The method includes processor implemented steps of: acquiring radiographic images obtained by capturing images of a subject including a soft part; calculating a body thickness distribution of the subject; specifying a soft region indicating a region of the soft part from the radiographic images; and calculating a proportion of muscle and a proportion of fat in the soft region for each pixel using the body thickness distribution and a pixel value of the soft region.
According to the invention, there is provided a non-transitory computer readable medium for storing a computer-executable program for causing a computer to perform steps of: acquiring radiographic images obtained by capturing images of a subject including a soft part; calculating a body thickness distribution of the subject; specifying a soft region indicating a region of the soft part from the radiographic images; and calculating a proportion of muscle and a proportion of fat in the soft region for each pixel using the body thickness distribution and a pixel value of the soft region.
According to the invention, it is possible to calculate the proportion of muscle and the proportion of fat in the subject for each pixel.
As illustrated in
Therefore, the first radiation detector 15 obtains a first radiographic image G1 of the subject H formed by low-energy X-rays including so-called soft rays. In addition, the second radiation detector 16 obtains a second radiographic image G2 of the subject H formed by high-energy X-rays excluding soft rays. The first and second radiographic images G1 and G2 are input to the computer 12. In this embodiment, in a case in which a scattered ray removal grid that removes scattered ray components of the X-rays transmitted through the subject H is used at the time of capturing the image of the subject H, the first radiographic image G1 and the second radiographic image G2 include primary ray components of the X-rays transmitted through the subject H. On the other hand, in a case in which the scattered ray removal grid is not used at the time of capturing the image of the subject H, the first and second radiographic images G1 and G2 include primary ray components and scattered ray components of the X-rays.
A so-called direct-type radiation detector that can repeatedly perform the recording and reading of a radiographic image, directly receives the emitted radiation, and generates charge may be used as the first and second radiation detectors 15 and 16. Alternatively, an indirect radiation detector that converts radiation into visible light and then converts the visible light into a charge signal may be used as the first and second radiation detectors 15 and 16. A so-called optical reading method which turns on and off a thin film transistor (TFT) switch to read a radiographic image signal is preferably used as a radiographic image signal reading method.
A display unit 18 composed of a display and an input unit 19 are connected to the computer 12. The display unit 18 consists of a cathode ray tube (CRT), a liquid crystal display, or the like and displays a radiographic image or the like acquired by imaging. The input unit 19 consists of, for example, a keyboard, a mouse, or a touch panel.
A subject information acquisition program is installed in the computer 12. In this embodiment, the computer 12 may be a workstation or a personal computer that is directly operated by an operator, or a server computer that is connected to them through a network. The subject information acquisition program is recorded on a recording medium, such as a digital versatile disc (DVD) or a compact disc read only memory (CD-ROM), is distributed, and is then installed in the computer 12 from the recording medium. Alternatively, the subject information acquisition program is stored in a storage device of the server computer connected to the network or a network storage in a state in which it can be accessed from the outside and is downloaded and installed in the computer 12 as required.
The memory 22 temporarily stores, for example, the programs that are stored in the storage 23 in order to cause the CPU 21 to perform various processes. The subject information acquisition program defines the following processes as the processes to be performed by the CPU 21: an image acquisition process of directing the imaging apparatus 10 to perform imaging and acquiring the first and second radiographic images G1 and G2 as radiographic images; a body thickness distribution acquisition process of calculating a body thickness distribution of the subject; a soft region specification process of specifying a soft region from the radiographic images; a subject information acquisition process of calculating the proportion of muscle and the proportion of fat in the soft region using the body thickness distribution and a pixel value of the soft region; and a display control process of displaying subject information on the display unit 18. In addition, the subject information acquisition program includes a recognition process for specifying a soft region, which will be described below.
Then, the CPU 21 composed of a processor performs the processes according to the subject information acquisition program such that the computer 12 functions as an image acquisition unit 31, a body thickness distribution acquisition unit 32, a soft region specification unit 33, a subject information acquisition unit 34, and a display control unit 35. In addition, the computer 12 functions as a soft region recognition processing unit 40 (see
One processing unit may be configured by one of the various processors or a combination of two or more processors of the same type or different types (for example, a combination of a plurality of FPGAs or a combination of a CPU and an FPGA). Further, a plurality of processing units may be configured by one processor. A first example of the configuration in which a plurality of processing units are configured by one processor is an aspect in which one processor is configured by a combination of one or more CPUs and software and functions as a plurality of processing units. A representative example of this aspect is a client computer or a server computer. A second example of the configuration is an aspect in which a processor that implements the functions of the entire system including a plurality of processing units using one integrated circuit (IC) chip is used. A representative example of this aspect is a system-on-chip (SoC). As such, various processing units are configured by using one or more of the various processors as the hardware structure.
In addition, specifically, an electric circuit (circuitry) obtained by combining circuit elements, such as semiconductor elements, is used as the hardware structure of the various processors.
The image acquisition unit 31 acquires the first and second radiographic images G1 and G2 detected by the first and second radiation detectors 15 and 16. In this embodiment, the images of the abdomen of the subject H are captured from the chest, and the first and second radiographic images G1 and G2 of the abdomen from the chest are acquired. In this case, imaging conditions, such as an imaging dose, a tube voltage, a source image receptor distance (SID) which is a distance between the X-ray source 13 and the surfaces of the first and second radiation detectors 15 and 16, a source object distance (SOD) which is a distance between the X-ray source 13 and the surface of the subject H, and the presence or absence of the scattered ray removal grid, are set.
The SOD and the SID are used to calculate the body thickness distribution, which will be described below. It is preferable that the SOD is acquired by, for example, a time-of-flight (TOF) camera. It is preferable that the SID is acquired by, for example, a potentiometer, an ultrasonic range finder, or a laser range finder.
It is preferable that the imaging conditions are set by input from the input unit 19 by the operator. The set imaging conditions are stored in the storage 23. In addition, the acquisition program may acquire the first and second radiographic images G1 and G2 using a separate program and store the acquired radiographic images in the storage 23. In this case, the image acquisition unit 31 reads the first and second radiographic images G1 and G2 stored in the storage 23 from the storage 23 in order to process the radiographic images.
The body thickness distribution acquisition unit 32 calculates the body thickness distribution of the subject H on the basis of the SID and the SOD included in the imaging conditions. It is preferable that the body thickness distribution is calculated by subtracting the SOD from the SID. Further, the body thickness distribution is calculated for each pixel corresponding to the first and second radiographic images G1 and G2. Furthermore, instead of calculating the body thickness distribution on the basis of the SID and the SOD, the body thickness distribution may be calculated from at least one of the first radiographic image G1 or the second radiographic image G2. Moreover, the body thickness distribution may be calculated from the soft part image of the subject H obtained by performing weighting and subtraction between the corresponding pixels of the first radiographic image and the second radiographic image. In addition, in the calculation of the body thickness distribution, in a case in which the first and second radiation detectors 15 and 16 are provided in an imaging table (not illustrated) on which the subject H is placed, it is preferable that the distance of the X-ray source 13 to the surface of the imaging table which comes into contact with the subject H is used as the SID.
The soft region specification unit 33 specifies a soft region of the subject H from the first and second radiographic images G1 and G2. Specifically, the soft region specification unit 33 performs calculation, for example, weighting and subtraction between the corresponding pixels of the first and second radiographic images G1 and G2 as represented by the following Expression (1) to generate a soft part image Gs obtained by extracting only the soft region of the subject H included in each of the radiographic images G1 and G2 as illustrated in
Gs(x,y)=G1(x,y)−μ×G2(x,y) (1)
For example, in a case in which the pixel value of a bone part and the pixel value of a soft part in the first radiographic image G1 are B1 and S1, respectively, and the pixel value of the bone part and the pixel value of the soft part in the second radiographic image G2 are B2 and S2, respectively, as illustrated in
In addition, for reference, a bone part image Gb obtained by extracting only the bone part from the first radiographic image G1 and the second radiographic image G2 may be generated. In this case, the second radiographic image G2 is multiplied by the weighting coefficient μ in Expression (1) to make the pixel values of the soft part almost equal to each other in the first radiographic image G1 and the second radiographic image G2. Then, the second radiographic image G2 multiplied by the weighting coefficient is subtracted from the first radiographic image G1 to obtain the bone part image Gb obtained by extracting only the bone part.
The subject information acquisition unit 34 acquires, as subject information related to the subject H, the proportion of muscle and the proportion of fat in the soft region for each pixel of the soft region included in the first and second radiographic images G1 and G2 on the basis of the body thickness distribution and the pixel value of the soft region. Specifically, the subject information acquisition unit 34 calculates the proportion of muscle and the proportion of fat from a predetermined specific relationship based on the body thickness distribution and the pixel value of the soft region. In addition, it is preferable that the specific relationship is stored by, for example, a look-up table (LUT).
For example, for the specific relationship, in a case in which the body thickness distribution is represented by the vertical axis and the amount of attenuation (1/(the pixel value of the soft region)) indicating the reciprocal of the pixel value of the soft region is represented by the horizontal axis, it is preferable that the body thickness distribution and the amount of attenuation have the relationship illustrated in
Further, it is preferable to change the specific relationship depending on the imaging conditions obtained at the timing when the image of the subject is captured, that is, the timing when the first radiographic image G1 or the second radiographic image G2 is acquired. For example, the amount of attenuation of X-rays in fat and muscle is changed by a change in the tube voltage or the dose of X-rays among the imaging conditions. Therefore, it is preferable to change the specific relationship according to a change in, for example, the tube voltage or the dose of X-rays. In a case in which the specific relationship is stored in the LUT, it is preferable to determine the specific relationship for each imaging condition.
The display control unit 35 displays various kinds of information related to the subject H on the display unit 18. In a case in which the proportion of muscle and the proportion of fat are calculated as the subject information, it is preferable that muscle and fat proportion information corresponding to the distribution of the proportion of muscle and the distribution of the proportion of fat is displayed so as to be superimposed on the soft part image Gs. For example, in a case in which the muscle and fat proportion information is displayed in pseudo-colors corresponding to the distribution of the proportion of muscle and the distribution of the proportion of fat, as illustrated in
Next, a process performed in this embodiment will be described with reference to a flowchart illustrated in
The body thickness distribution acquisition unit 32 acquires the body thickness distribution of the subject H. It is preferable to acquire the SID and the SOD and to subtract the SOD from the SID to acquire the body thickness distribution as a method for acquiring the body thickness distribution. Then, the soft region specification unit 33 specifies a soft region included in the subject H from the radiographic images. In a case in which the first and second radiographic images G1 and G2 are acquired as the radiographic images, it is preferable to specify the soft region using energy subtraction for the first and second radiographic images G1 and G2 (Expression (1)).
Then, the subject information acquisition unit 34 calculates the proportion of muscle and the proportion of fat in the soft region on the basis of the body thickness distribution and the pixel value of the soft region. The subject information acquisition unit 34 calculates the proportion of muscle and the proportion of fat from a predetermined specific relationship based on the body thickness distribution and the pixel value of the soft region. Then, the display control unit 35 displays muscle and fat proportion information corresponding to the proportion of muscle and the proportion of fat on the display unit 18 so as to be superimposed on an image such as the soft part image Gs.
Further, in the above-described embodiment, the soft region is specified by energy subtraction for the first and second radiographic images G1 and G2 having different energy distributions. However, the soft region may be specified by other methods. For example, as illustrated in
Further, a filtering process for specifying a soft region may be performed on one radiographic image to specify the soft region. For example, in a case in which there is a specific spatial frequency peculiar to a soft region, it is preferable to specify the soft region using a frequency filtering process that extracts a specific spatial frequency range. Alternatively, in a case in which the soft region has many low-frequency regions and it is difficult to specify the soft region using a frequency filtering process for extracting a soft region, the soft region may be specified by performing a frequency filtering process for extracting a bone region with a higher frequency than the soft region on a radiographic image and subtracting the radiographic image subjected to the frequency filtering process from the original radiographic image.
In the above-described embodiment, the first and second radiographic images G1 and G2 are acquired by the one-shot energy subtraction. However, the first and second radiographic images G1 and G2 may be acquired by a two-shot method that irradiates the subject with radiation having different energy distributions at different timings and detects the radiation with one specific radiation detector. In the two-shot method, any one of the imaging conditions in a case in which the first radiographic image G1 is acquired or the imaging conditions in a case in which the second radiographic image G2 is acquired may be used. Further, in the two-shot method, the position of the subject H included in the first and second radiographic images G1 and G2 is likely to be shifted by the body movement of the subject H. Therefore, it is preferable to align the subject in the first radiographic image G1 and the second radiographic image G2.
For example, a plurality of first band images and a plurality of second band images indicating structures having different frequency bands are generated for each of first and second radiographic images G1 and G2, and the amount of positional deviation between the corresponding positions in the first band image and the second band image of the corresponding frequency band is acquired. Then, the registration between the first radiographic image G1 and the second radiographic image G2 is performed on the basis of the amount of positional deviation.
Number | Date | Country | Kind |
---|---|---|---|
2019-016987 | Feb 2019 | JP | national |
This application is a Continuation of PCT International Application No. PCT/JP2020/002749 filed on 27 Jan. 2020, which claims priority under 35 U.S.C § 119(a) to Japanese Patent Application No. 2019-016987 filed on 1 Feb. 2019. The above application is hereby expressly incorporated by reference, in its entirety, into the present application.
Number | Date | Country | |
---|---|---|---|
Parent | PCT/JP2020/002749 | Jan 2020 | US |
Child | 17388833 | US |