Patent Application
20190295251
The present disclosure relates to an information processing apparatus and an information processing method.
Conventionally, there has been a method for setting a region of interest inside an object visualized in a medical image. For example, Japanese Patent Application Laid-Open No. 5-208001 discusses a method by which an image display apparatus sets a region of interest based on a reference point specified from a user (a region growing method). More specifically, the image display apparatus sets one pixel specified from the user as the reference point. Next, the image display apparatus determines a range of values of pixels to be set as the region of interest (for example, an upper limit value and a lower limit value) based on a value of the pixel set as the reference point. The image display apparatus sets pixels having values contained in the determined range as the region of interest.
Meanwhile, the user may check a value of an arbitrary pixel contained in the object visualized in the medical image. In such a case, there is used such a function that, according to specification of the arbitrary pixel contained in the object by the user, an information processing apparatus displays the value of the specified pixel on a display unit such as a display.
However, the pixel specified by the user may be affected by noise or an artifact generated when the object is imaged. This leads to a necessity of comparing a distribution of values of pixels located around the specified pixel and the value of the specified pixel and determining whether the value of the specified pixel is an outlier.
The pixels located around the specified pixel should be collected to make this comparison, but employment of the method discussed in Japanese Patent Application Laid-Open No. 5-208001 causes instances where all pixels having values contained in the range from the upper limit value to the lower limit value are undesirably extracted. More specifically, even a pixel located at a position far away from a position of the specified pixel is undesirably extracted, and it is difficult to extract only the pixels located around the specified pixel according to the method. Thus, even the value of the pixel located at the position far away from the position of the specified pixel is undesirably contained in the distribution of the values of the extracted pixels. Therefore, the distribution of the values of the pixels extracted in this manner is not appropriate as data to be compared with the specified pixel. Further, this method also involves instances where the user needs to set an appropriate upper limit value and lower limit value.
The present disclosure is directed to providing an information processing apparatus and an information processing method capable of appropriately performing statistic processing regarding the specified pixel.
Not only the above-described aspect, but also bringing about advantageous effects derived from each configuration that will be indicated in an exemplary embodiment for implementing the present disclosure that will be described below and unable to be acquired by the conventional technique can also be positioned as one of other objects in the present disclosure.
According to an aspect of the present disclosure, an information processing apparatus includes an acquisition unit configured to acquire a medical image captured by imaging a subject, a reception unit configured to receive specification of a pixel in the acquired medical image, a selection unit configured to select a predetermined number of pixels in the acquired medical image by searching from the specified pixel, and a processing unit configured to perform statistic processing regarding the specified pixel with use of the specified pixel and the selected predetermined number of pixels.
Further features will become apparent from the following description of exemplary embodiments with reference to the attached drawings.
In the following description, an exemplary embodiment will be described in detail with reference to the drawings. The exemplary embodiment that will be described below is merely one example, and the present disclosure shall not be limited thereto.
In the following description, a first exemplary embodiment will be described.
The database 22 stores a plurality of medical images regarding a plurality of patients and supplementary information about them therein. The medical image refers to two-dimensional or three-dimensional image data acquired by imaging a subject with use of an image diagnosis apparatus (a modality) such as a computed tomography (CT) apparatus, a magnetic resonance imaging (MRI) apparatus, an ultrasonographic apparatus, and an X-ray apparatus. Further, the medical image may be an image based on an acoustic wave emitted from the subject irradiated with light from a light source of a photoacoustic imaging apparatus, or an image indicating a distribution of an oxygen saturation. In the present exemplary embodiment, the information processing system will be described using an example that the medical image is two-dimensional image data. Then, the database 22 is also equipped with functions of, for example, reading out the information stored in the database 22, displaying a list of medical images, displaying a thumbnail, and searching for information. The information processing apparatus 10 acquires various kinds of information stored in the database 22 via the network 21.
The information processing apparatus 10 includes a communication interface (IF) 31, a read only memory (ROM) 32, a random access memory (RAM) 33, a storage unit 34, an operation unit 35, a display unit 36, and a control unit 37.
The communication IF 31 is realized by a LAN card or the like, and is in charge of communication between an external apparatus (for example, the database 22) and the information processing apparatus 10 via the network 21. The ROM 32 is realized by a nonvolatile memory or the like, and stores various kinds of programs therein. The RAM 33 is realized by a volatile memory or the like, and temporarily stores various kinds of information therein. The storage unit 34 is realized by a hard disk drive (HDD) or the like, and stores various kinds of information therein. The operation unit 35 is realized by a keyboard, a mouse, and/or the like, and inputs an instruction from a user to the apparatus. The display unit 36 is realized by a display or the like, and displays various kinds of information for a user (for example, a medical doctor).
The control unit 37 is realized by a central processing unit (CPU) or the like, and comprehensively controls processing in the information processing apparatus 10. The control unit 37 includes an image acquisition unit 40, a specification reception unit 41, a region search unit 42, a statistic processing unit 43, and a display control unit 44, as a functional configuration thereof.
The image acquisition unit 40 acquires the medical image from the database 22 via the communication IF 31 and the network 21 according to an operation of the user which is input by the operation unit 35. In other words, the image acquisition unit 40 corresponds to one example of an acquisition unit configured to acquire a medical image captured by imaging a subject. Then, the image acquisition unit 40 outputs the acquired medical image to the specification reception unit 41 and the display control unit 44.
The specification reception unit 41 receives specification from the user directed to an arbitrary pixel in the medical image displayed on the display unit 36 by the display control unit 44. In other words, the specification reception unit 41 corresponds to one example of a reception unit configured to receive specification of a pixel in the acquired medical image. Then, the specification reception unit 41 outputs information usable to identify the pixel for which the specification is received (for example, coordinates of the pixel or an identification (ID) of the pixel) to the region search unit 42.
The region search unit 42 selects a predetermined number of pixels located around the specified pixel by searching the acquired medical image, placing a starting point of the search at the specified pixel. In other words, the region search unit 42 corresponds to one example of a selection unit configured to select a predetermined number of pixels in the acquired medical image by searching from the specified pixel. Further, the region search unit 42 sets a region of interest that contains the specified pixel and the selected predetermined number of pixels. Then, the region search unit 42 outputs information usable to identify each of the pixels contained in the set region of interest to the statistic processing unit 43.
The statistic processing unit 43 performs statistic processing regarding the specified pixel with use of a value (a pixel value) of each of the pixels contained in the region of interest. In other words, the statistic processing unit 43 corresponds to one example of a processing unit configured to perform statistic processing regarding the specified pixel with use of the specified pixel and the selected predetermined number of pixels. Then, the statistic processing unit 43 outputs a result of the statistic processing to the display control unit 44. The value of the pixel in the present exemplary embodiment refers to a value held by the pixel, and indicates a luminance value, a concentration value, a signal value, an oxygen saturation value, or the like. The same also applies to a voxel value, which will be described below.
The display control unit 44 causes the result of the statistic processing to be displayed on the display unit 36. The result of the statistic processing may be displayed on the display unit 36 together with the medical image.
At least a part of the individual units included in the control unit 37 may be realized as an independent device. Alternatively, each of them may be realized as software that achieves the function. In this case, the software that achieves the function may run on a server via a network, such as a cloud. In the present exemplary embodiment, the individual units are each realized by software under a local environment.
Further, the configuration of the information processing system illustrated in
Next, a processing procedure performed by the information processing apparatus 10 according to the present exemplary embodiment will be described in detail with reference to
The medical image acquired by the photoacoustic imaging apparatus according to the present exemplary embodiment is a concept including any image derived from a photoacoustic wave generated from the light irradiation. The medical image includes image data indicating a spatial distribution of at least one of a generated sound pressure (an initial sound pressure) of the photoacoustic wave, a density of optical absorption energy, an optical absorption coefficient, information regarding a concentration of a substance forming the subject, and the like. The information regarding the concentration of the substance is a concentration of oxyhemoglobin, a concentration of deoxyhemoglobin, a total concentration of hemoglobin, the oxygen saturation, or the like. The total concentration of hemoglobin refers to a sum of the concentration of oxyhemoglobin and the concentration of deoxyhemoglobin. The oxygen saturation refers to a ratio of oxyhemoglobin to a total amount of hemoglobin. The medical image is not limited to the image indicating the spatial distribution, and may be, for example, an image indicating a numerical value. For example, the medical image is a concept including any image indicating information derived from a photoacoustic signal, such as the photoacoustic signal itself (RAW data), an average concentration of the substance forming the subject, a pixel value at a specific position in the spatial distribution, and a statistic value (a mean value, a median value, or the like) of pixel values in the spatial distribution. For example, a numerical value of the average concentration of the substance forming the subject may be displayed on the display unit 36 as the medical image.
In step S201, the image acquisition unit 40 acquires the medical image stored in the database 22 via the network 21. In the case where the medical image is stored in the storage unit 34, the image acquisition unit 40 may acquire the medical image from the storage unit 34. Then, the display control unit 44 causes the acquired medical image to be displayed on the display unit 36. The term “acquire” used herein includes, for example, downloading the medical image from the database 22, reading out the medical image from the RAM 33 or the storage unit 34, and storing the medical image in variables.
In step S202, the specification reception unit 41 receives specification of one pixel in the displayed medical image. The user specifies a pixel in a desired tissue visualized in the medical image via the operation unit 35. The specification reception unit 41 receives this specification and stores the information usable to identify the specified pixel (for example, the coordinates or the ID of the specified pixel). Hereinafter, the pixel for which the specification is received from the user will be referred to as the specified pixel. The display control unit 44 may highlight the specified pixel by setting a color to the specified pixel, drawing a thick line as a borderline of the specified pixel, or blinking the specified pixel, although this is not essential processing. Highlighting the specified pixel in such a manner allows the user to easily distinguish the specified pixel from other pixels.
In step S203, the region search unit 42 selects a predetermined number of pixels in the medical image by searching from the specified pixel. The predetermined number is set according to the instruction from the user. For example, in a case of a narrow blood vessel having a width of approximately 3 to 5 pixels, it is preferable that approximately 10 is set as the predetermined number. Alternatively, a number that allows the search to be conducted in a range spreading over a radius of approximately 1 mm around the specified pixel may be set as the predetermined number. Further alternatively, the region search unit 42 may estimate a size of the object visualized in the medical image and determine the predetermined number according to the size. In any case, it is desirable that the number of pixels that allows a neighborhood around the specified pixel to be searched is set as the predetermined number.
Various methods can be employed as a method for the search, but the search will be described to be conducted by a method that searches pixels adjacent to the specified pixel or the region of interest in four directions (upward, downward, leftward, and rightward directions) as illustrated in
(1) First, the region search unit 42 selects a pixel having the closest value to the value of the specified pixel 301 among pixels adjacent to the specified pixel 301 in the four directions that are the upward, downward, leftward, and rightward directions. In the example illustrated in
Further, the display control unit 44 may highlight the region of interest by setting a color to the region of interest, drawing a thick line as a borderline of the region of interest, or blinking the region of interest, although this is not essential processing. Highlighting the region of interest in such a manner allows the user to easily distinguish the region of interest from other pixels from each other.
Searching for the predetermined number of pixels in the four directions brings about the following advantageous effects. For example, supposing that the user has intended to specify a pixel corresponding to the internal cavity of the blood vessel but mistakenly specified a pixel corresponding to the blood vessel wall (pixels in gray in
Further, another conceivable configuration is that the region search unit 42 simply selects eight pixels (H7, H8, H9, 17, 19, J7, J8, and J9) surrounding the specified pixel (I8). However, in this case, even the pixel corresponding to the blood vessel wall is unintentionally selected despite the fact that the internal cavity of the blood vessel is specified, so that the value of the specified pixel may be unintentionally rejected in the statistic processing that will be described below. Therefore, it is necessary to search the predetermined number of pixels in the four directions in the above-described manner.
<Perform Statistic Processing regarding Specified Pixel>
In step S204, the statistic processing unit 43 performs the statistic processing regarding the specified pixel with use of the value of each of the pixels contained in the region of interest. More specifically, the statistic processing unit 43 determines whether the value of the specified pixel deviates from the value of each of the pixels located around the specified pixel, i.e., the value of the specified pixel is the outlier. In the present exemplary embodiment, the statistic processing will be described with use of Thompson's rejection test. First, the statistic processing unit 43 calculates a t value with use of the following equations (1) and (2).
x: Value of Specified Pixel and Value of Selected pixel
The statistic processing unit 43 compares the t value calculated with use of the equation (2) and a t distribution table, thereby conducting a significant difference test at a desired level. For example, the statistic processing unit 43 conducts a two-sided test at a level of 0.1%. As a result, the statistic processing unit 43 can determine whether the specified pixel is the outlier. In the present exemplary embodiment, the statistic processing unit 43 employs Thompsons's rejection test, but may employ Smirnoff-Grubbs' rejection test or may employ the rejection test developed by Doctor Motosaburo Masuyama. Alternatively, the statistic processing unit 43 may determine that the specified pixel is the outlier if the value of the specified pixel does not fall within a range defined by a mean value of the values of the pixels in the region of interest ±a standard deviation××a constant A as the detection of the outlier. Normally, a value in a range from 2 to 3 is used as the constant A, but the constant A can be changed freely by the user.
In step S205, the display control unit 44 causes the result of the statistic processing to be displayed on the display unit 36. The display control unit 44 may cause the result of the statistic processing to be displayed on the display unit 36 together with the medical image at this time.
According to the present exemplary embodiment, it is possible to select pixels in a necessary range, thereby appropriately performing the statistic processing.
The search has been described referring to the method that searches from the specified pixel in the four directions that are the upward, downward, leftward, and rightward directions in the present exemplary embodiment, but may be conducted by a method that searches from the specified pixel in four diagonal directions. More specifically, as illustrated in
Whether to search in the four directions that are the upward, downward, leftward, and rightward directions or search in the four diagonal directions may be selected by the user prior to the search or may be automatically determined based on detection of the shape of the blood vessel.
Further, the selection of the pixel has been described referring to the method that selects the pixel having the closest value to the value of the specified pixel in the present exemplary embodiment, but the information processing apparatus may select a pixel having the closest value to a value of a predetermined pixel contained in the region of interest. For example, the pixel may be selected by a method that selects a pixel having the closest value to a value of a pixel selected last as a next selected pixel. This method will be described with reference to
Further, the selection of the pixel has been described referring to the method that selects the pixel having the closest value to the value of the specified pixel in the present exemplary embodiment, but the pixel may be selected by a method that selects a pixel having the closest value to the mean value of the pixels contained in the region of interest. This method will be described with reference to
Further, the pixel selection method may be switched based on a selection from the user among the pixel selection method according to the present exemplary embodiment, the pixel selection method according to the second exemplary modification, and the pixel selection method according to the third exemplary modification. It is desirable to employ an appropriate selection method according to the shape of the object visualized in the medical image and/or the value of the pixel. Further, the selection method may be switched every time one or more pixels is(are) selected.
Further, the medical image is the two-dimensional image data in the present exemplary embodiment, but the medical image may be three-dimensional image data. In other words, the medical image may be volume data. In this case, similar advantageous effects can be achieved by replacing the term “pixel” described in the present exemplary embodiment and each of the exemplary modifications with the term “voxel”. Further, as the search direction in this case, the search is conducted from the specified pixel in six directions that are upward, downward, leftward, rightward, frontward, and backward directions.
Embodiment(s) of the present disclosure can also be realized by a computer of a system or apparatus that reads out and executes computer executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be referred to more fully as a ‘non-transitory computer-readable storage medium’) to perform the functions of one or more of the above-described embodiment(s) and/or that includes one or more circuits (e.g., application specific integrated circuit (ASIC)) for performing the functions of one or more of the above-described embodiment(s), and by a method performed by the computer of the system or apparatus by, for example, reading out and executing the computer executable instructions from the storage medium to perform the functions of one or more of the above-described embodiment(s) and/or controlling the one or more circuits to perform the functions of one or more of the above-described embodiment(s). The computer may comprise one or more processors (e.g., central processing unit (CPU), micro processing unit (MPU)) and may include a network of separate computers or separate processors to read out and execute the computer executable instructions. The computer executable instructions may be provided to the computer, for example, from a network or the storage medium. The storage medium may include, for example, one or more of a hard disk, a random-access memory (RAM), a read only memory (ROM), a storage of distributed computing systems, an optical disk (such as a compact disc (CD), digital versatile disc (DVD), or Blu-ray Disc (BD)™), a flash memory device, a memory card, and the like.
While the present disclosure has been described with reference to exemplary embodiments, it is to be understood that the disclosure is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.
This application claims the benefit of Japanese Patent Application No. 2018-052415, filed Mar. 20, 2018, which is hereby incorporated by reference herein in its entirety.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2018-052415 | Mar 2018 | JP | national |
