The present application claims priority under 35 U.S.C. § 119 to Japanese Patent Application No. 2023-218336, filed Dec. 25, 2023, the contents of which are incorporated herein by reference in their entirety. The present disclosure relates to an information processing system, an information processing method, a program and an information processing apparatus.
Patent document 1 discloses a technique for correcting a gap of a mechanical unit in a radiographic apparatus, based on distance information obtained from rotation of the mechanical unit in the radiographic apparatus.
However, in Patent Document 1, a distance sensor has been required to correct the gap.
In the light of the above circumstances, the present disclosure provides a technique for correcting SOD shifts without requiring any distance sensor for CT devices.
According to one aspect of the present disclosure, an information processing system for processing information between a CT device and the information processing system is provided. The CT device in this information processing system includes a sample stage, an X-ray generator and a detector. A sample is placed on the sample stage. The X-ray generator is configured to generate a cone beam X-ray toward the sample, and to be rotated around a rotation axis with respect to the sample stage. The detector detects the cone beam X-ray that has transmitted through the sample as measurement data. The information processing system includes at least one processor that executes following respective steps. In a tentative correction step, a tentatively corrected reconstruction image is acquired for each plurality of the tentative correction parameter from the measurement data, by using a tentative correction function which employs an angle position of the X-ray generator with respect to the rotation axis as a variable and the tentative correction parameter related to an SOD as a parameter. The SOD is a distance between the X-ray generator and the rotation axis. The tentatively corrected reconstruction image is an image obtained by reconstructing the sample in a predetermined plane. In an index calculation step, an index related to sharpness of each of the tentatively corrected reconstruction image acquired for said each plurality of the tentative correction parameter is calculated. In a shift quantity specification step, a correction function of the SOD is specified based on a plurality of the calculated index.
According to the present disclosure, the SOD shift can be corrected without requiring any distance sensor for the CT device.
The embodiment of the present disclosure will be described below with reference to the drawings. Various features shown in the following embodiment can be combined with each other.
The program for realizing software used in this embodiment may be provided as a non-transitory computer-readable medium, may be provided to be downloadable from an external server, or may be provided so that the program can be started on an external computer to realize its functions on a client device (so-called cloud computing).
In this embodiment, the term “part” in the present embodiment may include, for example, hardware resources implemented by circuits in a broad sense, together with information processing of software which may be specifically realized by those hardware resources. In addition, although various types of information are handled in this embodiment, such information may be represented by physical values of signal values representing, for example, voltage and current, high and low signal values as a binary bit array consisting of 0 or 1, or quantum superposition (so-called quantum bits), and communication and computation may be performed on a circuit in a broad sense
A circuit in a broad sense means a circuit realized by combining a circuit, circuitry, a processor, a memory and the like in an appropriate combination. That is, such circuits include an application specific integrated circuit (ASIC), a programmable logic device (e.g., a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), etc.), and an integrated circuit (IC), a field programmable gate array (FPGA) and the like.
Firstly, a system configuration and a hardware configuration of an information processing system 1 of the present embodiment will be described with reference to
As shown in
The information processing apparatus 2 is a PC (Personal Computer). The information processing apparatus 2 may be a tablet-type computer, a smart phone, etc., instead of a PC. The information processing apparatus 2 is an apparatus for processing information between the CT device 3 and the information processing apparatus 2. Specifically, for example, the information processing apparatus 2 is configured to be able to control arbitrary information processing to measurement data acquired from the CT device 3, control an X-ray XR generated from an X-ray generator 34, acquire a projection image detected by a detector 35, control movement of a sample holder 36, control rotation of a gantry unit 37, control a position of a variable magnification mechanism 38, and the like. Incidentally, the information processing apparatus 2 may be able to execute arbitrary information processing related to the CT device 3 as a result, and another information processing apparatus may be intervened between the information processing apparatus 2 and the CT device 3. As shown in
The processor 21 processes and controls an entire action related to the information processing apparatus 2. The processor 21 is, for example, a central processing unit (CPU). Information processing by a program stored in the memory unit 22 is specifically realized by the processor 21, which is an example of the hardware, thereby being executed as each functional unit included in the processor 21. By each functional unit included in the processor 21, for example, below-described processing shown in
The memory unit 22 stores various information defined by the above description. For example, the memory unit 22 may be implemented as a storage device such as a solid state drive (SSD) that stores various programs, etc. related to the information processing apparatus 2, which are executed by the processor 21, or as a memory such as a random access memory (RAM) that stores temporarily necessary information (arguments, arrays, etc.) for program calculations. The memory unit 22 stores various programs and variables related to the information processing apparatus 2, which are executed by the processor 21, and data used by the processor 21 to execute the processing based on the programs. The memory unit 22 may be an example of the storage medium.
The communication unit 23 is preferably a wire communication means such as USB, IEEE1394, Thunderbolt (registered trademark), wired LAN network communication, etc., but may also include wireless LAN network communication, mobile communication such as LTE/3G/4G/5G, Bluetooth (registered trademark) communication, and the like as necessary. More preferably, integration of these plural communication means is used. That is, the information processing apparatus 2 may communicate various information from outside via the communication unit 23.
The input unit 24 may be included in a housing of the information processing apparatus 2, or may be attached thereto externally. For example, the input unit 24 may be integrated with the output unit 25 and implemented as a touch panel. If the input unit 24 is implemented as a touch panel, a user can input by tap operations, swipe operations and the like. Needless to say, a switch button, a mouse, a keyboard or the like may be employed instead of a touch panel. That is, the input unit 24 accepts an input based on the operation performed by the user. The input is transferred as an instruction signal via the communication bus to the processor 21, and the processor 21 may execute predetermined control or calculation as necessary.
The output unit 25 can function as a display device of the information processing apparatus 2. The output unit 25 may be included in the housing of the information processing apparatus 2, or may be attached thereto externally. The output unit 25 displays a screen of a graphical user interface (GUI) that can be operated by a user. This displaying is preferably performed by a display device, for example, a CRT display, a liquid crystal display, an organic EL display, a plasma display or the like, depending on a type of the information processing apparatus 2.
Next, the CT device 3 will be explained with reference to
The X-ray generator 34 generates a cone beam X-ray XR so that the X-ray XR may be irradiated toward an area including the sample placed on the sample holder 36. The cone beam X-ray XR may be shaped so that an irradiation range of the X-ray XR may be expanded along a direction of travel of the X-ray beam, and may include a fan beam X-ray or the like. The X-ray generator 34 is configured to be rotated around a rotation axis RA of the gantry unit 37 with respect to the sample stage. Further, the X-ray generator 34 may also be configured to irradiate an X-ray including a characteristic X-ray such as CuKα and FeKα.
The detector 35 is configured to be able to detect the X-ray that is transmitted through the sample placed on the sample holder 36. The detected X-ray XR is analyzed as measurement data by the information processing apparatus 2. The measurement data is data obtained by the measurement by the CT device 3. The measurement data includes information indicating an angle of rotation of the gantry unit 37 and information on a projection image that corresponds to the angle. The detector 35 is configured to be rotated around the rotation axis RA of the gantry unit 37 with respect to the sample stage. As the detector 35, a two-dimensional detector using a CCD, an imaging plate or the like may be used.
The sample holder 36 is configured to be able to hold the sample stage on the rotation axis RA of the gantry unit 37. The sample holder 36 may be configured to be able to move the sample stage in an arbitrary direction based on a movement instruction generated by the processor 21 or the processor 31. The sample stage is configured to be able to place the sample. The sample to be used for acquiring the correction function may be any arbitrary objects or organisms, and is not limited to specific samples such as standard samples.
As shown in
The variable magnification mechanism 38 is a mechanism for adjusting an magnification ratio of a projection image at a time of acquisition. As shown in
The information transmission and reception unit 210 accepts, receives or acquires various information from the CT device 3 via the communication unit 23. The information transmission and reception unit 210 transmits various information via the communication unit 23 to the CT device 3.
The measurement data memory unit 211 allows the memory unit 22 to store measurement data acquired from the CT device 3.
The reconstruction unit 212 reconstructs an image of the sample from a plural projection images.
The tentative correction unit 213 acquires a tentatively corrected reconstruction image from the plural projection images to which the tentative correction function is applied.
The index calculation unit 214 calculates an index that represents sharpness of each tentatively corrected reconstruction image.
The plot output unit 215 outputs a plot of an index for a hypothesized tentative correction parameter.
The shift quantity specification unit 216 specifies the correction parameter so as to specify the correction function that indicates an actual quantity of the SOD shift.
The correction unit 217 corrects the actual quantity of the SOD shift so as to reconstruct the projection image, thereby acquiring a corrected reconstruction image.
Details of the information transmission and reception unit 210, the measurement data memory unit 211, the reconstruction unit 212, the tentative correction unit 213, the index calculation unit 214, the plot output unit 215, the shift quantity specification unit 216 and the correction unit 217 will be described below.
Next, a preferred example of information processing executed by the information processing system 1 of the present embodiment will be described. In this section, an example of specifying the correction function based on Formulae 1 and 2 and outputting the corrected reconstruction image by using the specified correction function will be explained with reference to an activity diagram of
Firstly, the processor 21 of the information processing apparatus 2 accepts setting of the measurement condition and an instruction to start measurement by the CT device (hereinafter referred to as a measurement start instruction) from the user via the input unit 24.
Subsequently, the information transmission and reception unit 210 transmits the measurement condition and the measurement start instruction via the communication unit 23 to the CT device 3.
Then, the processor 31 of the CT device 3 accepts the measurement condition and the measurement start instruction from the information processing apparatus 2 via the communication unit 33.
Thereafter, the CT device 3 acquires the measurement data based on the accepted measurement condition.
Subsequently, the processor 31 of the CT device 3 transmits the measurement data via the communication unit 33 to the information processing apparatus 2.
Then, the information transmission and reception unit 210 of the information processing apparatus 2 accepts the measurement data from the CT device 3 via the communication unit 23.
Thereafter, the measurement data memory unit 211 allows the memory unit 22 to store the acquired measurement data.
Subsequently, the processor 21 accepts setting of a hypothesized range of the SOD shift (hereinafter referred to as hypothetical range setting) and an instruction to acquire the corrected reconstruction image from the user via the input unit 24. The processor 21 proceeds the information processing to Activity A9.
Then, if having specified a correction function in a certain measurement condition in the past, the processor 21 of the information processing apparatus 2 can use the specified correction function in a measurement condition similar to the past measurement condition. That is, the correction function is stored in the memory unit 22 for each measurement condition. The measurement condition is a condition for the measurement by the CT device 3, and includes, for example, at least one condition of the number of images to be acquired, scanning speed, exposure time and an magnification ratio of an image to be acquired. If outputting the reconstruction image by using the specified correction function, the processor 21 proceeds the information processing to Activity A16. On the other hand, if specifying a new correction function, the processor 21 proceeds the information processing to Activity A10. According to this configuration, the correction of the SOD shift corresponding to the various measurement conditions can be executed. Further, according to this configuration, the correction function acquired in a certain measurement condition can be reused.
Subsequently, the tentative correction unit 213 hypothesizes a tentative correction parameter so as to calculate a tentative correction function. More specifically, for example, the tentative correction unit 213 calculates the tentative correction function which employs the angle position of the X-ray generator 34 with respect to the rotation axis RA as a variable and the tentative correction parameter for tentatively correcting the SOD shift as a parameter. The tentative correction function may be a function that includes the angle position of the X-ray generator 34 with respect to the rotation axis RA as a variable, and is not limited particularly. According to another viewpoint, the angle position of the X-ray generator 34 with respect to the rotation axis RA may be the angle of the gantry unit 37 or the angle of the acquisition.
The tentative correction function is, for example, below-described Formula 1. The tentative correction parameter is a parameter that is tentatively provided as a correction parameter. The tentative correction parameter includes a first tentative correction parameter as an SOD amp and a second tentative correction parameter as an SODoffset. The tentative correction unit 213 varies: θ as the angle position of the X-ray generator 34 with respect to the rotation axis RA; the first tentative correction parameter; and the second tentative correction parameter. In the present embodiment, the SODamp and the SODoffset are treated as equal parameters (i.e., SODamp=SODoffset), but may be treated as different parameters. According to such a configuration, θ as the angle position of the X-ray generator 34 with respect to the rotation axis RA is employed as a variable, whereby plural tentatively corrected reconstruction images can be acquired.
Thereafter, the tentative correction unit 213 acquires a tentatively corrected reconstruction image for each plurality of the tentative correction parameter from the measurement data, by using the tentative correction function that is hypothesized in Activity A10. The tentatively corrected reconstruction image is a two-dimensional image obtained by reconstructing the sample in a predetermined plane. The predetermined plane may be any arbitrary plane, but preferably includes an optical axis of the X-ray beam XR (which is the same as the straight line SL in the example of
Then, the index calculation unit 214 calculates an index related to sharpness of each tentatively corrected reconstruction image, which is acquired for each plurality of the tentative correction parameter. The index related to the sharpness is, for example, a total variation (TV) represented by Formula 2 below, but is not limited to it.
Subsequently, the processor 21 of the information processing apparatus 2 judges whether a condition of a loop has been completed or not, by reaching of the number of steps of the hypothesized tentative correction parameter to a predetermined value, based on the hypothetical range setting accepted in Activity A8. If the loop condition is not completed, the processor 21 proceeds the information processing to Activity A10. If the loop condition is completed, the processor 21 proceeds the information processing to Activity A14.
Thereafter, the plot output unit 215 plots the plural indices acquired by repeating Activity A12. The result of the plotting is, for example, as shown in
Then, the shift quantity specification unit 216 searches a maximal value of the index with respect to the tentative correction parameter (at a position of 58 μm pointed by an arrow in the example of
Finally, the correction unit 217 outputs an image, which is reconstructed by using the correction function specified in Activity A15, as a corrected reconstruction image. The corrected reconstruction image is an image in a form with the SOD shift corrected by the correction function, which enables the observation of a three-dimensional image of the sample and a cross-sectional view cut along an arbitrary plane of the sample. According to this configuration, images reconstructed by using the correction function can be output.
The reference button 40 is a button for displaying a window in which files of measurement data are listed, and specifying a certain file of the measurement data therefrom.
The projection image display area 41 is an area in which the projection image acquired from the measurement data is displayed. By specifying a position of a line on the projection image display area 41, a cross-section of the reconstruction image perpendicular to its Z-axis can be specified.
The reconstruction image area 42 is an area in which the reconstruction image acquired from the measurement data is displayed.
The hypothetical condition area 43 is an area that enables to accept setting of an initial value, the number of steps and step widths of the tentative correction parameter to be hypothesized. The setting input via the hypothetical condition area 43 becomes the hypothetical range setting. For example, in Activities A10 to A13 in
The AutoSOD button 44 is a button for instructing execution of the index calculation. For example, in response to push down of the AutoSOD button 44, the processor 21 starts the information processing of Activity A8 in
The result display area 45 is an area in which the specified actual correction parameter (58 μm in the example of
The correction function save button 46 is a button for storing the specified correction function. As mentioned above, the correction function is stored in connection with the measurement condition.
The reconstruction image acquisition button 47 is a button for reconstructing an image from a projection image.
Next, an example about a change of the reconstruction image between before and after the application of the correction function that is acquired by the present disclosure will be described with reference to
As described above, the present disclosure can provide the technique for correcting the SOD shift without requiring any distance sensor for the CT device.
The program is a program that allows one or more computers to execute each functional unit (step). In addition, the information processing system 1 is provided with one or more computers that execute the program. As to the information processing system 1 according to the above-described embodiment, the program may be a program that allows a computer to function as the processor 21 of the information processing system 1. In addition, the program may be an information processing method executed by the information processing system 1 (or the processor 21 of the information processing apparatus 2).
The embodiment has provided the example in which the gantry-type CT device is used as the CT device, but in a modified example, a sample-rotation CT device may also be used as the CT device. In the sample-rotation CT device, a sample stage is rotated together with a sample. In the sample-rotation CT device, a sample holder (or the sample stage) generates a position gap in the gravity direction due to the gravity. Also in the sample-rotation CT device, an SOD shift is corrected by using a tentative correction function and a correction function.
The embodiment has provided the explanation based on the premise of using the total variation (TV) as the index related to the sharpness, but the present disclosure is not limited to this. In a modified example, as an index related to sharpness, for example, an index in an inclination angle method, a half value method, a Nitka method or the like may be used by drawing a line profile in a specific part of the reconstruction image, or in a case where a sample includes a dotted structure, an index of a half-value width of a point spread function, which is estimated by using blind deconvolution or the like, may also be used.
In addition, the present disclosure may be provided in the following forms.
(1) An information processing system for processing information between a CT device and the information processing system, wherein the CT device includes: a sample stage on which a sample is placed; an X-ray generator configured to generate a cone beam X-ray toward the sample and to be rotated around a rotation axis with respect to the sample stage; and a detector configured to detect the cone beam X-ray that is transmitted through the sample as measurement data, the information processing system comprising at least one processor that is configured to execute each step of: a tentative correction step of acquiring a tentatively corrected reconstruction image for each plurality of tentative correction parameter from the measurement data, by using a tentative correction function which employs an angle position of the X-ray generator with respect to the rotation axis as a variable and the tentative correction parameter related to an SOD as a parameter, where the SOD is a distance between the X-ray generator and the rotation axis, and the tentatively corrected reconstruction image is an image obtained by reconstructing the sample in a predetermined plane; an index calculation step of calculating an index related to sharpness of each of the tentatively corrected reconstruction image acquired for said each plurality of the tentative correction parameter; and a shift quantity specification step of specifying a correction function of the SOD based on a plurality of the calculated index.
According to this configuration, the SOD can be corrected without requiring any distance sensor for the CT device.
(2) The information processing system according to (1), wherein the tentative correction parameter includes a first tentative correction parameter and a second tentative correction parameter, the tentative correction function is represented by a following formula (1),
where the variable of the angle position of the X-ray generator with respect to the rotation axis is denoted by θ, the first tentative correction parameter is denoted by an SODamp, and the second tentative correction parameter is denoted by an SODoffset, and the tentative correction step varies the first tentative correction parameter and the second tentative correction parameter.
According to such a configuration, a plurality of the tentatively corrected reconstruction image can be acquired by employing the position of the X-ray generator with respect to the rotation axis as the variable.
(3) The information processing system according to (1) or (2), wherein the index related to the sharpness is a total variation (TV) represented by a following formula (2), and
According to this configuration, since the total variation is used as the index of the sharpness, the appropriate correction function can be specified.
(4) The information processing system according to any one of (1) to (3), wherein a correction step outputs an image that is reconstructed by using the correction function specified in the shift quantity specification step.
According to such a configuration, the corrected reconstruction image which is restructured by using the correction function can be output.
(5) The information processing system according to any one of (1) to (4), wherein the correction function is stored for each measurement condition, and the measurement condition includes at least one condition of: a number of images to be acquired; scanning speed; exposure time; or an magnification ratio of an image to be acquired.
According to this configuration, correction of the SOD shift corresponding to various measurement conditions can be executed.
(6) The information processing system according to any one of (1) to (5), wherein the predetermined plane includes a plane that is parallel to an optical axis of the X-ray.
According to this configuration, since the plane of the image to be reconstructed can be limited to the plane parallel to the optical axis, the logic for specifying the correction function can be simplified.
(7) The information processing system according to any one of (1) to (6), wherein, in the tentative correction step, values obtained by dividing a range of values set by a user by step widths set by the user are used as the plurality of the tentative correction parameter.
According to this configuration, the tentative correction parameter can be verified within the range set arbitrarily by the user.
(8) An information processing method executed by an information processing system for processing information between a CT device and the information processing system, wherein the CT device includes: a sample stage on which a sample is placed; an X-ray generator configured to generate a cone beam X-ray toward the sample and to be rotated around a rotation axis with respect to the sample stage; and a detector configured to detect the cone beam X-ray that is transmitted through the sample as measurement data, the information processing system includes at least one processor that is configured to execute each step of: a tentative correction step of acquiring a tentatively corrected reconstruction image for each plurality of tentative correction parameter from the measurement data, by using a tentative correction function which employs an angle position of the X-ray generator with respect to the rotation axis as a variable and the tentative correction parameter related to an SOD as a parameter, where the SOD is a distance between the X-ray generator and the rotation axis, and the tentatively corrected reconstruction image is an image obtained by reconstructing the sample in a predetermined plane; an index calculation step of calculating an index related to sharpness of each of the tentatively corrected reconstruction image acquired for said each plurality of the tentative correction parameter; and a shift quantity specification step of specifying a correction function of the SOD based on a plurality of the calculated index.
According to this configuration, the SOD shift can be corrected without requiring any distance sensor for the CT device.
(9) A non-transitory computer-readable storage medium storing a program configured to allow a computer to function as the at least one processor of the information processing system according to any one of (1) to (7).
According to this configuration, the SOD shift can be corrected without requiring any distance sensor for the CT device.
(10) An information processing apparatus comprising at least one processor executing each step of: a tentative correction step of acquiring a tentatively corrected reconstruction image for each plurality of tentative correction parameter from measurement data including a projection image of a sample, by using a tentative correction function which employs an angle position of an X-ray generator of a CT device with respect to a rotation axis as a variable and the tentative correction parameter related to an SOD as a parameter, where the SOD is a distance between the X-ray generator and the rotation axis, and the tentatively corrected reconstruction image is an image obtained by reconstructing the sample in a predetermined plane; an index calculation step of calculating an index related to sharpness of each of the tentatively corrected reconstruction image acquired for said each plurality of the tentative correction parameter; and a shift quantity specification step of specifying a correction function of the SOD based on a plurality of the calculated index.
According to this configuration, the SOD shift can be corrected without requiring any distance sensor for the CT device.
(11) A non-transitory computer-readable storage medium storing a program configured to allow a computer to function as the at least one processor of the information processing apparatus according to (10).
According to this configuration, the SOD shift can be corrected without requiring any distance sensor for the CT device.
Needless to say, the present disclosure is not limited to the above description.
Finally, various embodiments of the invention have been described, which are presented as examples and are not intended to limit the scope of the invention. The novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made to the extent that they do not depart from the gist of the invention. The embodiment and variations thereof are included in the scope or gist of the invention and within the scope of the invention and its equivalents described in the claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2023-218336 | Dec 2023 | JP | national |