Patent Application
20220051786
The present invention relates to a medical image processing apparatus and a medical image processing method for a medical navigation device, and more particularly, to an apparatus and method for processing an image provided when using the medical navigation device.
A minimally invasive surgery that minimizes the incision site of the patient during surgery is widely used. The minimally invasive surgery has an advantage of minimizing the incision and thus minimizing blood loss and recovery time, but restricts the doctor's field of view thus having some risk factors such as meninx damage and eye damage in some surgeries. As a tool for overcoming the disadvantages of minimally invasive surgery in which the doctor's field of view of is restricted, a medical navigation device (or surgical navigation device) is used. The medical navigation device tracks in real time the position of the instrument in the surgical site in reference to a previously obtained medical image of the patient. In addition, such a medical navigation device may be used in combination with an endoscope.
An optical or electromagnetic position tracking devices may be used for real-time position tracking of the inserted surgical instrument in the medical navigation device. As an example for tracking the position of the surgical instrument, an optical position tracking device including an infrared emitting device and a passive image sensor may be used. The optical position tracking device emits reference light through the infrared emitting device and collects the image reflected by plural markers through the image sensor. The position tracking apparatus may obtain position information of the surgical instrument based on the positions of the markers. Meanwhile, as another example for tracking the position of the surgical instrument, an electromagnetic position tracking device including a magnetic field generator and a conductive metal object may be used. The electromagnetic position tracking device may obtain the position information of the surgical instrument by measuring the eddy current occurs in the conductive metal object in the magnetic field generated by the magnetic field generator. In order to accurately indicate the positional relationship between the surgical instrument and the body part in the position tracking device, a registration process may be required that defines the initial positional relationship between the medical data for the patient's body part and the surgical instrument.
The present invention has an object to provide a medical image processing method for helping the operator to intuitively identify information on surgical site and adjacent elements (e.g. organs) in a patient's body.
In addition, the present invention has an object to effectively render the medical image of the patient taken in advance and the intraoperative image in surgical site.
In addition, the present invention has an object to provide a medical navigation device that is easy to identify the patient's anatomical structure.
In order to solve the above problems, the present invention provides a medical image processing apparatus and a medical image processing method as follows.
First, an exemplary embodiment of the present invention provides a medical image processing apparatus using an augmented reality, including: an endoscopic image obtaining unit which obtains an endoscopic image of an object; a memory which stores medical image data generated based on a medical image of the object; and a processor which obtains position and direction information of the endoscope in reference to the medical image data, determines a target area to be displayed in augmented reality among the medical image data based on the obtained position and direction information, and renders partial medical image data corresponding to the target area as an augmented reality image on the endoscopic image.
In addition, an exemplary embodiment of the present invention provides a medical image processing method using an augmented reality, including: obtaining an endoscopic image of an object; obtaining position and direction information of the endoscope in reference to medical image data of the object, wherein the medical image data of the object is generated based on a medical image of the object; determining a target area to be displayed in augmented reality among the medical image data based on the obtained position and direction information; and rendering partial medical image data corresponding to the target area as an augmented reality image on the endoscopic image.
According to an embodiment, the medical image data may include data obtained by synthesizing the medical image of the object and user defined auxiliary data and performing volume rendering on the synthesized data.
In this case, the auxiliary data may be represented as a voxel having a value outside a pre-defined Hounsfield Unit (HU) range.
In addition, the range outside pre-defined HU range may include a first HU range exceeding a first threshold and a second HU range below a second threshold, and a value of the first HU range and a value of the second HU range may represent different types of auxiliary data.
According to an embodiment, the pre-defined HU range may reach from −1000 HU to +1000 HU.
According to another embodiment of the present invention, the processor may generate a first normal map using the endoscopic image, and obtain the position and direction information of the endoscope in reference to the medical image data based on a result of determining a similarity between the first normal map with a plurality of second normal maps obtained from the medical image data.
In this case, the processor may compare the first normal map with second normal maps within a preset range from a position and a direction of the endoscope at a previous time point.
According to an embodiment, the first normal map may be obtained based on reflection information of structured light with respect to a search area of the object.
In addition, the second normal map may be obtained from the medical image data based on position and direction information of a virtual endoscope for the object.
In addition, the direction information of the virtual endoscope may be determined based on a straight line connecting a start point (or a previous position) of a path of the virtual endoscope and a current position of the virtual endoscope.
Next, another exemplary embodiment of the present invention provides a medical image processing apparatus for a medical navigation device, including: a position tracking unit which obtains position information of the medical navigation device within an object; a memory which stores medical image data generated based on a medical image of the object; and a processor which sets a region of interest (ROI) based on position information of the medical navigation device in reference to the medical image data, and generates partial medical image data corresponding to the ROI.
In addition, another exemplary embodiment of the present invention provides a medical image processing method for a medical navigation device, including: obtaining position information of the medical navigation device within an object; storing medical image data generated based on a medical image of the object; setting a region of interest (ROI) based on position information of the medical navigation device in reference to the medical image data; and generating partial medical image data corresponding to the ROI.
In this case, the ROI may be set based on an area within a preset distance from a position of the medical navigation device in reference to at least one of a horizontal plane, a sagittal plane, and a coronal plane of the medical image data.
In addition, the preset distance in reference to each of the horizontal plane, the sagittal plane, and the coronal plane may be determined by a user input.
According to an embodiment, the partial medical image data may be generated by rendering voxels having a value within a pre-defined Hounsfield Unit (HU) range in the ROI.
In addition, the pre-defined HU range may be determined based on a CT value of a specific tissue of the object.
In addition, the specific tissue may be arbitrarily determined by a user.
According to a further embodiment of the present invention, the partial medical image data may be generated by rendering voxels in the ROI with a light from a virtual light source at a predetermined point based on a position of the medical navigation device.
In this case, each pixel value I(S0,Sn) of the partial medical image data may be determined based on the following equation.
Herein, S0 is a first voxel sampled by ray casting, Sn is a last voxel sampled by ray casting, Iλ(x) is a value of voxel x, τ(t) is an attenuation coefficient of voxel t, Kref is a reflection coefficient, P0 is a position of the virtual light source, L is a brightness value of the virtual light source at P0.
In this case, the Kref may be determined based on the following equation.
K
ref=max(G(x)*Vp0→x,0)
Herein, G (x) is a gradient vector at voxel x, and Vp0->x is a direction vector from a position P0 of the virtual light source to voxel x.
In addition, the medical image data may be set of voxels generated using the medical image of the object, and the partial medical image data is volume rendering data obtained by applying ray casting on voxels in the ROI.
According to an embodiment of the present invention, the medical image and the surgical site image of the patient may be effectively rendered to provide convenience of surgery and medical diagnosis.
In addition, according to an embodiment of the present invention, it is possible to minimize the amount of computation required to render additional data included in the medical image.
In addition, according to an embodiment of the present invention, the operator can easily identify the anatomical structure of the patient thereby improving the convenience and concentration on the surgery.
In the specification, up to date general terms are used considering functions in the present invention, but they may be changed depending on an intention of those skilled in the art, customs, and emergence of new technology. Further, in a specific case, there is a term arbitrarily selected by an applicant and in that case, a meaning thereof will be described in a corresponding description part of the invention. Accordingly, it should be revealed that a term used in the specification should be understood on not just a name of the term but a substantial meaning of the term and contents throughout the specification.
Throughout this specification and the claims that follow, when it is described that an element is “coupled” to another element, the element may be “directly coupled” to the other element or “electrically coupled” to the other element through a third element. Further, unless explicitly described to the contrary, the word “comprise” and variations such as “comprises” or “comprising”, will be understood to imply the inclusion of stated elements but not the exclusion of any other elements. Moreover, limitations such as “or more” or “or less” based on a specific threshold may be appropriately substituted with “more than” or “less than”, respectively.
Hereinafter, a medical image processing apparatus and a medical image processing method according to an exemplary embodiment of the present invention will be described with reference to the drawings. The image processing apparatus and the image processing method according to the embodiment of the present invention may be applied to a medical image of an object including a human body and an animal body. The medical image includes an X-ray image, a computed tomography (CT) image, a positron emission tomography (PET) image, an ultrasound image, and a magnetic resonance imaging (MRI), but the present invention is not limited thereto. In addition, in the present description, the term medical image data is used as a term in a broad sense including not only the medical image itself but also various types of data generated by rendering the medical image. According to an embodiment, the medical image data may refer to data obtained by performing volume rendering on the medical image. In addition, the medical image data may refer to a three-dimensional data set composed of a group of two-dimensional medical images. The value on a regular grid in the three-dimensional data set configured as described above is called a voxel. The medical image processing apparatus and the medical image processing method according to an embodiment of the present invention may generate or process an image provided by an endoscope and/or a medical navigation device.
First, the communication unit 12 includes a wired/wireless communication module of various protocols for communicating with an external device. The input unit 13 includes various types of interfaces for receiving a user input for the medical image processing apparatus 10. According to an embodiment, the input unit 13 may include a keyboard, a mouse, a camera, a microphone, a pointer, a USB, a connection port with an external device, and the like, but the present invention is not limited thereto. The medical image processing apparatus may obtain a medical image of the object through the communication unit 12 and/or the input unit 13 in advance. The memory 14 stores a control program used in the medical image processing apparatus 10 and various data related thereto. For example, the memory 14 may store a previously obtained medical image of an object. In addition, the memory 14 may store medical image data generated by rendering the medical image of the object.
The endoscopic image obtaining unit 15 obtains an endoscopic image of a search area of an object captured by the endoscope 50. The endoscopic image obtaining unit 15 may be connected with the endoscope 50 by wire or wireless to receive an image from the endoscope 50.
The display output unit 16 outputs an image generated according to an embodiment of the present invention. That is, the display output unit 16 may output an augmented reality image together with the endoscopic image of the object as described below. In this case, the augmented reality image may include partial medical image data corresponding to the endoscopic image. The image output by the display output unit 16 may be displayed by the monitor 60 connected to the medical image processing apparatus 10.
The processor 11 of the present invention may execute various commands and programs and process data in the medical image processing apparatus 10. In addition, the processor 11 may control each unit of the preceding medical image processing apparatus 10 and control data transmission and reception between the units.
The medical image processing apparatus 10 illustrated in
The endoscope tracking unit 110 obtains position and direction information of the endoscope 50 that provides an endoscopic image to the medical image processing 10. More specifically, the endoscope tracking unit 110 obtains the position and direction information of the endoscope 50 (e.g., position and direction information of the endoscope camera) based on a medical image data coordinate system of the object. According to an embodiment of the present invention, the endoscope tracking unit 110 may track the position and direction of the endoscope 50 by analyzing the endoscopic image obtained through the endoscopic image obtaining unit 15. Specific embodiments thereof will be described later. Meanwhile, according to another embodiment of the present invention, the endoscope tracking unit 110 may include a separate endoscope tracking device to track the position and direction of the endoscope 50. When a 6 degree of freedom (DOF) tracking device is coupled to the endoscope 50, the endoscope tracking unit 110 may obtain the position and direction information of the endoscope 50 from the tracking device. When the registration process is performed on the position and direction information obtained from the tracking device, the position and direction information of the endoscope 50 in reference to the medical image data coordinate system may be obtained.
Next, the medical image data generator 120 renders a medical image of the object to generate medical image data. As described above, the medical image includes at least one of an X-ray image, a CT image, a PET image, an ultrasound image, and an MRI. According to an embodiment, the medical image data generator 120 may generate medical image data by performing volume rendering on the medical image of the object. In addition, the medical image data generator 120 may generate medical image data by synthesizing the medical image of the object and the user defined auxiliary data and performing volume rendering on the synthesized data. Specific embodiments thereof will be described later.
Next, the partial medical image extractor 130 extracts the partial medical image data to be displayed in augmented reality among the medical image data based on the computed position and direction information of the endoscope 50. More specifically, the partial medical image extractor 130 determines a target area (i.e., field of view) to be displayed in augmented reality among the medical image data based on the position and direction information of the endoscope 50. According to an embodiment of the present invention, the target area may be determined as a view frustum based on a specific focal length, a viewing angle, and a depth of the endoscope 50. Therefore, when the position and direction information of the endoscope 50 in reference to the medical image data coordinate system is obtained by the endoscope tracking unit 110, a target area to be represented in augmented reality within the medical image data may be determined. The partial medical image extractor 130 extracts partial medical image data corresponding to the target area determined as described above.
Next, the augmented reality data generator 140 renders the augmented reality image from the extracted partial medical image data. That is, the augmented reality data generator 140 may compose the partial medical image data with the endoscopic image and provide the partial medical image data as an augmented reality image for the endoscopic image.
Among the information, the viewing angle, focal length, and depth of field follow the fixed specifications of the endoscope lens (i.e., endoscope camera). Therefore, in order to determine a target area to be represented in augmented reality within the medical image data, position and direction information of the endoscope 50 should be obtained in real time.
According to an embodiment of the present invention, the endoscope tracking unit 110 may track the position and direction of the endoscope 50 via a separate endoscope tracking device. However, according to another embodiment of the present invention, the endoscope tracking unit 110 may track the position and direction of the endoscope 50 by comparing the endoscopic image and the medical image data. More specifically, the endoscope tracking unit 110 tracks the position and direction of the endoscope 50 by comparing a normal map based on an endoscopic image with plural candidate normal maps based on medical image data. The normal map maybe represented as two dimensional projection data of surface information of the search area.
Referring to
According to a further embodiment of the present invention, an endoscopic image to which structured light or patterned light is applied may be used to generate a more accurate first normal map Mreal. In this case, the first normal map Mreal is obtained based on the reflection information of the structured light or the patterned light with respect to the search area of the object.
Returning to
The normal map comparator 116 compares the first normal map Mreal obtained from the endoscopic image with the plural second normal maps Mvirtual obtained from the medical image data to determine similarity. The position and direction information of the endoscope 50 in reference to the medical image data may be obtained based on the second normal map Mvirtual with highest similarity as a result of the similarity determination. According to a further embodiment of the present invention, in order to reduce the computing complexity of the similarity measure of the normal map, the normal map comparator 116 may preferentially compare the first normal map Mreal with the second normal maps Mvirtual within a preset range from the position and the direction of the endoscope 50 at a previous time point.
When the position and direction information of the endoscope 50 is obtained, the medical image processing apparatus 10 may extract partial medical image data to be displayed in augmented reality as described above, and render the extracted partial medical image data as an augmented reality image.
Meanwhile, the medical image data to be represented in augmented reality may include various types of data. As described above, the medical image data may be data obtained by performing volume rendering on a medical image such as an X-ray image, a CT image, a PET image, an ultrasound image, and an MRI. According to a further embodiment of the present invention, the medical image data may include an image of a target organ (e.g., brain, eye, lung, heart, etc.) represented in a mesh form after segmentation in a medical image of the object. In addition, the medical image data may further include user defined auxiliary data. The auxiliary data includes planning information such as markers and paths inserted into the medical image before the surgery represented as a mesh. According to an embodiment of the present invention, the medical image processing apparatus 10 may perform volume rendering on the auxiliary data represented in the mesh form together with the medical image without performing surface rendering on it. More specifically, the medical image processing apparatus 10 may generate medical image data for augmented reality by synthesizing the auxiliary data with the medical image and performing volume rendering on the synthesized data.
In order to define the start point and the end point of each ray in the volume rendering, front and the rear face of color cube images with the same size (that is, the pixel size) may be generated. The value obtained at the same position of each of the two generated images becomes the start point and the end point of the ray corresponding to the position. When accumulating the values obtained by performing three-dimensional texture sampling of the medical image with a predetermined interval along with the ray from the start point to the end point, the intended volume rendering result may be obtained. The medical image data generator 120 of the medical image processing apparatus 10 according to an embodiment of the present invention may perform volume rendering and generate medical image data using the preceding method.
The volume renderer 124 receives the medical image of the object, and performs volume rendering on the received medical image to generate medical image data. As described above, the medical image may include at least one of an X-ray image, a CT image, a PET image, an ultrasound image, and an MRI, but the present invention is not limited thereto. According to a further embodiment of the present invention, the volume renderer 124 may perform volume rendering on the user defined auxiliary data as well as the medical image of the object. The auxiliary data may represent arbitrary information whose size and position are defined in reference to a medical image coordinate system such as a path, a critical zone, and the like previously prepared by the user.
In general, the auxiliary data may be defined in the form of a triangle mesh and drawn separately from the medical image and then synthesized. However, according to an exemplary embodiment of the present invention, the volume rendering may be performed after synthesizing previously prepared auxiliary data with the medical image. In order to perform the volume rendering of the auxiliary data together with the medical image, the auxiliary data may be represented as voxels having a predetermined range of values.
In the case of CT, which is the most widely used medical image, the CT values of each component of the human body are shown in Table 1 below. In this case, the unit of each value is Hounsfield Unit (HU).
Data according to digital imaging and communications in medicine (DICOM), which is the medical imaging standard, uses 2 bytes per pixel. Thus, the range of values each pixel can have is 216, ranging from −32768 to 32767. Foreign substances such as implants may be inserted into the human body, but they are substituted with appropriate values during the reconstruction process so that values outside the range of +/−1000 HU are not used in the CT.
Therefore, according to an embodiment of the present invention, the auxiliary data may be represented as a voxel having a value outside the pre-defined HU range. In this case, the pre-defined HU range may be from −1000 HU to +1000 HU, but the present invention is not limited thereto. The HU setting unit 122 may substitute the voxel value corresponding to the position occupied by the auxiliary data in the medical image data with a value outside the range of +/−1000 HU. The volume renderer 124 obtains the voxel data substituted by the value outside the pre-defined HU range from the HU setting unit 122 and performs volume rendering on it together with the medical image. When performing volume rendering of the auxiliary data together with the medical image, the amount of computation required to render additional data included in the medical image may be minimized.
According to a further embodiment of the present invention, the range outside the pre-defined HU range may include the first HU range exceeding the first threshold and the second HU range below the second threshold. In this case, the first threshold may be +1000 HU, and the second threshold may be −1000 HU. The HU setting unit 122 may set a value of the first HU range and a value of the second HU range to represent different types of auxiliary data. For example, the value of the first HU range may represent marker information set by the user, and the value of the second HU range may represent path information. According to another embodiment, the value of the first HU range may represent path information, and the value of the second HU range may represent critical zone information. By representing the auxiliary data as voxels having different ranges of values, the user may easily identify different types of auxiliary data. The above-mentioned classification criteria of the auxiliary data type and the HU range allocation method are illustrative of the present invention, and the present invention is not limited thereto.
First, the communication unit 22 includes a wired/wireless communication module of various protocols for communicating with an external device. The input unit 23 includes various types of interfaces for receiving a user input for the medical image processing apparatus 20. According to an embodiment, the input unit 23 may include a keyboard, a mouse, a camera, a microphone, a pointer, a USB, a connection port with an external device, and the like, but the present invention is not limited thereto. The medical image processing apparatus may obtain a medical image of the object through the communication unit 22 and/or the input unit 23 in advance. The memory 24 stores a control program used in the medical image processing apparatus 10 and various data related thereto. For example, the memory 24 may store a previously obtained medical image of an object. In addition, the memory 24 may store medical image data generated by rendering a medical image of the object.
The position tracking unit 25 obtains position information of the medical navigation device 55 in the object. In the embodiment of the present invention, the medical navigation device 55 may include various kinds of surgical navigation devices. An optical position tracking method or an electromagnetic position tracking method may be used for position tracking of a medical navigation device, but the present invention is not limited thereto. If the position information obtained from the medical navigation device 55 is not matched with the medical image data of the object, the position tracking unit 25 may perform a matching process to generate position information of the medical navigation device 55 in reference to the medical image data. The position tracking unit 25 may be connected to the medical navigation device 55 by wire or wireless to receive position information from the medical navigation device 55.
The display output unit 26 outputs an image generated according to an embodiment of the present invention. That is, the display output unit 26 may output medical image data corresponding to the region of interest with respect to the object as described below. The image output by the display output unit 26 may be displayed by the monitor 65 connected to the medical image processing apparatus 20.
The processor 21 of the present invention may execute various commands or programs and process data in the medical image processing apparatus 20. In addition, the processor 21 may control each unit of the preceding medical image processing apparatus 20 and control data transmission and reception between the units.
The medical image processing apparatus 20 illustrated in
The ROI setting unit 210 sets the ROI of the user with respect to the object. More specifically, the ROI setting unit 210 receives the position information of the medical navigation device 55 from the position tracking unit 25 and sets the ROI based on the position information. According to an embodiment of the present invention, the ROI is set based on an area within a preset distance from the position of the medical navigation device 55 in reference to at least one of the horizontal plane, the sagittal plane, and the coronal plane of the medical image data. As such, the ROI may be set as a three-dimensional region including an area within a preset distance from a plane based on the position of the medical navigation device 55. Therefore, the ROI may be set as a slab having a thickness based on the preset distance. According to an embodiment, the ROI may be set in reference to at least one of the horizontal plane, the sagittal plane, and the coronal plane of the medical image data. To this end, the ROI setting unit 210 may receive in advance, as a user input, information on a preset distance (i.e., area setting information) in reference to each of the horizontal plane, the sagittal plane, and the coronal plane. The ROI setting unit 210 sets an ROI by cropping an area included, from the position of the medical navigation device 55, within the first distance in reference to the horizontal plane, within the second distance in reference to the sagittal plane, and/or within the third distance in reference to the coronal plane. If the user does not input area setting information on at least one reference plane among the horizontal plane, the sagittal plane and the coronal plane, the ROI setting unit 210 may not perform cropping in reference to the plane. The ROI information obtained by the ROI setting unit 210 is transferred to the partial medical image data generator 230.
Next, the medical image data generator 220 renders a medical image of the object to generate medical image data. As described above, the medical image includes at least one of an X-ray image, a CT image, a PET image, an ultrasound image, and an MRI. The medical image data may refer to voxels generated using the medical image of the object. However, the present invention is not limited thereto, and the medical image data may refer to data obtained by volume rendering the medical image of an object.
Next, the partial medical image data generator 230 extracts and renders medical image data of a portion corresponding to the ROI among the medical image data of the object. More specifically, the partial medical image data generator 230 may perform volume rendering by selectively ray casting voxels of the ROI. Accordingly, by preventing objects other than the ROI from overlapping with objects of the ROI within the object, the operator can easily identify the anatomical structure of the object.
According to an embodiment of the present invention, the partial medical image data generator 230 may generate volume rendering data in various ways. According to an embodiment, the partial medical image data generator 230 may generate volume rendering data by performing ray casting on all of the voxels included in the ROI.
According to another embodiment of the present invention, the partial medical image data generator 230 may generate volume rendering data by selectively performing ray casting on voxels having a value within a pre-defined HU range in the ROI. In this case, the pre-defined HU range may be determined based on the CT value of a specific tissue of the object. In addition, the specific tissue for performing the volume rendering may be selected by the user. In this way, volume rendering data may be generated by selectively performing ray casting only on voxels corresponding to a specific tissue selected by a user setting in the ROI.
As explained through Table 1, the range of CT values of each component of a human body is predetermined. If the user wants to selectively check only gray matter in the ROI with respect to the object, the user may input an arbitrary value within the CT value range of −37 to −45 or input a CT value range including the corresponding range through the input unit 23. In addition, the user may input a selection for gray matter among predetermined tissues of the object through the input unit 23. The partial medical image data generator 230 may generate volume rendering data by selectively performing ray casting only on voxels corresponding to the gray matter within the ROI of the object based on the user input.
According to another exemplary embodiment of the present invention, the partial medical image data generator 230 may generate partial medical image data by rendering voxel values of an ROI when light is emitted from a virtual light source at a predetermined point based on the position of the medical navigation device 55. More specifically, the partial medical image data generator 230 may assume that a virtual light source exists at a predetermined point based on the position of the medical navigation device 55, and set voxel values of an ROI when light is emitted from the virtual light source. The partial medical image data generator 230 may generate volume rendering data by performing ray casting on the voxels set as described above. Specific embodiments thereof will be described later.
The partial medical image data generated by the partial medical image data generator 230 may be provided as an output image of the display output unit 26.
Meanwhile, in the above embodiments, it is illustrated that the ROI is set based on the horizontal plane, sagittal plane, and coronal plane of the medical image data, but the present invention is not limited thereto. In the present invention, the ROI may be set with respect to any reference axis or reference plane of the medical image data.
First, each pixel value I(S0,Sn) of the volume rendering data using the general ray casting method may be expressed by Equation 1 below.
Here, S0 denotes the first voxel sampled by ray casting, and Sn denotes the last voxel sampled by ray casting. In addition, Iλ(x) denotes a value of the voxel x (or an intensity of the voxel x), and
denotes a transparency accumulated from the first voxel S0 to the current voxel x. τ(t) denotes an attenuation coefficient of the voxel t.
According to an embodiment of the present invention, it is assumed that a virtual light source exists at a predetermined point P0 based on the position of the medical navigation device 55, and the voxel values of the ROI 30 may be set when the light is emitted from the virtual light source. In this case, the value I′λ(x) of the voxel x may be expressed by Equation 2 below.
I′
λ(x)=Iλ(x)+R(x) [Equation 2]
Here, R(x) is a voxel value adjusted by the light emitted from the virtual light source and may be defined as in Equation 3 below.
Here, Kref denotes a reflection coefficient, P0 denotes a position of the virtual light source, and L denotes a brightness value of the virtual light source at P0, respectively. According to an embodiment of the present invention, the reflection coefficient Kref may be determined as in Equation 4 below.
K
ref=max(G(x)*Vp0→x,0) [Equation 4]
Here, G(x) denotes a gradient vector in the voxel x, and Vp0->x denotes the direction vector from the position P0 of the virtual light source to the voxel x, respectively. According to an embodiment, the gradient vector G(x) may be defined as a normal to a reference plane in which peripheral voxel values change most with respect to the voxel x.
Therefore, according to an embodiment of the present invention, each pixel value I(S0,Sn) of the partial medical image data may be determined based on Equation 5 below.
The partial medical image data generator 230 sets the volume rendering data generated as above as the partial medical image data. According to such an additional embodiment of the present invention, the effect may be as if an illumination is inserted into or around the ROI. When an illumination is inserted into or around the ROI, the stereoscopic effect of the ROI may be maximized due to the shadow effect on the ROI, and the user's identification of the ROI may be increased.
The description of the present invention is used for exemplification and those skilled in the art will be able to understand that the present invention can be easily modified to other detailed forms without changing the technical idea or an essential feature thereof. Thus, it is to be appreciated that the embodiments described above are intended to be illustrative in every sense, and not restrictive. For example, each component described as a single type may be implemented to be distributed and similarly, components described to be distributed may also be implemented in an associated form.
The scope of the present invention is represented by the claims to be described below rather than the detailed description, and it is to be interpreted that the meaning and scope of the claims and all the changes or modified forms derived from the equivalents thereof come within the scope of the present invention.
| Number | Date | Country | |
|---|---|---|---|
| Parent | 16807139 | Mar 2020 | US |
| Child | 17513884 | US | |
| Parent | PCT/KR2017/009541 | Aug 2017 | US |
| Child | 16807139 | US |
