Patent Application
20150164478
This application claims priority under 35 U.S.C. §119 from Korean Patent Application No. 10-2013-0156434, filed on Dec. 16, 2013 in the Korean Intellectual Property Office, the disclosure of which is incorporated herein by reference in its entirety.
1. Field of the Invention
Apparatuses and methods consistent with what is disclosed herein relate to a method of providing medical image analysis, and more specifically, to a method of analyzing blood vessel information in medical images obtained from at least one of various types of diagnosis equipment and providing the analysis result, and an apparatus using the method.
2. Description of the Related Art
Medical images obtained from medical image equipment, such as X-ray, CT, MRI, or ultrasonic wave equipment, are used for a diagnosis purpose in a variety of fields and are also frequently used in performing the medical treatment. A targeting subject and a corresponding method can be usable to perform the purpose of diagnosis or treatment. Bones and blood vessels are usually examined in medical images because they are distributed in most organs of the human body. Specifically, blood vessels are one of most landmarks in view of the anatomy since they are working in various patterns between human bodies or between organs while simultaneously being a center of functional roles for a living subject.
Such anatomic information of blood vessels is directly and indirectly used when medical images for the diagnosis and the treatment are obtained. For example, vector information of blood vessels is used to measure a blood flow rate by using Doppler effects (PW-Doppler). Further, information regarding blood vessel diameters, blood vessel vectors, and blood vessel positions are requested when the blood vessel intervention for treating the blood vessel related diseases is performed. Currently, the above-mentioned information is obtained depending on experienced knowledge or intuitive decision of the practitioners. However, the related information measuring methods may generate inter-observer or intra-observer errors, and cause the diagnosis to take longer time, and give difficulties to build the systematic diagnosis.
Meanwhile, when measuring a blood flow rate by using ultrasonic wave equipment, it is necessary to delete an aliasing area generated by a frequency variation and setting a region of interest (ROI) in addition to measuring a blood vessel. The ‘aliasing’ indicates an area which is expressed differently from a surrounded blood flow area due to a blocking section of blood vessels when image display equipment displays blood vessels by using ultrasonic waves. The ‘aliasing’ is such a phenomenon in which bandwidths of Doppler spectrum are shifted because of a frequency variation and is expressed in different areas from surrounded blood flow areas on medical images.
One of the related technologies to delete aliasing is to shift a base line. This method is performed in a Doppler spectrum area and has a disadvantage in that aliasing cannot be directly deleted from a medical image. If it is possible to determine an aliasing area and restore the aliasing area to a blood vessel area, it may require complicated image processing and longer processing time.
Further, when setting an ROI, a user directly designates the ROI using the related technology. Passive setting by humans deteriorates reproducibility, and has a disadvantage of a longer diagnostic time. Whenever the ROI is set by a user, the result may vary according to a user preference or error.
There may be methods usable to measure blood vessel information. One method is to detect outer edges of blood vessels with an image processing and to estimate the blood vessels with the detected outer edges, and another method is to estimate vectors of blood vessels by fitting blood flow components expressed in C-mode images generated by ultrasonic waves. These related methods may have problems. First, regarding the method to detect outer edges, B-mode images of ultrasonic waves are generally used; B-mode images may have a lower SNR (signal versus noise or a signal-to-noise ratio), lower clarity in images, and vagueness in determining blood vessel components among the detected outer edge components. Further, the fitting method to use blood vessel components in C-mode images may have a problem in that vectors of blood vessels are estimated on a wrong direction when blood flow signals (color information) constituting C-mode images are insufficient. Lastly, all the related method to measure blood vessel information are developed for considering a case that there is one blood vessel in an ROI. Thus, when there are a plurality of blood vessels, the related methods have disadvantages in that information cannot be measured because they distinguish one blood vessel from the various blood vessels and selectively recognize the blood vessel.
Further, when treatment involves use of blood vessel intervention, angiography is applied so that a medical practitioner proceeds the treatment, while directly viewing blood vessel angiographic images with his eyes. A medical practitioner moves a catheter to a lesion while viewing two-dimensional images at real time. Thus, a treatment time varies depending on experience and skill of a medical practitioner because of the above described process. Increasing the medical treatment time may lead to increasing radioactive exposure and additional injecting a contrast agent. A conventional method is just for providing positions of the catheter regarding the technology to provide information for the blood vessel intervention.
Further, when performing a bimodality image registration between different types of medical image equipment, indicators such as bifurcation and crossover of blood vessels are used as landmarks in view of blood vessels. Images having insufficiency for these indicators may have a problem in that blood vessels cannot be indicators for the registration.
The present general inventive concept provides a method of providing blood vessel analysis information to automatically set a region of interest (ROI) and an apparatus configured to provide blood vessel analysis information to display an image of a human body by using a ultrasonicwave.
The present general inventive concept also provides a method of providing blood vessel analysis information that can detect a diameter and an of a blood vessel regarding an ROI precisely even when there are one or more blood vessels, and an apparatus configured to provide blood vessel analysis information thereof.
The present general inventive concept also provides a method of providing blood vessel analysis information that can detect and interpolate an aliasing area more precisely in a blood vessel image and an apparatus thereof.
Additional features and utilities of the present general inventive concept will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the general inventive concept.
The foregoing and/or other features and utilities of the present general inventive concept may be achieved by providing a method of providing blood vessel analysis information, the method including emitting an ultrasonic signal on a body portion corresponding to a blood vessel and sensing a reflected ultrasonic signal, generating a color mode image by using the sensed ultrasonic signal, and determining a diameter of the blood vessel based on one or more pixel values of the generated color mode image. The determining the diameter of the blood vessel may include determining a shortest distance of a blood flow area as the diameter of the blood vessel, by comparing one or more profile values regarding the pixel values on one or more virtual lines crossing over the blood vessel in the generated color mode image.
The method may further include emitting and sensing a ultrasonic wave, generating a color mode image, and determining an angle of a blood vessel based on one or more pixel values of the generated color mode image.
The method may further include determining an angle of the blood vessel based on the one or more pixel values on one or more virtual lines crossing over the determined diameter.
The determining angles of the blood vessels may include adding one or more pixel values on a plurality of virtual lines crossing over the determined diameter according to a corresponding sliding angle from a horizontal plane, and determining an angle of the blood vessel based on the sliding angles regarding the plurality of virtual lines and the smallest value of the added pixel values.
The method may further include emitting and sensing a ultrasonic signal, generating a color mode image, and establishing an ROI regarding one or more portions of the generated color mode image. Further, the method may further include detecting an aliasing area whose one or more pixel values are out of a preset pixel value in a blood flow area of the ROI, determining a diameter of the blood vessel based on one or more pixel values of an ROI image, and determining an angle of the blood vessel based on one or more pixel values on one or more virtual lines crossing over the determined diameter.
The establishing the ROI may include establishing the ROI on a previously established position of the generated color mode image, and adjusting the ROI so that a center coordinate thereof is approached to a center coordinate of a blood flow, when a center coordinate of the ROI is out of a preset range from the center coordinate of the blood flow in the generated color mode image.
Further, the method may be performed on the ROI established regarding one or more portions of the generated color mode image, and the ROI may be newly established as a next or new ROI based on the determined angle of the blood vessel when image processing regarding the ROI completes.
Further, the detecting the aliasing area may include detecting the aliasing area by further considering a histogram of the generated color mode image.
Further, the detecting the aliasing area may include performing a labeling operation in each section of the generated color mode image according to one or more pixel values of the generated color mode image, performing a clustering operation regarding the labeled section based on one or more pixel values of the generated color mode image, determining the aliasing area based on a result of the clustering operation, and interpolating the determined aliasing area.
The determining the aliasing area may include determining the labeled section as the aliasing area when there are more than two clustering areas within one labeled section.
The foregoing and/or other features and utilities of the present general inventive concept may be achieved by providing a computer-readable medium containing computer-readable codes as a program to perform a method described above or hereinafter.
The foregoing and/or other features and utilities of the present general inventive concept may be achieved by providing an apparatus to provide blood vessel analysis information, the apparatus including a display, an ultrasonic transmitter and receiver configured to emit an ultrasonic signal on an object and sense a reflecting ultrasonic signal, and a controller configured to generate a color mode image by using the reflecting ultrasonic signal and determine a diameter of a blood vessel based on one or more pixel values of the generated color mode image.
The controller may determine a shortest distance of a blood flow area as a diameter of the blood vessel by comparing one or more profile values regarding one or more pixel values on one or more virtual lines crossing over the blood vessel in the generated color mode image.
The controller may determine an angle of the blood vessel based on one or more pixel values of one or more virtual lines crossing over the determined diameter.
The controller may add one or more pixel values on a plurality of virtual lines crossing over the determined diameter according to a corresponding sliding angle from a horizontal plane, and determine the angle of the blood vessel based on sliding angles regarding a plurality of virtual lines and the smallest value of the added pixel values.
The controller may establish an ROI having an image regarding a center of the blood vessel in one or more portions of the generated color mode image, and performs image processing regarding the ROI.
The controller may establish the ROI on a previously established position of the generated color mode image, and adjust the ROI so that a center coordinate thereof is approached to a center coordinate of a blood flow when a center coordinate of the ROI is out of a preset range from the center coordinate of the blood flow in the generated color mode image.
The controller may operate regarding the ROI established on one or more portions of the generated color mode image, and a newly establish ROI based on the determined angle of the blood vessel when image processing regarding the ROI completes.
The controller may distinguish a blood flow area based on one or more pixel values of the generated color mode image and detect an aliasing area whose pixel values are out of a preset pixel value in the distinguished blood flow area.
The controller may detect the aliasing area by further considering a histogram of the generated color mode image.
The controller may perform a labeling operation on each section of the generated color mode image according to one or more pixel values of the generated color mode image, perform a clustering operation regarding the labeled sections based on one or more pixel values of the generated color mode image, determine an aliasing area based on a result of the clustering operation, and interpolate the determined aliasing area.
Further, when there are more than two clustering areas within one labeled section, the controller may determine the labeled section to be an aliasing area.
The foregoing and/or other features and utilities of the present general inventive concept may be achieved by providing a method or apparatus to provide blood vessel analysis information to automatically establish an ROI to display a body image with a ultrasonic wave.
The foregoing and/or other features and utilities of the present general inventive concept may be achieved by providing a method or apparatus to provide blood vessel analysis information to detect a diameter and/or an angle of a blood vessel in an ROI precisely even when there are one or more blood vessels.
The foregoing and/or other features and utilities of the present general inventive concept may be achieved by providing a method or apparatus to provide blood vessel analysis information to detect and interpolate an aliasing area precisely in a blood vessel image.
The foregoing and/or other features and utilities of the present general inventive concept may be achieved by providing a method or apparatus to provide a non-transitory computer-readable medium to contain computer-readable codes as a program to execute a method described above or hereinafter.
The foregoing and/or other features and utilities of the present general inventive concept may be achieved by providing a method or apparatus to provide a method of providing blood vessel analysis information, the method including receiving a signal reflected from a body portion, displaying a color mode image on a screen of a display according to the received signal, and automatically outputting a diameter of the blood vessel according to a determination based on one or more pixel values of the generated color mode image.
The outputting the diameter of the blood vessel may include displaying the diameter over the color mode image on the screen of the display.
The method may further include automatically displaying a region of interest on the screen of the display according to information on a blood flow of the blood vessel.
The method may further include generating a new region of interest along the blood vessel according to a portion of the image corresponding to an external catheter.
The method may further include automatically displaying one or more region of interests each with at least one of a diameter and an angle of the blood vessel to correspond to the displayed region of interest.
The method may further include automatically displaying at least one angle of the blood vessel according to the pixel values of virtual lines passing an area corresponding to the diameter.
The method may further include automatically displaying an aliasing area with interpolated data using adjacent area of the blood vessel.
The foregoing and/or other features and utilities of the present general inventive concept may be achieved by providing a method or apparatus to provide an apparatus to provide blood vessel analysis information, the apparatus including a receiver configured to receive a signal reflected from a body portion, and a controller configured to generate a color mode image according to the received signal, to display the color mode image on a screen of a display, to determine a diameter of a blood vessel based on one or more pixel values of the generated color mode image, and to display the determined diameter on the screen of the display.
The controller may control the display to display the diameter of the blood vessel on the image included in the screen of display.
The controller may control the display to automatically display a region of interest on the screen of the display according to information on a blood flow of the blood vessel.
The controller may automatically generate and display a new region of interest along the blood vessel according to a portion of the image corresponding to an external catheter.
The controller may sequentially display one or more region of interests each with a diameter and an angle of the blood vessel to correspond to the displayed region of interest.
The controller may automatically generate and display at least one angle of the blood vessel according to the pixel values of virtual lines passing an area corresponding to the diameter.
The controller may automatically determine and display an aliasing area with interpolated data using adjacent area of the blood vessel.
The above and/or other features and utilities of the present general inventive concept will be more apparent by describing certain exemplary embodiments of the present inventive concept with reference to the accompanying drawings, in which:
Reference will now be made in detail to the embodiments of the present general inventive concept, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout. The embodiments are described below in order to explain the present general inventive concept while referring to the figures.
The matters defined in the description, such as detailed construction and elements, are provided to assist in a comprehensive understanding of the present inventive concept. Accordingly, it is apparent that the exemplary embodiments of the present inventive concept can be carried out without those specifically defined matters. Also, well-known functions or constructions are not described in detail since they would obscure the invention with unnecessary detail.
Referring to
The ultrasonic transmitter and receiver 110 is a unit to emit an ultrasonic signal on a portion of a human body corresponding to a flow of a blood vessel flow and to sense an ultrasonic echo signal reflecting from the portion of a human body. For the above, the ultrasonic transmitter and receiver 110 may include a probe constituted with a transducer including a vibrator and a tuning coil to sense the ultrasonic echo signal. Further, the ultrasonic transmitter and receiver 110 may include an analogue/digital converter and a signal processor to process the received signal.
The display 130 is provided to display one or more images processed by the controller 120. The display 130 may include various display panels. Thus, the display 130 may be implemented to be various display technologies such as organic light emitting diodes (OLED), liquid crystal display panel (LCD panel), plasma display panel (PDP), vacuum fluorescent display (VFD), field emission display (FED), and electro luminescence display (ELD). The display panel may be an emitting type; however, a reflecting type (E-ink, P-ink, photonic crystal) may be used as the display panel. Further, the display panel may be a flexible display or a transparent display, and it may include a plurality of display panels. The present general inventive concept is not limited thereto. It is possible that a touch panel can be usable as the display 130 to display an image through a screen thereof and to receive a user input from a user through the screen to control a function of the apparatus 100.
The controller 120 controls overall operations of the blood vessel analysis information providing apparatus 100.
The controller 120 may include hardware constituted of a micro processing unit (MPU) or a central processing unit (CPU), a cache memory, and a data bus, and software (program) constituted of an operating system and one or more applications to perform corresponding purposes. One or more controlling commands regarding each unit for the operation of the blood vessel analysis information providing apparatus 100 are read in a memory according to a system clock, an electrical signal is generated according to the read controlling commands to operate a corresponding unit of the hardware.
The controller 120 controls an ultrasonic trans-receiving operation of the ultrasonic transmitter and receiver 110. Further, when an ultrasonic signal reflected from one or more portions of a human body is received, the controller 120 generates a B-mode image having black and white signals or a C-mode (color mode) image by using the received signal.
The B-mode (Brightness-mode) image is an image corresponding to a portion of a human body where the ultrasonic waves are emitted in black and white by using an ultrasonic echo signal reflecting from the portion of the human body. When a distance from the portion of a human body is represented on a horizontal axis and a width of the reflected echo signal is represented on a vertical axis, the width may be substituted and expressed with brightness of dots. The B-mode image may be constituted of a black and white image.
The C-mode (color Doppler mode) image is an image corresponding to a portion of a human body where the ultrasonic wave is emitted in one or more colors by using the ultrasonic echo signal reflected from the portion of a human body. The controller 120 may measure a blood flow rate by calculating one or more variant frequencies when the ultrasonic echo signal is received and the frequency variations occur due to Doppler effects. Further, the C-mode image may be constituted by using the above described components.
The controller 120 selects one or more pixels, for example, m×n pixels surrounded a range gate of a Doppler beam. The m×n pixels may be selected by a user input or by covering a range including all of upper and the lower edges after automatically searching the upper and lower edges of a blood vessel wall. At this process, the blood vessel wall may be detected by using edge detection algorithm or homogeneity detection algorithm. Further, an ROI (region of interest) designating method which will be described below may be used.
Referring to
The controller 120 may measure a diameter and/or an angle of a blood vessel based on one or more pixel values of the generated color mode image.
Referring to
Thus, a new image generated by combining the B-mode image and the C-mode image. This method may compensate for a disadvantage that the B-mode image and/or the C-mode image may have. It may be difficult to find a visible boundary due to noise even though an anatomical boundary of a blood vessel and a surrounded organ cell can be viewed in the B-mode image. Further, color information may be insufficient even though a relative velocity of a blood flow can be viewed in the C-mode image. The blood vessel information is estimated by minimizing noise that can occur in the B-mode image and/or the C-mode image by using the reconstituted image.
Newly reconstituted image information may be calculated according to a following mathematical formula.
I
f-image(i,j)=α*Nb-image(i,j)+β*Nc-image(i,j)
where If-image is a reconstituted image (fusion image),
Nb-image, Nc-image are normalized B-mode and C-mode images,
α, β are a weight factor, and
(i,j) is a pixel position when an image size is m*n (0≧i≧m, 0≧j≧n)
For more efficient calculation, image reconstituting may be performed only on an ROI which will be described below.
The controller 120 may determine a diameter (distance) of the blood vessel having a shortest blood flow area profile value as the diameter of the above blood vessel by comparing profile values of blood flow areas regarding one or more virtual lines crossing over one or more random pixels of the blood vessel. Herein, the profile values of the blood flow areas indicate adding one or more values of consecutive pixel values corresponding to the blood flow areas.
In the C-mode image or the reconstituted image, pixel values on a plurality of virtual lines crossing over the blood vessel may distinguish the blood flow areas and other areas based on a preset threshold. The blood flow areas are expressed in different values compared to other areas because of a blood flow rate. Therefore, the profile values may be constituted of the pixel values. At this process, a shortest line disposed on an area whose profile value corresponds to at least one of the blood flow areas may be determined as a traverse line RD disposed orthogonal to the blood vessel. Further, a length of the profile value area having the shortest line of the traverse line RD becomes a diameter D of the blood vessel as illustrated in
When an ROI is set, a diameter of the blood vessel (ΔV) is measured in a range gate which is a center coordinate of the blood flow in the ROI.
Next, the controller 120 determines an angle Aa of the blood vessel in a direction Ar with respect to a reference line, for example, a horizontal line RH perpendicular to a vertical line RV, as illustrated in
At this process, as illustrated in a view A of
NVR∝ΔV/λ
where λ is a width between a plurality of virtual lines.
Thus, the number of virtual lines is inverse proportional to the width (or gap) of the adjacent virtual lines.
A plurality of virtual lines having various angles crossing over the diameter may be considered to determine an angle of the blood vessel. A view B of
At this process, the controller 120 may add one or more pixel values regarding a plurality of virtual lines crossing over the determined diameter according to a sliding angle from a horizontal plane. In a view A of
A representative value can be defined by mathematically formulizing the above described values or components. Thus, the controller 120 may calculate a representative value regarding a plurality of virtual lines 43 crossing over a center Cd of the determined diameter D according to corresponding sliding angles θ from a horizontal plane H. A representative value is defined by a following mathematical formula.
E(θ)=ΣNVRi=1(Li
where E(θ) is a representative value regarding a plurality of virtual lines having a sliding angle (θ) from the horizontal plane,
NVR is the number of virtual lines having a sliding angle (θ) from the horizontal plane,
Li
Li
Further, when the slinding angle among angles of the plurality of virtual lines with respect to the horizontal plane has a smallest calculated representative value, the controller 120 determines the sliding angle of the virtual line as an angle of the blood vessel. The horizontal plane is disposed between boundary walls of the blood vessel displayed on a screen of a display.
The following will explain a method of setting an ROI.
Referring to
The controller 120 establishes an ROI regarding a previously established position of the generated color mode image. Further, the controller 120 determines whether a center coordinate value of an ROI is out of a center coordinate value of a blood flow in the generated color mode image. If the center coordinate value of the ROI is within a previously established range from or similar to the center coordinate value of the blood flow, image processing may be performed. However, if the center coordinate value of the ROI is out of the previously established position from the center coordinate value of the blood flow in the generated color mode image, the ROI is adjusted so that the center coordinate value of the ROI is approached to the center coordinate value of the blood flow.
In a view A of
ROIs may be different according to clinical determining standards and corresponding diseases. Further, ROIs may be different according to a health condition, age, food digesting status, body condition, or body portion of a patient.
A location or a dimension (area) of an ROI may be set automatically or manually according to a user preference or design or may be adjusted according to a corresponding usage or a characteristic of the ROI and/or the image. The characteristic may be a resolution, color or outline.
The controller 120 may control the display 130 to display the views A, B, and/or C of
A center position of the ROI may correspond to a center of an image screen (or a displayed image) as illustrated in the view A of
It is also possible that the controller 120 may perform an adjusting process to move the center position of the blood flow to correspond to the center position of the ROI when the ROI is disposed in a center area of the image, rather than adjusting the position of the ROI. In this case, the controller 120 perform an adjusting process to adjust the image so that the center position of the blood flow can correspond to the center position of the ROI without moving the position of the ROI. Also the controller 120 may not have to perform the another adjusting process to change the centers of the ROI and the blood flow to correspond to the center area of the image.
When image processing regarding the established ROI completes, a next ROI may be set and image processing may be performed.
In order to move the initial ROI to a next ROI (or generate a next ROI) for image-processing after image processing regarding the established ROI, the controller 120 may perform a process to establish the new ROI based on the determined angle of a blood vessel described above.
The controller 120 may set absolute or relative locations of the ROIs according to a user preference or corresponding usage. The dimensions (areas) of the ROIs may be the same or may be differently set according to a user preference or corresponding usage. The initial ROI and one or more ROIs may be sequentially displayed on an image screen of the display 130 according to the respective process to set a new ROI. All of the ROIs may be simultaneously displayed when a last ROI is set. The ROIs may overlap depending on the positions and dimensions thereof. The ROIs may be superimposed. Only a currently set (established or generated) ROI may be displayed with highlight or emphasis on the displayed image. The ROI may have different brightness or different boundary lines (outlines) with different thicknesses from other ROIs although
The following will explain an embodiment of detecting an aliasing area and interpolating an image thereof.
The controller 120 may distinguish blood flow areas based on pixel values of a generated color mode image. Further, a reconstituted image can be usable to distinguish the blood flow areas as described above. The controller 120 detects one or more aliasing areas that are out of a preset pixel value on one or more blood flow areas. Pixel values of the blood flow areas may be differently established according to a blood flow rate; however, a pixel value may be higher than a critical value of a blood flow rate on a blood flow area. That is, a blocking section may be observed or detected because there may be an exterior material in a blood vessel, or noise may occur due to other reasons. Such a blocking section may be referred to as an aliasing area to be detected and interpolated. The aliasing area has a phenomenon in which a pixel value is shifted to a certain value higher than the critical value due to a bias, not by a value of a blood flow rate.
Referring to
However, since there may be various reasons why aliasing areas appear, it is necessary to determine whether the interpolating is requested because simple noise may causes aliasing.
A view A-1 of
Referring to a view B-1of
When an aliasing area is detected, a following algorithm can be considered. First, the controller 120 performs a labeling operation on each section regarding the generated color mode images according to pixel values of the generated color mode image. The labeling operation is performed to assign a same label to consecutive pixels and different labels to other components (pixels). Further, the controller 120 performs a clustering operation on the labeled sections based on the pixel values of the generated color mode image. Next, an aliasing area is determined based on a result of the clustering operation. At this process, where there are more than two clustering areas within one labeled section, the labeled section may be determined as an aliasing area. The controller 120 interpolates the determined aliasing area using the pixel values of the adjacent area.
Meanwhile, a blood vessel may be connected in a consecutive vessel shape, not an independent spot shape. Thus, a small spot size of a label is considered to be noise and removed. The labels remaining after removing a noise component are all the components constituting one or more blood vessels. Velocity distribution is calculated by performing the clustering operation based on color information (blood flow rate) in each label.
Referring to
Referring to
The method may further include determining one or more angles of the blood vessel based on one or more pixel values on virtual lines crossing over the corresponding diameters at operation S1040.
Herein, the operation S1040 of determining the angle of the blood vessel may include adding pixel values on a plurality of virtual lines crossing over the determined diameter according to a sliding angle from a horizontal plane and determining the angle of the blood vessel based on one or more sliding angles regarding a plurality of virtual lines and the smallest value of the added pixel values. The one or more angles of the blood vessel may be displayed on a screen thereof according to a control signal of the controller 120. Since one or more angles can be obtained according to a shape of the blood vessel, the angles may be displayed at corresponding positions of the blood vessel on a screen of the display 130 when the controller 120 determines the corresponding angles.
Referring to
The operation S1130 of setting the ROI may include setting the ROI on a previously established position of the generated color mode image, and adjusting the ROI so that a center coordinate value of the ROI is approached to the center coordinate value of a blood flow when the center coordinate value of the ROI is out of a previously established range from the center coordinate value of the blood flow in the generated color mode image.
Further, the method of providing the blood vessel analysis information may be performed on the ROI established corresponding to a portion of the generated color mode image. When image processing regarding the ROI completes, a next ROI may be newly established based on the determined angle of the blood vessel.
Further, the operation S1140 of detecting the aliasing area may include detecting the aliasing area by additionally considering a histogram of the generated color mode image.
Further, the operation S1140 of detecting the aliasing area may include performing the labeling operation in each section of the generated color mode image according to pixel values of the generated color mode image, performing the clustering operation on the labeled sections based on pixel values of the generated color mode image, determining the aliasing area based on a result of the clustering operation, and interpolating the determined aliasing area. The aliasing area is adjusted or changed to or is replaced with an interpolated area having interpolaged pixel values (data) to be displayed together with adjacent areas of the blood vessel on a screen of the display 130 when the controller 120 performs the interpolating operation.
The operation S1140 of determining the aliasing area may include determining the labeled section as the aliasing area when there are more than two clustering areas within one labeled section.
The present general inventive concept can also be embodied as computer-readable codes on a computer-readable medium. The computer-readable medium can include a computer-readable recording medium and a computer-readable transmission medium. The computer-readable recording medium is any data storage device that can store data as a program which can be thereafter read by a computer system. Examples of the computer-readable recording medium include a semiconductor memory, a read-only memory (ROM), a random-access memory (RAM), a USB memory, a memory card, a blue-ray disc, CD or DVD-ROMs, magnetic tapes, floppy disks, and optical data storage devices. The computer-readable recording medium can also be distributed over network coupled computer systems so that the computer-readable code is stored and executed in a distributed fashion. The computer-readable transmission medium can transmit carrier waves or signals (e.g., wired or wireless data transmission through the Internet). Also, functional programs, codes, and code segments to accomplish the present general inventive concept can be easily construed by programmers skilled in the art to which the present general inventive concept pertains.
Further, the above described method of providing the blood vessel analysis information may be architected in embedded software type or firmware type, and provided in any one of a CISC (complex instruction set computer) chip, an RISC (reduced instruction set computer) chip, and a bit slice MPU (micro processing unit).
The blood vessel analysis information providing apparatus 100 may be implemented to be a pulse wave Doppler ultrasonic diagnostic apparatus.
The ultrasonic diagnostic apparatus 200 may include an ultrasonic transmitter and receiver 210 including a probe 211, a controller 220, a display 230, and a body; it may also include other additional units. Thus, it may further include a key input unit including various keys for various user settings in the ultrasonic diagnosis, and other various user interfaces 250. The ultrasonic transmitter and receiver 210, the controller 220, and the display 230 of the ultrasonic diagnostic apparatus 200 may correspond to the ultrasonic transmitter and receiver 110, the controller 120, and the display 130 of the blood vessel analysis information providing apparatus 100 illustrated in
A user, for example, a diagnostician or medical doctor, may contact the probe 211 of the ultrasonic diagnostic apparatus 200 on a body portion to obtain blood vessel analysis information and drive the ultrasonic diagnostic apparatus 200. According to a setting operation performed by a user with a user input, at least one or a combination of a B-mode image and a C-mode image is generated and displayed on the display 230. The ultrasonic diagnostic apparatus 200 may have a unit to support a Doppler spectrum image. In this case, the display 230 displays the Doppler spectrum image as well as the B-mode or C-mode image.
The controller 220 may set an ROI regarding one or more portions of the generated color mode image. As described above, ROI indicates a body part for the purpose of emitting ultrasonic waves.
The controller 220 may set an ROI in the generated color mode image from a position of a body portion in which the diagnostician performs an initial operation to control or contact the probe. Further, the controller 220 determines whether a center coordinate value of an ROI is out of a preset range from center coordinate values of a blood flow in the generated color mode image. If the center coordinate value of the ROI is within the preset range, or similar to the center coordinate value of the blood flow, image processing may be performed. However, when a diagnostician controls the probe to be randomly disposed on a body portion and a center position of the probe is out of a blood vessel as illustrated in a view A of
However, as explained in the embodiment of the above described blood vessel analysis information providing apparatus 100, characteristics of ROIs can be different from each other according to clinical determining standards or preferences with respect to medical disease treatments. Further, when a signal to finish the diagnosis on an ROI is inputted automatically or by a user, a next ROI may be automatically established according to the above same method.
The ultrasonic diagnostic apparatus 200 may measure one or more diameters and one or more angles of a corresponding blood vessel regarding an ROI based on one r more pixel values of a color mode image likewise in the blood vessel analysis information providing apparatus 100 as illustrated in a view D of
The controller 220 determines the diameter of the blood vessel based on the pixel values of the color mode image. The controller 220 may also consider the generated C-mode image and B-mode image together. In this case, a new image is generated by combining the B-mode image and the C-mode image. Although an anatomical boundary of a blood vessel and a surrounding organ cell can be observed in the B-mode image, a boundary may be difficult to be viewed by a user due to at least a noise. Although a relative velocity of a blood flow can be observed or detected in the C-mode image, color information may be insufficient to show (or display) the boundary to a user. According to an embodiment, noise that may occur in the B-mode and C-mode images can be minimized, by using a reconstituted image, and blood vessel information can be estimated and generated. The angle and diameter may be informed to a user with respect to an ROI using a visual image displayed on a display or an audio signal generated from an audio unit or speaker (not illustrated) of the ultrasonic diagnostic apparatus 200 according to a user design or preference.
Newly reconstituted image information may be calculated according to a following mathematical formula.
I
f-image(i,j)=α*Nb-image(i,j)+β*Nc-image(i,j)
where If-image is an reconstituted image (fusion image),
Nb-image and Nc-image are normalized B-mode and C-mode images,
α and β are a weight factor, and
(i,j) is a pixel position where an image size is m*n (0≦i≦m, 0≦j≦n).
For more efficient calculation, image reconstituting may be performed only on an ROI which will be described below.
The controller 220 may determine a width (distance or gap) of a blood vessel on lines having a shortest profile value of a blood flow area as a diameter of the blood vessel by comparing one or more profile values of the blood flow area regarding virtual lines crossing over one or more random pixels of the blood vessel in the generated color mode image. Herein, the one or more profile values of the blood flow area indicate a value generated by adding values of consecutive pixels which indicate the blood flow area.
In the C-mode image or the reconstituted image, one or more pixels values on a plurality of virtual lines crossing over a blood vessel may distinguish a blood flow area and other areas based on a preset threshold value. The blood flow area may be expressed in different values from other areas because of a blood flow rate. Thus, the profile values may be constituted based on these pixel values. At this process, the shortest line on one area whose profile values correspond to a blood flow area may be determined as a traverse line disposed orthogonal to the blood vessel. Further, a length of the profile value area becomes a diameter of the blood vessel.
Further, the controller 220 may determine one or more angles of a blood vessel. The controller 220 determines the angles of the blood vessel based on one or more pixel values on a plurality of virtual lines crossing over the determined diameter. At this process, a plurality of virtual lines crossing over the diameter may be considered in determining or calculating the angle. The above virtual lines are vectors of the blood vessel, and angles of the virtual lines from a horizontal plane become angles of the blood vessel. A plurality of virtual lines crossing over a diameter of a blood vessel can be considered. If the number of virtual lines is NVR, NVR and the determined diameter ΔV satisfies a following relation.
NVR∝ΔV/λ
where λ is a width between a plurality of virtual lines.
Thus, the number of virtual lines is inverse proportional to the width of the virtual lines.
A plurality of virtual lines having various angles crossing over the diameter may be considered. Herein, a width of each virtual line may be generated by having a width of k° from −180° to 180°. As a k value is smaller, a resolution of the calculated angle may be greater; however, a too much small k value deteriorates a calculating speed. Herein, k may be used to be 1°, and can be managed (or set) automatically or manually according to performance of detecting angles.
At this process, the controller 220 may add pixel values regarding a plurality of virtual lines crossing over the determined diameter according to a sliding angle from the horizontal plane. It may add pixel values of virtual lines having the same angle and crossing over the diameter. Further, the controller 220 may determine an angle of a blood vessel based on sliding angles regarding a plurality of virtual lines and the smallest value among the added values of the pixel values. For example, if a result of adding the pixel values on virtual lines crossing over the diameter and having a small angle from the horizontal plane is less than a result of adding the pixel values on virtual lines crossing over the diameter and having different angles as illustrated in
A representative value can be defined by mathematically formulizing the above. Thus, the controller 220 may calculate a representative value regarding a plurality of virtual lines crossing over the determined diameter according to sliding angles from the horizontal plane. A representative value is defined by a following mathematical formula.
E(θ)=ΣNVRi=1(Li
where E(θ) is a representative value regarding a plurality of virtual lines having a sliding angle from the horizontal plane, θ,
NVR is the number of virtual lines having a sliding angle from the horizontal plane, θ,
Li
Li
Further, the controller 220 determines each sliding angle from the horizontal plane regarding a plurality of virtual lines and determines the sliding angle of the virtual line having the smallest calculated representative value as an angle of the blood vessel.
The ultrasonic diagnostic apparatus 200 according to an embodiment may calculate diameters and angles of blood vessels according to the above described method as illustrated in a view E of
Further, the ultrasonic diagnostic apparatus 200 may detect and interpolate one or more aliasing areas.
As explained above, an aliasing area indicates an area where there are pixel values more than a critical value of a blood flow rate in a blood flow area. An aliasing area may appear when a blocking section is viewed due to an exterior material of a blood vessel or when noise occurs due to other reasons. An aliasing area is a phenomenon in which pixel values are shifted to a certain level from a normal level due to a bias, not a value of a blood flow rate.
The controller 220 of the ultrasonic diagnostic apparatus 200 performs the labeling operation on each section regarding the color mode image according to pixel values of the generated color mode image. The controller 220 performs the clustering operation regarding the labeled section based on pixel values of the color mode image. Further, an aliasing area is determined based on a result of the clustering operation. At this process, when there are more than two clustering areas within one labeled section, the labeled section may be determined as an aliasing area. The controller 220 interpolates the determined aliasing area using pixel values of one or more adjacent areas.
Meanwhile, a blood vessel is usually connected (extended) to have a consecutive vessel shape, not an independent spot shape. Thus, a small spot size of a label is considered to be noise and removed. The labels remaining after noise components are removed are all the components constituting a blood vessel. Velocity distribution is calculated by performing the clustering operation based on color information (blood flow rate) in each label.
Further, the controller 220 controls the display 230 to display blood vessel information in which an aliasing area is removed.
A view A of
A blood vessel angiographic image apparatus will be explained hereinafter.
A blood vessel intervention is a medical treatment to make a small hole on a skin portion, insert a catheter or a medical induced steel wire directly through the small hole of the skin portion, and observe one or more blood vessels with the image display apparatus, and perform the corresponding treatment, which is usable to cure various blood vessel related diseases. When the intervention is performed, a practitioner performs a corresponding operation while observing a blood vessel within a body at real time. Generally, observing blood vessels with a non-invasive method is called as angiography. The angiography is usable to check progression before and after diagnosis and treatment in addition to an operation of the intervention.
MRI, CT, ultrasound and X-ray may be usable for a method for the angiography to observe blood vessels within a body. Each method may have one or more different characteristics from other methods; The MRI and CT are used for a precise diagnosis of a blood vessel, and The X-ray and ultrasound are used for a treatment involving the intervention and observance on a blood vessel at real time.
When the intervention is performed, the angiography is used by injecting a contrast agent into a blood vessel within a body and photographing one or more X-ray images. The blood vessel may not be observed or determined from an image using a conventional X-ray photographing method; however, when the contrast agent is injected into a blood vessel, a clear blood vessel image may be obtained.
As illustrated in
The blood vessel angiographic image providing apparatus is provided to detect and recognize one or more blood vessels in the image, track the recognized blood vessels, determining diameters, angles, crossovers, and bifurcations regarding the blood vessels, and providing the images thereof when performing the intervention to use blood vessel information with the X-ray. Further, moving paths from the inserting position of the catheter to the lesion position may be determined by using the obtained blood vessel information.
Referring to
A user (operator) establishes an inserting position of a catheter and a lesion position when viewing a blood vessel angiographic image displayed on the display 330. The two positions established by a user become a start and an end of a moving path of the catheter.
The above setting can be performed with the user interface 350. The setting method may be implemented to be various types such as clicking a screen with a mouse and directly touching the screen with a finger or a pen unit.
The established two positions may be expressed in a format which can be visually recognized in the displayed blood vessel angiographic image. For example, a moving path of the catheter may be highlighted and displayed so as to be more clearly visible in
A clinician inserts the catheter on the position near to the lesion position and injects a contrast agent. Further, when the blood vessel is clearly viewed from the blood vessel angiographic image, a clinician views the image, moves the catheter to the lesion position, and continues to make an operation.
When the contrast agent is injected on a specific position of a blood vessel, it flows through blood vessels because of blood circulation. Such a contrast agent has characteristics to block an X-ray. Thus, the blood vessels are expressed more clearly in an image. The contrast agent performs its role when staying in the blood vessels according to a circulation speed of the blood. As time goes, it disappears from the blood vessels.
The blood vessel angiographic image apparatus 300 generates and/or outputs a diameter, an angle, a crossover and a bifurcation of a blood vessel as an image by using an image processing technology. The bifurcation indicates a point in which one blood vessel flows (is divided) into two blood vessels, and the crossover indicates a point in which two blood vessels disposed on different planes are crossed from a view of a two-dimensional image.
The controller 320 analyzes blood vessel information.
Thus, the controller 320 measures a diameter and an angle of a blood vessel using, of rexample, a virtual ray and/or the above described method. It may use an image of a reconstituting B-mode and/or C-mode images by using the ultrasonic image; however, a single mono image can be used.
In this mono image, the controller 320 may determine a diameter of a blood vessel on lines having the shortest profile value of a blood flow area as a diameter of a blood vessel by comparing profile values of a blood flow area regarding virtual lines crossing over random pixels of a blood vessel. Herein, the profile values of the blood flow area indicate a value obtained by adding values of consecutive pixel values which indicate the blood flow area.
In the mono image, pixel values on a plurality of virtual lines crossing over a blood vessel may distinguish a blood flow area and other areas (for example, non-blood flow area or non-blood vassel area) based on a preset threshold. A blood flow area can be expressed in different values from values of other areas because of a blood flow rate. Therefore, profile values may be generated based on the pixel values. At this process, a shortest line on an area whose profile values correspond to a blood flow area may be determined as a traverse line disposed orthogonal to the blood vessel. Further, a length of the profile value area having the shortest line becomes a diameter of the blood vessel.
When an ROI is set, a diameter of a blood vessel (ΔV) are measured in a range gate which is a center coordinate of a blood flow in the set ROI.
Next, the controller 320 determines one or more angles of a blood vessel. The controller 320 determines an angle of the blood vessel based on one or more pixel values on virtual lines crossing over the determined diameter. As illustrated in a view A of
At this process, as illustrated in a view A of
NVR∝ΔV/λ
where λ is a width between a plurality of virtual lines.
Thus, the number of virtual lines is inverse proportional to the width of the virtual lines.
A plurality of virtual lines having various angles crossing over the diameter may be considered. A view B of
At this process, the controller 320 may add pixel values regarding a plurality of virtual lines crossing over the determined diameter according to a sliding angle from the horizontal plane. In a view A of
A representative value can be defined by mathematically formulizing the above. Thus, the controller 320 may calculate a representative value regarding a plurality of virtual lines crossing over the determined diameter according to sliding angles from the horizontal plane. A representative value is defined by a following mathematical formula.
E(θ)=ΣNVRi=1(Li
where E(θ) is a representative value regarding a plurality of virtual lines having a sliding angle (θ) from a horizontal plane,
NVR is the number of virtual lines having a sliding angle (θ) from the horizontal plane,
Li
Li
Further, the controller 320 determines a sliding angle from the horizontal plane regarding a plurality of virtual lines having the smallest calculated representative value as an angle of the blood vessel.
E(θ) and ΔV usable to calculate a diameter and an angle of a blood vessel are applied to the above formula when determining crossovers and bifurcations. An average pixel value within a blood vessel is used when the crossovers and bifurcations are determined. The contrast agent flows with the blood in the blood vessel. Contrast (pixel values) of a blood vessel expressed in the blood vessel angiographic image becomes different according to a density of the contrast agent within the blood vessel. Thus, the blood vessel (e.g., bifurcated blood vessels) may have an average contrast having similar bandwidths, and other crossover blood vessels may have different contrast bandwidths. By using the above characteristics expressed by the pixels, bifurcations and crossovers are determined.
In a process of selecting a blood vessel at a bifurvcation, a user determination is applied. When there are various paths from the bifurcation to a lesion position, the automatic method to select at least one of blood vessels can be performed. However, because it may be important to determine based on clinical standards such as moving easiness of the catheter according to a diameter and/or shape of a blood vessel, a selection can be made according to user clinical determination.
Moving information of the catheter is calculated based on the information obtained from automatic calculating and user determination.
As illustrated in
The information measured and calculated described above is expressed in the blood vessel angiographic image (e.g., the inserting position of the catheter, the lesion position, bifurcation and crossover information, the moving paths, and distances of the catheter), and is displayed (provided) in a proper shape to a user when performing the intervention and/or the medical treatment.
Meanwhile, the above determining diameters and angles of blood vessels may be performed only on an ROI 170 as illustrated in
The controller 320 establishes an ROI on a preset position of a mono image. Further, the controller 320 determines whether a center coordinate value regarding an ROI is out of a center coordinate value regarding a blood flow in the generated color mode image. If the center coordinate value regarding the ROI is within a previously established range from or is similar to the center coordinate value regarding the blood flow, image processing may be performed. However, if the center coordinate value regarding the ROI is out of the previously established range from or is not similar to the center coordinate value regarding the blood flow in the generated color mode image, the controller performs an ROI position adjusting process to adjust the ROI from an original portion to a new position so that the center coordinate value regarding the ROI is approached to the center coordinate value regarding the blood flow.
ROI can be different according to clinical determining standards regarding diseases. Further, it can be different according to a health condition, age, food digesting status, body condition, and/or body portion regarding a patient.
In order to move on to a next ROI for image processing after completion of the image processing regarding the established ROI, the controller 320 may newly establish a new ROI based on the determined angle of the blood vessel described above.
Referring to
At operation S1810, an ultrasonic signal is outputted and an blood vessel angiographic image is displayed. A user checks the image and establishes an inserting position of the catheter and a lesion position. Also, at operation S1810, ultrasound can be usable to obtain an image signal. However, the present general inventive concept is not limited thereto. Another method using another medium than the ultrasound can be usable to obtain an image signal. The setting may include an input to control one or more characteristics of the image regarding the body portion including the blood vessel and also control information thereof to be displayed on a display as described above or hereinafter.
At operation S1820, the blood vessel angiographic image apparatus calculates one or more diameters and one or more angles of one or more blood vessels and determines one or more crossovers and one or more bifurcations.
At operation S1830, the moving information of the catheter is calculated and expressed so as to be distinguished. The moving information of the catheter is displayed on a screen of a display unit independently or together with the displayed image. The moving information may be superimposed, highlighted, or inserted into a portion of the displayed image. The moving information may be generated as sound using an audio unit (not illustrated)
At operation S1840, the finally measured and calculated information is displayed on the display.
An medical image registering apparatus will be explained in more detail hereinafter.
When a uniform scene or object is photographed with different equipment or different perspectives, objects viewed in each of the images have different shapes and coordinate systems from each other. An image registration is a method to express (or display) the different photographed objects on one uniform (common) coordinate system. The image registration is one of computer vision methods usable in a medical image field. Examples of the representative applications requesting the image registration are as follows.
The method may include comparing images regarding affected portions which change as time goes for the purpose of observing disease progression and comparing the images before and after an medical operation (a uniform diagnostic apparatus is used, e.g., CT-CT)
The method may include simultaneously requesting anatomical information and functional information on a specific spot (different types of diagnostic apparatuses are used, e.g., MRI-CT). The anatomical information may be obtained in a diagnostic apparatus using CT, X-ray, ultrasound, etc. The anatomical information may also be obtained in the diagnostic apparatus using MRI, fMRI, PET, SPECT. Etc.
The method may include enabling to perform a medical operation at real time (different types of diagnostic apparatuses, e.g., CT-ultrasound)
It is possible that the image registration can be usable for various purposes more than the above described method. The image registration searches for a uniform spot on the photographed objects from the two sub-images in different states; the uniform spot is called as a landmark of the registration. The medical images may include one or more landmarks such as bone information, blood vessel information, and an outer edge of an organ (tissue structure).
It may be easy to automatically detect such landmarks in CT or MRI images having a better resolution or image quality. However, since ultrasonic images have characteristics of a lower image quality and a lower SNR, it may not be easy to detect the landmarks. Further, since the ultrasonic images have characteristics in that the photographed body portion is local, differently from other diagnostic apparatuses, it may be difficult to observe a wider range of a body portion.
However, in the ultrasonic diagnosis, there is no exposure of radioactive rays, observing can be performed at real time, and a cost for the diagnosis is relatively lower. Thus, the ultrasonic diagnostic apparatus is a useful apparatus among medical image apparatuses. Further, the above described operation, such as intervention, can be performed in the ultrasonic diagnostic apparatus. Before the operation, planning may be performed by using a higher precise image such as a CT image; however, when performing the operation, the ultrasonic apparatus can enable a user to observe the body part through the image at real time.
As illustrated in sub-images A and B of
Referring to
The blood vessel information may be obtained using the above described blood vessel analysis method. First, the controller 420 calculates one or more diameters and one or more angles of a bloodvessel. The mentioned measuring method (using virtual lines) reconstitutes B-mode and/or C-mode images in an ultrasonic image to create a new image and uses corresponding image values to obtain the blood vessel information. However, a mono image regarding images of CT or MRI can be used. Further, the method detects one or more bifurcations where blood vessels are parted (divided or extended) and respectively measures one or more angles of corresponding bifurcations.
Thus, in this mono image, the controller 420 may determine a diameter (distance or width) of a blood vessel on one or more lines having the shortest profile value of a blood flow area as a diameter of the blood vessel by comparing one or more profile values of a blood flow area regarding one or more virtual lines crossing over at least one random pixel of the blood vessel. Herein, the profile values of the blood flow area indicate a value generated by adding values of consecutive pixel values which indicate the blood flow area.
In the mono image, pixel values on a plurality of virtual lines crossing over a blood vessel may distinguish an blood flow area and other areas based on a preset threshold. A blood flow area is expressed in different values compared to other areas because of a blood flow rate. Therefore, profile values may be constituted based on the pixel values. At this process, the shortest line on an area whose profile values correspond to a blood flow area may be determined as an area having a traverse line orthogonal to the blood vessel. Further, a length of the profile value area having the shortest line becomes a diameter of the blood vessel.
When an ROI is set, at least one diameter of blood vessel (ΔV) may be measured in a range gate which is a center coordinate of a blood flow in the set ROI.
Next, the controller 420 determines one or more angles of a blood vessel. The controller 420 determines an angle of the blood vessel based on pixel values on corresponding virtual lines crossing over the determined diameter. As illustrated in a view A of
At this process, as illustrated in a view A of
NVR∝ΔV/λ
where λ is a width between a plurality of virtual lines.
Thus, the number of virtual lines is inverse proportional to the width of the virtual lines.
A plurality of virtual lines having various angles crossing over the diameter may be considered. A view B of
At this process, the controller 420 may add pixel values regarding a plurality of virtual lines crossing over the determined diameter according to a sliding angle from the horizontal plane. Referring to a view A of
A representative value can be defined by mathematically formulizing the above process. Thus, the controller 420 may calculate a representative value regarding a plurality of virtual lines crossing over the determined diameter according to sliding angles from the horizontal plane. A representative value is defined by a following mathematical formula.
E(θ)=ΣNVRi=1(Li
where E(θ) is a representative value regarding a plurality of virtual lines having a sliding angle (θ) from the horizontal plane,
NVR is the number of virtual lines having a sliding angle θ from the horizontal plane,
Li
Li
Further, the controller 420 determines a sliding angle from the horizontal plane regarding a plurality of virtual lines having the smallest calculated representative value as an angle of the blood vessel.
Further, the controller 420 may detect a plurality of pieces of uniform information, similar information to be obtained according to the above process, by using another image in which the image registration is performed.
Next, the controller 420 detects feature values by using a plurality of pieces of blood vessel information obtained from each of the images. Because angles of bifurcations can be different according to angles of photographing images among the obtained blood vessel information, there may be slight differences between angles even regarding the same bifurcation. For the above process, a plurality of bifurcations are used.
Referring to
The angle vectors (Vn_n1, Vn_n2) of blood vessels between bifurcations detect angle vectors of blood vessels from a bifurcation n to next bifurcations n1 and n2. Such angle vectors may be obtained by measuring angles of blood vessels while moving an ROI when angles of blood vessels are measured according to the described in this specification.
Vn_n1=[E(θ1)E(θ2)E(θ3) . . . E(θi-2)E(θi-1)E(θi)]
Herein, i is the number of ROIs which are measured. Each feature value described above is performed on every bifurcation viewed from the image. The finally obtained feature values from one image are a bifurcation angle (θn) at one bifurcation, bifurcation angles (θn1, θn2) of the parted blood vessels at a bifurcation n, lengths (Dn_n1, Dn_n2) of blood vessels from a bifurcation n to bifurcations n1 and n2, length ratios (Dn_n1/Dn_n2) of the two parted blood vessels, and angle vectors (Vn_n1, Vn_n2) of blood vessels between bifurcations. At least one of the parted two blood vessels can be selected for the medical treatment or for the moving path of the catheter automatically or manually. The ROI may be generated and displayed along the selected blood vessel.
Through the above processes, each feature value are estimated and calculated from one or two images applied in the image registration. The uniform spot viewed from the two images is searched by using corresponding feature values in a mono image or in a combination image. The corresponding spot is used as a landmark when performing the image registration.
Meanwhile, the above described detecting landmarks may be performed based on one or more ROIs 220 while moving from one bifurcation to next bifurcation, as illustrated in
The controller 420 establishes an ROI on a preset position of the mono image. Further, the controller 420 determines whether a center coordinate value regarding the ROI is out of a center coordinate value regarding a blood flow in a generated color mode image. If center coordinate value regarding the ROI is within a previously established range from or similar to the center coordinate value regarding the blood flow, image processing may be performed. However, if the center coordinate value regarding the ROI is out of the previously established position from the center coordinate value regarding the blood flow in the generated color mode image, the ROI is adjusted so that the center coordinate value regarding ROI is approached to the center coordinate value regarding the blood flow.
ROI can be different from other ROI according to clinical determining standards regarding diseases. Further, it can be different according to a health condition, age, food digesting status, body condition, and/or body position regarding a patient.
In order to move on to the next ROI for image processing upon completion of the image processing regarding the established ROI, the controller 420 may newly establish a new ROI based on the determined angles of blood vessels described above.
The following will explain a method of designating an image registration landmark according to an embodiment of the present general inventive concept.
Referring to
Although a few embodiments of the present general inventive concept have been shown and described, it will be appreciated by those skilled in the art that changes may be made in these embodiments without departing from the principles and spirit of the general inventive concept, the scope of which is defined in the appended claims and their equivalents.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10-2013-0156434 | Dec 2013 | KR | national |
