Method for Utilizing User Input for Feature Detection in Diagnostic Imaging

Abstract

A method for utilizing user input for segmentation and feature detection in diagnostic ultrasound imaging is provided. The method provides border detection to be performed rapidly; a feature, which allows the border detection method to be applied to real-time video imaging with little or no delay. The border detection method may be incorporated within a diagnostic ultrasound imaging system or as a user-installable software application capable of being installed on and executed by an ultrasound imaging system.

Description

The foregoing objects and advantages of the present invention may be more readily understood by one skilled in the art with reference being had to the following detailed description of preferred embodiments thereof, taken in conjunction with the accompanying drawings in which:

FIG. 1 is a flowchart illustrating the steps performed by the method for utilizing user input for border detection in diagnostic imaging in accordance with the present invention; and

FIG. 2 is a block illustration of a system for border detection in diagnostic imaging in accordance with the present invention.

Several embodiments of the present invention are hereby disclosed in the accompanying description in conjunction with the figures. Preferred embodiments of the present invention will now be described in detail with reference to the figures wherein like reference numerals identify similar or identical elements.

An embodiment of the present invention, shown in FIG. 1, provides a method for defining internal structural borders in a medical ultrasound image. In step 101, an ultrasound imaging system images a patient or other object appropriately capable of being imaged by ultrasound energy. The ultrasound imaging system transfers the ultrasound image(s) or volume data to an electronic data storage device, e.g. volatile and non-volatile memory, magnetic media, optical media, etc. in step 102. The image data is also displayed on a display screen having an interface configured for providing an operator controllable image processing and analysis functionality in step 103.

In step 104, an operator selects one or more region(s) of interest (RoI) on the displayed image data as the desired starting point (seed). The interface allows the operator to indicate the RoI (either in 2D or 3D) by selecting one or more shapes from amongst a variety of simple geometric models, e.g. circle, square, polygon, slice, cube, sphere, etc., and placing the selected model on the image so that the model bounds the RoI. Additionally the interface provides a method for the operator to indicate the ultrasound image type, for example, cardiac, fetal, etc.

The image type and bounded RoI are used by the system for analyzing the area within the region(s) of interest in step 105. Contours and structures within the RoI are detected in step 106. A method for delineating these contours and structures includes adjusting contrast and colorizing structures according to predefined or operator-definable preferences, and display of the resulting image data on the display screen are provided in step 108. The delineation preferences to be applied to the RoI of the ultrasound image are set in step 107 prior to execution of step 108.

In step 109, the operator is given the opportunity to review and either accept the image processing as displayed in step 108 or reject it if the RoI is not acceptably displayed. If the results of step 108 are acceptable, the process is completed. However, if the operator rejects the results of step 108, step 104 is executed again, giving the operator an opportunity to adjust the RoI selection as well as the image type in an attempt to refine the resulting image data in step 108. The subsequent steps are executed as described above.

Additional features may be incorporated into the present embodiment of the invention, for example, the method may include a process by which the system can learn and adapt over time based on the feedback received from the operator in step 109. Further, image processing and manipulation functions may also be provided by the system, such as enlarging, rotating, and cropping the RoI.

The analysis and detection steps are performed by the present embodiment through analytical algorithms, which use predetermined and internally located complex shapes approximating the general shapes of various bodily tissues and structures. The indicated image type is used to identify which of the variety of complex shapes are to be applied to the RoI analysis. However, as discussed previously the imaged shape of a bodily tissue or structure may appear different from-the typically associated shape of the tissues and structure due to various factors such as the angle and position of the ultrasound imaging unit. For this reason, the present embodiment utilizes a fuzzy model of these tissues and structures. In this case fuzzy is meant to indicate that the complex shapes have, as their boundaries, a predefined acceptable range (e.g., maximal size limit) instead of a sharply defined boundary, thus a tissue boundary point need not lie directly on the boundary of the corresponding complex shape but merely within the acceptable range. Additionally, as more of the tissue boundary points are detected on the image, the acceptable range of the boundary of the complex shape may be adjusted as appropriate, “on the fly” or in real-time, based on the location of the detected points. These detections and adjustments are performed automatically by the present embodiment.

An alternate embodiment of the present invention allows the operator to adjust a shape selected from the variety of simple geometric models following the execution of step 104. Thus, the shape used to indicate the RoI can more closely match the actual shape of the region and, consequently, increase the accuracy and speed of the analyzing and detection steps. Additionally, if in step 109, the results from step 108 are rejected, then the originally selected shape of step 104 can be modified to increase the likelihood of a successful end result from step 108.

The method as described above may be implemented as a software application or set of processor commands and installable onto a pre-existing ultrasound diagnostic system. In this embodiment, the software application may be stored on any of variety of commonly used computer readable media, such as compact disc, DVD, and magnetic media, or as a network downloadable software package.

Another embodiment, as shown in FIG. 2, provides an ultrasound diagnostic system 200 configured and disposed for executing the steps of the present invention as described above. The system 200 includes a controller/processor unit 201, having a user input device(s) 202, such as keyboard, mouse, speech recognition device, etc., a storage device 203, and a display screen 204, connected with and configured for controlling an ultrasound imaging device 206, such as an ultrasonic probe. An optional, hard copy output device 205, such as a printer, may also be present and connected to the controller/processor unit 201.

A software application or set of processor commands, residing within the controller/processor unit 201 or stored on the storage device 203, is configured to execute the steps of the method of the present invention as shown in FIG. 1 and described above. The controller/processor unit 201, upon receiving an actuation signal from the operator via the user input device(s) 202, activates the ultrasound imaging device 206. The actuation signal may include or be preceded by a set of operator-adjustable preference signals which are used by the controller/processor unit 201 to adjust the parameters of the ultrasound imaging device 206. The ultrasound imaging device 206 transmits high frequency audio signals toward a patient or object (not shown) to be imaged and receives signals reflected from structures internal to the scanned patient or object in a manner well known in the art. The received signals are transferred to the controller/processor unit 201 for further processing.

The controller/processor unit 201 processes signals and displays a corresponding image 208 on the display screen 204. Additionally, the controller/processor unit 201 provides an interface, preferably a graphical user interface (GUI) 207, which allows the operator to selectively indicate a region of interest (RoI) on the displayed image 208. The interface may consist of any of a combination of interface elements, such as menus 209, buttons 210 and icons (not shown) configured to provide predetermined functions. The operator selects the RoI by selecting one or more shape(s) from a variety of simple geometric shapes—square, slice, circle, cube, sphere, etc.—provided by the interface 207 and positioning the shape(s), orientation and size over the RoI such that the RoI is bounded approximately to the boundaries of the shape(s). Further, the operator indicates the type of ultrasound image being displayed through manipulation of interface elements 209, 210, etc. Based on these few inputs from the operator, the controller/processor unit 201 applies predefined algorithms to the RoI for enhancing the various structures contained within the RoI.

The described embodiments of the present invention are intended to be illustrative rather than restrictive, and are not intended to represent every embodiment of the present invention. Various modifications and variations can be made without departing from the spirit or scope of the invention as set forth in the following claims both literally and in equivalents recognized in law.

Claims

1. A method of defining internal structural borders in a medical ultrasonic image (208) comprising the steps of: placing at least one geometric shape in a proximal relationship to a feature in the ultrasonic image (208);locating at least one starting point within the at least one geometric shape; anddetecting a tissue border and/or structure within a portion of the ultrasonic image (208) bordered by the at least one shape, the detection is performed using one or more shapes selected from a set of predetermined shapes, each having generally the shape of a bodily tissue or structure and a fuzzy border region.

2. The method of claim 1 further comprising the step of displaying the ultrasonic image (208) with delineations, the delineations identifying the detected tissue border and/or structure.

3. The method of claim 1, wherein the placing step further includes adjusting at least one parameter from a set of parameters of the at least one selected geometric shape to approximate the shape of the feature.

4. The method of claim 3, wherein the set of parameters includes size, position and orientation.

5. An ultrasound imaging system configured and disposed for defining internal structural borders in a medical ultrasonic image (208) comprising: an ultrasound transducer probe (206) configured for producing ultrasound signals, directing the ultrasound signals towards a target to be imaged, and detecting the ultrasound signals reflected from the target;a display screen (204) for displaying the reflected ultrasound signals in an operator-viewable format;means for enabling an operator to indicate a region of interest (RoI) by placing at least one geometric shape in a proximal relationship to the RoI; anda processor (201) comprising:means for locating at least one starting point within the at least one shape; andmeans for detecting a tissue border and/or structure within a portion of the ultrasonic image (208) bordered by the at least one shape by using one or more shapes selected from a set of predetermined shapes, each having generally the shape of a bodily tissue or structure and a fuzzy border region.

6. The system of claim 5, wherein the display screen (204) displays the ultrasound image (208) with a plurality of delineations, the delineations identifying the tissue border and/or structure on the display screen.

7. The system of claim 5, further comprising means for adjusting at least one parameter from a set of parameters of the at least one selected geometric shape to approximate the shape of the feature.

8. The system of claim 6, wherein the set of parameters includes size, position and orientation.

9. A computer readable medium comprising a set of computer readable instructions capable of being executed by at least one processor (201) for defining internal structural borders in a medical ultrasonic image (208) comprising the steps of: placing at least one geometric shape in a proximal relationship to a feature in the ultrasonic image (208);locating at least one starting point within the at least one geometric shape; anddetecting a tissue border and/or structure within a portion of the ultrasonic image (208) bordered by the at least one shape using one or more shapes selected from a set of predetermined shapes, each having generally the shape of a bodily tissue or structure and a fuzzy border region.