Patent Application
20140357996
Embodiments of the invention relate generally to ultrasound systems and methods for using ultrasound systems. More particularly, embodiments of the invention relate to a system and method for ultrasound image processing.
Conventional ultrasonic imaging provides a mapping of ultrasonic echo signals onto an image plane where the intensity of the echo, caused principally by relatively small differences in material properties between adjacent material types, is mapped to brightness of pixels on the image plane. While such images serve to distinguish rough structure within the body, they provide limited insight into the physical properties of the imaged materials. Ultrasound-based diagnostic medical imaging techniques are used to visualize muscles, tendons, and many internal organs, to capture their size, structure and any pathological lesions with real time tomographic images. Ultrasound has been used by healthcare providers to image the human body for at least 50 years and has become one of the most widely used diagnostic tools in modern medicine. The technology is relatively inexpensive and portable, especially when compared with other medical imaging modalities.
Ultrasound technologies can be used to visualize and discern various medical information from soft tissues. However, the mechanical material properties (i.e. load versus deformation) of soft tissues such as tendon and ligament are nonlinear, deformation-dependent, and can reflect the pathological state of the tissue. Finding a non-invasive way of assessing these properties is a difficult task, but ultrasound techniques and systems can be utilized.
Today, most musculoskeletal pathologies are diagnosed by observing images captured through modalities such as MRI or Ultrasound. Often, key image texture changes affecting tissue pathology are observed. Yet, this observation-based diagnosis is highly subjective and observer-dependent. Hence an economical, yet objective ultrasound assessment method or imaging technology has been sought. To satisfy this clinical demand, additional ultrasound imaging technologies have been developed.
It is well known that tissue mechanical functionality (stiffness-strain relation and all other properties that can be deduced from this relation) is a function of mechanical behavior (deformation and displacement and all other properties that can be deduced from deformation and displacement). The tissue mechanical functionality is specific to each tissue type and tissue health status. Hence, a properly and reliably evaluated tissue mechanical functionality through a wide range of mechanical behavior can be a reliable metric for diagnosis or monitor tissue health.
With the advancement of ultrasound technology, ultrasound technology allows a fast, low cost, non-invasive and reliable measurement of both tissue mechanical functionality and tissue mechanical behavior.
However, known methods of tissue assessment with ultrasound do not provide an objective measure of the status of a pathology. Instead, typically an operator (such as a medical practitioner) observes behavior of a tissue in dynamic ultrasound images and makes a subjective determination as to the status.
It would therefore be desirable to have a system and method capable of objectively determining a status of the pathology with the tissue mechanical functionalities deduced via ultrasound dynamic image (CINE image) analysis.
Embodiments of the invention provide a system and method of measuring behavior of a subject and providing an objective assessment which can be used in a diagnosis.
In accordance with one aspect of the invention, an ultrasound system includes an ultrasound transducer adapted to obtain a dynamic series of echo signals of a subject tissue at different deformation states, and an image processor for generating and displaying ultrasound images of the tissue. The processor is configured to generate dynamic images that correspond to the dynamic series of echo signals, identify a plurality of pixels within a region of interest (ROI) of a first of the generated images, evaluate local tissue mechanical behavior by tracking the displacement, deformation, and echo intensity of the identified plurality of pixels from the first image to subsequent images based on groups of pixels that correspond to each of the identified plurality of pixels, determine tissue functionality in the subject at the tracked pixel locations, and display the tissue functionality in dynamic images that corresponds to the tracked pixel locations.
In accordance with another aspect of the invention, a method of determining a deformed state of a tissue in ultrasound images, the method includes selecting pixels that are within a region of interest (ROI) of a first ultrasound image of a tissue, wherein the tissue is at a first state of deformation, identifying pixels that surround the selected pixels in the first ultrasound image, evaluating a local tissue mechanical behavior by tracking the selected pixels from the first ultrasound image to subsequent locations in subsequent ultrasound images using the identified pixels that surround the selected pixels, wherein the subsequent ultrasound images correspond to different states of tissue deformation, determining functionality of the tissue at the subsequent locations of the identified pixels, and displaying the functionality at their original or subsequent locations in an image of the tissue.
In accordance with yet another aspect of the invention, a non-transitory computer readable storage medium having stored thereon a computer program comprising instructions which when executed by a computer cause the computer to obtain a dynamic series of echo signals of a subject taken using an ultrasound transducer with a tissue of the subject at different states of deformation, generate first and second images using the obtained series of echo signals, identify target pixels and their neighboring pixels in the first image, assume locations of the target pixels and their neighboring pixels in the second image, calculate values of a mathematical norm based on the target pixels and their neighboring pixels in the first image and based on their assumed location in the second image, derive actual locations of at least the target pixels in the second image based on the values of the mathematical norm, and overlay deduced functionality or mechanical behavior of the tissue that correspond to their actual locations in the original or second image.
In accordance with still another aspect of the invention, a method for monitoring tissue pathology includes generating a first tissue functionality histogram/probability density function plot based at least in part upon motion or deformation of a first pixel between a first ultrasound image at a first deformed state and a second ultrasound image at a second deformed state, calculating a first ordinal scale aspect ratio based upon the first tissue functionality histogram, generating a second tissue functionality histogram/probability density function plot based at least in part upon motion of a second pixel between a third ultrasound image at a third deformed state and a fourth ultrasound image at a fourth deformed state, calculating a second ordinal scale aspect ratio based upon the second tissue functionality histogram/probability density function plot, and generating a time series plot based on the first ordinal scale aspect ratio and the second ordinal scale aspect ratio as an indicator of a tissue pathology.
Various other features and advantages will be made apparent from the following detailed description and the drawings.
The drawings illustrate embodiments presently contemplated for carrying out the invention.
In the drawings:
Terms used to describe aspects of the present invention are given their ordinary and common meaning unless specifically defined herein. For the purposes of the present application, stress is the force distributed on a unit area of material, i.e., normalized force. The stress causing stretching deformation is expressed as positive stress. The stress causing contraction/compression deformation is expressed as negative stress. Strain is normalized deformation of material. Stretching deformation is expressed with positive strain. Contraction/compression deformation is expressed with negative strain. Stress-strain relation is a stress versus strain plot.
Stiffness of a material is the slope of a stress versus strain relationship. Because each different type of material has a different stiffness, the slope of the stress-strain relationship can be an important index for material identification. This slope can be a constant for the simplest materials, but when the stress versus strain relationship is linear these are called linear materials. However, some materials such as soft biological tissues are typically not necessarily linear, and as will be further discussed, their linearity may vary as a function of whether the tissue healthy or not. Such materials have a nonlinear stress-strain relationship with a stiffness (slope of relationship) that changes with increasing strain. Soft biological tissue (and rubber-like materials as well) are usually less stiff (a lower slope) at low levels of strain and stiffer (a higher slope) at higher levels of strain. Generally, the nonlinear stress-strain relation of a material is very specific to each material and considered as a signature of each material.
A “stiffness gradient” is due to the nonlinear nature of the stress-strain relation and a typical stiffness-strain relation deduced from a stress-strain relation is also a relationship (nonlinear) that changes with varying strain. The slope of this stiffness-strain relation is thus named the stiffness gradient. A set of parameters describing this curve can be considered as indices of material stiffness caused by applied strain. Generally, the stiffness gradient is also considered as a parameter that is specific to each material.
Derivation of exemplary stiffness gradients for biological tissues is illustrated in
Acoustic impedance is defined as the mathematical product of density and acoustic velocity, or square root of the product between density and stiffness. Ultrasound echo reflection is caused at the interface between two materials with different acoustic impedance. In the case of a biological tissue, the density of most tissues is a similar value (close to the density of water), the impedance difference of tissues are directly linked to stiffness differences. However, even the stiffness differences of different tissue types at a not-deformed state (not-loaded state) are minute, hence echo reflection is small that results in an unclear ultrasound image.
The acoustoelastic (AE) effect in elastic media occurs when acoustic waves propagate through deformed elastic media, acoustic characteristics (acoustic impedance, wave velocity, reflected echo magnitude) depend on material properties and magnitude of applied deformation. This phenomenon is called acoustoelasticity and the theory of acoustoelasticity provides a set of equations to analyze. Thus, when a biological tissue such as a tendon is flexed, the flexing causes a change in the amount of tension, which can be observed using ultrasonic images, according to the invention. Thus, in principle and as known in the art, deforming a tendon while receiving echoes from an ultrasound imaging apparatus can yield ultrasound images that highlight changes in the stiffness of the material that can be indicative of a level of injury in the tendon by processing acquired ultrasound dynamic image (also widely known as CINE image). Thus, such measurements can be employed to monitor a tissue as it heals, and ultrasound images may be taken over a period of weeks or months, as examples, to provide a means of observing the status of the tissue.
However, the act of flexing the tendon causes motion of the tendon to occur. Thus, in order to view an injured tendon the tendon is, paradoxically, caused to move (by the patient flexing a toe, for instance), which prevents a reference frame from being maintained from one image to the next during a dynamic (cine) ultrasound imaging session. As such, according to the invention, a region-of-interest (ROI) is established which can be maintained from image to image in a dynamic session, enabling both tissue functionality such as stiffness and tissue mechanical behavior such as tissue strain in an injured tendon, for instance, to be monitored despite it being moved in order to cause deformation and displacement of the tendon.
According to the invention, the ROI for analysis can be selected by a user on an image frame of dynamic ultrasound images. In one embodiment, a fiber-of-interest (FOI) for analysis can be selected by a user on an image frame of dynamic ultrasound images. According to one embodiment, the ROI and FOI can be selected on a first image (image of tissue resting state without deformation) of the dynamic ultrasound images and in another embodiment the ROI or FOI are selected on other than the first image frame of ultrasound dynamic images.
As implied, deformation-dependent stiffness is directly related to the echo intensity. Hence the deformation-dependent stiffness is calculated by assuming the echo intensity at any region to be “stiffness” that is modeled as the linear combination of finite numbers of constants and the same strain evaluated at the pixel. Deformation-dependent stress is a deformation-dependent function that is evaluated by integrating “deformation-dependent stiffness.”
Pattern recognition aims to classify data based either on a priori knowledge or on statistical information extracted from patterns. The patterns to be classified are usually groups of measurements or observations, defining points in an appropriate multidimensional space. The method and apparatus described herein can be directly implemented onto ultrasound hardware system for on site processing or delivered to any computer system as image post-processing software.
Referring to
An ultrasonic transducer 58 associated with the ultrasonic imaging machine 52 may transmit an ultrasonic beam 60 toward a region of interest 62 within the patient 64 on a table 65 to produce echo signals 66 that may be received by the ultrasonic transducer 58 and converted to an electrical echo signals 66. For the construction of an image, multiple rays within ultrasonic beam 60 and echo signals 66 will be acquired through different voxels 68 in the patient so as to obtain an “echo set” of echo signals 66 from a plurality of voxels 68 within the region of interest 62.
The electrical echo signals 66 may be received by interface circuitry 70 of the ultrasonic imaging machine 52, the interface circuitry 70 providing amplification, digitization, and other signal processing as is understood in the art. The digitized echo signals may then be transmitted to a memory 72 for storage and subsequent processing by the processor 56 as will be described. The processed echo signals 66 may be used to construct an image displayed on graphical display 74. Input commands from an operator may be received via a keyboard 76 or cursor control device 78, such as a mouse, attached to the processor 56 via an interface 80 as is well understood in the art. A position sensor 82 may be attached to the ultrasonic transducer 58 to indicate orientation of the ultrasonic transducer 58 through an electrical position signal 84 also provided to the interface circuitry 70.
At least one embodiment of the method includes an algorithm that evaluates material properties of user selected ROI and/or FOI of deforming medium by analyzing captured ultrasound dynamic images. Additionally, as will be described, data input/output is a feature that manages image upload and recording the deduced composite data image. The ROI analysis includes ROI selection, tracking, deformation evaluation, ROI echo intensity monitor and material property evaluation will be achieved in this feature. The deduced ROI data can then be visualized. In another embodiment, FOI tracking is provided. FOI selection, tracking and deformation evaluation will be achieved in a similar methodology as ROI tracking, with the exception that FOI tracking is linear. The deduced FOI data will be also display in this feature.
Referring now to
ROI selection can be achieved by a mouse click action on multiple pixels (including more than three pixels to properly define a region in an image). Once the ROI is selected and defined by the user 116, ROI inner pixels to be analyzed will be automatically defined by software. The number and location of ROI inner pixels will be automatically determined based on a default or user selected pixel spacing (density) of inner pixels. The user can select multiple ROIs for simultaneous analysis and comparison. According to the invention and as will be described, a small neighbor pixels surrounding the defined pixel will be automatically defined by an analysis algorithm. The shape of and size of neighbor region can be set default or selected by user.
Once the ROIs are selected by a user, the proposed method and system can automatically initiate ROI tracking feature 118. ROI tracking will be described further with respect to
Referring now to
According to the invention, ROI tracking 118 of method 100 includes tracking motion of the ROI by using pixels from the dynamic ultrasound images that surround 208 pixels 202. Thus, referring to
Pixel displacement and pixel neighbor-region deformation may be calculated by optimizing properly defined mathematical norm, according to the invention. Two example mathematical norms are presented herein. In each of these two mathematical norms, displacement of a pixel from one dynamic image to the next is calculated by assuming a displacement and deformation of an element 308, calculating the value of the norm 310, and comparing it to a threshold 312. If the value of the norm is not within a predetermined threshold 314, then the assumed displacement and deformation is perturbed or otherwise altered 316, and the norm is recalculated at step 310. The process iteratively repeats until, when the value of the norm is within the given threshold 318, then the process ends 320. The process of pixel displacement and neighbor-region deformation calculation just described can be done on a number of pixels within the ROI. Thus, dynamic images obtained by, for instance, flexing a tendon, can be evaluated in order to track the movement or displacement of pixels that define the ROI and pixels within the ROI from image to image.
As stated, pixel displacement may be calculated with any one of many mathematical norms. Two example norms are described here after. Referring to
By example, assume a original pixel (pixel 22 404) is displaced u and v to new location 22* 410. Along with pixel movement, the original square shaped surround neighbor of element F 402 has deformed and translated to be G(x*,y*) 408. It is also assumed that the magnitude of both displacement and deformation take place are relatively small and can be assumed to be bounded by a small search boundary. In this circumstance, the coordinate relation between each pixel in original and deformed neighbor region for general three dimensional case be related by the following relation:
{right arrow over (x)}*={right arrow over (x)}+{right arrow over (u)}+(∇x{right arrow over (u)})Δ{right arrow over (x)}; Eqn.0.
Here {right arrow over (x)}, and Δ{right arrow over (x)}, represent known coordinates vector of center pixel and known relative distances vector of other pixels from center pixel in the original neighbor region. The unknown displacements vectors of center pixel are represented by {right arrow over (u)}. However, to make the discussion simple, the two dimensional case will be used here after. In the two dimensional case the coordinate relation between each pixel in original and deformed neighbor region can be related by
Here x, y, Δx, and Δy represent known x, y coordinates of center pixel 404 and known relative distances of other pixels from center pixel 404 in the original neighbor region 402. Unknown displacements of center pixel 404 are represented by u and v. Similarly, the unknown deformation and rotation of neighbor-region (element) are represented by the differentials
Mathematically defined norms for assessing the deformation of center pixel 404 include evaluation of the cross-correlation coefficient rij:
s(i,j)=ΣiΣj[F(xi,yj)−G(x*i,y*j)]2; Eqn. 4.
Here F(xi,yj) is the gray-scale value at a point (xi,yj) in the original image and G(xi*,yj*) is the gray-scale value at a point (xi*,yj*) in the deformed image. The mean values of the sub-image F and G are denoted by
With these mathematical relations, the step by step process for tracking center pixel by finding best match of neighbor-region can be described as follows, as described also with respect to
Step 1: Assume initial displacement u, v and deformation du/dx, du/dy, dv/dx and, dv/dy and estimate new pixel coordinate x*, y* and neighbor region G(x* and y*) by equations 1 and 2.
Step 2: Evaluate mathematically defined norms (either Eqn. 3 or 4).
Step 3: Check the magnitude of the evaluated norm. If the value is below a defined threshold and/or change in u, v and deformation du/dx, du/dy, dv/dx and, dv/dy falls below a defined threshold, the new location of the neighbor region is considered found and terminate tracking.
Step 4: If the evaluated norm is relatively large, then perturb displacement u, v and deformation du/dx, du/dy, dv/dx and, dv/dy slightly and repeat process step 1 through 3 until properly small value of norm is achieved.
The disclosed process can be executed with any existing nonlinear optimization mathematical theory.
Upon the completion of the evaluation of local tissue mechanical behavior that includes pixel displacement and tracking, neighbor-region deformation evaluation and echo intensity change monitoring, this algorithm will evaluate the tissue functionality with deduced tissue mechanical behavior information. Here, the normalized material stiffness and deformation dependent normalized stiffness (stiffness gradient) are deduced from recoded pixel echo intensity and material deformation.
Since the deduced pixel displacement and pixel neighbor-region deformation are evaluated numerical value of the displacement and deformations of all pixels within ROI can be transferred onto subsequent images. Thus, returning to
Referring still to
This algorithm models the deformation-dependent stiffness in any sub-region in an ROI at arbitral image frame number, say N frame, as a linear combination of m numbers (picked by user) of unknown constant ai and m numbers of strains that are evaluated at the same point/region at N numbers of image frames that included current image frame (m, m−1, m−2, N−m+1).
C
N(εN)=a1εN+a2εN−1+ . . . +amεN+m−1
Unknown constants ai can be deduced by solving m numbers of linear equations with measured N sets of stiffness CN (εN) and strains evaluated at the same neighbor sub-region. Deduce unknown constant ai can be feedback into above relation to describe deformation dependent material stiffness.
Finally, this algorithm can evaluate deformation-dependent normalized stress for any sub-regions by integrating deformation-dependent stiffness deduced in previous step.
Once the tissue functionality and mechanical behavior are evaluated in ROI property evaluation feature, all data are passed to an ROI presentation feature for qualitative and quantitative data presentation.
First, the deduced numerical value of the tissue functionality and mechanical behavior of all pixels within ROI can be translated into a color scheme and a color image and be produced. In addition, the same deduced numerical values of all pixels within ROI can be used to evaluate the probability density function and/or histogram and presented as a plot.
The algorithm described in this document can be directly implemented onto ultrasound hardware system for on site processing or delivered to any computer system as image post-processing software. The overview architecture of this algorithm is presented in
As Numerical Data Output, all of the deduced the data can be saved with a simple viewable format such as ASCII format. ASCII format data can be easily accessed with any existing software that is available on market.
According to at least one embodiment, a fully automated tracking and ultrasound analysis is a solution for practical daily swift clinical use. To achieve that goal, currently used manual ROI selection may be replaced by an automated or systematic ROI selection. Thus, a more automated ROI selection may be achieved by one of following methods.
Method 1: Implementation of automated tendon/ligament identifier: The image texture of tendon/ligament is different from other type of tissues, such as fat, muscle and skin, hence automated tissue “differentiation”, also known as “segmentation”, is possible by implementing an existing digital image processing/machine vision algorithm.
Method 2: Tracking of all pixels in view space: Treating whole image as ROI and track all key pixels. Tracking all pixels can be time consuming. However, by splitting the tracking procedure into multiple cores, such as cores 31 of computer 30 of
Alternatively, the ROI tracking can be performed by utilizing an optical flow methodology. The direct output of the optical flow method is the velocity (speed in x and y direction) of a target pixel. There are two additional steps that are used to evaluate the deformation (stretch=Post motion length between two pixels−pre-motion length of two pixels) necessary for evaluation. First, the “time” factor has to be multiplied to the deduced velocity to find out the displacement of the pixel. Second, the deformation can be evaluated from pixel displacement.
In yet another alternative example, the ROI tracking can be performed utilizing a region-matching, or box matching, methodology. This method contains some similarities with the first ROI tracking methodology described above. First, a small sub-region is created around a target pixel to be tracked. The best matching sub-region through matching texture with optimization is then found.
In another embodiment, a method for monitoring tissue pathology is provided. In the deduced tissue functionality color map, each pixel contains tissue functionality data. A tissue functionality histogram/probability density function plot generated from the deduced tissue functionality. The plot can be plotted with the Frequency (frequency of pixels) on the y-axis and the deduced tissue functionality on the x-axis. The plot is then normalized to reduce the possible bias caused by differences in the region of interest. One method of normalization takes all frequency (frequency of pixels) normalized by the maximum frequency value of the deduced from other ultrasound data obtained for a particular subject from a particular data set. The aspect ratio for a particular normalized histogram is calculated. The height of the histogram (normalized frequency) is divided by the width of the histogram (range of tissue functionality and mechanical behavior distribution) to calculate the aspect ratio. The aspect ratio is converted and utilized as an ordinal scale to differentiate tissue pathology differences over time. To assist with this differentiation, a time series plot is generated for the normalized aspect ratios obtained for a particular subject at different times. The time series plot can graphically provide data for monitoring tissue pathology changes. Based upon the time series plot certain information about the monitored tissue can be deduced.
By example, a patient presented with a soft tissue injury can be monitored over time. At selected points, the injured tissue can be visualized through ultrasound and the tissue functionality and mechanical behavior histograms generated. The normalized aspect ratio can be plotted and provide an ongoing ability to monitor the injured tissue. Furthermore, a single patient can be compared to existing patients data for similar injuries and determine if the injury is healing at an expected rate, slow rate, or at an accelerated rate. Referring to
NC
N(εN)=A1ε1+A2ε2+ . . . +ANεN
In the above equation, tissue functionality NC(ε), measured strains ε, and relations are established from frame to frame via the variables A. Tissue functionality NC(ε) and strain ε are measured as a function of time. With the above relation, the time factor can be struck and simple tissue functionality relations may be evaluated. Once the tissue functionality is established, a tissue functionality gradient can be evaluated using the relationship as follows:
As such, the tissue functionality gradient can be calculated and is specific to tissue type or tissue health (and therefore varies over time as a tissue heals, for instance). Thus, tissue functionality fields are calculated and illustrated in
In another embodiment, there is implementation of automated tendon/ligament identifier: The image texture of tendon/ligament is different from other type of tissues, such as fat, muscle and skin, hence automated tissue “differentiation”, also known as “segmentation”, may be possible by implementing existing digital image processing/machine vision algorithm.
In another embodiment, tracking of all pixels in view space: Treating whole image as ROI and track all key pixels. Tracking all pixels can be time consuming. However, by splitting the tracking procedure into multiple cores, the calculation speed can be drastically reduced.
Furthermore, the ROI data points, including the neighboring points included within the algorithm, the distance between these points (Δx, Δy) be modified. in current code, default pixel distance is set at 10 pixels. However, a user can key in any pixel spacing. Generally, smaller pixel spacing results in a higher analysis resolution. On the other hand, larger pixel spacing results on a lower analysis resolution.
The following scenario provides an example: A patient is properly scanned with any ultrasound system. The dynamic (video) ultrasound images (CINE mode) of gradually deforming tissue are captured. Captured dynamic (video) ultrasound images are sent to PAC (Picture Archive Center) as part of DICOM (Digital Imaging and Communications in Medicine) format patient's information. In image diagnosis, radiologist retrieves patient's DICOM data, selects the ROI (or perhaps first performs one or more FOI determinations) and applies an embodiment of the present invention. Then, a Radiologist more accurately diagnoses pathology with deduced data from supplemental information.
Another example includes: A is patient properly scanned with any ultrasound system. The dynamic (video) ultrasound images (CINE mode) of gradually deforming tissue are captured. B1) Captured dynamic (video) ultrasound images sent to computer connected to ultrasound system. B2) ROI selected and an embodiment of the present invention for ROI tracking is applied on-site in the computer connected to ultrasound system. The deduced results are put into DICOM format patient file and sent to PAC. D) Diagnosis.
In yet another example, the ROI tracking method is employed: A) The patient properly scanned with any ultrasound system. The dynamic (video) ultrasound images (CINE mode) of gradually deforming tissue are captured. In the captured dynamic (video) ultrasound images, the ROIs are selected and analyzed with the ROI tracking methods programmed into ultrasound system. The deduced results are put into DICOM format patient file and sent to PAC. D) Diagnosis.
Currently ROI is selected by applying clicking action on the pixels that defines ROI Alternatively, a user can select ROI by encircling ROI with mouse movement. For example, the pencil feature in Microsoft paint program. Similarly, defining ROI with encircling ROI with tablet pen on touch screen can be an option.
The pixel tracking can be achieved by actually tracking the texture of sub-regions (currently circles) surrounding each target pixel. The size of disk-shaped sub-region can influence the tracking result. Larger sub-regions track better. Currently, the radius of sub-region disk is set at 20 pixels, but this can range significantly depending upon system user's selection. The size of the sub-region can be optimized. A differently shaped sub-region (square or rectangular) may be chosen alternatively.
Some of the major concept elements behind the ROI tracking methods are the evaluation of deformation-dependent tissue functionality named “stiffness gradient” by measuring the echo intensity change within the ROI. Indeed the echo intensity within ROI and sub-region (around target pixel)) change from frame-to-frame. However the magnitude change of echo intensity or texture (intensity of group of pixels) is ASSUMED to be small if TWO consecutive images are compared. Hence, tracking a single pixel can be properly achieved by tracking the sub-region surrounding the target pixel. The process of tracking texture is executed by slightly moving sub-region disk around target pixel and comparing texture in each step. Currently, a mathematically defined norm (summation of echo intensity differences of all pixels within sub-region) is used as the parameter to check how well newly found sub-region matches with original sub-region. If the both sub-regions are a good match, the echo intensity difference between each pixel is zero, hence the norm is zero. A newly found sub-region that output the minimum norm is ASSUMED as the perfect match and the pixel in its center is considered as the new location of target pixel.
If two sub-regions match well, the norm evaluated will be zero. In reality a zero norm can typically not be reached. Therefore a newly found sub-region that output the minimum norm is ASSUMED as a good match and the pixel in its center is considered as the new location of target pixel. Hence setting up a rigor yet achievable the criteria for norm will be important. On the other hand, if a large norm is chosen as the criterion for matching, the matching texture can be found fast yet not rigorous enough. Hence, setting proper norm criterion for terminating sub-region reach will be practical.
Another embodiment includes a feature to present Stiffness Gradient Histogram of fixed size disk-shaped sub-ROI is added. ROI analysis can be completed and Stiffness Gradient color map is presented, user can move cursor to any color coated pixel within the ROI color map to select the target pixel by clicking action. Once the target pixel is selected, a fixed size (this size can be selected by user) disk-shaped sub-ROI will be created around the target pixel for sub-ROI Stiffness Gradient assessment. Multiple ROIs and sub-ROIs can be used to generate a Stiffness Gradient Histogram which can be selected from same analyzed image (case) or different analyzed image (case) for more standardized compare.
The drawback of the ROI Stiffness Gradient Histogram evaluated from user-selected ROI (flexible size and shape) is the size dependency. If ROIs with significantly different size are compared, the deduced Stiffness Gradient Histograms will not be comparable. To solve this drawback, a feature for selecting a fixed size and disk-shaped sub-ROIs and evaluation of sub-ROI histograms are included as an embodiment of the invention.
In addition, following statistical indices are also evaluated from a Stiffness Gradient Histogram and presented on the view window Mean: Mean value of the histogram Variance: Second order moment around mean value that represents the “wideness” of the histogram
Skewness: Third order moment around mean value that represents the “measure of the asymmetry” of the histogram Kurtosis: Fourth order moment about mean value that represents the “peakedness” of the histogram Aspect Ratio: Also a parameter shows the “peakedness” of the histogram.
It is to be understood that the invention is not limited in its application to the details of construction and the arrangement of components set forth in the following description or illustrated in the following drawings. The invention is capable of other embodiments and of being practiced or of being carried out in various ways.
The disclosed method utilizes unique tissue (material) properties in a selected ROI and a tracking algorithm and ultrasound echo single/image analysis algorithm to achieve evaluation of tissue type/status specific mechanical functionality.
A technical contribution for the disclosed method and apparatus is that it provides for a computer implemented for ultrasound image processing.
In accordance with still another aspect of the invention, a method for deducing simple image output or numerical scale for monitoring tissue pathology includes feature that evaluates and presents of a local or total tissue stiffness-strain relation with selected and processed ROI (region of interest). Then the stiffness gradient is further evaluated as over-all slope of the deduced tissue stiffness-strain relation. The deduced tissue functionality (stiffness, stiffness-gradient) or tissue mechanical behavior (tissue deformation, displacement, rate of deformation and rate of displacement) at each image pixel can be presented as easy understand color map. The same information can be also presented in the form of histogram plot or probability distribution function plot. Finally, the shape aspect ratio of these plots can be calculated as a numerical single number ordinal scale that represents the tissue health. All these information can be evaluated from the ultrasound images captured from same pathological tissue location of the same patient at different visits. Finally deduced information can be compared and used to monitor heal or progress of tissue pathology.
One skilled in the art will appreciate that embodiments of the invention may be interfaced to and controlled by a computer readable storage medium having stored thereon a computer program. The computer readable storage medium includes a plurality of components such as one or more of electronic components, hardware components, and/or computer software components. These components may include one or more computer readable storage media that generally stores instructions such as software, firmware and/or assembly language for performing one or more portions of one or more implementations or embodiments of a sequence. These computer readable storage media are generally non-transitory and/or tangible. Examples of such a computer readable storage medium include a recordable data storage medium of a computer and/or storage device. The computer readable storage media may employ, for example, one or more of a magnetic, electrical, optical, biological, and/or atomic data storage medium. Further, such media may take the form of, for example, floppy disks, magnetic tapes, CD-ROMs, DVD-ROMs, hard disk drives, and/or electronic memory. Other forms of non-transitory and/or tangible computer readable storage media not list may be employed with embodiments of the invention.
A number of such components can be combined or divided in an implementation of a system. Further, such components may include a set and/or series of computer instructions written in or implemented with any of a number of programming languages, as will be appreciated by those skilled in the art. In addition, other forms of computer readable media such as a carrier wave may be employed to embody a computer data signal representing a sequence of instructions that when executed by one or more computers causes the one or more computers to perform one or more portions of one or more implementations or embodiments of a sequence.
In accordance with one embodiment of the invention, an ultrasound system includes an ultrasound transducer adapted to obtain a dynamic series of echo signals of a subject tissue at different deformation states, and an image processor for generating and displaying ultrasound images of the tissue. The processor is configured to generate dynamic images that correspond to the dynamic series of echo signals, identify a plurality of pixels within a region of interest (ROI) of a first of the generated images, evaluate local tissue mechanical behavior by tracking the displacement, deformation, and echo intensity of the identified plurality of pixels from the first image to subsequent images based on groups of pixels that correspond to each of the identified plurality of pixels, determine tissue functionality in the subject at the tracked pixel locations, and display the tissue functionality in dynamic images that corresponds to the tracked pixel locations.
In accordance with another embodiment of the invention, a method of determining a deformed state of a tissue in ultrasound images, the method includes selecting pixels that are within a region of interest (ROI) of a first ultrasound image of a tissue, wherein the tissue is at a first state of deformation, identifying pixels that surround the selected pixels in the first ultrasound image, evaluating a local tissue mechanical behavior by tracking the selected pixels from the first ultrasound image to subsequent locations in subsequent ultrasound images using the identified pixels that surround the selected pixels, wherein the subsequent ultrasound images correspond to different states of tissue deformation, determining functionality of the tissue at the subsequent locations of the identified pixels, and displaying the functionality at their original or subsequent locations in an image of the tissue.
In accordance with yet another embodiment of the invention, a non-transitory computer readable storage medium having stored thereon a computer program comprising instructions which when executed by a computer cause the computer to obtain a dynamic series of echo signals of a subject taken using an ultrasound transducer with a tissue of the subject at different states of deformation, generate first and second images using the obtained series of echo signals, identify target pixels and their neighboring pixels in the first image, assume locations of the target pixels and their neighboring pixels in the second image, calculate values of a mathematical norm based on the target pixels and their neighboring pixels in the first image and based on their assumed location in the second image, derive actual locations of at least the target pixels in the second image based on the values of the mathematical norm, and overlay deduced functionality or mechanical behavior of the tissue that correspond to their actual locations in the original or second image.
In accordance with still another embodiment of the invention, a method for monitoring tissue pathology includes generating a first tissue functionality histogram/probability density function plot based at least in part upon motion or deformation of a first pixel between a first ultrasound image at a first deformed state and a second ultrasound image at a second deformed state, calculating a first ordinal scale aspect ratio based upon the first tissue functionality histogram, generating a second tissue functionality histogram/probability density function plot based at least in part upon motion of a second pixel between a third ultrasound image at a third deformed state and a fourth ultrasound image at a fourth deformed state, calculating a second ordinal scale aspect ratio based upon the second tissue functionality histogram/probability density function plot, and generating a time series plot based on the first ordinal scale aspect ratio and the second ordinal scale aspect ratio as an indicator of a tissue pathology.
This written description uses examples to disclose the invention, including the best mode, and also to enable any person skilled in the art to practice the invention, including making and using any devices or systems and performing any incorporated methods. The patentable scope of the invention is defined by the claims, and may include other examples that occur to those skilled in the art. Such other examples are intended to be within the scope of the claims if they have structural elements that do not differ from the literal language of the claims, or if they include equivalent structural elements with insubstantial differences from the literal languages of the claims.
The present application is a continuation of and claims priority to U.S. patent application Ser. No. 13/293,499 filed Nov. 10, 2011, which claims priority to U.S. Provisional Application 61/412,071 filed Nov. 10, 2010, the disclosures of which are incorporated herein in their entirety.
| Number | Date | Country | |
|---|---|---|---|
| 61412071 | Nov 2010 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 13293499 | Nov 2011 | US |
| Child | 14460043 | US |
