Patent Application
20150018681
This application is based upon and claims the benefit of priority from Japanese Patent Application No. 2013-147048, filed Jul. 12, 2013; the entire contents all of which are incorporated herein by reference.
Embodiments relate to ultrasound diagnosis apparatus, medical image-processing apparatus, and methods of processing medical images.
Ultrasound diagnosis apparatus acquires biological information of a subject by sending ultrasound waves into the subject and receiving reflected waves through an ultrasound probe. The ultrasound diagnosis apparatus then generates ultrasound image data, which represent, for example, tissue structures of the subject, based on the acquired biological information.
As for prior-art ultrasound diagnosis apparatuses, there is a technique known as “transmission-reception compound technique”. The transmission-reception compound technique is a technique in which ultrasound waves through the subject are transmitted and received based on a plurality of transmission and reception conditions, and a plurality of sets of image data obtained accordingly are then combined to generate composition image data. For example, an ultrasound diagnosis apparatus transmits and receives ultrasound waves through the subject in a plurality of transmission and reception directions as transmission and reception conditions and then combines a plurality of sets of image data thus obtained. In addition, the ultrasound diagnosis apparatus may transmit and receive ultrasound waves of a plurality of transmission and reception frequencies through the subject as transmission and reception conditions and then combine a plurality of sets of image data thus obtained. Furthermore, the ultrasound diagnosis apparatus may generate a set of image data for each of a plurality of received-signal processing conditions as transmission and reception conditions and may combine a plurality of sets of image data thus obtained.
In such a transmission-reception compound technique, for example, the ultrasound diagnosis apparatus calculates arithmetic means for the pixel values of a plurality of sets of image data to determine pixel values for composition image data so as to generate the composition image data with reduced speckle noise.
Moreover, by the transmission-reception compound technique, the ultrasound diagnosis apparatus may emphasize a particular tissue structure depicted in an image. In such a case, the ultrasound diagnosis apparatus selects maximum values from the pixel values of a plurality of sets of image data and sets the maximum values as pixel values for composition image data so as to generate the composition image data with an enhanced contour for the tissue structure depicted in an image. In the specification, this method of image-synthesis is referred to as “highest selection”.
However, the image generated through the arithmetic means as composition image data has been such that the difference in pixel values representing the contour and the other part is smaller than that of the image generated through the highest selection as composition image data. As a result, the image generated through the arithmetic means as composition image data is rather difficult for the user to visually recognize the contour. On the other hand, the composition image data generated through the highest selection include more speckle noise than the composition image data generated through the arithmetic means. This means that images from the composition image data generated through the highest selection show unevenness in pixel values for the same tissue. Accordingly, the images are difficult for the user to visually recognize the same tissue.
An ultrasound diagnosis apparatus as an embodiment comprises an image generator, a first structural information acquirer, a second structural information acquirer, and a synthesizer. The image generator generates, based on ultrasound waves transmitted and received in accordance with a plurality of transmission and reception conditions, sets of image data whose images represent at least partially a common area for each of the transmission and reception conditions. The first structural information acquirer acquires tissue-structure information indicative of tissue structures depicted, respectively, in the sets of image data. The second structural information acquirer acquires common structural information indicative of a tissue structure common in the sets of image data, based on the tissue-structure information. The synthesizer changes the method of image-synthesis applied on the sets of image data, a different method for each of the image areas distinguished based on the common structural information, and generates composition image data based on the sets of image data.
The ultrasound probe 1 sends ultrasound waves into the subject, based on pulse signals received from a transmitter-receiver circuit 212, and ultrasound waves are reflected at boundaries of difference in acoustic impedance in the is subject. The ultrasound probe 1 receives reflected waves from the subject. The ultrasound probe 1 has a plurality of ultrasound transducers. The ultrasound probe 1 used may be a 1D array probe, whose plurality of ultrasound transducers are disposed in a line in scanning direction, or a 2D array probe, whose plurality of ultrasound transducers are disposed two-dimensionally. The ultrasound probe 1 converts pulse signals received from the transmitter-receiver circuit 212 into acoustic signals by the ultrasound transducers and sends them into the subject. In addition, the ultrasound probe 1 receives reflected waves from the subject with the ultrasound transducers, converts them into electrical signals (echo signals), and outputs them to the transmitter-receiver circuit 212.
The main body 2 comprises a scanner 21, an image-processor 22, a second storage 23, a display controller 24, and a system controller 25.
The scanner 21 transmits and receives ultrasound waves through the subject based on a plurality of transmission and reception conditions and generates image data that represent tissue structures of the subject for each of the transmission and reception conditions. In addition, the scanner 21 generates image data based on a plurality of transmission and reception directions, a plurality of transmission and reception frequencies, or a plurality of reception-signal processing conditions as the transmission and reception conditions. The scanner 21 comprises a transmission and reception controller 211, a transmitter-receiver circuit 212, an amplifier 213, an ADC (Analog-to-Digital Converter) 214, a beam-former 215, an image generator 216, and a first storage 217.
The transmission and reception controller 211 outputs control signals that indicate conditions for the transmission and reception of ultrasound waves, to the transmitter-receiver circuit 212. The transmission and reception conditions include a plurality of transmission and reception directions or a plurality of transmission and reception frequencies. For example, the transmission and reception controller 211 receives transmission and reception conditions set by the user, from the system controller 25. The control signals output from the transmission and reception controller 211 include transmission and reception direction information that is used for modifying the strength and the application timing of pulse signals that are output from the transmitter-receiver circuit 212 to the ultrasound probe 1, each signal for a corresponding one of the ultrasound transducers. As a result, the ultrasonic beam being emitted from the ultrasound probe 1 is controlled with respect to its direction and angle. The transmission and reception controller 211 stores, in advance, predetermined sets of transmission and reception direction information.
In addition, the control signals output from the transmission and reception controller 211 may include various sets of transmission and reception frequency information that indicate frequencies for pulse signals that are output from the transmitter-receiver circuit 212 to the ultrasound probe 1. As a result, the ultrasound waves being emitted from the ultrasound probe 1 are controlled with respect to their frequency. The transmission and reception controller 211 stores, in advance, predetermined sets of transmission and reception frequency information.
The transmitter-receiver circuit 212 outputs pulse signals to the ultrasound probe 1, based on control signals received from the transmission and reception controller 211. For example, the transmitter-receiver circuit 212 outputs a pulse signal for each individual path (channel) that leads to a corresponding one of the ultrasound transducers in order to emit ultrasound waves that are beam-formed at a predetermined focal point (i.e., transmission-beam-formed). In addition, the transmitter-receiver circuit 212 receives echo signals from each of the ultrasound transducers of the ultrasound probe 1 and outputs them to the amplifier 213.
The amplifier 213 amplifies the echo signals received from the ultrasound probe 1 and outputs them to the ADC 214. The amplifier 213 is configured to include, for example, a preamplifier circuit.
The ADC 214 converts the echo signals, which have been amplified by the amplifier 213, into digital signals and outputs them to the beam-former 215.
The beam-former 215 executes delay-processing and addition-processing on the digital signals received from the ADC 214 in order to calculate phased signals (i.e., reception-beam-formed). The beam-former 215 outputs the phased signals to the image generator 216 as reception signals.
(Image generator 216)
The image generator 216 generates, based on ultrasound waves transmitted and received in accordance with a plurality of transmission and reception conditions, sets of image data whose images represent at least partially a common area for each of the transmission and reception conditions. The image generator 216, as it receives reception signals from the beam-former 215, creates an image from the amplitude information of the received signals. At this instant, the image generator 216 processes the reception signals with a band-pass filter and detects the envelope of the signals, which have been band-pass filtered. The image generator 216 then executes compression-processing by logarithmic transformation on the data detected from the waves. In addition, the image generator 216 may execute a process of spatial filtering on the reception signals, the process being smoothing or sharping with respect to a predetermined direction. The image generator 216 outputs the processed data as image data to the first storage 217. Incidentally, the image generator 216 may generate a set of image data for each of a plurality of reception-signal processing conditions as the transmission and reception conditions. The image generator 216 stores, in advance, various sets of reception-signal processing conditions, which include, for example, processing conditions for the process of spatial filtering.
The first storage 217 receives image data from the image generator 216 and stores them.
Incidentally, all parts of the scanner 21 mentioned above function in accordance with each of the transmission and reception conditions. As a result, the image generator 216 generates a set of image data for each of the transmission and reception conditions, i.e., a plurality of transmission and reception directions, a plurality of transmission and reception frequencies or a plurality of reception-signal processing conditions provided as the transmission and reception conditions. The first storage 217, therefore, stores a set of image data for each of the transmission and reception conditions.
The image-processor 22 comprises a scan-converter 221, a first structural information acquirer 222, a second structural information acquirer 223, a synthesizer 224, and a third storage 225.
The scan-converter 221 reads image data out of the first storage 217. The scan-converter 221 converts the image data that correspond to a column of signals for a scanning line into data to be displayed in a coordinate system. The scan-converter 221 outputs the converted image data to the third storage 225, which stores them.
The first structural information acquirer 222 acquires tissue-structure information indicative of tissue structures depicted, respectively, in a plurality of sets of image data. For example, the first structural information acquirer 222 reads image data out of the third storage 225 and acquires tissue-structure information indicative of tissue structures depicted in the image data. The first structural information acquirer 222 also acquires first structural information for each set of image data (image data per frame). For example, the first structural information acquirer 222 executes on the image data edge-detection processing based on such edge-detection algorithms as Sobel, Laplacian, and Canny. As a result, tissue-structure information is acquired as contour information which provides enhanced pixel values for pixels representing the part along the contour of a tissue structure. In addition, the first structural information acquirer 222 may acquire structure tensor for the image data and may output the acquired structure tensor as tissue-structure information to the third storage 225. In the structure tensor, the contour in the image data is indicated by the magnitudes of specific values. Furthermore, the first structural information acquirer 222 may execute, on the image data, Wavelet conversion and such multi-resolution analysis as Laplacian Pyramid and may then acquire tissue-structure information for a predetermined layer by using the above-mentioned methods. Incidentally, the first structural information acquirer 222, after acquiring the contour, may execute a process of spatial filtering for emphasizing the contour. In addition, the first structural information acquirer 222 may execute normalization-processing on the tissue-structure information. Furthermore, the first structural information acquirer 222 may execute threshold-processing on the tissue-structure information for converting the tissue-structure information into binary information. In this case, for example, the pixel value for pixels representing the contour may be set at “1” while the pixel value for pixels representing other than the contour may be set at “0”. The first structural information acquirer 222 outputs the acquired tissue-structure information to the third storage 225, which stores it.
The second structural information acquirer 223 acquires common structural information indicative of a tissue structure common in the sets of image data, based on the tissue-structure information. In this case, the second structural information acquirer 223 reads more than one set of tissue-structure information out of the third storage 225. With respect to the sets of tissue-structure information read out, the second structural information acquirer 223 multiplies the pixel values of pixels that are at the same coordinates in the sets of image data. The second structural information acquirer 223 executes this multiplication for each pixel and acquires common structural information, and for example, the pixel values of pixels representing the contour in the image data are emphasized in the contour information. The second structural information acquirer 223 emphasizes the pixel values of pixels representing the common contour, which is a contour common in the sets of image data, by multiplying the pixel values in the contour information. As a result, in the common contour information as common structural information, the pixel values of pixels for the common contour are enhanced much more than the pixel values of pixels for other than the common contour. The positions of the pixels whose values have been emphasized represent the position of the common contour. Additionally, the second structural information acquirer 223 may execute normalization-processing on the acquired common structural information. The second structural information acquirer 223 outputs the acquired common structural information to the third storage 225, which stores it.
In addition, if the first structural information is binary information, the second structural information acquirer 223 executes AND operation on the pixel values of pixels that are at the same coordinates in the sets of tissue-structure information read out. The second structural information acquirer 223 executes this AND operation for each pixel and acquires common structural information. If the tissue-structure information is binary information, it has “1” as the pixel value for the pixels representing a tissue structure in the image data and “0” as the pixel value for the pixels representing no tissue structure. The second structural information acquirer 223 executes AND operation on the pixel values at the same coordinates in the sets of tissue-structure information so as to set the pixel value for pixels representing the common contour, which is a tissue structure common in the sets of image data, at “1” and the pixel value for pixels representing other than the common contour at “0”. As a result, the pixel value for pixels representing the common contour is set at “1” in the common structural information. The positions of these pixels represent the position of the common contour. The second structural information acquirer 223 outputs the acquired common structural information to the third storage 225, which stores it.
The synthesizer 224 applies different methods of image-synthesis on a plurality of sets of image data, each method to a corresponding one of the image areas distinguished based on the common structural information, in order to generate composition image data based on the sets of image data. For example, to the pixels representing a common structure and to the other of the pixels in a plurality of sets of image data, the synthesizer 224 applies different methods of image-synthesis, respectively, based on the common structural information, in order to combine the sets of image data and generate composition image data. The methods of image-synthesis here include two or more of the following: arithmetic mean in which the means of pixel values in the sets of image data are set as pixel values for the composition image data; highest selection in which the maximum values of pixel values in the sets of image data are set as pixel values for the composition image data; weighting addition in which the values obtained by weighting and adding pixel values in the sets of image data are set as pixel values for the composition image data; median selection in which the median values of pixel values in the sets of image data are set as pixel values for the composition image data; and lowest selection in which the minimum values of pixel values in the sets of image data are set as pixel values for the composition image data. In addition, the synthesizer 224 generates sets of intermediate composition image data, each set being a composition of the sets of image data by a corresponding one of the methods of image-synthesis applied, and generates a first composition map, which relates any one of the sets of intermediate composition image data to the common structural information, and then generates the composition image data based on the first composition map. The synthesizer 224 comprises an intermediate composer 226, a composition mapper 227, and a composition data unit 228.
The intermediate composer 226 reads sets of image data out of the third storage 225 and generates sets of intermediate composition image data, each set being a composition of the sets of image data by a corresponding one of the methods of image-synthesis applied. The methods of image-synthesis include two or more of the arithmetic mean, highest selection, weighting addition, median selection and lowest selection. In the following descriptive example, the intermediate composition image data are generated based on image data generated in accordance with n types of transmission and reception conditions (n: any natural number that is 2 or larger). For example, the intermediate composer 226 reads n sets of image data out of the third storage 225. The intermediate composer 226, for generating intermediate composition image data by the arithmetic mean of the methods of image-synthesis, executes a masking process that multiplies the pixel values of all pixels in the image data by 1/n. The intermediate composer 226 then adds together the n sets of image data that have been masking-processed so as to generate the intermediate composition image data by the arithmetic mean. In addition, the intermediate composer 226, for generating intermediate composition image data by the highest selection of the methods of image-synthesis, selects the image data whose pixel values are the maximum for the pixels at the same respective coordinates in the n sets of image data. The intermediate composer 226 then substitutes the pixel values respectively selected of the pixels in the image data, so as to generate the intermediate composition image data by the highest selection. Furthermore, the intermediate composer 226, for generating intermediate composition image data by the weighting addition, stores in advance a weighting coefficient for each of the n sets of image data and multiplies the pixel values of the pixels in each set of image data by a corresponding weighting factor. The intermediate composer 226 then adds together the n sets of image data after the multiplication, so as to generate the intermediate composition image data by the weighting addition. Moreover, the intermediate composer 226, for generating intermediate composition image data by the median selection of the methods of image-synthesis, selects the image data whose pixel values are the medians for the pixels at the same respective coordinates in the n sets of image data. The intermediate composer 226 then substitutes the pixel values respectively selected of the pixels in the image data, so as to generate the intermediate composition image data by the median selection. Also, the intermediate composer 226, for generating intermediate composition image data by the lowest selection of the methods of image-synthesis, selects the image data whose pixel values are the minimum for the pixels at the same respective coordinates in the n sets of image data. The intermediate composer 226 then substitutes the pixel values respectively selected of the pixels in the image data, so as to generate the intermediate composition image data by the lowest selection. The intermediate composer 226 outputs the generated intermediate composition image data to the third storage 225, which stores them.
For the intermediate composer 226, the methods of image-synthesis are preset to be used for generating intermediate composition image data. For example, the methods of image-synthesis are set for a particular part of the subject to be depicted in image data. Also, the intermediate composer 226 may accept the specifications of the methods of image-synthesis by the user.
The composition mapper 227 generates a first composition map, which indicates intermediate composition image data in relation to respective coordinates. In the composition mapper 227, methods of image-synthesis are preset, for example, one method for the pixels representing a common structure and another for the pixels representing no common structure. These methods of image-synthesis are the methods applied for image-synthesis by the intermediate composer. Furthermore, different methods of image-synthesis are set, respectively, one for the pixels representing a common structure and another for the pixels representing no common structure. The composition mapper 227 reads common structural information and intermediate composition image data out of the third storage 225. The composition mapper 227 relates the coordinates of the pixels representing a common structure, which are indicated in the common structural information, to the pixels at the respective coordinates of the intermediate composition image data by the method of image-synthesis that corresponds to the pixels representing a common structure. In addition, the composition mapper 227 relates the coordinates of the pixels representing no common structure, which are indicated in the common structural information, to the pixels at the respective coordinates of the intermediate composition image data by the method of image-synthesis that corresponds to the pixels representing no common structure. As a result, on the first composition map, sets of intermediate composition image data, each set having been generated by a method of image-synthesis different from the other, are related respectively to the coordinates of the pixels representing a common structure and to the coordinates of the pixels representing no common structure. The composition mapper 227 outputs the generated first composition map to the third storage 225, which stores it.
The composition data unit 228 generates composition image data based on the first composition map. The composition data unit 228 reads the first composition map and intermediate composition image data out of the third storage 225. The composition data unit 228 executes a process that sets the pixel values of the pixels at the coordinates in the intermediate composition image data that are related to coordinates on the first composition map, as the pixel values of the pixels at the corresponding coordinates in the composition image data. The composition data unit 228 generates composition image data by executing this process for all the coordinates.
Here, on the first composition map, related respectively to the coordinates of the pixels representing a common structure and to the coordinates of the pixels representing no common structure are sets of intermediate composition image data, each set having been generated by a method of image-synthesis different from the other. For the sets of composition image data, therefore, the method of image-synthesis applied to the pixel values in the intermediate composition image data substituting for the pixels representing a common structure is different from the method of image-synthesis applied to the pixel values in the intermediate composition image data substituting for the pixels representing no common structure. For example, on the first composition map, if the intermediate composition image data by the highest selection are related to the coordinates of the pixels representing a common structure, and the intermediate composition image data by the arithmetic mean are related to the coordinates of the pixels representing no common structure, then, for the composition image data, the composition data unit 228 substitutes the pixel values in the intermediate composition image data by the highest selection for the pixels representing a common structure and the pixel values in the intermediate composition image data by the arithmetic mean for the pixels representing no common structure. As a result, the composition image data are generated with the pixel values calculated by the highest selection of the methods of image-synthesis, which is assigned to the pixels representing a common structure, and with the pixel values calculated by the arithmetic mean of the methods, which is assigned to the pixels representing no common structure. This is equivalent to that the composition image data are generated as image data combined by different methods of image-synthesis, one method for the pixels representing a common structure and another for the pixels representing no common structure. The composition data unit 228 outputs the generated composition image data to the second storage 23.
Now, explanation is given of the significance of applying different methods of image-synthesis, respectively, for the pixels representing a common structure and for the pixels representing no common structure. Here, as a descriptive example, image data are generated, based on three transmission and reception directions as transmission and reception conditions. The first structural information acquirer calculates, as tissue-structure information, contour information on the image data, and the second structural information acquirer receives the contour information and acquires, as common structural information, common contour information that is common in the sets of image data.
The first structural information acquirer 222 acquires the contour of a tissue structure in each set of image data, and therefore, generates contour information that indicates as contours both the real image and the artifact depicted in the image data. In other words, the contour information includes information that indicates the contours whose coordinate information is both for the real image and the artifacts. The second structural information acquirer 223 acquires common contour information that indicates a common contour, which is the contour common in the sets of image data. In the case of the example shown in
For example, the synthesizer 224 executes image-synthesis by the highest selection on the pixels representing the common contour (real image T1, real image T2, and real image T3) and executes image-synthesis by the arithmetic mean on the pixels representing no common contour. In this process, maximum values existing in real image T1, real image T2 and real image T3 are assigned as the pixel values for the pixels representing the common contour. As a result, large pixel values are assigned to the pixels representing the common contour. As large pixel values are employed in this way, the real image, which is the common contour, is emphasized. On the other hand, for the pixel values of the pixels representing no common contour, employed are the addition mean values of the corresponding pixel values in image P1, image P2 and image P3. As a result, pixel values are reduced for artifact A1, artifact A2 and artifact A3, so the artifacts depicted at coordinates, which are not for the common contour, are reduced in the composition image data.
In addition,
Contour is a part where acoustic impedance changes greatly. If the contour is emphasized in the composition image data, viewability is improved of the image based on the composition image data. Respective undulations of line L1, line L2 and line L3 schematically show pixel value distributions in the transmission and reception directions and unevenness of pixel values caused by speckle noise. In image P1, which has been generated based on transmission and reception direction D1, pixel values are high in the vicinity of position S4, where the contour C is perpendicular to transmission and reception direction D1, and pixel values decrease as the position along the contour goes away from position S4. In addition, in image P2, which has been generated based on transmission and reception direction D2, pixel values are high in the vicinity of position S5, where the contour C is perpendicular to transmission and reception direction D2, and pixel values decrease as the position along the contour goes away from position S5. In addition, in image P3, which has been generated based on transmission and reception direction D3, pixel values are high in the vicinity of position S3, where the contour C is perpendicular to transmission and reception direction D3, and pixel values decrease as the position along the contour goes away from position S3.
On the other hand, in the pixel value distribution by the highest selection shown by line L5, pixel values are high in all positions. Assigning pixel values obtained by the highest selection as pixel values for the contour C in the composition image data means the emphasizing of the pixel values representing is the contour C. As a result, the contour C in the composition image data is enhanced, improving the viewability of the image on the composition image data.
In addition,
The inside of the part R is not the place where acoustic impedance changes greatly. If the unevenness of pixel values in position S8 through position S14 is reduced in composition image data, then the viewability of the image on the composition image data will improve. From position S8 to position S14, line L6, line L7, and line L8 show undulations indicating the unevenness of pixel values caused by speckle noise but do not show any pixel value change that is influenced by the transmission and reception direction.
In the pixel value distribution by the arithmetic mean shown by line L9, the unevenness of pixel values caused by speckle noise is reduced from those shown by line L6, line L7 and line L8. For the composition image data, applying the pixel values obtained by the arithmetic mean to the pixels representing the part from position S8 to position S14 is equivalent to reducing the unevenness of pixel values over these positions. As a result, the unevenness of pixel values is reduced over different positions in the part R, and the viewability is improved of the image on the composition image data.
Incidentally, the example explained here involves the generation of image data based on three transmission and reception directions for a part having a circular cross-section, and the application of the highest selection to the pixels representing a common contour and of the arithmetic mean to the pixels representing no common contour as methods of image-synthesis. However, other methods of image-synthesis may be applied. For example, such other methods include the weighting addition, median selection, and lowest selection. The synthesizer 224 accepts the setup of methods of image-synthesis to be applied respectively to the pixels representing a common contour and to the pixels representing no common contour, and the synthesizer 224 generates composition image data based on the set methods of image-synthesis.
In addition, these methods of image-synthesis may be preset in the synthesizer 224 for each part of the subject to be scanned. For example, if the part is the liver, then the highest selection may be applied for the common contour, and the arithmetic mean may be applied for part other than the common contour. Also, if the part is the muscle, then the highest selection may be applied for the common contour, and the lowest selection may be applied for part other than the common contour.
Furthermore, the methods of image-synthesis applied for the common contour and for part other than the common contour may be a method for generating a composition image by weighting a plurality of composition images. For example, the part other than the common contour may be rendered with a method of image-synthesis that applies the weighting addition to the arithmetic mean and median selection, to generate a new composition image.
The third storage 225 stores image data by the scan-converter 221. The third storage 225 stores tissue-structure information by the first structural information acquirer 222. The third storage 225 stores common structural information by the second structural information acquirer 223. The third storage 225 stores intermediate composition image data by the intermediate composer 226. The third storage 225 stores a composition map by the composition mapper 227.
The second storage 23 receives composition image data from the composition data unit 228 and stores it.
The display controller 24 reads composition image data out of the second storage 23 and causes the display 3 to display an image based on the composition image data, which have been read out.
The system controller 25 controls the actions of all parts of the ultrasound diagnosis apparatus. The system controller 25 stores, in advance, computer programs for execution of the functions of all parts of the ultrasound diagnosis apparatus. The system controller 25 executes the computer programs for realization of the functions. For example, the system controller 25 accepts through the operation unit 4 a setup of transmission and reception conditions by the user, and outputs the set transmission and reception conditions to the transmission and reception controller 211.
The display 3 displays an image based on the composition image data that the display controller 24 has read out. For example, the display 3 comprises a display device like CRT (Cathode Ray Tube) or LCD (Liquid Crystal Display).
The operation unit 4 accepts operations by the user and, through the system controller 25, inputs signals and information that correspond to the contents of the operation, to corresponding parts of the apparatus. For example, the operation unit 4 is configured with a keyboard, a mouse, a touch panel. etc.
The system controller 25 accepts a setup of transmission and reception conditions by the user through the operation unit 4 and outputs the set transmission and reception conditions to the transmission and reception controller 211. The transmission and reception controller 211 receives the transmission and reception conditions from the system controller 25 and stores them.
The image generator 216 generates sets of image data whose images represent at least partially a common area for the respective transmission and reception conditions, based on ultrasound waves transmitted and received in accordance with the transmission and reception conditions. In addition, for each of the transmission and reception conditions, the scanner 21 stores, a corresponding set of image data in the first storage 217.
The scan-converter 221 reads the image data out of the first storage 217. The scan-converter 221 converts the image data, which are represented in columns of signals by scanning line, into those to be displayed in a coordinate system. The scan-converter 221 outputs the converted image data to the third storage 225, which stores them. In addition, the first structural information acquirer 222 reads the image data out of the third storage 225 and acquires tissue-structure information present in the image data. The first structural information acquirer 222 outputs the acquired tissue-structure information to the third storage 225, which stores it. Incidentally, step S003 corresponds to an example of the “step of acquiring first structural information” in the embodiment of a method of processing medical images.
The second structural information acquirer 223 acquires common structural information, which is common in the sets of image data, based on the tissue-structure information. The second structural information acquirer 223 outputs the acquired common structural information to the third storage 225, which stores it. Incidentally, step S004 corresponds to an example of the “step of acquiring second structural information” in the embodiment of a method of processing medical images.
The intermediate composer 226 reads a plurality of sets of image data out of the third storage 225 and generates sets of intermediate composition image data, each set being a composition of the sets of image data generated by a corresponding one of the methods of image-synthesis applied. The intermediate composer 226 outputs the generated intermediate composition image data to the third storage 225, which stores them.
The composition mapper 227 reads the common structural information and the intermediate composition image data out of the third storage 225. The composition mapper 227 then generates a first composition map that indicates the intermediate composition image data in relation to their respective coordinates. The composition mapper 227 outputs the generated first composition map to the third storage 225, which stores it.
The composition data unit 228 reads the first composition map and the intermediate composition image data out of the third storage 225. The composition data unit 228 then generates composition image data based on the first composition map. The composition data unit 228 outputs the generated composition image data to the second storage 23.
Incidentally, step S005, step S006, and step S007 correspond to examples of the “step of generating” in the embodiment of a method of processing medical images.
The display controller 24 reads the composition image data out of the second storage 23 and causes the display 3 to display an image based on the composition image data, which have been read out.
Now, description is about the effects of the ultrasound diagnosis apparatus as this embodiment. The ultrasound diagnosis apparatus as this embodiment comprises an image generator 216, a first structural information acquirer 222, a second structural information acquirer 223, and a synthesizer 224. The image generator 216 generates, based on ultrasound waves transmitted and received in accordance with a plurality of transmission and reception conditions, sets of image data whose images represent at least partially a common area for the respective transmission and reception conditions. The first structural information acquirer 222 acquires tissue-structure information indicative of tissue structures depicted, respectively, in the sets of image data. The second structural information acquirer 223 acquires, based on the tissue-structure information, common structural information indicative of a tissue structure common in the sets of image data. The synthesizer 224 applies different methods of image-synthesis on the sets of image data, respectively, one method for a corresponding one of the image areas distinguished based on the common structural information so as to generate composition image data based on the sets of image data. In this way, the ultrasound diagnosis apparatus finds a common structure present in a plurality of sets of image data, each set of image data having been acquired on a corresponding one of the transmission and reception conditions, and applies different methods of image-synthesis, one method to the pixels representing the common structure and another to the pixels representing no common structure, in order to generate a composition image. As a result, the ultrasound diagnosis apparatus can provide an improved viewability to the tissue structure depicted in the image.
This variant embodiment is different from the first embodiment in the processing steps performed by the second structural information acquirer 223 and by the synthesizer 224. The following description, therefore, concerns particularly on the matters different from those of the first embodiment.
The second structural information acquirer 223 acquires common structural information in divisions of a plurality of ranks, based on the tissue-structure information. In this case, the second structural information acquirer 223 reads a plurality of sets of tissue-structure information out of the third storage 225. The second structural information acquirer 223 multiplies the pixel values of pixels that are at the same respective coordinates in the sets of tissue-structure information read out. The second structural information acquirer 223 executes this multiplication on each pixel. In the common structural information, the pixel values of pixels representing a common structure are enhanced. In addition, the second structural information acquirer 223 divides the pixel values into a plurality of sections and classifies the pixels representing a common structure by the sections, into a plurality of ranks. Such sections are preset in the second structural information acquirer 223. The ranks of this classification indicate contour tendency with respect to the respective pixels representing the common structure. For example, the larger the pixel value in the common structural information, the higher it is set in the ranks. In this case, the higher in the ranks, the closer the pixel is located to the contour of the common structure in the coordinate system.
As for the pixels representing the common structure indicated by the common structural information, the synthesizer 224 generates composite data by applying different methods of image-synthesis in accordance with the respective ranks of the pixels indicated in the common structural information. The methods of image-synthesis here include two or more of the following: arithmetic mean in which the means of pixel values in the sets of image data are set as pixel values for the composition image data; highest selection in which the maximum values of pixel values in the sets of image data are set as pixel values for the composition image data; weighting addition in which the values obtained by weighting and adding pixel values in the sets of image data are set as pixel values for the composition image data; median selection in which the median values in the sets of image data are set as pixel values for the composition image data; and lowest selection in which the minimum values of pixel values in the sets of image data are set as pixel values for the composition image data. The synthesizer 224 generates a plurality of sets of intermediate composition image data, each set being a composition of the sets of image data by a corresponding one of the methods of image-synthesis applied, and generates a second composition map, which relates the ranks indicated in the common structural information to weighting factors for the sets of intermediate composite data, and then generates composition image data based on the second composition map.
In the composition mapper 227, the weighting factors are preset for the methods of image-synthesis, each of which methods is applied to a corresponding one of the ranks of the pixels representing a common structure, with the ranks being indicated in the common structural information. In addition, in the composition mapper 227, also preset is the method of image-synthesis that is applied to the pixels representing no common structure. The composition mapper 227 relates the weighting factors for the methods of image-synthesis, each method applied to a corresponding one of the ranks of the pixels representing a common structure, to the coordinates of the respective pixels. As a result, the intermediate composition image data generated by the methods of image-synthesis with the weighting factors are related to the coordinates of the pixels representing a common structure. In addition, the composition mapper 227 relates the intermediate composition image data generated by the method of image-synthesis applied to the pixels representing no common structure to the coordinates of the pixels representing no common structure. In this way, the composition mapper 227 generates the second composition map, which indicates the intermediate composition image data generated by the methods of image-synthesis with the weighting factors related to the coordinates of the pixels representing a common structure and which indicates the intermediate composition image data related to the coordinates of the pixels representing no common structure. The composition mapper 227 outputs the generated second composition map to the third storage 225, which stores it.
The composition data unit 228 generates composition image data based on the second composition map. The composition data unit 228 reads the second composition map and the intermediate composition image data out of the third storage 225. Of the coordinates on the second composition map, the composition data unit 228 treats the coordinates related to the weighting factors as the coordinates of the common structure and the coordinates not related to any weighting factor as the coordinates of the part other than the common structure. As for the coordinates of the common structure, the composition data unit 228 executes a process in which the weighting addition is performed on the pixel values of the pixels at the respective coordinates in the sets of intermediate composition image data, which are linked respectively with the weighting factors related to the coordinates. Then, the values obtained by the weighting addition based on the weighting factors are set as the pixel values for the pixels at the corresponding coordinates in the composition image data. In addition, of the coordinates on the second composition map, the composition data unit 228 executes a process that sets the pixel values of the pixels at the coordinates in the intermediate composition image data which coordinates are for the part other than the common structure, as the pixel values for the pixels at the corresponding coordinates in the composition image data. The composition data unit 228 generates composition image data by executing these processes for all coordinates.
For example, the weighting factors are set for the arithmetic mean and the highest selection as methods of image-synthesis and are set such that the higher the common structure in the ranks, the heavier the weight is set for the highest selection, and the lower in the ranks, the heavier the weight is set for the arithmetic mean. On the second composition map, the intermediate composition image data generated by the arithmetic mean are related to the coordinates of the part other than the common structure. In this case, the contribution of the pixel values by the highest selection increases as it goes from the coordinates far-off from the contour to the coordinates close to the contour of the common structure. As a result, pixel values are enhanced more strongly at the coordinates closer to the contour. In addition, since the pixel values by the arithmetic mean are employed for the coordinates of the part other than the common structure, there is less speckle noise there than for the common structure.
In this way, the ultrasound diagnosis apparatus of this variant embodiment classifies the pixels representing a common structure into the ranks and sets the values obtained by the addition of the pixel values in the sets of intermediate composition image data with the weights different for the respective ranks, as the pixel values for the composition image data. As a result, as for the common structure, the pixel values are further emphasized, gradually from the coordinates far-off from the contour to the coordinates close to the contour.
The image storage 5 stores in advance a plurality of sets of image data that have been generated, based on ultrasound waves transmitted and received in accordance with a plurality of transmission and reception conditions, each set of image data being for a corresponding one of the transmission and reception conditions, each image for each set of image data at least partially sharing a common area. In other words, the image storage 5 stores, in advance, image data representing tissue structures of the subject that have been acquired for each of the transmission and reception conditions on which the ultrasound waves transmitted and received through the subject are based for the scanning. This means that the image storage 5 stores, in advance, image data that were generated in the past by the transmission-reception compound technique under each of the transmission and reception conditions.
The image-processor 22 comprises a scan-converter 221, a first structural information acquirer 222, a second structural information acquirer 223, a synthesizer 224, and a third storage 225. The scan-converter 221 reads image data out of the image storage 5 and converts the image data read out into data to be displayed in a coordinate system. The scan-converter 221 outputs the converted image data to the third storage 225, which stores them.
The first structural information acquirer 222 reads image data out of the third storage 225, as does the ultrasound diagnosis apparatus of the first embodiment, and acquires tissue-structure information indicative of tissue structures depicted, respectively, in the sets of image data. The second structural information acquirer 223 acquires common structural information indicative of a tissue structure common in the sets of image data, as does the ultrasound diagnosis apparatus of the first embodiment. The synthesizer 224, as does the ultrasound diagnosis apparatus of the first embodiment, then applies different methods of image-synthesis on the sets of image data, each method to a corresponding one of the image areas distinguished based on the common structural information and generates composition image data based on the sets of image data.
The scan-converter 221 reads image data out of the image storage 5. The scan-converter 221 converts the image data into data to be displayed in a coordinate system. The scan-converter 221 outputs the converted image data to the third storage 225, which stores them. In addition, the first structural information acquirer 222 reads the image data out of the third storage 225 and acquires tissue-structure information indicated in the image data. The first structural information acquirer 222 outputs the acquired tissue-structure information to the third storage 225, which stores it.
The second structural information acquirer 223 acquires, based on the tissue-structure information, common structural information indicative of a tissue structure common in the sets of image data. The second structural information acquirer 223 outputs the acquired common structural information to the third storage 225, which stores it.
The intermediate composer 226 reads a plurality of sets of image data out of the third storage 225 and generates sets of intermediate composition image data, each set being a composition of the sets of image data by a corresponding one of the methods of image-synthesis applied. The intermediate composer 226 outputs the generated intermediate composition image data to the third storage 225, which stores them.
The composition mapper 227 reads the common structural information and the intermediate composition image data out of the third storage 225. The composition mapper 227 generates a first composition map, which indicates the intermediate composition image data in relation to respective coordinates. The composition mapper 227 outputs the generated first composition map to the third storage 225, which stores it.
The composition data unit 228 reads the first composition map and the intermediate composition image data out of the third storage 225. The composition data unit 228 generates composition image data based on the first composition map. The composition data unit 228 outputs the generated composition image data to the second storage 23.
The display controller 24 reads the composition image data out of the second storage 23 and causes the display 3 to display an image based on the composition image data read out.
Now, description is about the effects of the medical image-processing apparatus of this embodiment. The medical image-processing apparatus of this embodiment comprises an image storage 5, a first structural information acquirer 222, a second structural information acquirer 223, and a synthesizer 224. The image storage 5 stores, in advance, a plurality of sets of image data that have been generated based on ultrasound waves transmitted and received in accordance with a plurality of transmission and reception conditions, each set of image data having been generated and stored for a corresponding one of the transmission and reception conditions, each image for each set of image data at least partially sharing a common area. The first structural information acquirer 222 acquires tissue-structure information indicative of tissue structures depicted, respectively, in the sets of image data. The second structural information acquirer 223 acquires, based on the tissue-structure information, common structural information indicative of a tissue structure common in the sets of image data. The synthesizer 224 applies different methods of image-synthesis on the sets of image data, respectively, each method to a corresponding one of the image areas distinguished based on the common structural information and, by doing so, generates composition image data based on the sets of image data. In this way, the medical image-processing apparatus calculates a common structure represented commonly in the sets of image data, each set of image data having been acquired on a corresponding one of the transmission and reception conditions, and then generates a composition image by applying different methods of image-synthesis, one method to the pixels representing the common structure and another to the pixels representing no common structure. As a result, it is possible that the medical image-processing apparatus be provided with an improved viewability of tissue structures depicted in images.
It is also possible that a method of processing medical images be so implemented to realize some of the above-mentioned embodiments as a computer program, which can be stored on an arbitrary computer-readable storage medium. Such storage media can include for example, semiconductor memory, optical discs, magneto-optical disks, magnetic storages, etc. In addition, the computer program can be transmitted or received through a network like the Internet or a LAN.
With an ultrasound diagnosis apparatus, a medical image-processing apparatus or a method of processing medical images according to at least one of the above-mentioned embodiments, calculation is made for a common structure represented commonly throughout a plurality of sets of image data, each set of image data having been acquired on a corresponding one of a plurality of transmission and reception conditions. Then, a composition image is generated by applying different methods of image-synthesis, one method to the pixels representing the common structure and another to the pixels representing no common structure. As a result, viewability is improved of the tissue structure depicted in the image.
While certain embodiments have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the inventions. Indeed, the novel embodiments described herein may be embodied in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the embodiments described herein may be made without departing from the spirit of the inventions. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and spirit of the inventions.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2013-147048 | Jul 2013 | JP | national |
