The present invention generally relates to medical imaging, and more particularly, to compensating for image-quality discrepancies between an imaging modality and a viewing station.
Medical imaging often includes creating images of the human body or parts of the human body for clinical purposes such as examination, diagnosis and/or treatment. These images may be acquired by a number of different imaging modalities including, for example, ultrasound (US), magnetic resonance (MR), positron emission tomography (PET), computed tomography (CT), mammograms (MG) digital radiology (DR), computed radiology (CR) or the like. In a number of example medical imaging workflows, an acquired image may be reviewed by a technician of the imaging modality, and then sent to a viewing station where the image may be reviewed by a medical professional such as a radiologist. This is the case, for example, in a picture archiving and communication system (PACS).
Maintaining consistency in the quality of an acquired image through an imaging workflow is often desirable. Due to different monitor calibration functions between imaging modalities (senders) and viewing stations (receivers), however, an undesirable visualization discrepancy may occur. These calibration functions may be described as being performed by a modality or viewing station, but in more particular examples, may be performed by video drivers of the respective apparatuses, software associated with monitors of the respective apparatuses or the like. In one example, an imaging modality may apply a first calibration function such as the gamma correction function (e.g., γ=2.2) to an acquired image viewed by a monitor of the modality. The viewing station in this example, however, may apply a second, different calibration function to the acquired image viewed by a monitor of the viewing station—the second calibration function in one example being the DICOM GSDF. For more information on the DICOM GSDF, see National Electrical Manufacturers Association (NEMA), PS 3.14-2009, entitled: Digital Imaging and Communications in Medicine (DICOM)—Part 14: Grayscale Standard Display Function, the content of which is hereby incorporated by reference in its entirety.
In the above example, an imaging modality may have a particular gamma value (the value that describes the relationship between the varying levels of luminance that a monitor can display). This gamma value may differ from one imaging modality to another imaging modality, which may compound the undesirability of differences in monitor calibration functions in various instances in which a viewing station may receive images from different modalities.
In light of the foregoing background, exemplary embodiments of the present invention provide an apparatus, method and computer-readable storage medium for compensating for image-quality discrepancies between an imaging modality and a viewing station. According to one aspect of exemplary embodiments of the present invention, an apparatus is provided that includes a processor and a memory storing executable instructions that in response to execution by the processor cause the apparatus to at least perform a number of operations. In this regard, the apparatus is caused to receive a digital image including a plurality of pixels each of which has a pixel value of a plurality of pixel values, where the pixel value of each pixel has been calibrated according to a first calibration function for calibrating an image for display by a first monitor, such as the gamma function.
The apparatus is caused to transform the pixel value of each of at least some of the pixels to a corresponding transformed pixel value calibrated according to a different, second calibration function for calibrating an image for display by a second monitor, such as the Digital Imaging and Communications in Medicine (DICOM) Grayscale Standard Display Function (GSDF). The apparatus is also caused to cause output of the digital image including the plurality of pixels each of at least some of which has a transformed pixel value, where the respective digital image is displayable by the second monitor. In one example, the apparatus is caused to transform the pixel value according to a lookup table that relates pixel values calibrated according to the first calibration function to corresponding pixel values calibrated according to the second calibration function.
The first and second calibration functions may be respective functions for calculating luminance as a function of pixel value. In one example, the first calibration function and second calibration function may be described by the following functions for calculating luminance ML and SL, respectively, as a function of pixel value x:
ML=G(x)
SL=F(x)
In this example, the apparatus may be caused to calculate a transformed pixel value LUT as a function of pixel value x in accordance with the following:
LUT=F
−1(G(x))
in which F−1 denotes the inverse function of F.
In another example, the first calibration function may be described by the following function for calculating luminance ML; as a function of pixel value xi:
ML
i
=G(xi)
In this example, the second calibration function is described by the following function for calculating luminance SLj as a function of pixel value xj:
SL
j
=F(xj)
The apparatus, then, may be caused to transform the pixel value according to a lookup table that relates (xi, xj) where |MLi−SLj| has the minimum value.
The apparatus may be caused to receive a digital image from an imaging modality of a plurality of different types of modalities each of which has a respective first calibration function for calibrating an image for display by a first monitor. In such instances, the memory may further store executable instructions that in response to execution by the processor cause the apparatus to further determine a type of modality from which the digital image is received. The apparatus may then be caused to transform the pixel value based on the determined type of modality.
Having thus described the invention in general terms, reference will now be made to the accompanying drawings, which are not necessarily drawn to scale, and wherein:
The present invention now will be described more fully hereinafter with reference to the accompanying drawings, in which preferred embodiments of the invention are shown. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Further, the apparatus and method of example embodiments of the present invention will be primarily described in conjunction with medical-imaging applications. It should be understood, however, that the apparatus and method can be utilized in conjunction with a variety of other applications, both in the medical industry and outside of the medical industry. Like numbers refer to like elements throughout.
The system also includes a viewing station 14 configured to receive an image from one or more modalities 12, and present the image such as for review by a medical professional such as a radiologist. In one example embodiment, the viewing station may be a picture archiving and communication system (PACS) viewing station (or workstation).
As explained in the background section, in various instances, a modality 12 and viewing station 14 may apply different monitor calibration functions to images presented by monitors of the respective apparatuses. For example, a modality may apply the gamma correction function, while the viewing station may apply the DICOM GSDF. This difference in monitor calibration functions may lead to an undesirable visual discrepancy between an image presented by the modality, and the same image presented by the viewing station. As explained in greater detail below, the system of example embodiments of the present invention therefore further includes a computing apparatus 16 configured to transform pixel values calibrated according to a first calibration function (e.g., gamma correction) to corresponding pixel values calibrated according to a second, different calibration function (DICOM GSDF). In this manner, the computing apparatus may compensate for visual discrepancies otherwise due to the different calibration functions.
The imaging modality 12, viewing station 14 and/or computing apparatus 16 may be configured to directly and/or indirectly communicate with one another in any of a number of different manners including, for example, any of a number of wireline or wireless communication or networking techniques. Examples of such techniques include, without limitation, Universal Serial Bus (USB), radio frequency (RF), Bluetooth (BT), infrared (IrDA), any of a number of different cellular (wireless) communication techniques such as any of a number of 2G, 2.5G or 3G communication techniques, local area network (LAN), wireless LAN (WLAN) techniques or the like. In accordance with various ones of these techniques, the imaging modality, viewing station 14 and/or computing apparatus can be coupled to and configured to communicate across one or more networks. The network(s) can comprise any of a number of different combinations of one or more different types of networks, including data and/or voice networks. For example, the network(s) can include one or more data networks, such as a LAN, a metropolitan area network (MAN), and/or a wide area network (WAN) (e.g., Internet), and include one or more voice networks, such as a public-switched telephone network (PSTN). Although not shown, the network(s) may include one or more apparatuses such as one or more routers, switches or the like for relaying data, information or the like between the imaging modality, viewing station and/or computing apparatus.
Reference is now made to
Generally, the apparatus of exemplary embodiments of the present invention may comprise, include or be embodied in one or more fixed electronic devices, such as one or more of a laptop computer, desktop computer, workstation computer, server computer or the like. Additionally or alternatively, the apparatus may comprise, include or be embodied in one or more portable electronic devices, such as one or more of a mobile telephone, portable digital assistant (PDA), pager or the like. The apparatus of exemplary embodiments of the present invention includes various means for performing one or more functions in accordance with exemplary embodiments of the present invention, including those more particularly shown and described herein. It should be understood, however, that one or more of the entities may include alternative means for performing one or more like functions, without departing from the spirit and scope of the present invention.
As shown in
In addition to the memory 22, the processor 20 can also be connected to at least one interface or other means for displaying, transmitting and/or receiving data, content or the like, such as in accordance with USB, RF, BT, IrDA, WLAN, LAN, MAN, WAN (e.g., Internet), PSTN techniques or the like. In this regard, the interface(s) can include at least one communication interface 26 or other means for transmitting and/or receiving data, content or the like. In addition to the communication interface(s), the interface(s) can also include at least one user interface that can include one or more earphones and/or speakers, a monitor 28, and/or a user input interface 30. The user input interface, in turn, can comprise any of a number of devices allowing the apparatus to receive data from a user, such as a microphone, a keypad, a touch-sensitive surface (integral or separate from the monitor), a joystick, or other input device. As will be appreciated, the processor may be directly connected to other components of the apparatus, or may be connected via suitable hardware. In one example, the processor may be connected to the monitor via a display adapter 32 configured to permit the processor to send graphical information to the monitor.
As indicated above, the system of example embodiments of the present invention includes a computing apparatus 16 configured to transform pixel values calibrated according to a first calibration function (e.g., gamma correction) to corresponding pixel values calibrated according to a second, different calibration function (DICOM GSDF). In this manner, the computing apparatus may compensate for visual discrepancies otherwise due to the different calibration functions. The computing apparatus may be configured to apply the transformation in any of a number of different manners. As explained below, the computing apparatus may be configured to transform pixel values using a lookup table (LUT). It should be understood, however, that the computing apparatus may be equally configured to transform pixel values using an algorithm such as that from which an appropriate LUT may be calculated.
Reference is now made to
A. Known Calibration Functions
In an instance in which the first and second calibration functions are known, the LUT may be calculated based on the respective functions. In this instance, assume for example that the first calibration function (the function of the imaging modality 12) may be described by the following representation of modality luminance (ML), and that the second calibration function (the function of the viewing station 14) may be described by the following representation of the station luminance (SL):
ML=G(x) (1)
SL=F(x) (2)
In the preceding, x represents the pixel value that belongs to the domain [−2n-1, 2n-1−1] for a signed image or [0, 2n−1] for an unsigned image (n representing the number of bits of the pixel value).
Given the above equations (1) and (2), the LUT of one example embodiment may be calculated in accordance with the following:
LUT=F
−1(G(x)) (3)
where F−1 denotes the inverse function of F. A solution for the above expression of the LUT exists in instances in which both functions F(x) and G(x) are monotone. This is the case, for example, for both gamma and DICOM GSDF functions. In addition, the SL range may be equal or larger than the ML range to thereby produce a unique solution, which may be the case with typical PACS monitors.
In a more particular example in which the first and second calibration functions are known, consider an instance in which the first calibration function is a gamma correction, and the second calibration function is the DICOM GSDF. In this example, the gamma function may be described as follows:
ML=G(x)=C×xγ+B (4)
In equation (4), C and B represent the contrast and minimum luminance (brightness) of the monitor of the modality 12, which may be set by respective monitor controls. The variable x represents a normalized pixel value between 0 and 1, which may take into account minimum and the maximum pixel values, and γ (gamma) represents the gamma value of the modality monitor. For a signed DICOM MONOCHROME2 image with pixel of range [−2n-1, 2n−1], the corresponding ML range may be (MLmin, MLmax), where MLmin=C×(−2n-1)γ+B and MLmax=C×(2n-1−1)γ+B.
Also in this more particular example in which the second calibration function is the DICOM GSDF, the luminance of the monitor of the viewing station 14 may be derived from the following DICOM GSDF (a monotone function):
In the preceding, Ln refers to the natural logarithm, and j refers to an index (1 to 1023) of luminance levels Lj of the just-noticeable differences (JND), where the JND may be considered the luminance difference of a given target under given viewing conditions that the average human observer can just perceive. In this regard, one step in the JND index j may result in a luminance difference that is a JND. Also in the preceding, the constants a-h, k and m may be set as follows: a=−1.3011877, b=−2.5840191×10−2, c=8.0242636×10−2, d=−1.0320229×10−1, e=1.3646699×10−1, f=2.8745620×10−2, g=−2.5468404×10−2, h=−3.1978977×10−3, k=1.2992634×10−4 and m=1.3635334×10−3.
The inverse function of equation (5) is as follows:
j(L)=A+B·Log10(L)+C·(Log10(L))2+D·(Log10(L))3+E·(Log10(L))4+F·(Log10(L))5+G·(Log10(L))6+H·(Log10(L))7+I·(Log10(L))8 (6)
In equation (6), Log10 represents a logarithm to the base 10, and the constants A-I may be set as follows: A=71.498068, B=94.593053, C=41.912053, D=9.8247004, E=0.28175407, F=−1.1878455, G=−0.18014349, H=0.14710899 and I=—0.017046845.
Equation (6) permits computing discrete JNDs for the modality luminance range (MLmin, MLmax) as jmin=j(MLmin) and jmax=j(MLmax). In this regard, for a signed image, the span of j values may range from jmin for pixel value x=−2n-1, jmax for pixel value x=2n-1−1, such as according to the following:
For an unsigned image, the span of j values may range from jmin for pixel value x=0, to jmax for pixel value x=2−1−1, such as according to the following:
The corresponding luminance values of each j(x), then, can be calculated by equation (5) as L(j(x)).
In order to calculate the LUT, for each pixel value x calibrated according to the first calibration function, the corresponding LUT value may be found. This may be achieved by being given or otherwise determining the minimum and maximum luminance values (MLmin and MLmax) and the gamma value (γ) of the monitor of the modality 12, which can be used to determine the parameters C and B of equation (4). Alternatively, in an instance in which the luminance range of the viewing station 14 monitor (SLmin and SLmax) is known, and the gamma of the modality monitor is known, these values may be substituted in equation (4) to determine the parameters C and B. In another alternative, in an instance in which the parameters C and B and the gamma value of the modality monitor are given, these parameters may be used to determine the minimum and maximum luminance values (MLmin and MLmax). In any instance, by substitution of MLmin and MLmax (or SLmin and SLmax) in equation (6), one may determine the values of jmin and jmax.
For each pixel value x, equation (4) may be used to determine G(x), which may be substituted into equation (6) to determine j(G(x)). The value j(G(x)) may be substituted into equation (7) or equation (8) (depending on the signed/unsigned nature of the image) to determine the value x as the corresponding LUT value. Written notationally, for a signed image, the LUT value may be determined from value j(G(x)) in accordance with the following:
Or for an unsigned image, the LUT value may be determined from value j(G(x)) in accordance with the following:
As an example, consider the computing apparatus 16 being configured to transform pixel values calibrated according to gamma correction to corresponding pixel values calibrated according to DICOM GSDF. Further consider that the modality monitor (gamma calibrated) has the following parameter values: MLmin=B=0.4 cd/m2, MLmax=178 cd/m2, and γ=2.2. In this example, the LUT values for an 8-bit (n=8) unsigned image may be represented as in the graph of
B. Unknown Calibration Functions
In an instance in which either or both of the first or second calibration functions are unknown, the LUT may be calculated by looking to the display characteristic curves of the modality 12 and viewing station 14, each of which may be determined or otherwise measured by means of a quantitative procedure. The display characteristic curve for a monitor may define the relationship between luminance and pixel values (equation (1) and (2) above). One may, for example, use TG18-LN test patterns for this purpose. These test patterns are provided by the American Association of Physicists in Medicine (AAPM), task group (TG) 18, and may be imported to the modality and sent to the viewing station to mimic an image workflow. By using test patterns such as the TG18-LN test patterns, a number of distinct luminance levels may be measured and the remaining luminance values may be interpolated, such as according to a cubic spline. The interpolated display characteristic curves of the modality and viewing station may then be used to determine the LUT, such as by taking equation (3) into consideration.
More particularly, for example, assume that the modality and viewing station transfer functions are measured and described by the following tabulated functions:
ML
i
=G(xi) (11)
SL
j
=F(xj) (12)
In equations (11) and (12), xi represents a pixel value calibrated according to the first calibration function, and xj represents a pixel value calibrated according to the second calibration function, each of which may be in the range [−2n-1, 2n-1−1] for a signed image or [0, 2n−1] for an unsigned image. MLi represents the modality luminance for its pixel value xi, and SLj represents the viewing station luminance for its pixel value xj. The LUT may then be calculated according to the following pseudo-algorithm for a signed image:
A similar pseudo-algorithm may be implemented for an unsigned image by appropriately adjusting the range of i and j values. After execution of above algorithm, the LUT may be uniquely defined by the set of (xi, xj) values.
Returning to
The LUT may be applied in any of a number of different manners, and at a number of different locations in an image workflow from a modality 12 to viewing station 14. In one example in which the second calibration function is the DICOM GSDF, the LUT may be applied as a presentation LUT or value-of-interest LUT in accordance with appropriate DICOM standards. Also, the LUT may be applied by the computing apparatus 16 which may be implemented as part of the imaging modality 12 or viewing station 14, or as a separate device between the modality and viewing station. The computing apparatus (separate or part of the modality) may be configured to add the LUT as a presentation LUT. The LUT values may be burned or otherwise stored with the respective pixels of the image, or the LUT may be passed through with the image. In another example in which the computing apparatus is implemented at the viewing station, image viewer software on the viewing station may be configurable to apply the LUT as a presentation LUT.
In various instances, particularly when the computing apparatus 16 is implemented separate from the imaging modality 12, the computing apparatus may be configured to apply different LUTs for different types of modalities (e.g., modalities 12a, 12b, 12c). In such instances, the computing apparatus may be configured to determine the type of modality that captured an image, and load and apply an appropriate LUT for the respective type of modality. The computing apparatus may be configured to determine the type of modality in a number of different manners.
In one example in which the imaging modalities 12 and computing apparatus 16 are coupled to and configured to communicate with one another across a network, each imaging modality may have a respective network address (e.g., IP address). In this example, the computing apparatus may store or otherwise have access to a table that associates the network addresses of the modalities with their modality types. When the computing apparatus receives an image across the network, the image or a record referring to the image may identify the network address of its source modality. The computing apparatus may then consult the table based upon the source network address to identify the type of the respective modality.
In another example, the image may be formatted to include a header with one or more tags including respective acquisition parameters that refer to the name of the modality 12 that acquired the image (source modality), its software version or the like. In this other example, the computing apparatus 16 may store or otherwise have access to a table that associates acquisition parameters (tags) with modality types, or may be setup to operate according to logic that specifies application of the LUT in instances in which an image has parameters (tags) with particular values. When the computing apparatus receives an image, the computing apparatus may be configured to analyze the image's header and its parameters (tags), and apply the LUT in accordance with the table or logic.
In a more particular example, a DICOM image may include a tag (0008, 0070) that identifies the “Manufacturer ID,” tag (0008, 1090) that identifies the “Manufacturer's Model Name ID,” tag (0008, 0060) that identifies the “Modality ID” and tag (0008, 1010) that includes a name identifying the machine that produce images. In this example, the computing apparatus 16 may be configured to apply the LUT in instances in which the computing apparatus receives an image from US (ultrasound) modality X with the name “koko” and software version “12.1.1.” When the computing apparatus receives a DICOM image for display, the computing apparatus may be configured to analyze the image's header and its parameters. In an instance in which the “Modality ID” is US and “Manufacturer's Model Name ID” is “koko,” the computing apparatus may apply the LUT; otherwise, the computing apparatus may forego application of the LUT.
To further illustrate example embodiments of the present invention, consider a hypothetical image workflow investigation in which the same image was displayed on an image-modality monitor with gamma calibration, and on a PACS viewing station with DICOM GSDF calibration. This investigation indicated that there would be no visual consistency in image display on monitors that were calibrated to gamma and DICOM GSDF calibration functions. As an example,
Even further, consider tests of a real-world workflow in which three ultrasound devices using gamma calibration, noted as USX, USY and USZ, sent images to a PACS viewing station connected to a monitor calibrated to DICOM GSDF. In these tests, patterns similar to TG18-LN were used, and the measured display characteristic curves of ultrasound devices and PACS monitor were determined (including cubic spline interpolation). The gamma values (γ) of the ultrasound device monitors were estimated by minimizing the mean square errors (MSE) of equation (4) and measured display characteristic values. The PACS monitor was a color LG 1200ME monitor with a resolution 280×1024, and with a color temperature set to 6500 K. Its display characteristics curve was evaluated with the ideal DICOM GSDF function.
The above real-world workflow investigation provided the following results for the measured minimum and maximum luminance values, gamma values (γ) and MSEs:
The deviation of the PACS monitor from the DICOM GSDF ideal curve was on average 5.5% with a minimum and maximum deviation of 0.5% and 12.3%, respectively. These measurements showed that the monitors were indeed calibrated according to the functions (gamma and DICOM GSDF), with the acceptable tolerance deviation from theoretical models.
The display characteristics of all four monitors in this example are shown in
According to one aspect of the present invention, all or a portion of the modality 12, viewing station 14 and/or computing apparatus 16 of exemplary embodiments of the present invention, generally operate under control of a computer program. The computer program for performing the methods of exemplary embodiments of the present invention may include one or more computer-readable program code portions, such as a series of computer instructions, embodied or otherwise stored in a computer-readable storage medium, such as the non-volatile storage medium.
Accordingly, blocks or steps of the flowchart support combinations of means for performing the specified functions, combinations of steps for performing the specified functions and program instruction means for performing the specified functions. It will also be understood that one or more blocks or steps of the flowchart, and combinations of blocks or steps in the flowchart, may be implemented by special purpose hardware-based computer systems which perform the specified functions or steps, or combinations of special purpose hardware and computer instructions.
Many modifications and other embodiments of the invention will come to mind to one skilled in the art to which this invention pertains having the benefit of the teachings presented in the foregoing descriptions and the associated drawings. It should therefore be understood that the invention is not to be limited to the specific embodiments disclosed and that modifications and other embodiments are intended to be included within the scope of the appended claims. Although specific terms are employed herein, they are used in a generic and descriptive sense only and not for purposes of limitation.