The present invention relates to avionics and military displays and, more generally, relates to such displays which receive data from sensors having a relatively higher dynamic range.
High-performance imaging sensors typically have dynamic ranges greater than 8 bits/pixel; however, many displays limit displayable dynamic range to 8 bits/pixel.
As a result, to maintain the dynamic range advantage of these high-performance sensors, efforts have been made to find a way to effectively display the high-dynamic range of the sensor on a lower dynamic range display.
Dynamic Range vs. Bits (in dB)
8 bits is 48.2 dB.
9 bits is 54.2 dB.
10 bits is 60.2 dB.
In the past, the output of high-dynamic range video camera sensors have been mapped to lower-dynamic range displays using an assortment of look-up tables with differing mapping functions, where non-linear functions utilized have been known as the gamma function where the mapping relationship is X raised to the power of gamma. i.e., the X (the sensor output value to be mapped to the display) is the base numeral. While the linear and the gamma functions have been well known in the art for many years, they have some drawbacks.
A single aspect linear mapping approach will, by design, result in a loss in image dynamic range across the entire display, thereby eliminating some of the benefits of a higher dynamic range imaging sensor. The gamma function can be problematic in that either it often is too similar to the linear mapping approach with its concomitant problems, or it is prone to saturation where dynamic range is not degraded, but entirely lost.
Also in the past, it has been known to provide pilots or airborne refueling personnel, who are provided with a live video image, with a mere brightness adjustable display which allows an adjustability of the brightness of the incoming video image. In such displays, the mapping scheme is not believed to be altered other than a gain increase or decrease of brightness on every pixel.
Consequently, there exists a need for a system for airborne personnel to be able to view and have the ability to benefit from live, high-dynamic range video images on a low-dynamic range display.
It is an object of the present invention to provide systems and methods for improved image display of high-dynamic range data.
It is a feature of the present invention to include a pilot-selectable mapping scheme with a plurality of sensor data mapping mode choices.
It is an advantage of the present invention to better manage data being displayed, so as to give a high-dynamic range image in certain brightness ranges and lower, but not zero, in other ranges.
It is another feature of the present invention to include a plurality of selection mapping exponential functions, where the sensor output value X is not utilized in the base of the mapping function (as in the gamma function), but instead in the exponent.
It is another advantage of the present invention to provide for the use of a relatively small number of alternate selectable modes, which provide, in combination, a wide range of displayed dynamic ranges to span the dynamic range of input values.
It is yet another advantage of the present invention to utilize a Logarithmic—Exponential (Log-Exp) mapping function, which provides a Dynamic Range Multiplier, which out performs the gamma function.
The present invention is a method and apparatus for displaying high-dynamic range image sensing data to lower-dynamic range displays, which is designed to satisfy the aforementioned needs, provide the previously stated objectives, include the above-listed features, and achieve the already articulated advantages.
Accordingly, the present invention is a method and apparatus providing a plurality of selectable Log-E×p non-linear mapping function modes.
The invention may be more fully understood by reading the following description of the preferred embodiments of the invention in conjunction with the appended drawings wherein:
Now referring to the drawings, wherein like numerals refer to like matter throughout, and more particularly to
One embodiment of the present invention is a system which allows the airborne personnel to select among four different aspects of the 10 bit data to be mapped to the 8 bit display. Each of these aspects will have a limited range, but will provide full image resolution within its limited range of input values, but each aspect will not provide any information outside of the limited range. The pilot or other airborne personnel is enabled to select between four detailed aspects of interest, or a fifth aspect that spans the entire range but with lower-dynamic range. In a linear-mapping embodiment of the present invention, the 8 bit display is limited to 256 pixel variations, but the incoming 10 bit data has 1024 pixel variations.
Now referring to
Now referring to
Now referring to
Now referring to
Now referring to
Now referring to
Now referring to
Now referring to
Now referring to
Now referring to
Now referring to
Now referring to
The low brightness or dotted line is a graph of the following function:
Y=2^(Ny)*(1−10^(−ax))
And the high brightness or dashed line is a graph of the following function:
Y=10^(ax)−1
Where:
Nx=Number of bits in the Input (X-axis) [Max=2^(Nx)−1]
Ny=Number of bits in the Output (Y-axis) [Max=2^(Ny)−1]
Now referring to
Now referring to
y=2^(Ny)[1+2by{1−10^(−abx(x−2^(Nx)/2))}]/2for {2^(Nx)/2≦x≦2^(Nx)−1}
And the lower portion of the middle line is a graph of the following equation:
y=by[10^(abxx)−1]
Where:
Now referring to
When the dual-mode gamma and 1/gamma methods are compared to the dual-mode Log-Exp methods, it become clear that the Log-Exp may be superior. Chart 1, below, shows the DRM above the linear line, and the max average DRM for each method. Also shown in the chart, is the product of the DRM and the max average DRM as a statistic indicating improvement over the standard linear mapping.
As shown in Chart 1, the Log-Exp has a higher % of curve with max DRM>1 for values of gamma below 3.0. However, for values of gamma <6.0, the Log-Exp has a superior average max DRM. As a result, the Log-Exp has aspects that exceed the gamma curve for all values of gamma. In addition, this is further illustrated by comparing the product of % of curve with max DRM>1 and average max DRM. The Log-Exp exceeds the gamma curves for all values of gamma.
In addition, if the Log-Exp curve with low, medium, and high regions is used, this curve outperforms the gamma curves for all values of gamma in all three characteristics.
The examples of the present invention are shown with a 10-Bit to 8-Bit mapping. It should be understood that the 12-Bit to 8-Bit, 14-Bit to 8-Bit and 16-Bit to 8-Bit, etc. combinations are also easily adaptable. Similarly, addition of more interstitial curves could be desired, and readily accomplished, following the teachings herein. Of course, the output is not limited to 8-bit outputs, and others could be substituted.
The application contemplates a selection to be made by the airborne operator. This could be accomplished in many ways, and is a matter of design choices. However, it should be understood that either a static or a sequenced scan of the various aspects could be utilized so that the operator does not need to make motor movement to see different data. Also it may be desirable to have sequence timing adjustment knob or other selection configuration to make adjustable the duration for each display of the different aspects. In certain situations, it may be desirable to make the sequencing so rapid that the operator's eyes and mind integrate the rapidly changing aspect displays, and thereby effectively create a 10-Bit perceived video image on an 8-Bit physical display device.
Now referring to
A high dynamic range sensor 1102, which could be a 10-Bit or a high definition video camera, provides high dynamic range video to a display rendering system 1110, which could be a dedicated hardware system, or it could be a portion of, or application on, a more general purpose computing platform with specialized software configured to operate the computing platform to accomplish the mapping and display innovation described herein. The high-dynamic range video is provided to an input 1112, which could be memory which temporarily retains the video signal, as well as application-specific software configured to perform the mapping. Numerous other implementations could be substituted. Shown here is merely an example of such various structures. A microprocessor 1114 runs the mapping software of the present invention and accepts inputs from the pilot or airborne personnel selector 1130. Look-up table 1116 is populated with pre-calculated mapped relationships, in accordance with the mapping schemes of the present invention. This mapped image is then provided to the display 1120.
It is thought that the method and apparatus of the present invention will be understood from the foregoing description, and that it will be apparent that various changes may be made in the form, construction, steps, and arrangement of the parts and steps thereof, without departing from the spirit and scope of the invention or sacrificing all of their material advantages. The form herein-described is merely a preferred or exemplary embodiment thereof.
Number | Name | Date | Kind |
---|---|---|---|
20080129763 | Awakura et al. | Jun 2008 | A1 |
20130063341 | Hirata | Mar 2013 | A1 |
20140210847 | Knibbeler et al. | Jul 2014 | A1 |