This disclosure relates to calibrating cameras, and particularly to calibrating High Dynamic Range (HDR) video cameras.
For many years, film cameras have far exceeded the image dynamic range of available video cameras, and have been the preferred image capture medium of movie production. In the past decade, Complementary Metal Oxide Semiconductor (CMOS) and Charge Coupled Device (CCD) digital image technology has improved pixel resolution as well as light sensitivity and useful dynamic range. These new digital technologies are now rapidly replacing film cameras in movie and television production. Digital video cameras are now able to capture over 15-stops of dynamic range. In addition, reduced cost imagers are bringing this High Dynamic Range (HDR) to low-end video production including episodic and streaming video services. Calibrating a digital camera using a paper chart having various levels of darkness is limited to about 9 or 10 stops, which is insufficient for modern cameras.
To utilize the high dynamic range of these cameras on-set, it is often preferred to refer to stops (f-stops or t-stops) when measuring scene and subject lighting, as has been the practice for many years in film production. An Opto-Electric Transfer Function (OETF) of a camera is a function that plots the electrical output of the camera from various light input levels. The OETF may be characterized in terms of stops and displayed on a waveform monitor. The user specifies which camera output format is being used in the signal driving the waveform monitor. Examples of typical OETF's include Sony S-log/2/3, Cannon C-log, Cineon log C, as well as the common BT.709 gamma, which is typically available in all cameras.
Most cameras, however, also have custom adjustments affecting the OETF that can be modified and stored by the user. These adjustments may be manipulated by the user based on artistic evaluation of the pixels without adherence to any particular published OETF. Additionally, the standard OETF of a particular camera may not exactly match the factory-set OETF. Therefore, two problems exist for accurately measuring camera output—users may adjust a camera OETF for artistic reasons, or the factory OETF may not be accurate for all cameras. So, neither existing cameras nor current test equipment include accurate light calibrators to properly characterize and measure the accuracy of the camera OETF, due at least in part to these variations.
Embodiments of the invention address this and other limitations of the prior art.
Embodiments of the invention include a light calibrator that can be placed in front of the camera, on any production set, to provide exact calibrated light values to the camera. Then the camera output can be reviewed to see how the camera output aligns to the known input. In one embodiment the calibrated light values differ from one another in loge weighted stop values. For instance, the light calibrator may first output full light, then one-half that amount, i.e., one “stop” down, then one-quarter of the full light (two stops), etc. The range of light values calibrated may exceed 14 stops, which spans from camera black sensitivity to full light. Embodiments of the invention also include a method and apparatus of precisely calibrating a camera output for specified levels of light input.
As illustrated in
In some embodiments, the duty cycle of pulse-current driving signal 122 may be expressed as I_duty_cycle(n)=2−n, where n is the dimension-less stop value.
More generally, n is not restricted to integer values, allowing fractional stop changes as well as 1-stop increments. The minimum pulse repetition rate may be set to several multiples of the highest video frame rate expected to allow the imager, e.g., the camera being characterized, to average the light pulse. Further, setting the pulse rate to an odd integer multiple of ½ the frame rate may minimize aliasing of any amplitude variation due to insufficient averaging of the pulse in the imager. For example, a rate of 99×29.97 Hz=2.967 KHz can be used with good results and, the frequency is not critical due to the 99× oversampling.
In operation, a user selects the stop value, n, using the selector 130, which causes the signal pulse generator 120 to generate the driving signal 122 having a duty cycle that corresponds to the selected stop value. In other embodiments the user may select an initial stop value, and then the signal pulse generator 120 automatically cycles through all of the discrete stop values that it is programmed to generate. The sequence of stepping through the pre-set values may be repeated many times and the individual outputs that correspond to the pre-set values may be averaged to enhance calibration accuracy. In some systems there may be up to 14 or 16 discrete stop values, while in other systems 10 or 12 stop values is sufficient. Then, the electrical output from a camera pointed at the LED 110 will correspondingly step its output in a defined relation to the amount of light generated by the LED. The stop values generated by the pulse generator 120 may be generated in ascending or descending values.
Other aspects of the invention are directed to a calibration system, such as the system 200 illustrated in
The container 210 containing the LED 110 has a non-reflective interior, which may be black in color, and acts as a light trap to create a black surround adjacent to the LED 110 as seen by a camera 230 that is desired to be calibrated. This black surround created by the container 210 creates a black reference level in a video signal output of the camera 230. The black surround is created by trapping and absorbing ambient lighting, such as the set-lighting 220, including any ambient sunlight, which is normally reflected back to the camera 230 when not using a light trap. The black surround from the container 210 is used to determine a black level of the output of the camera 230 relative to the brightest parts of the scene captured by the camera, as well as the calibrated LED light source 110.
The LED light source 110 may be a fast LED, which is capable of creating low light levels from a very narrow pulse width generated by the signal pulse generator 120 (
The output of the camera 230 may be displayed on a screen 240 of, for example, a waveform monitor set to capture the electrical output of the camera 230, as described in more detail below.
As a first step in calibrating a camera 230, a table of output values is created, with a measured output value for every discrete light value, i.e., stop value, being measured.
With reference to Table 1, 11 stops (n), labeled 0-−10 are illustrated in the first column. The second column holds measured electrical voltages, in mV, measured from the output of a camera 230 on, for example, the graticule 300 of
In many instances, this discrepancy of measured OETF values from ideal values is undesirable. Embodiments of the invention may be used to compensate for the non-ideal performance of the camera 230, as described below.
As illustrated in
In more detail, the calibrator 600 includes an Analog to Digital Converter (ADC) 620, which receives the analog voltage value from the output of the camera 230 and converts it to a data value that is used to index a Look-Up Table (LUT) 650. Then, based on the particular value that the LUT 650 receives, the LUT selects and produces the desired output. In some embodiments the ADC 620 illustrated in
The LUT 650 is populated with values that allow a correspondence to be made from the digitized camera value from the ADC 620 to the desired output. The LUT 650 may be generated in several different ways. In one embodiment the ideal scaled values are determined from several variables. Once such variable is the number of stops that were selected by the user using the light value selector 130. The user may specify a 10-stop system, 12-stop system 14 stop system, etc. Another variable is the bit-depth of the ADC 620. For instance, the ADC 620 may have a 12-bit output and generate output values between 0 and 4095. Then a scale is generated corresponding to the data values of the output curve of the camera 230 as illustrated in
The final values determined by Equation 1 and stored in LUT 650 for the particularly described system including a 700 mV maximum signal output from the camera 230, 10 non-zero stops, and a 12-bit ADC may appear as illustrated in Table 2:
With reference back to
In one particular example, if the output of the ADC 620 is “550”, then the LUT 650 outputs −6 stops. In other words, the camera 230 is sensing light approximately −6 stops down from full light. If the output of the ADC were instead “1920”, then the LUT 650 would output −2 stops. Such a relationship makes sense because a higher 12-bit number from the ADC 620 means there was a higher electrical input from the camera 230. The camera 230 generates a higher electrical output when there is more light, and the final output of −2 stops means that the camera 230 is sensing more light than when the output was −6 stops.
Illustrative examples of the technologies disclosed herein are provided below. An embodiment of the technologies may include any one or more, and any combination of, the examples described below.
Example 1 includes a stop-weighted light reference, comprising: a Light Emitting Diode (LED) light source; a selector device configured to be operated by a user to cause a predefined amount of light to be output by the LED; and a pulse-generator having a predefined number of pre-set modes, and each mode having a pulse width different than any other mode, the pulse-width generator structured to accept a user-selected value from the selector device and to provide to the LED light source a light driving output in one of the pre-set modes that corresponds to the user selected value.
Example 2 includes the stop-weighted light reference of Example 1, or any other example light reference described herein, in which the pulse-width of a particular pre-set mode is approximately one-half the pulse width of another of the pre-set modes.
Example 3 includes the stop-weighted light reference of Examples 1-2, or any other example light reference described herein, in which one of the pre-set modes of the pulse-generator includes a full-width pulse.
Example 4 includes the stop-weighted light reference of Example 3, or any other example light reference described herein, in which other modes of the pulse generator include a one-half width pulse, a one-quarter width pulse, and a one-eighth width pulse.
Example 5 includes the stop-weighted light reference of Examples 1-4, or any other example light reference described herein, in which the selector device is structured to automatically cause the pulse-generator to sequentially step through the number of pre-set modes.
Example 6 includes the stop-weighted light reference of Examples 1-5, or any other example light reference described herein, in which the pulse-generator is structured to drive each mode with constant electrical current, and in which each of the pre-set modes has a different pulse width.
Example 7 includes the stop-weighted light reference of Examples 1-6, or any other example light reference described herein, in which the pulse-generator includes at least 10 pre-set modes.
Example 8 includes the stop-weighted light reference of Examples 1-7, or any other example light reference described herein, in which an individual one of the pre-set modes is repeated multiple times at a particular frequency.
Example 9 includes the stop-weighted light reference of Example 8, or any other example light reference described herein, in which the frequency is selected based on a light integration rate of the camera.
Example 10 includes a camera calibration system for a camera having an Optical-Electrical Transfer Function, the calibration system comprising: a three-dimensional structure including an LED light located within an interior of the structure, and including a hole through which the camera may view the LED light; and a pulse-generator having a predefined number of pre-set modes, and each mode having a pulse width different than other modes, the pulse-width generator structured to provide to the LED light a light driving output in one of the pre-set modes that corresponds to the user selected value.
Example 11 includes a camera calibration system of Example 10, or any other example camera calibration system described herein, further comprising: a selector device configured to be operated by a user to cause a predefined amount of light to be output by the LED, and in which the pulse-width generator is structured to accept a user-selected value from the selector device and to provide to the LED light source the light driving output.
Example 12 includes a camera calibration system of Examples 10-11, or any other example camera calibration system described herein, in which the pulse-width of a particular pre-set mode is exactly one-half the pulse width of another of the pre-set modes.
Example 13 includes a camera calibration system of Examples 10-12, or any other example camera calibration system described herein, in which one of the pre-set modes of the pulse-generator includes a full-width pulse.
Example 14 includes a camera calibration system of Example 13, or any other example camera calibration system described herein, in which other modes of the pulse generator include a one-half width pulse, a one-quarter width pulse, and a one-eighth width pulse.
Example 15 includes a method of calibrating a camera output, comprising: measuring a plurality of uncalibrated electrical outputs of the camera that respectively correspond to a plurality of known amounts of light; storing the plurality of uncalibrated electrical outputs of the camera; and, from the plurality of uncalibrated electrical outputs of the camera, creating a correlation table that respectively correlates the plurality of uncalibrated electrical outputs of the camera to pre-selected calibrated outputs, the pre-selected calibrated outputs being related to one another on a loge scale.
Example 16 includes the method of calibrating a camera output of Example 15, or any other example method of calibrating a camera output described herein, in which creating a correlation table comprises: determining how many number of independent calibrated outputs will be in the correlation table; and, for every of the number of independent calibrated outputs, associating a range of uncalibrated electrical output levels.
Example 17 includes the method of calibrating a camera output of Examples 15-16, or any other example method of calibrating a camera output described herein, further comprising storing the range of uncalibrated electrical output levels and their associated independent calibrated output in a Look-Up-Table.
Example 18 includes a test and measurement apparatus, comprising: an input structured to accept a camera output for a camera that has an uncalibrated Optical-Electrical Transfer Function; a first converter structured to accept the camera output and generate a numerical equivalent thereof; a second converter structured to accept one of the numerical equivalents from the first converter and to generate an output that is one of a plurality of calibrated outputs.
Example 19 includes the test and measurement apparatus of Example 18, or any other example test and measurement apparatus described herein, in which the plurality of calibrated outputs comprises a set of values related to one another by a loge function.
Example 20 includes the test and measurement apparatus of Examples 18-19, or any other example test and measurement apparatus described herein, in which the camera output is generated by pointing the camera at one of a known plurality of light values.
The previously described versions of the disclosed subject matter have many advantages that were either described or would be apparent to a person of ordinary skill. Even so, all of these advantages or features are not required in all versions of the disclosed apparatus, systems, or methods.
Additionally, this written description makes reference to particular features. It is to be understood that the disclosure in this specification includes all possible combinations of those particular features. For example, where a particular feature is disclosed in the context of a particular aspect, that feature can also be used, to the extent possible, in the context of other aspects.
Also, when reference is made in this application to a method having two or more defined steps or operations, the defined steps or operations can be carried out in any order or simultaneously, unless the context excludes those possibilities.
Although specific embodiments of the invention have been illustrated and described for purposes if illustration, it will be understood that various modifications may be made without departing from the spirit and scope of the invention.
This application is a non-provisional of and claims benefit of U.S. provisional application 62/291,795, filed Feb. 5, 2016, entitled HDR CAMERA F-STOP CALIBRATOR, the contents of which are incorporated by reference herein.
Number | Date | Country | |
---|---|---|---|
62291795 | Feb 2016 | US |