The invention relates to the field of color-measurement, more specifically to the field of measuring values of primaries of a human standard-observer based color space, such as the tristimulus values X, Y, Z, or values of the primaries L* a* b* of the CIELAB color space, and in particular to the field of calibrating multi-filter based colorimeters, multi-filter based imaging colorimeters and to colorimeter systems that are based on RGB-imaging systems.
In the field of colorimetry two basic measurement principles are known. In the first principle the light is measured spectrally resolved. Integration with weighting according to the eye sensitivity of the “standard observer” defined in the CIE 1931 XYZ color space are applied to receive the tristimuli values of XYZ. In the second principle the eye sensitivity is mimicked with a filtered photosensor. The filters are made either of bulk absorber (color glass filter) or with interference filters. A minimum of three filters is needed to measure up to the trichromaticity of human vision. Often a fourth filter is used to ease the technical realization of the double lobbed nature of the X channel. More channels are can be used to overcome technical limitations of the accuracy of the sensitivity response of the filter/sensor pair.
Kosztyán et al, “Matrix-based color measurement correction of tristimulus colorimeters”, Applied Optics, Vol. 49, No. 12, 20 Apr. 2010, p. 2288-2302 describe a measurement of tristimulus curves of a plurality of test light-sources with known tristimulus values (and therefore known chromaticity values) with a multi-input-channel colorimeter. Each input-channel of the colorimeter provides an output signal. These output signals are used to calculate three corrected tristimulus values by applying a matrix to these signals. The matrix maps the output signals to the tristimulus values. The matrix elements are determined by minimizing an arithmetic mean of the color-distances ΔEa,b* of the L* a* b* color-space or an arithmetic mean of the chromaticity distances Δ(u,v) of the L* u* v* color space. These distances are provided as a function of the tristimulus values resulting from application of the matrix to the measured output-signals and known tristimulus values of the test-light sources.
Exemplary embodiments of the invention are now described, also with reference to the accompanying drawings, wherein
According to a first aspect, a method of calibrating a colorimeter arranged to measure light with a sensor arrangement providing n sensings with different spectral sensitivities, wherein n is a number greater than or equal to four, and to measure that light in the form of three primaries of a human-standard-observer-based color space, wherein one of the three primaries is an achromatic primary, is provided. The method comprises:
According to a second aspect, a colorimeter for providing measurements of light with regard to primaries of a human-standard-observer-based color space, wherein the colorimeter comprises memory with sets of calibration factors stored therein, is provided. The sets of calibration factors are obtained by
The colorimeter further comprises
According to a third aspect, the colorimeter of the previous aspects is equipped with an imaging sensor. Each pixel can be treated as an individual colorimeter but resulting in a measurement of a spatially extended light distribution.
Other features are inherent in the disclosed methods and systems or will become apparent to those skilled in the art from the following description of examples and its accompanying drawings.
According to a first aspect a method of calibrating a colorimeter is provided. The term “colorimeter” refers generally to devices that measure color and luminosity of a certain spot illuminated with light. In particular, colorimeters that are arranged to mimic the color-perception of a human-standard-observer, providing readings of primaries of a human-standard-observer based color space are considered for the method.
The colorimeter is arranged to measure light with a sensor arrangement providing n sensings with different spectral sensitivities. The sensor arrangement comprises elements that convert light into electric signals (light sensors), such as photo diodes, CCD or CMOS sensors.
Those photosensors are equipped for example with filters placed in a beam path from the light to the photosensors. For example, a photodiode-array, comprising six elements with separate beam paths leading to them, is provided. In this exemplary sensor arrangement, one specific spectral filter is provided in the beam path of each photodiode element. Another example to realize a sensor arrangement is to place tristimulus filters, in the beam path in front of a respective photosensor. The sensor arrangement of the colorimeter provides n sensings of light that is measured by the colorimeter, wherein n is a number greater or equal four.
A sensing refers to a measurement of a particular quality of the light measured, e.g. a sensing corresponds to the response of a sensor in the sensor arrangement. For example, one sensing corresponds to the response of an X1 sensor of the sensor arrangement, e.g. the photodiode response after the light was transmitted through an X1 filter, and another sensing corresponds to the response of the X2 sensor (having an X2 filter). X1 filters and X2 filters mimic the response to of a human-standard-observer's eyes cone-cells in different spectral regions.
One of the primaries for which values are produced by the colorimeter is an achromatic primary. The achromatic primary of a human-standard-observer-based color space is the primary that yields rather the intensity of light rather than its color. Examples for human-standard-observer based color spaces are the X, Y, Z color space, where the X, Y and Z responses are the tristimulus values of a human-standard-observer and Y is the achromatic primary defined as luminance, the xyY color space with Y as the achromatic primary, the CIELAB L*, a*, b* color space, where L* is the achromatic primary, also referred to as “lightness”, or the CIELUV L*, u*, v* color space, having the same achromatic primary L*.
In a first activity, m sets of n sensings are generated for m calibration illuminants with known values of the three primaries, wherein m is a number greater than n. Hence, n sensings are obtained for each calibration illuminant of altogether m calibration illuminants. The term “calibration illuminant” means, for example, a real light source used to illuminate a real colorimeter. However, also a simulated light source used in embodiments in which the calibration is simulated by a computer using a computer-model of a real colorimeter, shall be covered by the term “calibration illuminant”. The values of the three primaries of the calibration illuminants are known, as they are either measured or predetermined. If the values of the three primaries are predetermined, the calibration illuminants have been, for example, calibrated beforehand to emit light with these primaries and/or chromaticity values.
In a second activity, a first set of calibration factors herein further referred to as the “chromaticity-optimized set of calibration factors” that yields chromaticity-optimized values of the primaries of the human-observer-based color space, when applied to signals measured by the sensings, is determined. The term “chromaticity-optimized set of calibration factors” as well as the term “chromaticity-optimized values of the primaries of the human-observer-based color space” is used in this document to make clear that this set of calibration factors resulting from the method for calibrating a colorimeter yields, when applied to the signals measured by the sensings, values of the primaries of the human-standard-observer based space with chromaticity values that have a minimal norm of chromaticity-distances for all the corresponding calibration illuminants.
The chromaticity-optimized set of calibration factors, is determined by minimizing a norm of chromaticity distances. The chromaticity-distances are the distances between (i) the chromaticity values retrieved by applying the set of calibration factors to the signals measured by the n sensings, and (ii) known chromaticity values for all calibration illuminants. To provide a particular example, the norm of the chromaticity distances is a mathematical norm, for example, given by a root-mean-square of these chromaticity-distances obtained for the calibration illuminants. This norm can be seen as an absolute value of the measurement error of the colorimeter.
By choosing a set of calibration factors that minimizes the norm of chromaticity distances, measurement errors of a colorimeter equipped with those calibration-factors with respect to chromaticity values are reduced. If a plurality of filters provide only a deficient filter function, e.g. due to production-related errors, those deficiencies can be compensated by the set chromaticity-optimized calibration-factors, resulting from these minimizations.
Choosing this set of calibration factors is, for example, achieved by iterative numerical methods, such as non-linear optimization algorithms. These methods vary a set of variable calibration-factors until the norm of the chromaticity-distances is minimal. Alternatively, the minimization of the norm of the chromaticity-distances can be achieved by using analytical mathematical methods such as the well-known Lagrange method.
An example for the determination of such a chromaticity-difference as a function of the set of calibration factors is given in the following:
A set of six sensings, obtained by measuring the calibration illuminant i (i is a number from 1 to m, wherein m is number of calibration illuminants), is given by the vector si, each vector component represents a measurement signal caused by the illuminant i,
The sensings X1i,LC, X2i,LC, Yi,LC, Zi,LC, Ki,LC and Li,LC stand for a sensings obtained by an X1 filter and an X2 filter (yielding the X tristimulus response) Y, Z tristimulus filters and two additional compensatory filters K and L for a certain calibration illuminant i, respectively. Mx/y is a set of calibration factors, in this example a 3×6 Matrix with calibration factors a11 to a36.
The set of calibration factors Mx/y is transformed into the values of the primaries for illuminant i, namely: Xi, Yi, Zi:
The chromaticity values, are given as a function of the values of those primaries by the following expressions:
wherein xcam i+ycam i+zcam i=1. As the chromaticity value zcam i is dependent on the other two chromaticity values, only xcam i and ycam i are considered in this example.
The chromaticity distance Di, chrom between the chromaticity xcam, i, ycam i, produced by the transformation of the six exemplary sensings si, for a calibration-illuminant i and the known chromaticity of the calibration illuminant i xref i, yref i is given by the distance between a vector comprising xcam, i, ycam i, and a vector comprising xref i, yref i.
This chromaticity distance Di, chrom is defined by, e.g. an L1 or an L2 norm.
After determining the chromaticity-distances Di, chrom, the chromaticity-optimized set of calibration factors is, as mentioned above, for example, determined by choosing the set of calibration factors that minimizes the norm of chromaticity distances for all the corresponding calibration-illuminants. The specific example of minimizing a root-mean-square as an example of a norm of chromaticity-distances when choosing the set of calibration factors is further explained below.
In a third activity, a second set of calibration-factors, herein further referred to as a set of calibration factors optimized with respect to the achromatic primary—that yields an optimized intensity value of the achromatic primary, when applied to the signals measured by the sensings, is determined. The terms “optimized with respect to the achromatic primary” and “optimized intensity value of the achromatic primary” are also used in this document to make clear that the set of calibration factors resulting from the method yields, when applied to the signals measured by the sensings, values of the primaries of the human-standard-observer based space with an achromatic primary that has a minimal norm of the achromatic distances for all the calibration illuminants, which is further explained below.
The set of calibration factors optimized with respect to the achromatic primary is determined by minimizing the norm of achromatic distances. The achromatic distances are defined as the distances between (i) the values of the achromatic primary retrieved by applying the set of calibration factors to the signals measured by the n sensings, and (ii) known values of the achromatic primary for all calibration illuminants. To provide a particular example, also the norm of the achromatic-distances is a mathematical norm, such as a root-mean-square of these achromatic-distances obtained for the calibration illuminants. The norm of the achromatic-distances can be seen as absolute value of the measurement error of the colorimeter too.
Thus, determining this achromatic-optimized set of calibration-factors comprises, for example, choosing the set of calibration-factors that minimizes the norm of said achromatic distances, as described above and hereinafter.
By choosing this set of calibration factors the measurement error of a colorimeter equipped with those calibration factors optimized with respect to the achromatic primary, is reduced, as already described in conjunction with the determination of the set of chromaticity-optimized calibration factors. The set of calibration factors (being a function of the set of calibration factors to be chosen) is also, for example, chosen such that the norm of the achromatic-distances is minimized. The specific example of minimizing a root-mean-square as an example of a norm of these achromatic-distances obtained for a plurality of calibration illuminants, is further explained below.
Choosing this set of calibration factors, for example, achieved by iterative numerical methods, such as non-linear optimization algorithms. These methods vary a set of variable calibration-factors until the norm of the chromaticity-distances or the norm of the achromatic distances is minimized.
Alternatively, this set of calibration factors that minimizes the norm of the achromatic distances is chosen, for example, by using analytical mathematical methods, analogous as described in conjunction with choosing the set of calibration factors that minimizes the norm of the chromaticity-distances.
An example of determining an achromatic-distance is described in the following: The six signals measured by the sensings si, that were already introduced in the above example, are transformed into the achromatic primary Y0i by a set of calibration factors represented by the matrix MY, as follows:
MY is a 3×6-matrix with entries (calibration-factors) b11 to b36:
X0i and Z0i are redundant in this example, therefore the transformation could also be achieved by a 1×6 Matrix with calibration factors b11 to b16, as shown by the formula reproduced below:
The achromatic distance Di, achrom, i.e. the distance between Y0i and the known achromatic primary of calibration illuminant i, namely Yref i, is given by:
D
i,achrom
=∥Y
ref i
Y
0i∥
This difference Di, achrom is defined by, e.g. a L1 or a L2 norm.
After determining the achromatic-distances Di, achrom, the set of calibration factors optimized with respect to the achromatic primary is, as mentioned above, for example, determined by choosing the set of calibration factors that minimizes the norm of the achromatic-distances for corresponding calibration-illuminants.
The activity of choosing the set of calibration factors that minimizes the norm of the achromatic distances and the activity of choosing the set of calibration factors that minimizes the norm of the chromaticity-distances are carried out independently from each other.
The resulting chromaticity-optimized set of calibration factors corresponds to the set of calibration factors that minimizes the norm of the chromaticity-distances of all calibration illuminants, whereas the resulting set of chromaticity factors optimized with respect to the achromatic primary corresponds to the set of calibration factors that minimizes the norm of the achromatic distances of all calibration illuminants.
One consequence of separating these two choosing activities is that the intensity value of the achromatic primary that is obtainable by applying the chromaticity-optimized set of calibration factors to signals measured by the n sensings, is different to the intensity value of the achromatic primary that is obtainable by applying the set of calibration factors optimized with respect to the achromatic primary to those signals. The former is part of a set of values of primaries that have optimized chromaticity values, the latter is the optimized intensity value itself.
Carrying out the choosing activities simultaneously would lead neither to the chromaticity-optimized set of calibration factors nor lead to the set of calibration factors optimized with respect to the achromatic primary. The achromatic primary (once expressed as a function of the set of the set calibration factors that is chosen to minimize the norm of the chromaticity-distances and once expressed as a function of the set of calibration factors that is chosen to minimize the norm of the achromatic distances) would simultaneously be part of the first choosing activity and also the second choosing activity. As a result a compromise between those contradictory criterions that should be fulfilled by the first and second choosing activity would be found for the parts of the sets of calibration factors that influence the achromatic primary. Hence neither of the two sets of calibration factors would be optimal.
Both sets of calibration factors together enable the colorimeter, when measuring light after the calibration, to provide optimized readings both in chromaticity and for the achromatic primary.
The term “readings” referrers to final measurement values of light with respect to the three primaries.
The two sets of calibration factors obtained by the method are (i) a chromaticity-optimized set of calibration factors and (ii) a set of calibration factors optimized with respect to the achromatic primary. The colorimeter is arranged to measure light after the calibration. Also a camera using the functional elements of the colorimeter, such as a photodiode array equipped with different filters to obtain the n sensings as described above is to be understood as a colorimeter in the above sense.
The colorimeter provides optimized readings both in chromaticity and for the achromatic primary due to the two sets of calibration factors. The chromaticity-optimized set of calibration factors enables the colorimeter to provide optimized readings of the chromaticity values xy in the xyY human-observer based color space.
In the above example, the chromaticity optimized calibration factors with optimized x/y-chromaticity values when applied to the signals measured by the sensings si. The optimized chromaticity readings x/y can be obtained from these tristimulus values as they are a function of the tristimulus values obtained by applying the set of calibration factors:
The set of calibration factors optimized with respect to the achromatic primary enables the colorimeter, in turn, for example, to provide optimized readings of the values of the achromatic primary Y in the xyY color space, or L* in the CIELAB or CIELUV color space.
Comments on the Generation of the n Times m Sensings by Illumination with Calibration Illuminants
In the above mentioned first activity, m sets of n sensings for the m calibration illuminants with known values of the three primaries are generated.
In some embodiments, the colorimeter is illuminated separately with real calibration illuminants having different spectra (contrary to simulated calibration illuminants mentioned above). Such real calibration illuminants with different spectra are, for example, light emitting diodes (LED), tungsten lamps, halogen lamps, fluorescence light source or the like. However the term “calibration illuminant” relates to source of light with different spectra in general. Therefore also a single light source, driven to emit light of different spectra by adjusting, for example its temperature or the chemical composition of the light emitting components of the illuminant (for example by heating up different chemical elements emitting light of different spectra when heated) is covered by the term “calibration illuminant”. If different groups of light sources emit light simultaneously this is too seen as a “calibration illuminant”. The colorimeter is then separately illuminated by different groups of light sources, each different group corresponding to a calibration illuminant.
In some embodiments, the m sets of n sensings are generated by measuring the spectral sensitivity of the n sensors and the spectral emission of the calibration illuminants. The n sensings are computed thereof. The n sensings are, for example, computed by applying a computer model of a sensor arrangement using the measured spectral sensitivity of the n sensors and the measured spectral emission of the calibration illuminants.
The known values of the three primaries of the human-standard-observer-based color space of the calibration illuminants are measured or predetermined, as already mentioned above.
The values of the corresponding achromatic primary and/or the chromaticity values of those primaries are, for example, measured by illuminating the colorimeter and a very precise reference-spectrometer, such as a high quality spectrometer using color-matching-functions to obtain the values of the primaries and at the same time measuring the same calibration-illuminants.
Therefore, the colorimeter and the reference-spectrometer are illuminated by the same calibration illuminants, and the known value of the primaries of these calibration illuminants is obtained by measuring the light of the respective calibration illuminant with said reference-spectrometer.
Comments on the Measuring Light after the Calibration-Producing XYZ Readings
As already mentioned above, when measuring light with the colorimeter, the chromaticity-optimized set of calibration-factors is applied to signals provided by the sensor arrangement originating from the light to obtain chromaticity-optimized values of the primaries. The set of calibration-factors optimized with respect to the achromatic primary is also applied to these signals to obtain the optimized value of the achromatic primary.
This is, for example, carried out by multiplying the matrix Mx/y of the above example, representing the chromaticity-optimized set of calibration-factors with a vector of the signals measured by the sensings s and by multiplying the matrix MY of the above example, representing the set of calibration factors optimized with respect to the achromatic primary, with the same vector s:
By applying the chromaticity-optimized set of calibration factors Mx/y to the signals measured by the sensings, values of primaries with optimized readings in chromaticity x/y are obtained, whereas by applying the set of calibration factors optimized with respect to the achromatic primary MY, optimized readings with respect to the achromatic primary Y are obtained. In the case that optimized readings in the xyY color space should be obtained and x/y readings were derived from the optimized (X′, Y′, Z′) readings, these x/y readings in combination with the X reading would already be the desired readings in the xyY color space.
In the case that, for example, tristimulus values (X, Y, Z) with optimized chromaticity values x/y and also an optimized achromatic primary Y (wherein the optimized achromatic primary Y is also referred to as “the optimized value of the achromatic tristimulus”) are the desired readings, the two readings and the corresponding calibration factors are, for example, used in the following way to provide these X, Y, Z, readings optimized both in chromaticity and for the achromatic primary:
The optimized readings in chromaticity x/y are scaled with a factor including the optimized intensity value of the achromatic primary Y0 and the intensity value of the achromatic primary of the chromaticity-optimized primaries Y′.
By performing this scaling, the chromaticity values of the chromaticity-optimized values of the primaries remain unchanged, thereby the chromaticity values of the chromaticity-optimized values of the primaries still have a minimal chromaticity-distance to the known chromaticity values of the calibration illuminants. Hence, e.g. tristimulus chromaticity values remain optimal, regardless of the scaling. This is explained by the fact that every factor multiplied with a chromaticity, e.g. the factor three as shown below, which is equally applied to all three values of primaries, cancels out and has therefore no influence on chromaticity. This can be demonstrated by the example of tristimulus primaries X, Y, Z and their respective chromaticity values x, y:
This scaling-factor is, for example, a function of those two primary values f(Y0, Y′) (the reading of the achromatic primary of the chromaticity-optimized readings of the primaries and the optimized reading of the achromatic primary). Such an exemplary scaling operation is mathematically expressed by:
In this expression, the vector representing the chromaticity-optimized readings of the primaries X′, Y′, Z′, is multiplied with the factor f(Y0, Y′) to obtain the final readings of the primaries produced by the colorimeter, namely Xfinal, Yfinal, Zfinal.
The factor f(Y0, Y′) is given, for example, by the ratio between the achromatic primary Y′ of the chromaticity-optimized reading of the primaries (X′, Y′, Z′) and the optimized reading of the achromatic primary Y0, e.g. Y0 divided by Y′, such that the final readings of the primaries are then given by:
By carrying out the scaling using this exemplary ratio, the chromaticity-optimized achromatic primary Y′ is transformed into the optimized achromatic primary Y0, wherein the chromaticity values of the chromaticity optimized primaries X′, Y′, Z′ remain unchanged.
The result of this scaling are the final readings of the primaries X, Y, Z (tristimulus values), optimized both in chromaticity and for the achromatic primary Y.
If only the chromaticity-optimized set of calibration factors were applied, the reading of the achromatic primary Y was, as a consequence, non-optimal, as the chromaticity-optimized set of calibration factors also shifts that achromatic primary.
Comments on Chromaticity-Distances and/or Achromatic Distances
In some embodiments the chromaticity distances and/or the achromatic distances are Euclidian distances. Generically expressed, the chromaticity difference Di,chrom taken from the example described above is given by:
This chromaticity distance is in this embodiment a Euclidian distance, given by the formula:
D
i,chrom=√{square root over ((xref i−xcam i)2+(yref i−ycam i)2)}
Generally expressed, the achromatic difference Di,achrom taken from the example described above is given by:
D
i,achrom
=∥Y
ref i
−Y
0i∥
This chromaticity distance is in this embodiment a Euclidian distance, given by the formula:
D
i,achrom=√{square root over ((Yref i−Y0i)2)}
By using a Euclidian distance as the chromaticity distance and/or the achromatic distance, those distances correspond to distances in a Euclidian space. The Euclidian distance is positive definite, i.e. it results only in positive values for the distances Di,achrom and Di,chrom. Therefore, when these distances are minimized using a root-mean-square as the norm of the achromatic distances or chromaticity-distances, the root-mean-square can only be minimized by minimizing the chromaticity-distances or achromatic distances. This is the case here, as all summands are always positive and cannot cancel each other out.
In some embodiments, the norm of the chromaticity-distances is a root-mean-square of the chromatic distances, obtained for the m calibration illuminants, and/or the norm of the achromatic distances is a root-mean-square, of the achromatic distances, obtained for the m calibration illuminants.
Hence, the norm of chromaticity distances in this example given by a root-mean-square Fchrom of the chromaticity differences Di chrom, which reads:
wherein m is the number of calibration-illuminants for which a chromaticity-difference Di chrom is determined.
The norm of the chromaticity-distances is minimized as follows:
The minimization is, for example, carried out by means of an iterative numerical method mentioned above. Such iterative numerical methods comprise varying a set of variable calibration factors in an iterative manner to until a minimal value of the root-mean-square is found. Examples for applicable numerical methods are the Nelder-Mead algorithm or other nonlinear programming algorithms, such as the Powell-algorithm.
As start values for the variation of the variable calibration factors, for example, previously stored calibration factors can be used.
Alternatively, as an analytical solution for the set of calibration factors can be determined in the case that the number of measured sensing n is equal to the number of calibration illuminants m, the set of calibration factors which is the solution of that problem for chosen calibration can serve as start values for the variation. Advantageously, n calibration illuminants are chosen that cover a broad part of the spectrum, when determining these start values.
The chromaticity values of the primaries obtained by applying the chromaticity-optimized calibration factors to the signals measured by the sensings have a lower residual deviation from the known chromaticity values of the calibration-illuminants than chromaticity values of primaries that were determined by minimizing the differences between (i) just the primaries (Xcam i, Ycam i, Zcam i)—not the chromaticity of the primaries—obtained by applying the calibration factors and (ii) the known primaries of the calibration illuminants (Xref i, Yref i, Zref i).
Such a difference is given for a calibration-illuminant i:
And therefore the root-mean-square Fcolor of those differences is given by:
If the chromaticity-optimized set of calibration factors were determined by minimizing this root-mean-square Fcolor, the chromaticity values of readings for primaries resulting from applying this set to the signals measured by the sensings are, in general, non optimal.
Alternatively or additionally, the norm of the achromatic distances is a root-mean square of the achromatic distances obtained for the m calibration illuminants (m is a number greater than n).
This root-mean-square Fachrom of the achromatic differences Di achrom, is given by:
wherein m is the number of calibration-illuminants for which a chromaticity-difference Di achrom is determined.
Hence the criterion for finding the set of calibration factors optimized with respect to the achromatic primary by minimizing the norm given above, reads:
The minimization is, for example, carried out by means of an iterative numerical method, as mentioned above.
In some embodiments, the summands of the root-mean-square of the chromaticity distances have either uniform weights or, alternatively, non-uniform weights, i.e. at least one of the summands is weighted with a higher or lower weight than another summand.
An exemplary root-mean-square of chromaticity distances, including weights for each summand, is given below:
wherein wi is the weight for calibration illuminant i and Di, chrom is the chromaticity distance for that calibration illuminant.
If the weights are non-uniform, the higher the weighting factor is, the higher the chromaticity distance for a certain calibration-illuminant, the more this chromaticity distances is prioritized by the iterative numerical method or variation method. Hence, the chromaticity distance for a certain calibration-illuminant, or the calibration distances for a certain group of calibration-illuminants will be, for example, minimized at the expense of chromaticity distances for other calibration illuminants.
Alternatively or additionally, in some embodiments the summands of the root-mean square of the achromatic distances have either uniform weights or, alternatively, non-uniform weights, i.e. at least one of the summands is weighted with a higher or lower weight than that of other summand.
An exemplary root-mean-square of achromatic distances with weighted summands is given below:
wherein wi is the weighting factor for calibration illuminant i and Di, achrom is the achromatic distance for that calibration illuminant.
The considerations made above for the root-mean-square of chromaticity-distances in conjunction with the behavior of the iterative numerical method or variation method in response to summands with uniform weights or non-uniform weights also hold true for the root-mean-square of achromatic distances.
In some embodiments, in response to at least one chromaticity distance and/or at least one achromatic distance exceeding a given penalty-distance from a target value when varying the set of variable calibration factors, the at least one exceeding chromaticity distance and/or exceeding achromatic distance is weighted higher in the subsequent variation of the set of variable calibration factors than in the preceding variation of the sets of variable calibration factors, wherein the exceeding chromaticity distance and/or exceeding achromatic distance is weighted higher than the chromaticity distances and/or achromatic distances that do not exceed this penalty distance.
The penalty distance is a given distance from the target value. The target value can either be arbitrarily chosen (predetermined) or may be a momentary value of a corresponding norm of the chromaticity distances or achromatic distances, such as a root-mean-square of chromaticity-distances or a root-mean-square of achromatic distances.
This “limit and penalty” mechanism is, for example, applied after several “warm up runs” of an iterative minimization method, as penalizing a lot of chromaticity-distances/achromatic distances at this early stage might lead to numerical unstable behavior of standard nonlinear programming algorithms.
By increasing the weight of an exceeding chromaticity-distance/achromatic distance in a norm of achromatic or chromatic distances, e.g. the root-mean-square of these distances, the exceeding chromaticity-distance/achromatic distance is minimized at the expense of the other chromaticity-distance/achromatic distance to be minimized.
However, the overall result for the chromaticity-distances/achromatic distances is more uniform, i.e. confined within a range around the target value defined by the penalty distance, when this functionality is applied.
In some embodiments, the sensor arrangement comprises n filter-photo sensors comprising n filters with different spectral sensitivities coupled to corresponding n photo sensors, to provide the n sensings simultaneously.
The filter photo sensors comprise photo sensors that convert light into electric signals, such as photodiodes, charge-coupled devices (CCD) or complementary metal-oxide-semiconductor (CMOS) photo-sensors and corresponding filters. The filters are, for example, chromatic filters, such as X1, X2, Y or Z filters. In this embodiment at least four filters are used to obtain at least four sensings.
These n filters are, for example placed on the corresponding photosensor so that they face the light measured, i.e. in the beam path of the light. For example, an array of photo sensors having six sub-arrays with separate beam paths leading to them, is provided. In this exemplary sensor arrangement, a different filter is provided in the beam path of each sub-array.
The filters have different spectral sensitivities. Additionally to the effects already mentioned, for example, a first set of filters can be used that provides an accurate filter function in a certain spectral region but a rather inaccurate in other spectral regions. This first set of filters is for example supported by a second set of filters that provides an accurate filter function right in that spectral region where the first set of filters is inaccurate and vice versa.
The at least four sensings and therefore the corresponding at least four signals measured by the sensings are obtained simultaneously, as the same light is measured by the sensor arrangement equipped with n different filters facing n photosensors such as CCD elements, CMOS elements or photodiodes.
In some embodiments, the sensor arrangement comprises n movable filters with different spectral sensitivities and a photo sensor, wherein the filters are sequentially moved into a filtering position, to provide the n sensings sequentially.
The sensor arrangement is, for example, equipped with one photo sensor such as a CMOS sensor, and a filter arrangement moveable into the beam path to the photo sensor. The filter arrangement has, e.g. ten filters, which are moved into a filtering position, e.g. into a beam path leading to the photo sensor. Therefore ten measurement cycles in which different filters are moved into the filtering position have to be carried out to obtain the ten sensings.
In some embodiments the photo sensor of a monochromatic camera that is arranged to measure a spatially extended light distribution, is used as the photo sensor. The monochromatic camera is capable of measuring light of, e g millions of pixels simultaneously. The photo sensor used comprises, for example, CCD or CMOS sensors.
Using CCD or CMOS sensors as photo sensors is advantageous as they are less prone to noise such as dark currents than, for example, photo diode arrays.
The n sensings are obtained for example by moving n filters sequentially into a filtering position and measuring the sensings for each of the millions of pixels. According to the method described herein, a set of chromaticity optimized calibration factors and a set of calibration factors optimized with respect to the achromatic primary can be determined for a certain spot, e.g. a pixel in the center of the light distribution measured by the camera and the respective filters.
Using the chromaticity-optimized calibration-factors and the calibration factors optimized with respect to the achromatic primary obtained for this certain spot, and values of XYZ primaries are the desired readings produced by the colorimeter for each pixel of the spatial light distribution can be obtained by scaling the chromaticity-optimized set of primaries with the factor including the optimized achromatic primary and the achromatic primary of the chromaticity optimized primaries. Hence, the calibration factors obtained for a certain spot of the light distribution, e.g. a certain pixel at the center of the light distribution, are applied to obtain the XYZ primaries of each pixel of the measured spatially extended light distribution.
Alternatively, both sets of calibration factors are obtained for each pixel of the measured extended light distribution and then used to obtain the primaries produced by the colorimeter for each pixel of the spatially extended light distribution.
In some embodiments at least one of the calibration illuminants has a wavelength distribution with a full-width-half-maximum in a range from 10 nm to 50 nm.
Examples for such calibration illuminants are light emitting diodes (LEDs). Using calibration illuminants with a full width half maximum in this range allows to measure a plurality of calibration illuminants with contiguous full-width-half-maxima, wherein all the peaks of the wavelength distributions lie within the range of visible light, i.e. 360-830 nm. Visible light is the light perceived by a human standard observer and therefore especially suitable to calibrate the colorimeter that produces values of primaries of the human standard observer based color space. Additional to those rather narrowband light sources also broadband light sources, such as tungsten lamps, can be used as calibration illuminants.
In some embodiments the majority or even all of the calibration illuminants have a wavelength distribution with a full-width-half-maximum in a range from 10 nm to 50 nm. Common tristimulus filter often produce non-accurate filter signals when measuring light with such a (rather narrowband) wavelength distribution. When such common tristimulus filters are implemented in the sensor arrangement of the colorimeter to be calibrated, using such light sources as calibration illuminants is advantageous, as the sets of calibration factors are chosen by the calibration method described herein such that the non-accurate filter signals of the common tristimulus filter, are compensated by applying the chromaticity-optimized set of calibration factors and/or the set of calibration factors optimized with respect to the achromatic primary to the sensing signals obtained by the sensor arrangement that comprises that tristimulus filter.
In some embodiments the optimized readings in chromaticity and for the achromatic primary are obtained for the color spaces xyY, CIELAB or CIELUV.
The chromaticity-optimized set of calibration factors as well as the set of calibration-factors optimized with respect to the achromatic primary are determined to enable the colorimeter to produce optimized readings in chromaticity and for the achromatic primary of the primaries of a human-standard-observer based color space. In the above examples, the determination of such calibration-factors for the color space xyY was described in detail. The values for (i) xy and for (ii) Y were obtained by (i) applying the chromaticity-optimized set of calibration factors to the signals measured by the sensings and determining the optimized chromaticity readings as a function of the resulting tristimulus primaries, and (ii) applying the set of calibration factors optimized with respect to the achromatic primary to the signals measured by the sensings and using the obtained achromatic primary as the optimized reading for the achromatic primary.
Furthermore it was described how tristimulus primaries having optimal readings in chromaticity and optimal readings for the achromatic primary could be obtained by applying the sets of calibration factors to the signals measured by the sensings in a combined manner, i.e. the scaling operation beforehand described.
However, in embodiments in which the calibration factors enable the colorimeter to produce optimized readings of the CIELAB primaries L*a*b* or the CIELUV primaries L*u*v*, the chromaticity-distances are obtained for the chromaticity values related to these primaries and the achromatic distances are obtained for the achromatic primaries of those color spaces.
When the method of calibrating a colorimeter is applied to obtain such optimized readings for the CIELAB or CIELUV primaries, the signals measured by the sensings have to be normalized relative to the light of a reference white point, e.g. Xn, Yn, Zn, used in the conversion from readings in the XYZ color space to the L*a*b* color space or L*u*v* color space.
The chromaticity-distances are, for example, determined using chromaticity values that are related to values of primaries of the L* u*v* color space. The transformation to Xi, Yi, Zi by the L*u*v*—chromaticity-optimized set of calibration factors Mu′/v′ is, for example, in this case given by:
The mathematical transformation from Xi, Yi, Zi related chromaticity values xcam i, ycam i to the L*, u*, v* related chromaticity values u′cam i, v′cam i and from Xi, Yi, Zi to u′cam i, v′cam i is given by:
A chromaticity distance for a respective illuminant i with L*, u*, v* related chromaticity values u′ref i and v′ref i is given by:
By applying chromaticity-optimized calibration factors, obtained by, e.g. by minimizing a root-mean-square of those chromaticity-distances, to the signals measured by the sensings, chromaticity-optimized tristimulus primaries X′, Y′, Z′, are obtained. Chromaticity-optimized means in this context, that the root-mean square of the chromaticity-distances of the CIELUV chromaticity values u′, v′ of those tristimulus primaries X′, Y′, Z′ are minimal but the root-mean square of the chromaticity-distances of the tristimulus chromaticity-values x, y of those primaries are probably not minimal.
To obtain the set of calibration factors optimized with respect to the achromatic primary L*, of the L*u*v* color space, Y0i is, for example, expressed as a function of L*0i (the achromatic primary of the CIELUV space), by applying the respective mathematical transformations, and the achromatic differences:
D
i,achrom L*
=∥L*
ref i
−L*
0i∥
The norm of these achromatic differences, e.g. a root-mean-square of these distances, is minimized to determine the set of calibration factors optimized with respect to the achromatic primary.
After determining the two sets of calibration factors, optimized readings for chromaticity and the achromatic primary of the color space L*u*v* can be obtained when measuring light after the calibration by applying the respective sets of calibration factors to the signals measured by the sensings and—thereby obtaining tristimulus values optimized with respect to the chromaticity values u*v* and tristimulus values optimized with respect to the achromatic primary L*. By converting these tristimulus values into L*, u*, v* readings, L*u*v*readings, wherein the chromaticity values u*v* as well as the achromatic primary value L* is optimal, are obtained.
If tristimulus values corresponding to optimal values for both L* and u*v* should be obtained, the sets of calibration factors can be used in a combined manner, for example by scaling the achromatic primary of the chromaticity optimized tristimulus values with a factor containing the optimized achromatic primary Y, as described above.
The activities described above in conjunction with the primaries L*, u*, v* of the CIELUV color space are also applicable for determining the sets of calibration factors for the primaries L*, a*, b*, in an analogous manner. The activities are the same, but the mathematical transformations from the primaries L*, a*, b* to their chromaticity values a, b are different.
Comment on the Colorimeter Equipped with the Sets of Calibration Factors
According to a second aspect, a colorimeter for measuring values of light with regard to primaries of a human-standard-observer-based color space is provided. The colorimeter is equipped the sets of calibration factors obtainable by the method for calibrating a colorimeter as described above. This means that calibration factors that are obtained by a mathematically equivalent method to the method described herein, shall be covered by the subject-matter for which protection is sought. To provide an example, the result obtainable by the method of dividing 1 by 2 is 0.5, the mathematical equivalent method of dividing 2 by 4 yields the same result. Sets of calibration factors are, for example, stored in a physical memory of the colorimeter, e.g. a non-volatile memory such as a flash memory of the colorimeter, replacing old calibration factors.
The colorimeter comprises, for example, a sensor arrangement providing n sensings of the light with different spectral sensitivities, n being a number greater or equal four.
The sensor arrangement comprises, for example, a combination of n photo sensors and n filters with different spectral sensitivities is provided that is arranged to measure the light with n sensings simultaneously. These filter photo sensors include, for example, photo sensors that convert light into electric signals, such as photo diodes, charge-coupled devices (CCD) or complementary metal-oxide-semiconductor (CMOS) sensors and filters. The filters are placed, for example, on the photo sensors so that they face the light measured, i.e. they are placed in the beam path of the light. For example arrays of such CMOS or CCD sensors, wherein each CMOS or CCD sensor is coupled to a corresponding filter, are provided as the sensor arrangement.
In other examples, the light sensor arrangement comprises a filter arrangement, moveable into the beam path of one or more light sensors, wherein the number of light sensors equipped to measure the light passing through a filter is smaller than the number of filters of the filter arrangement. The filter arrangement has, for example ten filters, which are moved into a filtering position, e.g. into the beam path leading to a CCD sensor. If such an exemplary sensor arrangement is provided, ten measurement cycles in which different filters are moved into the filtering position are necessary to obtain the ten sensings.
The colorimeter further comprises a processing system that is arranged to determine the values of the light with respect to the three primaries of the human-standard-observer based color space from the n sensings. The processing system is therefore arranged to map signals measured by the at least four sensings to tristimulus values, such as the chromaticity-optimized set of calibration factors and the set of calibration factors optimized with respect to the achromatic primary.
The processing system itself comprises, for example, a central processing unit (CPU), being connected to at least one interface providing the signals measured by the sensings and a central memory connected to said CPU in which the calibration factors are stored. The CPU is programmed to carry out the method further described below. Alternatively, the processing unit is replaced by a plurality of integrated circuit, such as an array of adder and multiplier circuits that are capable of carrying out a matrix multiplication, and other integrated circuits, such as dividers.
The processing system is arranged to determine the values of the light with respect to the three primaries of the human-standard-observer based color space by:
(i) Applying the chromaticity-optimized set of calibration factors to signals provided by the sensor arrangement originating from the light to obtain chromaticity-optimized values of the primaries.
This activity (i) is carried out, for example, by multiplying the matrix Mx/y, representing the chromaticity-optimized set of calibration-factors with a vector of the signals measured by the sensings s:
(ii) Applying the set of calibration factors optimized with respect to the achromatic primary to signals provided by the sensor arrangement originating from the light to obtain the optimized intensity value of the achromatic primary. This activity (ii) is carried out, for example, by multiplying the matrix MY, representing the set of calibration factors optimized with respect to the achromatic primary, with the same vector s:
If primaries of the human-standard observer based space xyY are desired as optimized readings obtained by the colorimeter, the optimized reading in x/y can be obtained by applying the chromaticity-optimized set of calibration factors to the signals measured by the sensings and determining the chromaticity values of the resulting chromaticity optimized tristimulus values (X′, Y′, Z′). The optimized reading in Y is Y0. Hence, the reading can be directly obtained by applying the set of calibration factors optimized with respect to the achromatic primary to the signals measured by the sensings s.
The processing system may be arranged to apply the two sets of calibration factors in a combined manner to the signals measured by the sensings:
The processing system is therefore further arranged to: (i) scale the chromaticity-optimized values (X′, Y′, Z′) with a factor including the optimized reading of the achromatic primary Y0 and the reading of the achromatic primary Y′ of the chromaticity-optimized readings of the primaries (X′, Y′, Z′) to obtain readings of the primaries, optimized both in chromaticity x/y and for the achromatic primary Y. The factor is, for example, as described above, the optimized reading of the achromatic primary Y0 divided by the achromatic primary Y′ mentioned above.
By performing this scaling, the chromaticity values of the chromaticity-optimized readings of the primaries remain unchanged, as mentioned above in conjunction with the first aspect. Such an exemplary scaling operation is mathematically expressed by:
The obtained readings Xfinal, Yfinal, Zfinal are, in this example, the readings of the primaries X, Y, Z produced by the colorimeter.
An exemplary calibration arrangement for a colorimeter, in this particular case, an imaging colorimeter 1, is shown in
An exemplary method of calibrating a colorimeter, illustrated by the block diagram of
In
At box S2, for each calibration light source 8, a set of n sensings is obtained by the imaging colorimeter 1. The activity at box S2 thereby leads to m sets of n (in this example six) sensings 6 measured by the imaging colorimeter 1. The activity at box S3, namely measuring the light with the reference spectrometer 6 and obtaining reference chromaticity values, is also carried out for each activated LED 8 and leads to m sets of reference chromaticity values xref i/yref i 11 and a set of m reference luminances Yref i 12. One set of chromaticity values and one reference luminance are measured by the reference spectrometer 2 for each light of a different spectrum emitted by a calibration light source 8. The m sets of reference chromaticity values xref i/yref i 11 and the set of m reference luminances Yref i 12 represent the known chromaticity values and the known values of the achromatic primary (luminance Y).
The m sets of n sensings si 10 and the m sets of reference chromaticity values 11 are used in the activity at box S4, to obtain a chromaticity-optimized set of calibration factors Mx/y. This activity at box S4 is further described in conjunction with
The m sets of n sensings 10 and the set of m reference luminances Yref i 12 are used in the activity at box S5 to obtain a set of calibration factors MY, optimized with respect to luminance Y 14. This activity is further described in conjunction with
The activities at boxes S4 and S5 are carried out independently from each other.
By determining the two sets of calibration factors 13, 14, the actual calibration procedure is concluded. If, for examples, primaries of color space xyY are the desired reading, these primaries can be obtained by applying the calibration factors to the sensings to obtain the XYZ values. The x/y readings derived from these XYZ values (x=X/(X+Y+Z), y=Y/(X+Y+Z)) and Y value of these XYZ readings are then the desired xyY reading.
The first part of the block diagram of
At box M1, a set of n sensings is measured by this colorimeter 1′. The chromaticity-optimized set of calibration factors Mx/y 13 is applied to this set of n sensings in the activity of box M2. This results in chromaticity-optimized tristimulus values X′, Y′, Z′ 15 that represent the chromaticity-optimized values of primaries of the human standard observer based color space.
The set of calibration factors MY, optimized with respect to luminance Y 14 is applied in the activity at box M3 to the set of n sensings obtained in the activity of box M1. This results in an optimized intensity value of the luminance Y0 16 that represents the optimized intensity value of the achromatic primary.
In the activity of box M4, a scaling factor, is determined that is a function of the luminance Y′ of the chromaticity-optimized tristimulus values X′, Y′, Z′ 15 and the optimal intensity value of the luminance Y0 16. The scaling factor is the ratio between those two luminances, namely Y0/Y′. In the course of a scaling activity at box M5, the chromaticity-optimized tristimulus values X′, Y′, Z′ 11 are multiplied by the scaling factor determined in the activity at box M4. By scaling these tristimulus values 11 with this scaling factor (activity M5 of the block diagram of
These final tristimulus values 17 have optimized chromaticity values x/y and an optimized luminance Y′. Optimized refers here to the context already described in the “general description” above.
The activities of box S4—choosing the chromaticity optimized set of calibration-factors Mx/y illustrated in
The chromaticity-distances are determined by setting up the Euclidian distance between a vector (xcam i, ycam i) for a calibration light source 8 with index i (i=1 to m) and a reference vector (xref i, yref i) for the same calibration light source 8, taken from the m sets of reference chromaticity values xref i/yref i 11. Subsequently, a root-mean-square Fchrom of these chromaticity distances, having the chromaticity-distances for each calibration light source 8 as summands, is set up. Each summand of Fchrom is weighted with a weigh wi, corresponding to the importance of an optimal result for the light of a certain spectrum.
At box S42, the chromaticity-related root-mean-square Fchrom is minimized by adjusting the variable set of calibration factors Mx/y. Choosing the set of calibration factors that yields a minimal root-mean-square Fchrom is carried out, in this example, by applying a Nelder-Mead algorithm on the chromaticity-related root-mean-square Fchrom.
The activity of setting up the root-mean-square of the achromatic distances Fachrom and subsequently choosing the set of calibration factors that minimizes this root-mean-square (the activity of box S5 in
For each calibration light source with index i (i=1 to m), a variable set of calibration factors, represented by the matrix MY, is applied to the signals measured by the six sensings for a respective calibration light source with index i, represented by vector si, the respective n sensings are taken out of the m sets of n sensings si 10. The result of these matrix multiplications is a luminance Y0i for a certain calibration light source with a certain index i, expressed by the set of variable calibration factors. The achromatic distances Di, achrom are the Euclidian distances between (i) the reference luminances Yref i, taken from the set of m reference luminances 12, for a certain calibration light source 8 with index a certain index i and (ii) the result of the above mentioned matrix multiplication, namely the luminance Y0i for the light of the same calibration light source 8.
Subsequently, an achromatic-distance related root-mean-square Fachrom is set up. The summands of this root-mean-square are the achromatic distances Di, achrom for each calibration light source 8. These summands are weighted in analogy to the summands of the chromaticity-related root-mean-square of
In analogy to the activity discussed in conjunction with
The exemplary sensor arrangement 20, a schematic slice view of which is shown in
Schematic sectional views of an alternative sensor arrangement 20′, arranged to obtain the six signals measured by the sensings sequentially, are depicted in
A schematic view of an imaging colorimeter 1′, equipped with the sensor arrangement 20, 20′ and the chromaticity-optimized (here x/y—optimized) set of calibration factors 13 and the set of calibration factors optimized with respect to luminance 14 is given by
The CPU 41 is programmed to scale the chromaticity-optimized values X′ Y′ Z′ by these factors to obtain the final tristimulus values X Y Z 17. The imaging colorimeter 1′ is also equipped with an I/O interface 80 in order to be connectable to personal computers for data exchange and/or to be connectable to the internet via this interface, for example for retrieving sets of calibration factors from the internet. The I/O interface is, for example, a USB port. The imaging colorimeter 1′ may alternatively be equipped with an internet connection for retrieving sets of calibration factors from the internet.
Spectral curves representing the filter function of the tristimulus filter X1, X2, Y and Z of the sensor arrangement are illustrated by
The chromaticity-distances in xy color space 100, 101 shown in
The chromaticity-distances 101, obtained by minimizing chromaticity-differences according to the invention (x/y optimization), are illustrated by the filled-out black bars of
Furthermore, it should be mentioned that not only the chromaticity distances of primaries of a human-standard observer based space are minimized, but also the achromatic-distances are optimized, when the method as described above is applied. The calibration factors are chosen as such by the method, that both targets are reached. When applying methods as presented in the prior art, mentioned in the outset, only the chromaticity-distance would be minimized, at the expense of the achromatic primary.
All publications and existing systems mentioned in this specification are herein incorporated by reference.
Although certain products constructed in accordance with the teachings of the invention have been described herein, the scope of coverage of this patent is not limited thereto. On the contrary, this patent covers all embodiments of the teachings of the invention fairly falling within the scope of the appended claims either literally or under the doctrine of equivalents.
Number | Date | Country | Kind |
---|---|---|---|
EP 14003792.0 | Nov 2014 | EM | regional |