This application claims priority of German Application No. 103 46 595.2, filed Oct. 2, 2003, the complete disclosure of which is hereby incorporated by reference.
a) Field of the Invention
The invention is directed to a photosensor for color measurement based on three spectral components, the sensor chip having three partial surfaces of different sensitivity for detecting the three spectral components through a preceding interference filter structure. The partial surfaces provide measurement values which are converted into color values in a suitable color space, particularly for highly accurate color measurement (point measurement) for testing and guaranteeing color constancy in engineered surfaces and consumer articles of any kind.
b) Description of the Related Art
Over the course of general technical/technological development, requirements for simple individual color sensors, color sensor arrays and color cameras have also increased sharply. This is the result of heightened expectations with regard to design (chiefly color constancy) of industrial products and consumer articles on the one hand and of the steadily increasing demands on quality in man-machine communications on the other hand. The latter branch of technology in particular is characterized by steadily increasing demands of modem media in general and e-commerce in particular and must deliver satisfactory results in a wide variety of display systems and printer systems. For this reason, the push for standardized color measurement (true color) in different application-specific requirements for accuracy continues to increase.
In principle, three different methods for color measurement are known:
For reasons of expenditure and cost, the three-range method is relied upon principally, although it has substantial limitations due to the fact that it results in wavelength-integral color values which are valid only for the illumination used. For example, metamerism indices can only be determined through a series of measurements with different illuminations (reference illuminant and test illuminant) which must always be physically present.
The underlying principle of a spectrally adapted semiconductor sensor is already known from U.S. Pat. No. 3,996,461 which describes an optical thin-film filter based on a multilayer interference system for a silicon photosensor for limiting the sensitivity or response of the sensor to the spectral response of the human eye. The interference filter comprises an alternating layer system of pure quarter-wave layers for the wavelengths λ=550 nm, 780 nm and 1000 nm. The high-refraction layers are made of titanium oxide and the low-refraction layers are made of silicon oxide. The resulting filter system corresponds to a Y-characteristic of the spectral response curve of the human eye without the possibility of a spectrally selective resolution of the color spectrum in the sense of a correlation of color values or standard spectral colors, since the filter layers are not structured but rather are applied to a plurality of sensor elements at the same time.
U.S. Pat. No. 5,246,803 discloses structured or patterned dichroic filters for solid state electronic image sensors which are carried out by alternating deposition on the sensor surface or on a glass layer. The description refers to the alternating deposition of SiO2 layers and TiO2 layers under vacuum conditions and low temperature for generating color filters. The spectral characteristic of the filters is controlled through the quantity and thickness of the layers and the shaping and deposition of the layers is repeated as often as necessary to generate red filters, green filters and blue filters. According to U.S. Pat. No. 5,246,803, for example, in an alternating layer filter stack for the blue filter, a pass region (“on-band region” with approximately 80% transmission) of 400-500 nm is generated, while the reflection region (“off-band region” with less than 5% transmission) is between 500 and 700 nm.
This solution is disadvantageous in that it involves pure bandpass or edge filters, so that point measurements with narrowband color stimuli in the off-band region of the color filters regularly lead to the measurement of falsified color values or require a special reference light calibration.
It is the primary object of the invention to find a novel possibility for color measurement based on a three-range method with three color measurement values generated by preceding interference filters with different spectral selectivity which permits a virtually true-color measurement in conformity with standards in a simple manner without costly reference light calibration.
According to the invention, in a photosensor for color measurement based on three spectral components, a sensor chip having at least three partial surfaces of different sensitivity for detecting the three spectral components through a preceding interference filter structure, wherein the interference filter structure contains three different alternating layer systems of silicon dioxide and titanium dioxide for selective transmission of incident light into the different partial surfaces of the sensor chip and the partial surfaces provide measurement values, the stated object of the invention is met in that the photosensor has three partial surfaces which are covered by different interference filters adapted to the spectral characteristic of the human eye, each partial surface being arranged so as to be distributed in a sector-shaped manner around a central point with passive webs located therebetween, and in that the transmission characteristic of each interference filter over the wavelength of the light to be measured spectrally is adapted to the response of the human eye in such a way that the product of the base sensitivity of the partial surfaces of the photosensor and the transmission of the interference filter is proportional to the normal spectral value curve of the human eye for the relevant coordinate of the color space, so that the passed spectral components generate measurement values in the partial surfaces, which measurement values can be converted into spectral color values with simple scaling relative to one another in the color space.
Since the product of the base sensitivity of the photosensor (photodiode) and the transmission characteristic of every interference filter is proportional to the normal spectral value curve of the human eye for the relevant coordinate of the color space, the spectral response of the photosensor according to the invention corresponds almost exactly to the color perception of the human eye and makes possible the separation of color differences with the same quality as or better quality than the human eye.
In technological implementation of an interference filter which is ideally adapted as a computer-simulated alternating layer system (with alternating layers of TiO2 and SiO2 of different thickness) for the respective color coordinate in the color space, the transmission characteristic of each interference filter is advisably produced with a tolerance of the layer thicknesses of less than 2%.
Since achieving appreciably smaller layer thickness tolerances (say, of less than 1%) is currently unrealistic from a technological standpoint, a linear correction of the measurement values given by the partial surfaces is carried out—insofar as this is required for the accuracy of the color measurement for the desired application. This can be accomplished by a non-local or global matrixing for correcting the output measurement values for the entire color space on the one hand and—in case of higher accuracy requirements, e.g., for output of exact tristimulus values—by linear correction of the output measurement values by means of local matrixing of suitable tetrahedral areas of the color space on the other hand.
In order to realize a compact construction of the color sensor, the interference filters are advantageously arranged directly on the semiconductor diodes of the sensor chip. The interference filters are preferably arranged directly on silicon diodes of the sensor chip for this purpose. For this purpose, the Si diodes are best produced by a PIN diode technique specially adapted to the visual spectral region in order to achieve an advantageous base sensitivity of the Si diodes of the entire sensor chip. In this case, there is a special added advantage in that the aging and temperature dependency of the entire system of photodiodes and interference filters are negligible. Further, it is even possible to convert the photocurrents as readout color measurement values directly into a standardized color space for certain classes of accuracy.
The interference filters can also advisably be arranged on Si diodes which have been produced by CMOS technology that is adapted to the visual spectral region.
Further, the interference filters can also be arranged on a sensor chip with germanium diodes or with diodes based on InGaAs.
With regard to the technological aspects of the layer thickness tolerances to be met, i.e., in order not to waste the entire sensor chip when tolerances are exceeded, the interference filters over the Si diodes (partial surfaces) of the sensor chip can also advantageously be arranged on a separate glass plate or can also be inserted by applying lift-off techniques.
For measurements of reflectance on surfaces in which there is a uniform illumination of the photosensor, the partial surfaces on the sensor chip which have different sensitivities because of the interference filters arranged on them are preferably shaped as segments of a circle (thirds of a circle area) and are arranged in a uniformly distributed manner around a central point.
In another arrangement by which the spectral characteristics of the partial surfaces of the photosensor can be scaled to the response distribution of the eye at least partially with resect to hardware, partial surfaces on the sensor chip which are covered by the adapted interference filters and have different sensitivities are arranged around a central point as sectors of a circle area with different surface contents, wherein the different surface contents are adapted in such a way that a lower base sensitivity of one partial surface which comes about because of limited wavelength transmission of the respective interference filter is compensated by a correspondingly greater surface content of the partial surface of the photosensor.
In another advisable shape of the partial surfaces of the photosensor, the partial surfaces coated with different interference filters are arranged in a uniformly distributed manner around a central point in the shape of rhombuses with a 120-degree angle, so that they form a regular hexagon as a tricolor segment.
These hexagonal tricolor segments can advantageously be arranged on the sensor chip so as to be uniformly distributed around a plurality of central points with identical webs, so that the tricolor segments form a honeycomb pattern, wherein partial surfaces having identical spectral response do not share any adjacent lateral edges.
By means of the photosensor according to the invention it is possible to realize color measurements based on a three-range method with three color measurement values which are generated by interference filters with different spectral selectivity which permit a virtually standardized true color measurement by means of interference filters adapted to the normal spectral function of the human eye without costly reference light calibration. As a result, color differences can be separated with a quality comparable to the human eye. Further, the measured photocurrents of the three partial surfaces of the sensor can be converted directly into standardized color spaces for certain classes of color measurement accuracy. Inexpensive color sensors can be realized with the invention and can be integrated into efficient compact color measurement devices.
The invention will be described more fully in the following with reference to embodiment examples.
In the drawings:
a shows an optimized interference filter comprising an alternating layer system of SiO2 and TiO2 for the adapted red response function of the photosensor as X-coordinate of the color space;
b shows an optimized SiO2/TiO2 interference filter for the adapted green response function of the photosensor (Y-coordinate in the color space);
c shows an optimized SiO2/TiO2 interference filter for the adapted blue response function of the photosensor (Z-coordinate in the color space);
a shows the spectral transmission (or reflectance) of a narrowband model target with 15 nm spectral width and 1/e fall-off for a centroid wavelength of 555 nm;
b shows the maximum value of ΔE over all centroid wavelengths as a function of the filter curve displacement of the model target according to
c shows the total results of the error calculation as a function of the centroid wavelength and of the displacement of the filter function of the model target according to FIG. 8a;
a shows the spectral transmission (or reflectance) of a model target with 40 nm spectral width and 1/e fall-off for the centroid wavelength of 555 nm;
b shows the maximum value of ΔE over all centroid wavelengths as a function of the filter curve displacement of the model target according to
c shows the total results of the error calculation as a function of the centroid wavelength and of the displacement of the filter function of the model target according to
a shows the reflectance of a model target with ramp-shaped reflectance curve with a width of the transition region of 50 nm;
b shows the maximum color deviation for model targets according to
c shows the total results of the error calculation with displacement of the X-filter function for targets;
a shows the reflectance of a model target with ramp-shaped reflectance curve with a width of the transition area of 50 nm at a lower color contrast;
b shows the maximum color deviation for model targets according to
c shows the total results of the error calculation with displacement of the X-filter function for targets according to
a shows the maximum color deviation for color stimuli with a width of 15 nm as a function of the displacement of the X-filter curve, determined for conventional sensors with three-bandpass filter system (MSC3 sensor manufactured by MAZeT, Germany);
b shows the total results of the error calculation with displacement of the X-filter function for a spectral width of 15 nm of the color stimulus (according to
In its basic construction, as is shown schematically in
The interference filter system 2 has three alternating layer systems of different dimensions as a triple element comprising silicon dioxide layers and titanium dioxide layers whose spectral transmission is adapted to the normal spectral functions of the human eye.
The spectral transmission of the interference filters 21, 22 and 23 is dimensioned in such a way that the product of the base sensitivity S (shown in
In the following, it is assumed—without limiting generality—that the base material of the sensor chip 1 is outfitted with Si diodes which were produced by PIN diode technology specially adapted to the visual spectral region and their spectral response accordingly best approximates that of the human eye. The response curve of a PIN diode fabricated in this way is shown in
A special arrangement of the color sensor according to the invention for area color measurements is shown in
As can be seen from
The interference filters 21, 22 and 23 calculated by computer-assisted optimization (of the transmission functions required for the approximation of the normal spectral function of the eye) have between 30 and 40 layers. In the example shown in
The interference filters 21, 22 and 23 calculated in this way can be arranged directly on the Si diodes of the sensor chip 1 by means of plasma-assisted coating (after applying a passivation coat) or, in order to avoid wasting valuable semiconductor material when layer tolerances are not met for the complicated interference filter structure 2, can also be applied to a glass substrate or produced by lift-off techniques and subsequently adjusted over the silicon chip.
Further remarks are addressed to the achievable accuracy of the color measurement for a tolerance of the layer thicknesses of less than 2% to be adhered to according to the invention. It was discovered that a varied layer thickness on this order of magnitude causes substantially only a displacement of the theoretically calculated filter function by a maximum of ±12 nm (at 600 nm). This displacement due to variances in layer thickness was shown additionally in
In the following remarks, the conversion of the measurement values of the three-range photosensor into a normalized CIE color space is always assumed. An overview of the characteristics of CIE color spaces is offered in ISO definitions 7724 (or DIN 5033). Without limiting application of the invention with other CIE color spaces, the LAB color space is used for error assessment. It will be noted that any meaningful normalizing of the color values as in the XYZ space is impossible in the CIELAB color space due to nonlinearity.
In order to show a self-luminous object, the luminance of the object with respect to the background luminance is needed. However, without additional information it is difficult to provide a representative value for the luminance. Often, for this reason, only reflected and transmitted color stimuli are assumed. Self-luminous color stimuli are therefore advantageously reinterpreted as body colors, e.g., in that their emission spectrum is scaled to values of ≧1, and are accordingly interpreted as the transmission spectrum of an equivalent filter.
A scaling, i.e., an adjustment of the sensor channels to one another (i.e., a white adjustment of the signals/measurement values of the partial surfaces 11 of the three-channel photosensor to the normal spectral functions of the human eye) is, of course, indispensable. Aside from this scaling, no correction of the measurement values should be required under normal conditions.
A narrowband color stimulus can be simulated as a spectral bandpass interference filter, assuming a typical measure for the spectral bandwidth of a conventional interference filter of 15 nm.
a shows the spectral transmission (or reflectance) of an object of the kind mentioned above for a centroid wavelength of 555 nm. For a model target of this kind, the transmittance has a spectral width of 15 nm and a 1/e fall-off and is examined with variable centroid wavelength. Compared to a reference position of 555 nm, the filter curve is shifted from −12 nm to +12 nm in steps of 0.5 nm for error estimation and, in so doing, is determined for every displacement ΔE of the emission spectrum of the reference color and measured color in the CIELAB space, specifically as a function of the centroid wavelength of the reference transmission. The maximum value of ΔE over all centroid wavelengths was plotted as a function of the filter curve displacement in
The overall results of the error calculation are illustrated in
As a result, the measured color deviation for every centroid wavelength is approximately proportional to the amount of the filter curve displacement. Results of equivalent quality are given for the Y- and Z-displacements. Local maxima of the color deviations which are comparable in order of magnitude with the absolute maximum have their centroid wavelength approximately at the reversal points of the filter function. This statement applies to transmitting and reflecting objects, wherein maximum brightness was assumed since the CIELAB space values greater brightness at a greater color distance.
LEDs can be simulated by providing a transmission filter with a filter width of 40 nm because the spectral behavior of typical LEDs can be closely approximated in this way. Accordingly, an object with corresponding transmission is taken as a starting point by way of substitution. The results for such a model target with a spectral width of 40 nm are very similar to those of the filter function with a bandwidth of 15 nm as can be seen from
With a thickness tolerance of ±2% per layer of the filter system, a maximum curve displacement of about ±12 nm occurs as given by variational calculations. With a displacement of this type, clearly noticeable color deviations can be measured as is shown in
With standardized test colors, the spectral reflectance can often be approximated by a rising ramp function, this ramp function being characterized by an interval with constant minimal reflectance, a following interval with a positive rise, and a subsequent interval with constant maximum reflectance.
In this third example, it is assumed, using the standard illuminant D65, that there is no correction of measurement values aside from scaling. The transition area of the ramp function has a width of 50 nm and its center position (hereinafter: ramp position) which is shown as 555 nm in
Once again, there is a maximum color deviation ΔE in the CIELAB color space with a displacement of the X-, Y- and Z-filter curves. In contrast to the narrowband color stimuli, there is only a clear maximum of the color deviation at about 630 nm for every X-filter displacement as can be seen in
On the whole, the color deviation is substantially smaller than with narrowband color stimuli.
As a further example, a flatter ramp function (low color contrast) is analyzed according to
Thus it may be concluded that the sensed color deviations decrease with increasing bandwidth and decreasing saturation.
In the relevant range (±12 nm) of occurring displacements of the ideal filter function which must be included in calculations due to production-related deviations in the layer thickness of the interference filters 21, 22 and 23 from the theoretically calculated layer thickness d, a linear dependency can be assumed between filter curve displacement and color deviation. This results in the possibility of limiting to a linear (differential) tolerance calculation insofar as this is necessary by reason of the required accuracy of the color measurement.
In the examples above, the expected measurement errors were analyzed with reference to selected reflectance and transmission curves. Thus the question of which color stimulus function leads to maximum measurement errors (critical reflectance curve) has not yet been answered. However, a true worst-case scenario which is not dependent on the application is only possible on the basis of the critical color stimuli. The theory behind this is demanding and will only be roughly outlined in the following. The following equation can be given for the displacement ΔE of a color value in the CIELAB space:
ΔE={square root}{square root over ((ΔL*)+(Δa*)2+(Δb*)2)} (1)
with deviations ΔL*, Δa*, Δb* of the color coordinates caused by erroneous spectral sensor responses. Let it be assumed that all deviations from the ideal state are differentially small, so that there is linear error propagation. Let it further be assumed that the errors of the spectral sensor responses can be described by a reasonable number of curve parameters t1, t2, . . . , tn. The three parameters (curve displacements) used so far are sufficient for the time being when the transmission curves of the filters are not significantly disturbed by other manufacturing errors (apart from the layer thickness). Under these assumptions, it follows from equation (1) that:
A maximum displacement ΔE can only occur when all individual errors Δtk (assuming that the individual errors are independent from one another) take on their maximum value:
The CIELAB color coordinates are differentiable functions of the standard color values X, Y, Z. Let X=X1, Y=X2, Z=X3 by way of exception, then it follows from equation (3) that:
In this formula, only the terms ∂Xj/∂Xk are unknown. With standard spectral values {overscore (x)}={overscore (x)}1, {overscore (y)}={overscore (x)}2, {overscore (z)}={overscore (x)}3 and the color stimulus function φ:
The standard spectral value of {overscore (x)}j is arrived at by multiplication from the filter transmission Tj (reference value) and the base sensitivity S of the sensor. For body colors, φ can be the product of the light source spectrum φB and the spectral reflectance β. It follows (Equation 5) that:
A function β(λ) must now be found such that the right side of Equation (4) is maximized by means of Equation (6). Since 0≦β(λ)≦1, a solution to this variational problem exists.
The solution consists in discretizing the sought for function β by substituting the approximation sum for the integral in Equation (6). The variational problem is accordingly changed into a nonlinear optimization problem with, e.g., 81 free parameters (with a distance of 5 nm between reference points). Without a priori knowledge, however, such a problem can only be solved locally by iteration methods. Thus it remains uncertain whether or not one of the local solutions concurs with the global optimum. However, it can be discerned that a critical reflectance curve does not result for the model functions above (narrowband and ramp-shaped color stimuli) or simple combinations thereof.
In the preceding, the measurement results of a three-range sensor according to the invention which meets the requirements described above were simulated with reference to test color stimuli that were generated by a number of model functions (model targets) of practical relevance. Each of these test color stimuli contains a free parameter which was varied practically continuously (centroid wavelength or ramp position).
The simulation and colorimetric evaluation of the measurement results with variation of suitably selected model parameters was used as a basic method. This centered around error analysis with variation (deviations caused by production) of the filter functions, not the correction of systematic measurement errors.
With regard to the systematic measurement errors of the sensor according to the invention, it should be briefly noted that under unfavorable circumstances these systematic errors are too high by an order of magnitude for a precise measurement of color values (true color). This situation is altered only very slightly by reducing the layer thickness tolerances of the interference filter to about 1%. Therefore, an additional, unit-dependent correction of the measurement errors by software is useful. It should be noted that appreciable improvements are achieved already with a global linear correction (matrixing).
When a uniform and exact correction of the entire color space is required, a local linear correction may be resorted to if necessary. By this is meant breaking down the color space into tetrahedrons and applying a separate linear correction to each tetrahedron, wherein constant transition conditions must be maintained at the interfaces or boundary surfaces. However, this (pessimistic) approach is significant only for very demanding color measurement tasks, i.e., for output of exact tristimulus values with approximation of the XYZ-curves.
However, when directly compared to the “old” filter functions (red, green and blue bandpasses) of three-range sensors, simulations of the effects of color displacements in the filter functions X, Y, Z of the interference filters 21, 22 and 23 according to the invention show that even without measurement value correction the photosensor, according to the invention, for color measurement leads to appreciably fewer measurement errors than previous color sensors with conventional RGB filter systems. For example, when the color deviation with conventional filters is calculated in the same manner, the results obtained have appreciably more maximum deviations (
It can be seen from
Based on the model color stimuli selected above as well as on additional model color stimuli, simulations can be used to understand how the quality of the measurement results can be improved by global linear correction. The optimization criterion must be carefully determined for this purpose based on the measurement tasks to be accomplished.
However, the previous results already clearly show the adequacy of a linear approach for the individual errors and linear superposition.
Using the linear approach which has been substantiated in this way, it is possible to calculate the maximum manufacturing tolerances for the filter systems from the given maximum measurement errors in order to approximate the normal spectral function of the human eye and to make adjustments in production.
While the foregoing description and drawings represent the present invention, it will be obvious to those skilled in the art that various changes may be made therein without departing from the true spirit and scope of the present invention.
Number | Date | Country | Kind |
---|---|---|---|
103 46 595.2 | Oct 2003 | DE | national |