This disclosure relates generally to measurement systems and more specifically to an apparatus and method for camera-based color measurements.
Many different production and processing systems are used to produce paper products and other items having various colors. For example, paper production systems are often used to produce sheets of paper having different colors. As another example, printing systems are often used to print color graphics or other color content on sheets of paper. As yet another example, plastic film production systems are often used to produce sheets of plastic having different colors. It is often necessary or desirable to monitor the colors of items being produced or processed, such as to ensure that the items' colors are within standard or other specifications.
Spectrophotometers and calorimeters are often used to measure surface or transmittance colors of still or moving items. Spectrophotometers often use spectrometers that are based on diffraction gratings, and these spectrometers often have a low optical throughput. This optical throughput can be increased using transmission gratings, but even then only one signal or channel can be analyzed at a time with a spectrometer. Moreover, spectrometers are often quite expensive and large in size. Colorimeters typically utilize photodetectors having suitable filters so that each photodetector measures a weighted average of light in a range of wavelengths. However, these types of calorimeters typically lack the flexibility to change illuminants and observers as is often required in various industries.
Black/white and color cameras with different Bayer masks have also been used in conjunction with filter wheels to capture spectral images of still items such as paintings. However, cameras with moving filter wheels are often not suitable for analyzing moving objects, such as moving paper sheets (especially with printing or other applied markings).
This disclosure provides an apparatus and method for camera-based color measurements.
In a first embodiment, a method includes receiving light from a material at a digital imaging device. The method also includes filtering the light into at least three spectral bands using a filter, where different regions of the filter pass different spectral bands. The method further includes measuring the light in each of the spectral bands and determining at least one calorimetric quantity associated with the material using the measured light in the spectral bands.
In particular embodiments, measuring the light in each of the spectral bands includes taking multiple measurements of the light in each of the spectral bands.
In other particular embodiments, the different regions of the filter include multiple masks (where each mask passes one of the spectral bands), different areas of a linear variable filter, and/or individual filters (where each individual filter passes one of the spectral bands).
In yet other particular embodiments, the digital imaging device includes a digital camera. Also, the filter is formed on a detector in the digital camera, and/or a component of the digital camera is replaced with the filter.
In still other particular embodiments, the spectral bands include wavelength bands that are 20 nm in width and that include one or more of the following wavelengths: 350 nm, 400 nm, 450 nm, 500 nm, 550 nm, 600 nm, 650 nm, 700 nm, and 750 nm.
In additional particular embodiments, the method also includes adjusting a process associated with the material based on the at least one determined color. The material could include a paper sheet, and the process could include a paper production process and/or a printing process.
In a second embodiment, an apparatus includes a filter configured to receive light associated with a material and to filter the light into at least three spectral bands, where different regions of the filter pass different spectral bands. The apparatus also includes a detector configured to generate a measurement of the light in each of the spectral bands. In addition, the apparatus includes an interface configured to output the measurements for use in determining at least one calorimetric quantity associated with the material.
In particular embodiments, the detector includes a plurality of pixels each configured to measure the light in one of the spectral bands. In other particular embodiments, the detector includes a charge-coupled device, a complimentary metal oxide semiconductor device, and/or a charge injection device in a digital camera.
In a third embodiment, a system includes an illumination source configured to illuminate a material. The system also includes a color sensor. The color sensor includes a filter configured to receive light associated with the material and to filter the light into at least three spectral bands, where different regions of the filter pass different spectral bands. The color sensor also includes a detector configured to generate measurements of the light in each of the spectral bands. In addition, the color sensor includes an interface configured to output the measurements for use in determining at least one calorimetric quantity associated with the material.
In particular embodiments, the system also includes one or more controllers configured to determine the at least one calorimetric quantity associated with the material and to control a processing or production system based on the at least one determined calorimetric quantity.
In other particular embodiments, the at least one calorimetric quantity includes a spatial calorimetric quantity based on an image of the material and/or an average color of the material.
Other technical features may be readily apparent to one skilled in the art from the following figures, descriptions, and claims.
For a more complete understanding of this disclosure, reference is now made to the following description, taken in conjunction with the accompanying drawings, in which:
In this example, the system 100 generally includes a processing or production system 102 and a color monitor 104. The processing or production system 102 generally denotes any suitable processing or production system that can output at least one item having some form of color to be measured. In this example, the processing or production system 102 is used to produce a paper sheet 106 having some form of color in or on the sheet 106. For example, the processing or production system 102 could represent a paper machine capable of producing a colored paper sheet 106 (including white paper) or a film sheet. The processing or production system 102 could also represent a printing system capable of printing color content onto the paper sheet 106. The processing or production system 102 could represent any other or additional system capable of generating or processing a sheet 106 having at least some form of color or appearance to be measured (such as CIE L*, a*, b* or CIE whiteness). In this example, the processing or production system 102 includes multiple rollers 108, which can be used (among other things) to form the sheet 106 or to impart printing or other colored marks onto the sheet 106. The processing or production system 102 may include any other or additional components depending on the particular function(s) being performed by the system 102. Also, the processing or production system 102 could be used to produce or process any type of item having at least one color to be measured (such as plastic films) and is not limited to use with just paper sheets.
The color monitor 104 is capable of examining one or more items and to measure one or more color or other appearance properties associated with the items. For example, the color monitor 104 could measure the color of the paper sheet 106 or the color of printing placed on the paper sheet 106. In this way, the color monitor 104 can determine whether the processing or production system 102 is producing items with suitable colors, such as colors that satisfy certain color standards or specifications. This may allow the color monitor 104 to ensure that the processing or production system 102 is operating properly and allow identification of potential problems with the processing or production system 102.
In this example, the color monitor 104 includes one or more camera-based color sensors 110. As described in more detail below, each camera-based color sensor 110 includes a detector and a wavelength selectable bandpass filter. The wavelength selectable bandpass filter allows, for example, light within different narrow bandpass ranges to pass to different pixels of the detector. As a result, the detector can measure a broad spectrum of light coming from the sheet 106 or other item being analyzed. Moreover, this can be done very quickly, allowing the camera-based color sensors 110 to be used with still and moving items. As shown in
The color monitor 104 also includes one or more illumination sources 112. The illumination sources 112 generate light that illuminates the paper sheet 106 or other item being examined. This helps to facilitate more accurate color measurements of the paper sheet 106 or other item. Each of the illumination sources 112 represents any suitable source of light, such as one or more light emitting diodes, bulbs, or other light source(s). The illumination sources 112 could also generate any suitable light, such as white light. Further, any suitable geometry could be used for illuminating the item being examined and for measuring light reflected from or transmitted through the item being examined. In addition, a camera-based color sensor 110 and an associated illumination source 112 could be used on the same side or on different sides of the item being examined.
As shown in
Although
As shown in
Light from the item being examined passes through a wavelength selectable bandpass filter 204. The wavelength selectable bandpass filter 204 includes different regions that filter different wavelengths of light. This allows light in different wavelength bands to pass through the different regions of the filter 204. For example, different regions of the wavelength selectable bandpass filter 204 could filter the light into different bands that are 20 nanometers wide. As particular examples, regions in the wavelength selectable bandpass filter 204 could filter light into different 20 nanometer-wide bands centered at or including 350 nm, 400 nm, 450 nm, 500 nm, 550 nm, 600 nm, 650 nm, 700 nm, and 750 nm. The wavelength selectable bandpass filter 204 includes any suitable structure(s) for filtering light into different wavelength bands. Example embodiments of the wavelength selectable bandpass filter 204 are shown in
The filtered wavelength bands are received at a detector 206. The detector 206 is capable of measuring an intensity of light in the various wavelength bands provided by the wavelength selectable bandpass filter 204. For example, the detector 206 could include an array or matrix of smaller detectors, such as an array or matrix of pixels. Each detector in the array or matrix could be used to measure the intensity of light provided in one of the wavelength bands. By using multiple detectors to measure light in multiple wavelength bands, spectral or calorimetric information about the item being examined can be obtained, allowing the color(s) of the item to be determined. For instance, multiple detectors in the array or matrix could simultaneously measure light in multiple wavelength bands, thereby enabling the use of the color sensor 110 with a moving item. The detector 110 includes any suitable structure(s) for measuring light in multiple wavelength bands. The detector 110 could, for example, represent a charge-coupled device (CCD), a complimentary metal oxide semiconductor (CMOS) device, or a charge injection device (CID).
Micro-optics 208 could be used to focus light from the wavelength selectable bandpass filter 204 onto individual pixels or other structures of the detector 206. The micro-optics 208 include any suitable structure(s), such as micro-lenses formed on the surface of the detector 206.
A detector controller 210 is coupled to and controls the operation of the detector 206. For example, the detector controller 210 could cause the detector 206 to begin measuring light and to stop measuring light in wavelength bands provided by the wavelength selectable bandpass filter 204. The detector controller 210 could also receive measurement data from the detector 206 and provide the measurement data to an external component, such as the controller 114 or 116. The detector controller 210 could perform any other or additional actions to facilitate operation of the detector 206. The detector controller 210 includes any suitable structure(s) for controlling the operation of one or more detectors.
An interface 212 can be used to facilitate communication between the color sensor 110 and an external component, such as the controller 114 or 116. The interface 212 could support communications over any suitable type of communication medium, such as a wired or wireless network or link. The interface 212 includes any suitable structure supporting communication with the color sensor 110. As particular examples, the interface 212 could support communications over a Universal Serial Bus (USB) link, a FireWire link, or a gigabit Ethernet link.
In some embodiments, the entire color sensor 110 could be implemented using a digital camera or other digital imaging device. In general, a “digital imaging device” represents any digital device designed to capture visual information using individual pixels or other image capturing elements. In these embodiments, a custom filter (the wavelength selectable bandpass filter 204) can be used in front of the camera's pixels or other image capturing elements (the detector 206) to enable the camera to be utilized as a color analyzer/sensor. Conventional digital cameras typically use red-green-blue (RGB) or cyan-magenta-yellow (CMY) filters, which are inappropriate for calorimetric measurements. The wavelength selectable bandpass filter 204 provides proper wavelength bands for spectral analysis and color determinations. In particular embodiments, at least four wavelength bands are provided by the wavelength selectable bandpass filter 204 for detection and analysis, although any other suitable number of wavelength bands could be used. The wavelength bands could represent any suitable wavelength bands, whether in the ultraviolet, visible, near infrared, infrared, or other spectrums.
Digital cameras may be less expensive than other color measurement techniques, such as those using expensive diffraction grating-based spectrometers. Also, the wavelength selectable bandpass filter 204 could be removable, allowing different wavelength selectable bandpass filters 204 to be inserted into and used in the color sensor 110. This would allow the same overall color sensor structure to be reused for various types of measurements, further reducing costs to users of the color sensors. Further, since narrow wavelength bands are measured in the color sensor 110, the color sensor 110 could reduce signal-to-noise ratios in the color measurements (such as by examining larger areas of the sheet 106 and averaging spatial pixel values). In addition, the color sensor 110 could be smaller than conventional color measuring devices, enabling the color sensor 110 to be used in space-confined applications.
In particular embodiments, a digital camera could be fabricated with the wavelength selectable bandpass filter 204. For example, the wavelength selectable bandpass filter 204 could be formed as part of the detector 206, such as during formation of a CCD, CMOS, or CID-based detector 206. In other particular embodiments, the wavelength selectable bandpass filter 204 could be retrofitted into an existing digital camera. For instance, the cover glass or infrared block on a digital camera could be replaced with the wavelength selectable bandpass filter 204. A digital camera incorporating the wavelength selectable bandpass filter 204 could be produced in any other suitable manner.
In some embodiments, the detector 206 can be calibrated to ensure proper operation of the color sensor 110. A photometric calibration could occur in any suitable manner, such as by using a calibration tile. The calibration tile could include different areas with known reflectances at specific wavelength bands. The calibration tile could be illuminated (such as by using an illumination source 112), and measurements of the calibration tile could be taken using the detector 206. In this way, a controller or other component can determine how the detector 206 operates given specific illumination of a surface with known reflectances. Also, a wavelength calibration could occur in any suitable manner, such as by using a mercury pen-ray lamp and/or wavelength calibration tiles. These types of calibrations are generally well known to one skilled in the art.
Although
As shown in
As shown in
As shown in
As shown in
In
In
In these various embodiments, the wavelength selectable bandpass filter is used to allow light in different narrow wavelength bands to reach different pixels or other portions of the detector 206. This allows the detector 206 to measure the spectrum of light coming from the item being examined. The wavelength bands passed by the wavelength selectable bandpass filter could represent any suitable bands, such as different 20 nanometer-wide bands centered at or including 350 nm, 400 nm, 450 nm, 500 nm, 550 nm, 600 nm, 650 nm, 700 nm, and 750 nm. However, any other or additional wavelength bands could be provided by the wavelength selectable bandpass filter and measured by the detector 206. Also, areas of pixels or other individual detectors within the detector 206 could be predefined prior to use, where the areas of pixels or other detectors correspond to the different filtering regions of the wavelength selectable bandpass filter 204.
In some embodiments, the signal-to-noise ratios in the wavelength bands passed from the wavelength selectable bandpass filter could be similar or equal. Also, the sensitivity of the detector 206 may or may not be the same at all wavelength bands. Further, the transmittance of the wavelength selectable bandpass filter may or may not vary as a function of wavelength. Beyond that, the total area of the wavelength selectable bandpass filter used to provide light at a particular wavelength band could be selected in any suitable manner, such as to optimize the signal-to-noise ratio for that wavelength band. In addition, the pattern of the regions used to provide light at particular wavelength bands could be selected based on any suitable criteria, such as the measurement task to be performed. In other embodiments, multiple bandpass filters may be provided, not all of which are simultaneously deployed in front of the detector. In these embodiments, the bandpass filter or set of filters deployed at any time can be selected according to the measurement task to be performed.
As shown in
As noted above, different types of optics can be used in the color sensor 110, and the use of optics in the color sensor 110 may be optional. If a defocused image of a paper sheet 106 or other item is received at the wavelength selectable bandpass filter, the light in the defocused image could represent the average light from the paper sheet 106 or other item (or a portion thereof). In this case, each filtering region of the wavelength selectable bandpass filter could output the portion of that average light falling within the narrow wavelength band of that region. The measured values produced by the detector 206 could then be used in any suitable manner, such as by summing the measurements for each individual wavelength band to produce improved measurement values.
If a focused image of the paper sheet 106 or other item is received at the wavelength selectable bandpass filter, the light in the image can vary depending on the color of the item in different areas of the focused image. In this case, at least some of the filtering regions of the wavelength selectable bandpass filter could receive light from different areas of the paper sheet 106 or other item. The filtering regions of the wavelength selectable bandpass filter could therefore output light in narrow wavelength bands from different areas of the paper sheet 106 or other item. In this way, the detector 206 could be used, for example, to detect color variations in different areas of the paper sheet 106 or other item. For measurements with different spatial resolutions, corresponding patterns of regions on the bandpass filter and suitable degrees of focusing sharpness (or de-focusing) can be chosen and used.
Although
A material to be analyzed is received at step 402. This may include, for example, placing a color monitor 104 near the surface of a still or moving item (or placing a still or moving item near the color monitor 104). As a particular example, this may include running a paper sheet 106 being formed or processed past the color monitor 104.
The material is illuminated at step 404. This may include, for example, using one or more illumination sources 112 to illuminate one or more surfaces of the material. As a particular example, this may include using one or more illumination sources 112 to illuminate one or more surfaces of the paper sheet 106. Any suitable light could be used here, such as white light. Illumination sources 112 could be used so that one or more spectral power distributions are used to irradiate the surface of the material, allowing one or more measurement to be utilized to form a final calorimetric quantity.
Light from the material is separated into multiple narrow spectral bands at step 406. This may include, for example, passing light reflected from or transmitted by the material through a wavelength selectable bandpass filter 204. The wavelength selectable bandpass filter 204 includes multiple regions, each of which can block all light except for light in narrow spectral bands. The wavelength selectable bandpass filter 204 may include at least one region for each of the narrow spectral bands to be analyzed.
The light in the narrow spectral bands is measured at step 408. This may include, for example, measuring the intensity of the light in each of the narrow spectral bands using one or more pixels in the detector 206. Any suitable number of pixels could be used to measure the light in each of the narrow spectral bands.
One or more colors of the material are determined at step 410. This may include, for example, the detector 206 outputting the measured values of light in each of the narrow spectral bands. This may also include the controller 114, 116 using the measured values to determine one or more colors associated with the material being analyzed. The measured color(s) could then be used in any suitable manner. For example, the measured color(s) may be used to adjust one or more processes at step 412. This could include, for example, altering one or more processes performed in the processing or production system 102. These alterations could be made to improve color uniformity or reduce color variation. These alterations could also be made to ensure that an item satisfies desired or required color specifications. The measured color(s) could be used in any other suitable manner.
Although
It may be advantageous to set forth definitions of certain words and phrases used throughout this patent document. The term “couple” and its derivatives refer to any direct or indirect communication between two or more elements, whether or not those elements are in physical contact with one another. The terms “include” and “comprise,” as well as derivatives thereof, mean inclusion without limitation. The term “or” is inclusive, meaning and/or. The phrases “associated with” and “associated therewith,” as well as derivatives thereof, may mean to include, be included within, interconnect with, contain, be contained within, connect to or with, couple to or with, be communicable with, cooperate with, interleave, juxtapose, be proximate to, be bound to or with, have, have a property of, or the like. The term “controller” means any device, system, or part thereof that controls at least one operation. A controller may be implemented in hardware, firmware, software, or some combination of at least two of the same. The functionality associated with any particular controller may be centralized or distributed, whether locally or remotely.
While this disclosure has described certain embodiments and generally associated methods, alterations and permutations of these embodiments and methods will be apparent to those skilled in the art. Accordingly, the above description of example embodiments does not define or constrain this disclosure. Other changes, substitutions, and alterations are also possible without departing from the spirit and scope of this disclosure, as defined by the following claims.
Number | Name | Date | Kind |
---|---|---|---|
3787206 | Goffe | Jan 1974 | A |
4006358 | Howarth | Feb 1977 | A |
4288691 | Horton | Sep 1981 | A |
4315279 | Kuwayama et al. | Feb 1982 | A |
4376946 | Kaminow et al. | Mar 1983 | A |
4439038 | Mactaggart | Mar 1984 | A |
4565444 | Mactaggart | Jan 1986 | A |
4592043 | Williams | May 1986 | A |
4634928 | Figueroa et al. | Jan 1987 | A |
4699510 | Alguard | Oct 1987 | A |
4786817 | Boissevain et al. | Nov 1988 | A |
4807630 | Malinouskas | Feb 1989 | A |
4856014 | Figueroa et al. | Aug 1989 | A |
4883963 | Kemeny et al. | Nov 1989 | A |
4928013 | Howarth et al. | May 1990 | A |
5015099 | Nagai et al. | May 1991 | A |
5047652 | Lisnyansky et al. | Sep 1991 | A |
5122974 | Chance | Jun 1992 | A |
5137364 | McCarthy | Aug 1992 | A |
5220172 | Berthold et al. | Jun 1993 | A |
5235192 | Chase et al. | Aug 1993 | A |
5272518 | Vincent | Dec 1993 | A |
5313187 | Choi et al. | May 1994 | A |
5338361 | Anderson et al. | Aug 1994 | A |
5374555 | Pokora et al. | Dec 1994 | A |
5400258 | He | Mar 1995 | A |
5642189 | Alguard | Jun 1997 | A |
5642192 | Gordon et al. | Jun 1997 | A |
5717605 | Komiya et al. | Feb 1998 | A |
5774213 | Trebino et al. | Jun 1998 | A |
5793486 | Gordon et al. | Aug 1998 | A |
5795394 | Belotserkovsky et al. | Aug 1998 | A |
5821536 | Pettit | Oct 1998 | A |
5933243 | Hagen | Aug 1999 | A |
5963333 | Walowit et al. | Oct 1999 | A |
5992318 | DiBello et al. | Nov 1999 | A |
6058201 | Sikes et al. | May 2000 | A |
6074483 | Belotserkovsky et al. | Jun 2000 | A |
6215962 | Cooper | Apr 2001 | B1 |
6252663 | Cooper | Jun 2001 | B1 |
6263291 | Shakespeare et al. | Jul 2001 | B1 |
6272440 | Shakespeare et al. | Aug 2001 | B1 |
6466839 | Heaven et al. | Oct 2002 | B1 |
6499402 | Sikes et al. | Dec 2002 | B1 |
6556305 | Aziz et al. | Apr 2003 | B1 |
6584435 | Mestha et al. | Jun 2003 | B2 |
6603551 | Mestha et al. | Aug 2003 | B2 |
6724473 | Leong et al. | Apr 2004 | B2 |
6743337 | Ischdonat | Jun 2004 | B1 |
6760103 | Shakespeare et al. | Jul 2004 | B2 |
6763322 | Potyrailo et al. | Jul 2004 | B2 |
6805899 | MacHattie et al. | Oct 2004 | B2 |
6856436 | Brukilacchio et al. | Feb 2005 | B2 |
6949734 | Neff et al. | Sep 2005 | B2 |
7199884 | Jasinski et al. | Apr 2007 | B2 |
7291856 | Haran et al. | Nov 2007 | B2 |
7573575 | Shakespeare et al. | Aug 2009 | B2 |
7675620 | Imura | Mar 2010 | B2 |
20020001066 | Kobayashi | Jan 2002 | A1 |
20020140832 | Summa | Oct 2002 | A1 |
20030058441 | Shakespeare et al. | Mar 2003 | A1 |
20040119781 | Szumla | Jun 2004 | A1 |
20040212804 | Neff et al. | Oct 2004 | A1 |
20040260520 | Braendle et al. | Dec 2004 | A1 |
20050065400 | Banik et al. | Mar 2005 | A1 |
20060132796 | Haran | Jun 2006 | A1 |
20060243931 | Haran et al. | Nov 2006 | A1 |
20070139735 | Shakespeare et al. | Jun 2007 | A1 |
20070144388 | Shakespeare et al. | Jun 2007 | A1 |
20070153277 | Shakespeare et al. | Jul 2007 | A1 |
20070153278 | Shakespeare et al. | Jul 2007 | A1 |
Number | Date | Country |
---|---|---|
3148076 | Jun 1983 | DE |
19515499 | Oct 1996 | DE |
0 319 158 | Jun 1989 | EP |
1437222 | Jul 2004 | EP |
1457335 | Sep 2004 | EP |
1 491 877 | Dec 2004 | EP |
WO 8400181 | Jan 1984 | WO |
WO 03037111 | May 2003 | WO |
Number | Date | Country | |
---|---|---|---|
20090185185 A1 | Jul 2009 | US |