Patent Application
20240098214
The present disclosure generally relates to a system and method for gas cloud detection and, in particular, to a system and method of detecting spectral signatures of chemical compositions in a mid- and long-wave infrared spectral region.
Spectral imaging systems and methods have applications in a variety of fields. Spectral imaging systems and methods obtain a spectral image of a scene in one or more regions of the electromagnetic spectrum to detect phenomena, identify material compositions or characterize processes. The spectral image of the scene can be represented as a three-dimensional data cube where two axes of the cube represent two spatial dimensions of the scene and a third axes of the data cube represents spectral information of the scene in different wavelength regions. The data cube can be processed using mathematical methods to obtain information about the scene. Some of the existing spectral imaging systems generate the data cube by scanning the scene in the spatial domain (e.g., by moving a slit across the horizontal dimensions of the scene) and/or spectral domain (e.g., by scanning a wavelength dispersive element to obtain images of the scene in different spectral regions). Such scanning approaches acquire only a portion of the full data cube at a time. These portions of the full data cube are stored and then later processed to generate a full data cube.
The systems, methods and devices of this disclosure each have several innovative aspects, no single one of which is solely responsible for the desirable attributes disclosed herein.
Various embodiments of the systems described herein provide an infrared (IR) imaging system for determining a concentration of a target chemical species in an object (e.g., a gas plume). The imaging system includes (i) an optical system, having an optical focal plane array (FPA) unit configured to receive IR radiation from the object along at least two or more optical channels defined by components of the optical system, the at least two or more optical channels being spatially and spectrally different from one another; and (ii) a processor or processing electronics configured to acquire multispectral optical data representing said target chemical species from the received IR radiation in a single occurrence of data acquisition (or snapshot). The optical FPA unit includes an array of photo-sensitive devices that are disposed at the focus of one or more lenses. In various embodiments, the array of photo-sensitive devices can include a two-dimensional imaging sensor that is sensitive to radiation having wavelengths between 1 μm and 20 μm (for example, in mid infra-red wavelength range, long infra-red wavelength range, visible wavelength range, etc.). In various embodiments, the array of photo-sensitive devices can include CCD or CMOS sensors, bolometers or other detectors that are sensitive to infra-red radiation. The optical system may include an optical aperture (a boundary of which is defined to circumscribe or encompass the at least two or more spatially distinct optical channels) and one or more optical filters. In various implementations, the one or more optical filters can comprise at least two spectrally-multiplexed filters. Each of these optical filters can be associated with one of the at least two or more optical channels and configured to transmit a portion of the IR radiation received in the associated optical channel. In various embodiments, the one or more optical filters can be spectrally multiplexed and may include, for example, at least one of a longpass optical filter and a shortpass optical filter, or a band pass filter (with or without a combination with another filter such as a notch filter, for example). The optical system may further include at least two imaging lenses. The at least two imaging lenses, for example each of the imaging lens, may be disposed to transmit IR radiation (for example, between about 1 micron and about 20 microns), that has been transmitted through a corresponding optical filter towards the optical FPA unit. In one embodiment, the optical FPA unit is positioned to receive IR radiation from the object through the at least two imaging lenses to form respectively-corresponding two or more sets of imaging data representing the object. The processor or processing electronics is configured to acquire this optical data from the two or more sets of imaging data. In various embodiments of the imaging systems, the FPA unit may be devoid of cooling systems. In various embodiments, two or more of the array of photo-sensitive devices may be uncooled. In some embodiments, the system further comprises two or more temperature-controlled shutters removably positioned to block IR radiation incident onto the optical system from the object.
Also disclosed herein is an implementation of a method of operating an infrared (IR) imaging system. The method includes receiving IR radiation from an object through at least two optical channels defined by components of an optical system of the IR imaging system, which at least two optical channels are spatially and spectrally different from one another. The method further includes transmitting the received IR radiation towards an optical focal plane array (FPA) unit that is not being cooled in the course of normal operation. For example, in various embodiments of the imaging systems, the FPA unit may be devoid of cooling systems. In various embodiments, two or more of the array of photo-sensitive devices may be uncooled. Some embodiments further comprise removably positioning at least one of at least two temperature-controlled shutters in front of the optical system to block IR radiation incident onto the optical system from the object.
Various innovative aspects of the subject matter described in this disclosure can be implemented in the following embodiments:
Embodiment 1: An infrared (IR) imaging system, the imaging system comprising:
Embodiment 2: The system of Embodiment 1, wherein the plurality of cameras comprises a FPA unit and a plurality of lenses.
Embodiment 3: The system of any of Embodiments 1-2, wherein the FPA unit comprises one FPA or a plurality of FPAs.
Embodiment 4: The system of any of Embodiments 1-3, wherein the at least one thermal reference source has a known spectrum.
Embodiment 5: The system of any of Embodiments 1-4, further comprising an additional thermal reference source imaged by the plurality of cameras.
Embodiment 6: The system of any of Embodiments 1-5, wherein the additional reference source has a temperature and a spectrum different from the known temperature and the known spectrum of the at least one reference source.
Embodiment 7: The system of any of Embodiments 1-6, wherein the temperature of the additional thermal reference source is less than the known temperature.
Embodiment 8: The system of any of Embodiments 1-7, wherein the temperature of the additional thermal reference source is greater than the known temperature.
Embodiment 9: The system of any of Embodiments 1-8, wherein the at least one reference source is displaced away from a conjugate image plane of the plurality of cameras such that the image of the at least one reference source captured by the plurality of cameras is blurred.
Embodiment 10: The system of any of Embodiments 1-9, wherein the at least one reference source is positioned at a conjugate image plane of the plurality of cameras.
Embodiment 11: The system of any of Embodiments 1-10, further comprising a plurality of mirrors configured to image the at least one reference source onto the plurality of cameras.
Embodiment 12: The system of any of Embodiments 1-11, wherein the plurality of mirrors are disposed outside a central field of view of the plurality of cameras.
Embodiment 13: The system of any of Embodiments 1-12, further comprising a first and a second temperature-controlled shutter removably positioned to block IR radiation incident on the system from reaching the plurality of cameras.
Embodiment 14: The system of any of Embodiments 1-13, wherein the system includes at least two spatially and spectrally different optical channels.
Embodiment 15: The system of any of Embodiments 1-14, wherein the system includes at least three optical channels.
Embodiment 16: The system of any of Embodiments 1-15, wherein the system includes at least four optical channels.
Embodiment 17: The system of any of Embodiments 1-16, wherein the system includes at least five optical channels.
Embodiment 18: The system of any of Embodiments 1-17, wherein the system includes at least six optical channels.
Embodiment 19: The system of any of Embodiments 1-18, wherein the system includes at least seven optical channels.
Embodiment 20: The system of any of Embodiments 1-19, wherein the system includes at least eight optical channels.
Embodiment 21: The system of any of Embodiments 1-20, wherein the system includes at least nine optical channels.
Embodiment 22: The system of any of Embodiments 1-21, wherein the system includes at least ten optical channels.
Embodiment 23: The system of any of Embodiments 1-22, wherein the system includes at least twelve optical channels.
Embodiment 24: The system of any of Embodiments 1-23, further comprising one or more sensors configured to measure a temperature of the at least one reference source.
Embodiment 25: The system of any of Embodiments 1-24, wherein the plurality of cameras is configured to image the same portion of the at least one reference source.
Embodiment 26: An infrared (IR) imaging system, the imaging system comprising:
Embodiment 27: The imaging system of any of Embodiment 26, wherein the data-processing unit is configured to calculate a dynamic calibration correction and apply the correction to the plurality of cameras for each of the plurality of frames.
Embodiment 28: The system of any of Embodiments 26-27, wherein the first reference source is maintained at a first temperature.
Embodiment 29: The system of any of Embodiments 26-28, wherein the second reference source is maintained at a second temperature.
Embodiment 30: The system of any of Embodiments 26-29, wherein the first temperature is greater than the second temperature.
Embodiment 31: The system of any of Embodiments 26-30, wherein the first temperature is less than the second temperature.
Embodiment 32: The system of any of Embodiments 26-31, wherein the first and the second reference sources are displaced away from a conjugate image plane of the plurality of cameras such that the image of the first and the second reference sources captured by the plurality of cameras is blurred.
Embodiment 33: The system of any of Embodiments 26-32, wherein the first and the second reference sources are positioned at a conjugate image plane of the plurality of cameras.
Embodiment 34: The system of any of Embodiments 26-33, further comprising:
Embodiment 35: The system of any of Embodiments 26-34, further comprising a first and a second temperature-controlled shutter removably positioned to block IR radiation incident on the system from reaching the plurality of cameras.
Embodiment 36: The system of any of Embodiments 26-35, wherein the system includes at least two spatially and spectrally different optical channels.
Embodiment 37: The system of any of Embodiments 26-36, wherein the system includes at least four optical channels.
Embodiment 38: The system of any of Embodiments 26-37, wherein the system includes at least six optical channels.
Embodiment 39: The system of any of Embodiments 26-38, wherein the system includes at least eight optical channels.
Embodiment 40: The system of any of Embodiments 26-39, wherein the system includes at least ten optical channels.
Embodiment 41: The system of any of Embodiments 26-40, wherein the system includes at least twelve optical channels.
Embodiment 42: The system of any of Embodiments 26-41, further comprising one or more sensors configured to measure a temperature of the first or the second reference source.
Embodiment 43: The system of any of Embodiments 26-42, wherein the plurality of cameras is configured to image the same portion of the first reference source and wherein plurality of cameras is configured to image the same portion of the second reference source.
Embodiment 44: An infrared (IR) imaging system, the imaging system comprising:
Embodiment 45: The system of any of Embodiment 44, wherein the reference is displaced away from a conjugate image plane of the plurality of cameras such that the image of the reference source captured by the plurality of cameras is blurred.
Embodiment 46: The system of any of Embodiments 44-45, wherein the reference is positioned at a conjugate image plane of the plurality of cameras.
Embodiment 47: The system of any of Embodiments 44-46, further comprising a plurality of mirrors configured to image the reference onto the plurality of cameras.
Embodiment 48: The system of any of Embodiments 44-47, further comprising a first and a second temperature-controlled shutter removably positioned to block IR radiation incident on the system from reaching the plurality of cameras.
Embodiment 49: The system of any of Embodiments 44-48, wherein the system includes at least two spatially and spectrally different optical channels.
Embodiment 50: The system of any of Embodiments 44-49, wherein the system includes at least three optical channels.
Embodiment 51: The system of any of Embodiments 44-50, wherein the system includes at least four optical channels.
Embodiment 52: The system of any of Embodiments 44-51, wherein the system includes at least five optical channels.
Embodiment 53: The system of any of Embodiments 44-52, wherein the system includes at least six optical channels.
Embodiment 54: The system of any of Embodiments 44-52, wherein the system includes at least seven optical channels.
Embodiment 55: The system of any of Embodiments 44-53, wherein the system includes at least eight optical channels.
Embodiment 56: The system of any of Embodiments 44-54, wherein the system includes at least nine optical channels.
Embodiment 57: The system of any of Embodiments 44-55, wherein the system includes at least ten optical channels.
Embodiment 58: The system of any of Embodiments 44-56, wherein the system includes at least twelve optical channels.
Embodiment 59: The system of any of Embodiments 44-57, wherein the plurality of cameras is configured to image the same portion of the reference.
Embodiment 60: An infrared (IR) imaging system, the imaging system comprising:
Embodiment 61: The system of any of Embodiment 60, wherein the at least one thermal reference has a known spectrum.
Embodiment 62: The system of any of Embodiments 60-61, further comprising an additional thermal reference, wherein radiation from the additional reference is directed towards the optical FPA unit and imaged by the at least two detector arrays.
Embodiment 63: The system of any of Embodiments 60-62, wherein the additional reference has a temperature and a spectrum different from the known temperature and the known spectrum of the at least one reference source.
Embodiment 64: The system of any of Embodiments 60-63, wherein the temperature of the additional thermal reference is less than the known temperature.
Embodiment 65: The system of any of Embodiments 60-64, wherein the temperature of the additional thermal reference is greater than the known temperature.
Embodiment 66: The system of any of Embodiments 60-65, wherein the at least one reference is displaced away from a conjugate image plane of the at least two detector arrays such that the image of the at least one reference captured by the at least two detector arrays is defocused.
Embodiment 67: The system of any of Embodiments 60-66, wherein the at least one reference is positioned at a conjugate image plane of the at least two detector arrays such that the image of the at least one reference captured by the at least two detector arrays is focused.
Embodiment 68: The system of any of Embodiments 60-67, further comprising at least two reflecting elements configured to direct radiation from the at least one reference source toward the at least two detector arrays.
Embodiment 69: The system of any of Embodiments 60-68, wherein the at least two reflecting elements are disposed outside a central field of view of the at least two detector arrays.
Embodiment 70: The system of any of Embodiments 60-69, further comprising a third detector array disposed between the at least two detector arrays.
Embodiment 71: The system of any of Embodiments 60-70, wherein the data-processing unit is configured to:
Embodiment 72: The system of any of Embodiments 60-71, wherein radiation emitted from the at least one reference source is not imaged by the third detector array.
Embodiment 73: The system of any of Embodiments 60-72, wherein the third detector array has a field of view greater than a field of view of the at least two detector arrays.
Embodiment 74: The system of any of Embodiments 60-73, wherein the at least one reference is imaged by the third detector array.
Embodiment 75: The system of any of Embodiments 60-74, further comprising a third reflecting element disposed outside the field of view of the at least two detector arrays and configured to image the at least one reference onto the third detector array.
Embodiment 76: The system of any of Embodiments 60-75, further comprising a first and a second temperature-controlled element removably positioned to block IR radiation incident on the optical system from reaching the optical FPA unit.
Embodiment 77: The system of any of Embodiments 60-76, wherein the optical system includes components associated with three optical channels.
Embodiment 78: The system of any of Embodiments 60-77 wherein the optical system includes components associated with four optical channels.
Embodiment 79: The system of any of Embodiments 60-78, wherein the optical system includes components associated with six optical channels.
Embodiment 80: The system of any of Embodiments 60-79, wherein the optical system includes components associated with eight optical channels.
Embodiment 81: The system of any of Embodiments 60-80, wherein the optical system includes components associated with ten optical channels.
Embodiment 82: The system of any of Embodiments 60-81, wherein the optical system includes components associated with twelve optical channels.
Embodiment 83: The system of any of Embodiments 60-82, wherein the optical system includes components associated with sixteen optical channels.
Embodiment 84: The system of any of Embodiments 60-83, wherein the optical system includes components associated with twenty four optical channels.
Embodiment 85: The system of any of Embodiments 60-84, wherein each of the at least two detector arrays is configured to image the same portion of the at least one reference so as to consistently provide a common reference temperature.
Embodiment 86: The system of any of Embodiments 60-85, wherein the data-processing unit comprises processing electronics.
Embodiment 87: The system of any of Embodiments 60-86, wherein the data-processing unit comprises a processor.
Embodiment 88: The system of any of Embodiments 60-87, wherein the data-processing unit comprises one or more processors.
Embodiment 89: An infrared (IR) imaging system, the imaging system comprising:
Embodiment 90: The system of Embodiment 89, wherein the first reference is maintained at a first temperature.
Embodiment 91: The system of any of Embodiments 89-90, wherein the second reference is maintained at a second temperature.
Embodiment 92: The system of any of Embodiments 89-91, wherein the first temperature is greater than the second temperature.
Embodiment 93: The system of any of Embodiments 89-92, wherein the first temperature is less than the second temperature.
Embodiment 94: The system of any of Embodiments 89-93, wherein the first and the second references are displaced away from a conjugate image plane of the at least two detector arrays such that the image of the first and the second references captured by the at least two detector arrays is defocused.
Embodiment 95: The system of any of Embodiments 89-94, wherein the first and the second references are positioned at a conjugate image plane of the at least two detector arrays such that the image of the first and the second references captured by the at least two detector arrays is focused.
Embodiment 96: The system of any of Embodiments 89-95, further comprising:
Embodiment 97: The system of any of Embodiments 89-96, wherein the first reflecting element is disposed outside a field of view of the at least two detector arrays.
Embodiment 98: The system of any of Embodiments 89-97, wherein the second reflecting element is disposed outside a field of view of the at least two detector arrays.
Embodiment 99: The system of any of Embodiments 89-98, further comprising a third detector array disposed between the at least two detector arrays.
Embodiment 100: The system of any of Embodiments 89-99, wherein the data-processing unit is configured to:
Embodiment 101: The system of any of Embodiments 89-100, wherein the first and second references are not imaged by the third detector array.
Embodiment 102: The system of any of Embodiments 89-101, wherein the third detector array has a field of view greater than a field of view of the at least two detector arrays.
Embodiment 103: The system of any of Embodiments 89-102, wherein r first and second references are imaged by the third detector array.
Embodiment 104: The system of any of Embodiments 89-103, further comprising a third reflecting element disposed outside the field of view of the at least two detector arrays and configured to image the first and second references onto the third detector array.
Embodiment 105: The system of any of Embodiments 89-104, further comprising a first and a second temperature-controlled element removably positioned to block IR radiation incident on the optical system from reaching the optical FPA unit.
Embodiment 106: The system of any of Embodiments 89-105, wherein the optical system includes components associated with three optical channels.
Embodiment 107: The system of any of Embodiments 89-106, wherein the optical system includes components associated with four optical channels.
Embodiment 108: The system of any of Embodiments 89-107, wherein the optical system includes components associated with five optical channels.
Embodiment 109: The system of any of Embodiments 89-108, wherein the optical system includes components associated with six optical channels.
Embodiment 110: The system of any of Embodiments 89-109, wherein the optical system includes components associated with seven optical channels.
Embodiment 111: The system of any of Embodiments 89-110, wherein the optical system includes components associated with eight optical channels.
Embodiment 112: The system of any of Embodiments 89-111, wherein the optical system includes components associated with ten optical channels.
Embodiment 113: The system of any of Embodiments 89-112, wherein the optical system includes components associated with twelve optical channels.
Embodiment 114: The system of any of Embodiments 89-113, wherein each of the at least two detector arrays is configured to image the same portion of the first reference source so as to consistently provide a common first reference temperature and wherein each of the at least two detector arrays is configured to image the same portion of the second reference source so as to consistently provide a common second reference temperature.
Embodiment 115: The system of any of Embodiments 89-114, further comprising a temperature controller configured to control the temperature of the first or second reference.
Embodiment 116: The system of any of Embodiments 89-115, further comprising one or more sensors configured to measure a temperature of the first or the second reference.
Embodiment 117: The system of any of Embodiments 89-116, wherein the one or more sensors are configured to communicate the measured temperature of the first or the second reference to a temperature controller.
Embodiment 118: The system of any of Embodiments 89-117, wherein the one or more sensors are configured to communicate the measured temperature of the first or the second reference to the data-processing unit.
Embodiment 119: The system of any of Embodiments 89-118, wherein the first or the second reference is associated with a heater.
Embodiment 120: The system of any of Embodiments 89-119, wherein the first or the second reference is associated with a cooler.
Embodiment 121: The system of any of Embodiments 89-120, wherein the data-processing unit comprises processing electronics.
Embodiment 122: The system of any of Embodiments 89-121, wherein the data-processing unit comprises a processor.
Embodiment 123: The system of any of Embodiments 89-122, wherein the data-processing unit comprises one or more processors.
Embodiment 124: An infrared (IR) imaging system, the imaging system comprising:
Embodiment 125: The system of Embodiment 124, wherein the one or more parameters is associated with a gain of the cameras in the plurality of cameras.
Embodiment 126: The system of any of Embodiments 124-125, wherein the one or more parameters is associated with a gain offset of the cameras in the plurality of cameras.
Embodiment 127: The system of any of Embodiments 124-126, wherein the calibration surface is displaced away from a conjugate image plane of the plurality of cameras such that an image of the surface is defocused.
Embodiment 128: The system of any of Embodiments 124-127, wherein the calibration surface is positioned at a conjugate image plane of the plurality of cameras such that an image of the surface is focused.
Embodiment 129: The system of any of Embodiments 124-128, further comprising at least one reflecting element configured to image the surface onto the plurality of cameras.
Embodiment 130: The system of any of Embodiments 124-129, further comprising a first and a second temperature-controlled element removably positioned to block IR radiation incident on the optical system from reaching the plurality of cameras.
Embodiment 131: The system of any of Embodiments 124-130, wherein the optical system includes components associated with three optical channels.
Embodiment 132: The system of any of Embodiments 124-131, wherein the optical system includes components associated with four optical channels.
Embodiment 133: The system of any of Embodiments 124-132, wherein the optical system includes components associated with six optical channels.
Embodiment 134: The system of any of Embodiments 124-133, wherein the optical system includes components associated with eight optical channels.
Embodiment 135: The system of any of Embodiments 124-134, wherein the optical system includes components associated with ten optical channels.
Embodiment 136: The system of any of Embodiments 124-135, wherein the optical system includes components associated with twelve optical channels.
Embodiment 137: The system of any of Embodiments 124-136, wherein the data-processing unit comprises processing electronics.
Embodiment 138: The system of any of Embodiments 124-137, wherein the data-processing unit comprises a processor.
Embodiment 139: The system of any of Embodiments 124-138, wherein the data-processing unit comprises one or more processors.
Embodiment 140: The system of any of Embodiments 124-139, wherein the calibration surface comprises a sidewall of a housing of the system.
Embodiment 141: An infrared (IR) imaging system, the imaging system comprising:
Embodiment 142: The system of Embodiment 141, further comprising twelve optical channels.
Embodiment 143: The system of any of Embodiments 141-142, configured to simultaneously acquire multispectral optical data from the at least four different optical channels.
Embodiment 144: The system of any of Embodiments 141-143, further comprising a plurality of optical filters associated with the optical channels.
Embodiment 145: The system of any of Embodiments 141-144, wherein a number of optical filters is two.
Embodiment 146: The system of any of Embodiments 141-145, wherein a number of optical filters is three.
Embodiment 147: The system of any of Embodiments 141-146, wherein a number of optical filters is four.
Embodiment 148: The system of any of Embodiments 141-147, wherein the plurality of optical filters comprise at least one long pass (LP) filter.
Embodiment 149: The system of any of Embodiments 141-148, wherein the plurality of optical filters comprise multiple long pass (LP) filters.
Embodiment 150: The system of any of Embodiments 141-149, wherein the plurality of optical filters comprise at least one short pass (SP) filter.
Embodiment 151: The system of any of Embodiments 141-150, wherein the plurality of optical filters comprise multiple short pass (SP) filters.
Embodiment 152: The system of any of Embodiments 141-151, wherein the plurality of optical filters comprise at least one band pass (BP) filter.
Embodiment 153: The system of any of Embodiments 141-152, wherein the plurality of optical filters comprise at one short pass (SP) filter and one long pass (LP) filter.
Embodiment 154: The system of any of Embodiments 141-153, wherein the FPA unit comprises a plurality of FPAs.
Embodiment 155: The system of any of Embodiments 141-154, further comprising first and second temperature-controlled elements removably positioned to block IR radiation incident on the imaging system from reaching the FPA unit.
Embodiment 156: The system of any of Embodiments 141-155, further comprising a field reference configured for dynamically calibrating a plurality of the FPAs in the FPA unit.
Embodiment 157: The system of any of Embodiments 141-156, wherein the field reference is configured to obscure a peripheral region of an image generated by a plurality of the FPAs in the FPA unit.
Embodiment 158: The system of any of Embodiments 141-157, configured to compare spectral data in at least one of the four optical channels acquired at a first instant of time with spectral data in the at least one of the four optical channels acquired at a second instant of time to generate a temporal difference image.
Embodiment 159: The system of any of Embodiments 141-158, configured to use a difference between the multispectral optical data acquired by the two optical channels to correct parallax-induced imaging errors.
Embodiment 160: The system of any of Embodiments 141-159, configured to use a difference between the multispectral optical data acquired by the two optical channels to estimate a distance between the system and the object.
Embodiment 161: The system of any of Embodiments 141-160, configured to estimate a size of the object based on the estimated distance and an optical magnification factor of the two optical channels.
Embodiment 162: The system of any of Embodiments 141-161, configured to compare spectral data in one of the at least four optical channels with spectral data in another one of the at least four optical channels to generate a spectral difference image.
Embodiment 163: The system of any of Embodiments 141-162, further comprising a visible light imaging sensor.
Embodiment 164: The system of any of Embodiments 141-163, configured to use the visible light imaging sensor to compensate for motion-induced imaging errors.
Embodiment 165: The system of any of Embodiments 141-164, configured to process the multispectral optical data by cross-correlating multispectral optical data from at least one of the optical channels with a reference spectrum.
Embodiment 166: The system of any of Embodiments 141-165, configured to process the multispectral optical data using spectral unmixing.
Embodiment 167: The system of any of Embodiments 141-166, further comprising five optical channels.
Embodiment 168: The system of any of Embodiments 141-167, further comprising six optical channels.
Embodiment 169: The system of any of Embodiments 141-168, further comprising seven optical channels.
Embodiment 170: The system of any of Embodiments 141-169, further comprising eight optical channels.
Embodiment 171: The system of any of Embodiments 141-170, further comprising nine optical channels.
Embodiment 172: The system of any of Embodiments 141-171, further comprising ten optical channels.
Embodiment 173: The system of any of Embodiments 141-172, further comprising eleven optical channels.
Embodiment 174: The system of any of Embodiments 141-173, wherein a number of optical filters is five.
Embodiment 175: The system of any of Embodiments 141-174, wherein a number of optical filters is six.
Embodiment 176: The system of any of Embodiments 141-175, wherein a number of optical filters is seven.
Embodiment 177: The system of any of Embodiments 141-176, wherein a number of optical filters is eight.
Embodiment 178: The system of any of Embodiments 141-177, wherein a number of optical filters is nine.
Embodiment 179: The system of any of Embodiments 141-178, wherein a number of optical filters is ten.
Embodiment 180: The system of any of Embodiments 141-179, wherein a number of optical filters is eleven.
Embodiment 181: The system of any of Embodiments 141-180, wherein a number of optical filters is twelve.
Embodiment 182: The system of any of Embodiments 141-181, wherein the processing electronics comprises one or more processors.
Embodiment 183: The system of any of Embodiments 141-182, further comprising a thermal reference configured to be imaged onto the FPA unit such that a plurality of frames of the acquired multispectral optical data has an image of the thermal reference source.
Embodiment 184: The system of any of Embodiments 141-183, wherein the thermal reference has a known temperature.
Embodiment 185: The system of any of Embodiments 141-184, wherein the thermal reference is a temperature-controlled reference source.
Embodiment 186: The system of any of Embodiments 141-185, wherein the temperature-controlled reference source includes a heater.
Embodiment 187: The system of any of Embodiments 141-186, wherein the temperature-controlled reference source includes a cooler.
Embodiment 188: The system of any of Embodiments 141-187, further comprising a mirror configured to image the thermal reference onto the FPA unit.
Embodiment 189: The system of any of Embodiments 141-188, wherein a temperature of the thermal reference is unknown.
Embodiment 190: The system of any of Embodiments 141-189, wherein the thermal reference is a surface.
Embodiment 191: The system of any of Embodiments 141-190, wherein the surface comprises a wall of a housing of the system.
Embodiment 192: The system of any of Embodiments 141-191, wherein different optical channels receive IR radiation from the same portion of the thermal reference so as to consistently provide a common reference temperature.
Embodiment 193: The system of any of Embodiments 141-192, wherein a temperature of the same portion of the thermal reference is unknown.
Embodiment 194: The system of any of Embodiments 141-193, configured to acquire the multispectral optical data at a frame rate between about 5 Hz to about 200 Hz.
Embodiment 195: The system of any of Embodiments 141-194, wherein one or more of the at least four optical channels is configured to collect IR radiation to provide spectral data corresponding to a discrete spectral band located in the wavelength range between about 7.9 μm and about 8.4 μm.
Embodiment 196: The system of any of Embodiments 141-195, wherein each optical channel is configured to transfer spectrally distinct, two-dimensional image data of the common object to one or more imaging sensors.
Embodiment 196: The system of any of Embodiments 1-24, wherein the one or more sensors are configured to communicate the measured temperature of the at least one reference source to a temperature controller.
Embodiment 197: The system of any of Embodiments 1-24, wherein the one or more sensors are configured to communicate the measured temperature of the at least one reference source to the data-processing unit.
Embodiment 198: The system of any of Embodiments 26-42, wherein the one or more sensors are configured to communicate measured temperature of the first or the second reference to a temperature controller.
Embodiment 199: The system of any of Embodiments 26-42, wherein the one or more sensors are configured communicate the measured temperature of the first or the second reference to the data-processing unit.
Embodiment 200: An infrared (IR) imaging system for imaging a target species in an object, the imaging system comprising:
Embodiment 201: The system of Embodiment 200, wherein the multispectral data comprises a number of spectrally different images of the object obtained from IR image data transferred to the optical FPA unit by a corresponding optical channel.
Embodiment 202: The system of any of Embodiments 200-201, further comprising an optical filter corresponding to a particular optical channel and configured to transmit the portion of IR radiation towards the optical FPA unit.
Embodiment 203: The system of any of Embodiments 200-202, wherein the optical filter includes one of a longpass optical filter and a shortpass optical filter.
Embodiment 204: The system of any of Embodiments 200-203, further comprising one or more front objective lenses.
Embodiment 205: The system of any of Embodiments 200-204, wherein the optical system comprises a plurality of lenses, each lens corresponding to an optical channel.
Embodiment 206: The system of any of Embodiments 200-205, wherein each optical channel is defined at least in part by a corresponding filter and a corresponding lens.
Embodiment 207: The system of any of Embodiments 200-206, wherein the plurality of lenses comprises a lens array.
Embodiment 208: The system of any of Embodiments 200-207, further comprising a plurality of relay lenses configured to relay the IR radiation along the optical channels.
Embodiment 209: The system of any of Embodiments 200-208, further comprising a plurality of moveable temperature-controlled reference source removably positioned to block IR radiation incident onto the optical system from reaching the optical FPA unit.
Embodiment 210: The system of any of Embodiments 200-209, wherein the multispectral optical data from the plurality of optical channels is captured substantially simultaneously by the optical FPA unit.
Embodiment 211: The system of any of Embodiments 200-210, wherein the multispectral optical data from the plurality of optical channels is captured during one image frame acquisition by the optical FPA unit.
Embodiment 212: The system of any of Embodiments 200-211, further comprising first and second temperature-controlled moveable shutters removably positioned to block IR radiation incident onto the optical system from reaching the optical FPA unit.
Embodiment 213: The system of any of Embodiments 200-212, wherein the optical FPA unit is devoid of a cooling device.
Embodiment 214: The system of any of Embodiments 200-213, further comprising a filter array.
Embodiment 215: The system of any of Embodiments 200-214, wherein the processor is configured to execute instructions stored in a tangible, non-transitory computer-readable storage medium to acquire said optical data from the two or more sets of imaging data.
Embodiment 216: The system of any of Embodiments 200-215, wherein the processor is configured to execute instructions stored in a tangible, non-transitory computer-readable storage medium to process the acquired optical data to compensate for at least one of (i) parallax-induced differences between the two or more sets of imaging data and (ii) difference between the two or more sets of imaging data induced by changes in the object that are not associated with the target species.
Embodiment 217: The system of any of Embodiments 200-216, wherein the processor is configured to execute instructions stored in a tangible, non-transitory computer-readable storage medium to process the acquired optical data to generate a temporal reference image.
Embodiment 218: The system of any of Embodiments 200-217, wherein the processor is configured to execute instructions stored in a tangible, non-transitory computer-readable storage medium to use the temporal reference image to generate a temporal difference image.
Embodiment 219: The system of any of Embodiments 200-218, wherein the processor is configured to execute instructions stored in a tangible, non-transitory computer-readable storage medium to process the acquired optical data to estimate a volume of a gas cloud.
Embodiment 220: The system of any of Embodiments 200-219, wherein IR radiation measured at a pixel comprises a spectrum comprising a sum of component spectra, and wherein the processor is configured to execute instructions stored in a tangible, non-transitory computer-readable storage medium to unmix the spectrum.
Embodiment 221: The system of any of Embodiments 200-220, wherein the optical FPA unit includes a bolometer configured to operate without being cooled.
Embodiment 222: The system of any of Embodiments 200-221, further comprising a field reference for dynamically adjusting data output from the optical FPA unit.
Embodiment 223: The system of any of Embodiments 200-222, wherein the field reference comprises an array of field stops.
Embodiment 224: The system of any of Embodiments 200-223, wherein the field reference comprises a uniform temperature across its surface.
Embodiment 225: The system of any of Embodiments 200-224, wherein the field reference is adapted to obscure or block a peripheral portion of the IR radiation propagating from the object towards the optical FPA unit.
Embodiment 226: The system of any of Embodiments 200-225, further comprising a visible light imaging sensor.
Embodiment 227: The system of any of Embodiments 200-226, wherein the processor is configured to execute instructions stored in a tangible, non-transitory computer-readable storage medium to process data received from an imaging sensor to compensate for motion-induced imaging errors.
Embodiment 228: The system of any of Embodiments 200-227, wherein the processor is configured to execute instructions stored in a tangible, non-transitory computer-readable storage medium to process data received from the visible light imaging sensor to compensate for motion-induced imaging errors.
Embodiment 229: The system of any of Embodiments 200-228, wherein the processor is configured to execute instructions stored in a tangible, non-transitory computer-readable storage medium to construct, in the single occurrence of data acquisition, a multispectral data cube of the object, the multispectral data cube comprising a number of spectrally different images of the object, each spectrally different image comprising IR image data transferred to the optical FPA unit by a corresponding optical channel.
Embodiment 230: The system of any of Embodiments 200-229, wherein the portion of the IR radiation corresponds to a region of wavelengths of the spectrum of wavelengths, the region of wavelengths at least partially overlapping another region of wavelengths transferred by another optical channel.
Embodiment 231: An infrared (IR) imaging system, the imaging system comprising:
Embodiment 232: An infrared (IR) imaging system, the imaging system comprising:
Embodiment 232: The system of Embodiment 231, wherein spectral characteristics of the two optical channels are identical.
Embodiment 233: An infrared (IR) imaging system, the imaging system comprising:
Embodiment 234: The system of Embodiment 233, wherein spectral characteristics of the two optical channels are identical.
Embodiment 235: An infrared (IR) imaging system, the imaging system comprising:
Embodiment 236: An infrared (IR) imaging system, the imaging system comprising:
Embodiment 237: An infrared (IR) imaging system, the imaging system comprising:
Embodiment 238: An infrared (IR) imaging system, the imaging system comprising:
Embodiment 239: An infrared (IR) imaging system, the imaging system comprising:
Embodiment 240: The system of any of Embodiments 1-59, wherein the plurality of cameras are configured to acquire multispectral image data from an object continuously for a duration of time.
Embodiment 241: The system of any of Embodiments 1-59, comprising at least two spectrally and spatially distinct optical channels configured to transfer two-dimensional image data of an object to the plurality of cameras.
Embodiment 242: An infrared (IR) imaging system for imaging a scene, the imaging system comprising:
Embodiment 243: The imaging system of Embodiment 242, wherein the at least one mid-wavelength optical channel comprises a cold stop filter.
Embodiment 244: The imaging system of any of Embodiments 242-243, wherein the at least one mid-wavelength optical channel comprises filter having a pass-band in the mid-wavelength infrared spectral range.
Embodiment 245: The imaging system of any of Embodiments 242-244, further comprising processing electronics configured to extract information from the first and second video image to detect presence of one or more chemical species in the scene.
Embodiment 246: The imaging system of Embodiment 245, wherein the processing electronics are configured to compare the extracted information to one or more spectral information stored in a database.
Embodiment 247: The imaging system of any of Embodiments 242-246, further comprising a feedback system configured to synchronize the first and the second video image.
Embodiment 248: The imaging system of any of Embodiments 242-247, wherein the first and/or second video image has a frame rate between about 5 frames per second and about 120 frames per second.
Embodiment 249: The imaging system of any of Embodiments 242-248, wherein the processing electronics are configured to extract information from the first and/or second video image on a frame by frame basis.
Embodiment 250: The imaging system of any of Embodiments 242-249, wherein the processing electronics are configured to extract information from the first video and second video image and detect presence of one or more chemical species in the scene within 5 seconds from a time when imaging of the scene started.
Embodiment 251: The imaging system of any of Embodiments 242-250, wherein the processing electronics are configured to extract information from the first video and second video image and detect presence of one or more chemical species in the scene within 1 second from a time when imaging of the scene started.
Embodiment 252: The imaging system of any of Embodiments 242-251, wherein the processing electronics are configured to extract information from the first video and second video image and detect presence of one or more chemical species in the scene in sufficiently real time from a time when imaging of the scene started.
Embodiment 253: The imaging system of any of Embodiments 242-252, wherein the one or more chemical species are selected from the group consisting of methane, cyclopropane, alkanes, alkenes, ammonia, freon, hydrogen cyanide, sulfur dioxide, and hydrogen sulfide.
Embodiment 254: The imaging system of any of Embodiments 242-253, wherein the scene includes a moving gas plume.
Embodiment 255: The imaging system of any of Embodiments 242-254, wherein the FPA unit includes at least one mid-wavelength infra-red FPA capable of detecting mid-wavelength infra-red radiation and at least one long-wavelength infra-red FPA capable of detecting long-wavelength infra-red radiation.
Embodiment 256: The imaging system of Embodiment 255, wherein the at least one mid-wavelength infra-red FPA is cooled to a temperature below 200 degree Kelvin.
Embodiment 257: The imaging system of Embodiment 256, wherein the at least one mid-wavelength infra-red FPA is cooled to a temperature between about 110 degree Kelvin and about 150 degree Kelvin.
Embodiment 258: The imaging system of Embodiment 257, wherein the at least one mid-wavelength infra-red FPA is cooled to a temperature of about 135 degree Kelvin.
Embodiment 259: The imaging system of any of Embodiments 255-258, wherein the at least one mid-wavelength infra-red FPA is coupled to a cooler.
Embodiment 260: The imaging system of any of Embodiments Claims 255-259, wherein the at least one mid-wavelength infra-red FPA and the at least one long-wavelength infra-red FPA are configured to image one more reference sources.
Embodiment 261: The imaging system of Embodiment 260, wherein each of the one more reference sources has a known temperature.
Embodiment 262: The imaging system of any of Embodiments 242-261, wherein a number of the plurality of optical channels is at least 4.
Embodiment 263: The imaging system of any of Embodiments 242-262, wherein a number of the plurality of optical channels is at least 5.
Embodiment 264: The imaging system of any of Embodiments 242-263, wherein a number of the plurality of optical channels is at least 8.
Embodiment 265: The imaging system of any of Embodiments 242-264, wherein a number of the plurality of optical channels is at least 9.
Embodiment 266: The imaging system of any of Embodiments 242-265, wherein a number of the plurality of optical channels is at least 12.
Embodiment 267: The imaging system of any of Embodiments 242-266, wherein a number of the plurality of optical channels is at least 13.
Embodiment 268: The imaging system of any of Embodiments 242-267, wherein a number of the plurality of optical channels is at least 20.
Embodiment 269: The imaging system of any of Embodiments 242-268, wherein a number of the plurality of optical channels is between 4 and 50.
Embodiment 270: The imaging system of any of Embodiments 255-261, wherein at least one of the plurality of optical channels comprises a spectrally selective optical element configured to receive radiation from the scene and direct a portion of the radiation in the mid-wavelength infrared spectral range toward the mid-wavelength infra-red FPA and direct a portion of the radiation in the long-wavelength infrared spectral range toward the long-wavelength infra-red FPA.
Embodiment 271: A method of detecting one or more chemical species in a scene, the method comprising:
Embodiment 272: The method of Embodiment 271, wherein the first and/or the second video image data has a frame rate between about 5 frames per second and about 60 frames per second.
Embodiment 273: The method of any of Embodiments 270-272, wherein the one or more spectra are obtained using hyperspectral video analytics.
Embodiment 274: The method of any of Embodiments 270-273, wherein the one or more spectra are obtained within 5 seconds from a time when imaging of the scene begins.
Embodiment 275: The method of any of Embodiments 270-274, wherein the one or more spectra are obtained within 1 second from a time when imaging of the scene begins.
Embodiment 276: The method of any of Embodiments 270-275, wherein the one or more spectra are obtained in sufficiently real time from a time when imaging of the scene begins.
Embodiment 277: The method of any of Embodiments 270-276, wherein the one or more chemical species detected are selected from the group consisting of methane, cyclopropane, alkanes, alkenes, ammonia, freon, hydrogen cyanide sulfur dioxide, and hydrogen sulfide.
Embodiment 278: The imaging system or method of any of Embodiments 242-277, wherein some of the plurality of spatially and spectrally distinct optical channels have a different field of view than some other of the plurality of spatially and spectrally distinct optical channels.
Embodiment 279: The imaging system or method of any of Embodiments 242-277, wherein some of the plurality of spatially and spectrally distinct optical channels have a field of view that is lower than the field of view of the system.
Embodiment 280: The imaging system or method of any of Embodiments 242-279, wherein at least two of the plurality of optical channels is in the long-wavelength infrared spectral range.
Embodiment 281: The imaging system or method of any of Embodiments 242-279, wherein a number of optical channels in the long-wavelength infrared spectral range is less than 50.
Embodiment 282: The imaging system or method of any of Embodiments 242-279, wherein at least two of the plurality of optical channels is in the mid-wavelength infrared spectral range.
Embodiment 283: The imaging system or method of any of Embodiments 242-279, wherein a number of optical channels in the mid-wavelength infrared spectral range is less than 50.
Details of one or more implementations of the subject matter described in this disclosure are set forth in the accompanying drawings and the description below. Other features, aspects, and advantages will become apparent from the description, the drawings and the claims. Note that the relative dimensions of the following figures may not be drawn to scale.
Like reference numbers and designations in the various drawings indicate like elements.
The following description is directed to certain implementations for the purposes of describing the innovative aspects of this disclosure. However, a person having ordinary skill in the art will readily recognize that the teachings herein can be applied in a multitude of different ways. The described implementations may be implemented in any device, apparatus, or system that can be configured to operate as an imaging system such as in an infra-red imaging system. The methods and systems described herein can be included in or associated with a variety of devices such as, but not limited to devices used for visible and infrared spectroscopy, multispectral and hyperspectral imaging devices used in oil and gas exploration, refining, and transportation, agriculture, remote sensing, defense and homeland security, surveillance, astronomy, environmental monitoring, etc. The methods and systems described herein have applications in a variety of fields including but not limited to agriculture, biology, physics, chemistry, defense and homeland security, environment, oil and gas industry, etc. The teachings are not intended to be limited to the implementations depicted solely in the Figures, but instead have wide applicability as will be readily apparent to one having ordinary skill in the art.
Various embodiments disclosed herein describe a divided-aperture infrared spectral imaging (DAISI) system that is structured and adapted to provide identification of target chemical contents of the imaged scene. The system is based on spectrally-resolved imaging and can provide such identification with a single-shot (also referred to as a snapshot) comprising a plurality of images having different wavelength compositions that are obtained generally simultaneously. Without any loss of generality, snapshot refers to a system in which most of the data elements that are collected are continuously viewing the light emitted from the scene. In contrast in scanning systems, at any given time only a minority of data elements are continuously viewing a scene, followed by a different set of data elements, and so on, until the full dataset is collected. Relatively fast operation can be achieved in a snapshot system because it does not need to use spectral or spatial scanning for the acquisition of infrared (IR) spectral signatures of the target chemical contents. Instead, IR detectors (such as, for example, infrared focal plane arrays or FPAs) associated with a plurality of different optical channels having different wavelength profiles can be used to form a spectral cube of imaging data. Although spectral data can be obtained from a single snapshot comprising multiple simultaneously acquired images corresponding to different wavelength ranges, in various embodiments, multiple snap shots may be obtained. In various embodiments, these multiple snapshots can be averaged. Similarly, in certain embodiments multiple snap shots may be obtained and a portion of these can be selected and possibly averaged. Also, in contrast to commonly used IR spectral imaging systems, the DAISI system does not require cooling. Accordingly, it can advantageously use uncooled infrared detectors. For example, in various implementations, the imaging systems disclosed herein do not include detectors configured to be cooled to a temperature below 300 Kelvin. As another example, in various implementations, the imaging systems disclosed herein do not include detectors configured to be cooled to a temperature below 273 Kelvin. As yet another example, in various implementations, the imaging systems disclosed herein do not include detectors configured to be cooled to a temperature below 250 Kelvin. As another example, in various implementations, the imaging systems disclosed herein do not include detectors configured to be cooled to a temperature below 200 Kelvin.
Implementations disclosed herein provide several advantages over existing IR spectral imaging systems, most if not all of which may require FPAs that are highly sensitive and cooled in order to compensate, during the optical detection, for the reduction of the photon flux caused by spectrum-scanning operation. The highly sensitive and cooled FPA systems are expensive and require a great deal of maintenance. Since various embodiments disclosed herein are configured to operate in single-shot acquisition mode without spatial and/or spectral scanning, the instrument can receive photons from a plurality of points (e.g., every point) of the object substantially simultaneously, during the single reading. Accordingly, the embodiments of imaging system described herein can collect a substantially greater amount of optical power from the imaged scene (for example, an order of magnitude more photons) at any given moment in time especially in comparison with spatial and/or spectral scanning systems. Consequently, various embodiments of the imaging systems disclosed herein can be operated using uncooled detectors (for example, FPA unit including an array of microbolometers) that are less sensitive to photons in the IR but are well fit for continuous monitoring applications. For example, in various implementations, the imaging systems disclosed herein do not include detectors configured to be cooled to a temperature below 300 Kelvin. As another example, in various implementations, the imaging systems disclosed herein do not include detectors configured to be cooled to a temperature below 273 Kelvin. As yet another example, in various implementations, the imaging systems disclosed herein do not include detectors configured to be cooled to a temperature below 250 Kelvin. As another example, in various implementations, the imaging systems disclosed herein do not include detectors configured to be cooled to a temperature below 200 Kelvin. Imaging systems including uncooled detectors can be capable of operating in extreme weather conditions, require less power, are capable of operation during day and night, and are less expensive. Some embodiments described herein can also be less susceptible to motion artifacts in comparison with spatially and/or spectrally scanning systems which can cause errors in either the spectral data, spatial data, or both.
An aperture of the system 100 associated with the front objective lens system 124 is spatially and spectrally divided by the combination of the array of optical filters 130 and the array of imaging lenses 128. In various embodiments, the combination of the array of optical filters 130 and the array of imaging lenses 128 can be considered to form a spectrally divided pupil that is disposed forward of the optical detector array 136. The spatial and spectral division of the aperture into distinct aperture portions forms a plurality of optical channels 120 along which light propagates. In various embodiments, the array 128 of re-imaging lenses 128a and the array of spectral filters 130 which respectively correspond to the distinct optical channels 120. The plurality of optical channels 120 can be spatially and/or spectrally distinct. The plurality of optical channels 120 can be formed in the object space and/or image space. In one implementation, the distinct channels 120 may include optical channels that are separated angularly in space. The array of spectral filters 130 may additionally include a filter-holding aperture mask (comprising, for example, IR light-blocking materials such as ceramic, metal, or plastic). Light from the object 110 (for example a cloud of gas), the optical properties of which in the IR are described by a unique absorption, reflection and/or emission spectrum, is received by the aperture of the system 100. This light propagates through each of the plurality of optical channels 120 and is further imaged onto the optical detector array 136. In various implementations, the detector array 136 can include at least one FPA. In various embodiments, each of the re-imaging lenses 128a can be spatially aligned with a respectively-corresponding spectral region. In the illustrated implementation, each filter element from the array of spectral filters 130 corresponds to a different spectral region. Each re-imaging lens 128a and the corresponding filter element of the array of spectral filter 130 can coincide with (or form) a portion of the divided aperture and therefore with respectively-corresponding spatial channel 120. Accordingly, in various embodiment an imaging lens 128a and a corresponding spectral filter can be disposed in the optical path of one of the plurality of optical channels 120. Radiation from the object 110 propagating through each of the plurality of optical channels 120 travels along the optical path of each re-imaging lens 128a and the corresponding filter element of the array of spectral filter 130 and is incident on the detector array (e.g., FPA component) 136 to form a single image (e.g., sub-image) of the object 110. The image formed by the detector array 136 generally includes a plurality of sub-images formed by each of the optical channels 120. Each of the plurality of sub-images can provide different spatial and spectral information of the object 110. The different spatial information results from some parallax because of the different spatial locations of the smaller apertures of the divided aperture. In various embodiments, adjacent sub-images can be characterized by close or substantially equal spectral signatures. The detector array (e.g., FPA component) 136 is further operably connected with a processor 150 (not shown). The processor 150 can be programmed to aggregate the data acquired with the system 100 into a spectral data cube. The data cube represents, in spatial (x, y) and spectral (k) coordinates, an overall spectral image of the object 110 within the spectral region defined by the combination of the filter elements in the array of spectral filters 130. Additionally, in various embodiments, the processor or processing electronics 150 may be programmed to determine the unique absorption characteristic of the object 110. Also, the processor/processing electronics 150 can, alternatively or in addition, map the overall image data cube into a cube of data representing, for example, spatial distribution of concentrations, c, of targeted chemical components within the field of view associated with the object 110.
Various implementations of the embodiment 100 can include an optional moveable temperature-controlled reference source 160 including, for example, a shutter system comprising one or more reference shutters maintained at different temperatures. The reference source 160 can include a heater, a cooler or a temperature-controlled element configured to maintain the reference source 160 at a desired temperature. For example, in various implementations, the embodiment 100 can include two reference shutters maintained at different temperatures. The reference source 160 is removably and, in one implementation, periodically inserted into an optical path of light traversing the system 100 from the object 110 to the detector array (e.g., FPA component)136 along at least one of the channels 120. The removable reference source 160 thus can block such optical path. Moreover, this reference source 160 can provide a reference IR spectrum to recalibrate various components including the detector array 136 of the system 100 in real time. The configuration of the moveable reference source 160 is further discussed below.
In the embodiment 100, the front objective lens system 124 is shown to include a single front objective lens positioned to establish a common field-of-view (FOV) for the imaging lenses 128a and to define an aperture stop for the whole system. In this specific case, the aperture stop substantially spatially coincides with and/or is about the same size as or slightly larger than, the plurality of smaller limiting apertures corresponding to different optical channels 120. As a result, the positions for spectral filters of the different optical channels 120 coincide with the position of the aperture stop of the whole system, which in this example is shown as a surface between the lens system 124 and the array 128 of the imaging lenses 128a. In various implementations, the lens system 124 can be an objective lens 124. However, the objective lens 124 is optional and various embodiments of the system 100 need not include the objective lens 124. In various embodiments, the objective lens 124 can slightly shift the images obtained by the different detectors in the array 136 spatially along a direction perpendicular to optical axis of the lens 124, thus the functionality of the system 100 is not necessarily compromised when the objective lens 124 is not included. Generally, however, the field apertures corresponding to different optical channels may be located in the same or different planes. These field apertures may be defined by the aperture of the imaging lens 128a and/or filters in the divided aperture 130 in certain implementations. In one implementation, the field apertures corresponding to different optical channels can be located in different planes and the different planes can be optical conjugates of one another. Similarly, while all of the filter elements in the array of spectral filters 130 of the embodiment 100 are shown to lie in one plane, generally different filter elements of the array of spectral filter 130 can be disposed in different planes. For example, different filter elements of the array of spectral filters 130 can be disposed in different planes that are optically conjugate to one another. However, in other embodiments, the different filter elements can be disposed in non-conjugate planes.
In contrast to the embodiment 100, the front objective lens 124 need not be a single optical element, but instead can include a plurality of lenses 224 as shown in an embodiment 200 of the DAISI imaging system in
In one implementation, the front objective lens system such as the array of lenses 224 is configured as an array of lenses integrated or molded in association with a monolithic substrate. Such an arrangement can reduce the costs and complexity otherwise accompanying the optical adjustment of individual lenses within the system. An individual lens 224 can optionally include a lens with varying magnification. As one example, a pair of thin and large diameter Alvarez plates can be used in at least a portion of the front objective lens system. Without any loss of generality, the Alvarez plates can produce a change in focal length when translated orthogonally with respect to the optical beam.
In further reference to
The embodiment 400 has several operational advantages. It is configured to provide a spectrally known object within every image (e.g., sub-image) and for every snapshot acquisition which can be calibrated against. Such spectral certainty can be advantageous when using an array of IR FPAs like microbolometers, the detection characteristics of which can change from one imaging frame to the next due to, in part, changes in the scene being imaged as well as the thermal effects caused by neighboring FPAs. In various embodiments, the field reference array 438 of the embodiment 400 can be disposed within the Rayleigh range (approximately corresponding to the depth of focus) associated with the front objective lenses 424, thereby removing unusable blurred pixels due to having the field reference outside of this range. Additionally, the embodiment 400 of
In various embodiments, the multi-optical FPA unit of the IR imaging system can additionally include an FPA configured to operate in a visible portion of the spectrum. In reference to
The optical filters, used with an embodiment of the system, that define spectrally-distinct IR image (e.g., sub-image) of the object can employ absorption filters, interference filters, and Fabry-Perot etalon based filters, to name just a few. When interference filters are used, the image acquisition through an individual imaging channel defined by an individual re-imaging lens (such as a lens 128a of
The optical filtering configuration of various embodiments disclosed herein may advantageously use a bandpass filter defining a specified spectral band. Any of the filters 0a through 3a, the transmission curves of which are shown in
Referring again to
In one implementation, the LP and SP filters can be combined, in a spectrally-multiplexed fashion, in order to increase or maximize the spectral extent of the transmission region of the filter system of the embodiment.
The advantage of using spectrally multiplexed filters is appreciated based on the following derivation, in which a system of M filters is examined (although it is understood that in practice an embodiment of the invention can employ any number of filters). As an illustrative example, the case of M=7 is considered. Analysis presented below relates to one spatial location in each of the images (e.g., sub-images) formed by the differing imaging channels (e.g., different optical channels 120) in the system. A similar analysis can be performed for each point at an image (e.g., sub-image), and thus the analysis can be appropriately extended as required.
The unknown amount of light within each of the M spectral channels (corresponding to these M filters) is denoted with f1, f2, f3, . . . fM, and readings from corresponding detector elements receiving light transmitted by each filter is denoted as g1, g2, g3 . . . gM, while measurement errors are represented by n1, n2, n3, . . . nM. Then, the readings at the seven FPA pixels each of which is optically filtered by a corresponding band-pass filter of
g
1
=f
1
+n
1,
g
2
=f
2
+n
2,
g
3
=f
3
+n
3,
g
4
=f
4
+n
4,
g
5
=f
5
+n
5,
g
6
=f
6
+n
6,
g
7
=f
7
+n
7,
These readings (pixel measurements) g1 are estimates of the spectral intensities f1. The estimates g1 are not equal to the corresponding f1 values because of the measurement errors n1. However, if the measurement noise distribution has zero mean, then the ensemble mean of each individual measurement can be considered to be equal to the true value, i.e. gi
=fi. Here, the angle brackets indicate the operation of calculating the ensemble mean of a stochastic variable. The variance of the measurement can, therefore, be represented as:
(gi−fi)2
=
ni2
=σ2
In embodiments utilizing spectrally-multiplexed filters, in comparison with the embodiments utilizing band-pass filters, the amount of radiant energy transmitted by each of the spectrally-multiplexed LP or SP filters towards a given detector element can exceed that transmitted through a spectral band of a band-pass filter. In this case, the intensities of light corresponding to the independent spectral bands can be reconstructed by computational means. Such embodiments can be referred to as a “multiplex design”.
One matrix of such “multiplexed filter” measurements includes a Hadamard matrix requiring “negative” filters that may not be necessarily appropriate for the optical embodiments disclosed herein. An S-matrix approach (which is restricted to having a number of filters equal to an integer that is multiple of four minus one) or a row-doubled Hadamard matrix (requiring a number of filters to be equal to an integer multiple of eight) can be used in various embodiments. Here, possible numbers of filters using an S-matrix setup are 3, 7, 11, etc and, if a row-doubled Hadamard matrix setup is used, then the possible number of filters is 8, 16, 24, etc. For example, the goal of the measurement may be to measure seven spectral band fi intensities using seven measurements gi as follows:
g
1
=f
1+0+f3+0+f5+0+f7+n1,
g
2=0+f2+f3+0+0+f6+f7+n2
g
3
=f
1
+f
2+0+0+f5+0+f7+n3
g
4=0+0+0+f4+f5+f7+f8+n4
g
5
=f
1+0+f3+f4+0+f6+0+n5
g
6=0+f2+f3+f4+f5+0+0+n6
g
7
=f
1
+f
2+0+f4+0+0+f7+n7
Optical transmission characteristics of the filters described above are depicted in gi
=fi. Instead, if a “hat” notation is used to denote an estimate of a given value, then a linear combination of the measurements can be used such as, for example,
{circumflex over (f)}
1=¼(+g1−g2+g3−g4+g5−g6+g7),
{circumflex over (f)}
2=¼(−g1+g2+g3−g4−g5+g6+g7),
{circumflex over (f)}
3=¼(+g1+g2−g3−g4+g5+g6−g7),
{circumflex over (f)}
4=¼(−g1−g2−g3+g4+g5+g6+g7),
{circumflex over (f)}
5=¼(+g1−g2+g3+g4−g5+g6−g7),
{circumflex over (f)}
6=¼(−g1+g2+g3+g4+g5−g6−g7),
{circumflex over (f)}
7=¼(+g1+g2−g3+g4−g5−g6+g7),
These {circumflex over (f)}i are unbiased estimates when the ni are zero mean stochastic variables, so that {right arrow over (f)}i−fi
=0. The measurement variance corresponding to ith measurement is given by the equation below:
({circumflex over (f)}i−fi)2
7/16σ2
From the above equation, it is observed that by employing spectrally-multiplexed system the signal-to-noise ratio (SNR) of a measurement is improved by a factor of √{square root over (16/7)}=1.51.
For N channels, the SNR improvement achieved with a spectrally-multiplexed system can be expressed as (N+1)/(2√{square root over (N)}). For example, an embodiment employing 12 spectral channels (N=12) is characterized by a SNR improvement, over a non-spectrally-multiplexed system, comprising a factor of up to 1.88.
Two additional examples of related spectrally-multiplexed filter arrangements 0c through 3c and 0d through 3d that can be used in various embodiments of the imaging systems described herein are shown in
The use of microbolometers, as detector-noise-limited devices, in turn not only can benefit from the use of spectrally multiplexed filters, but also does not require cooling of the imaging system during normal operation. In contrast to imaging systems that include highly sensitive FPA units with reduced noise characteristics, the embodiments of imaging systems described herein can employ less sensitive microbolometers without compromising the SNR. This result is at least in part due to the snap-shot/non-scanning mode of operation.
As discussed above, an embodiment may optionally, and in addition to a temperature-controlled reference unit (for example temperature controlled shutters such as shutters 160; 460a, 460b), employ a field reference component (e.g., field reference aperture 338 in
In particular, and in further reference to
Indeed, the process of calibration of an embodiment of the imaging system starts with estimating gain and offset by performing measurements of radiation emanating, independently, from at least two temperature-controlled shutters of known and different radiances. The gain and offset can vary from detector pixel to detector pixel. Specifically, first the response of the detector unit 456 to radiation emanating from one shutter is carried out. For example, the first shutter 460a blocks the FOV of the detectors 456 and the temperature T1 is measured directly and independently with thermistors. Following such initial measurement, the first shutter 460a is removed from the optical path of light traversing the embodiment and another second shutter (for example, 460b) is inserted in its place across the optical axis 226 to prevent the propagation of light through the system. The temperature of the second shutter 460b can be different than the first shutter (T2≠T1). The temperature of the second shutter 460b is also independently measured with thermistors placed in contact with this shutter, and the detector response to radiation emanating from the shutter 460b is also recorded. Denoting operational response of FPA pixels (expressed in digital numbers, or “counts”) as gi to a source of radiance Li, the readings corresponding to the measurements of the two shutters can be expressed as:
g
1
=γL
1(T1)+goffset
g
2
=γL
2(T2)+goffset
Here, goffset is the pixel offset value (in units of counts), and γ is the pixel gain value (in units of counts per radiance unit). The solutions of these two equations with respect to the two unknowns goffset and γ can be obtained if the values of g1 and g2 and the radiance values L1 and L2 are available. These values can, for example, be either measured by a reference instrument or calculated from the known temperatures T1 and T2 together with the known spectral response of the optical system and FPA. For any subsequent measurement, one can then invert the equation(s) above in order to estimate the radiance value of the object from the detector measurement, and this can be done for each pixel in each FPA within the system.
As already discussed, and in reference to
Because each FPA's offset value is generally adjusted from each frame to the next frame by the hardware, comparing the outputs of one FPA with another can have an error that is not compensated for by the static calibration parameters goffset and γ established, for example, by the movable shutters 160, 460a, 460b. In order to ensure that FPAs operate in radiometric agreement over time, it is advantageous for a portion of each detector array to view a reference source (such as the field reference 338 in
Among the FPA elements in an array of FPAs in an embodiment of the imaging system, one FPA can be selected to be the “reference FPA”. The field reference temperature measured by all the other FPAs can be adjusted to agree with the field reference temperature measured by the reference as discussed below. The image obtained by each FPA includes a set of pixels obscured by the field reference 338. Using the previously obtained calibration parameters goffset and γ (the pixel offset and gain), the effective blackbody temperature Ti of the field reference as measured by each FPA is estimated using the equation below:
T
i=mean{(g+Δgi+goffset/γ}=mean{(g−goffset)/γ}+ΔTi
Using the equation above, the mean value over all pixels that are obscured by the field reference is obtained. In the above equation Δgi is the difference in offset value of the current frame from Δgoffset obtained during the calibration step. For the reference FPA, Δgi can be simply set to zero. Then, using the temperature differences measured by each FPA, one obtains
T
i
−T
ref=mean{(g+Δgi+goffset/γ}+ΔTi−mean{(g−goffset)/γ}=ΔTi
Once ΔTi for each FPA is measured, its value can be subtracted from each image in order to force operational agreement between such FPA and the reference FPA. While the calibration procedure has been discussed above in reference to calibration of temperature, a procedurally similar methodology of calibration with respect to radiance value can also be implemented.
Prior to optical data acquisition using an embodiment of the IR imaging system as described herein, one or more, most, or potentially all the FPAs of the system can be calibrated. For example, greater than 50%, 60%, 70%, 80% or 90% of the FPAs 336 can be initially calibrated. As shown in
To achieve at least some of these goals, a spectral differencing method may be employed. The method involves forming a difference image from various combinations of the images from different channels. In particular, the images used to form difference images can be registered by two or more different FPAs in spectrally distinct channels having different spectral filters with different spectral characteristics. Images from different channels having different spectral characteristics will provide different spectral information. Comparing (e.g., subtracting) these images, can therefore yield valuable spectral based information. For example, if the filter element of the array of spectral filters 130 corresponding to a particular FPA 336 transmits light from the object 110 including a cloud of gas, for example, with a certain spectrum that contains the gas absorption peak or a gas emission peak while another filter element of the array of spectral filters 130 corresponding to another FPA 336 does not transmit such spectrum, then the difference between the images formed by the two FPAs at issue will highlight the presence of gas in the difference image.
A shortcoming of the spectral differencing method is that contributions of some auxiliary features associated with imaging (not just the target species such as gas itself) can also be highlighted in and contribute to the difference image. Such contributing effects include, to name just a few, parallax-induced imaging of edges of the object, influence of magnification differences between the two or more optical channels, and differences in rotational positioning and orientation between the FPAs. While magnification-related errors and FPA-rotation-caused errors can be compensated for by increasing the accuracy of the instrument construction as well as by post-processing of the acquired imaging, parallax is scene-induced and is not so easily correctable. In addition, the spectral differencing method is vulnerable to radiance calibration errors. Specifically, if one FPA registers radiance of light from a given feature of the object as having a temperature of 40° C., for example, while the data from another FPA represents the temperature of the same object feature as being 39° C., then such feature of the object will be enhanced or highlighted in the difference image (formed at least in part based on the images provided by these two FPAs) due to such radiance-calibration error.
One solution to some of such problems is to compare (e.g., subtract) images from the same FPA obtained at different instances in time. For example, images can be compared to or subtracted from a reference image obtained at another time. Such reference image, which is subtracted from other later obtained images, may be referred to as a temporal reference image. This solution can be applied to spectral difference images as well. For example, the image data resulting from spectral difference images can be normalized by the data corresponding to a temporal reference image. For instance, the temporal reference images can be subtracted from the spectral difference image to obtain the temporal difference image. This process is referred to, for the purposes of this disclosure, as a temporal differencing algorithm or method and the resultant image from subtracting the temporal reference image from another image (such as the spectral difference image) is referred to as the temporal difference image. In some embodiments where spectral differencing is employed, a temporal reference image may be formed, for example, by creating a spectral difference image from the two or more images registered by the two or more FPAs at a single instance in time. This spectral difference image is then used as a temporal reference image. The temporal reference image can then be subtracted from other later obtained images to provide normalization that can be useful in subtracting out or removing various errors or deleterious effects. For example, the result of the algorithm is not affected by a prior knowledge of whether the object or scene contains a target species (such as gas of interest), because the algorithm can highlight changes in the scene characteristics. Thus, a spectral difference image can be calculated from multiple spectral channels as discussed above based on a snap-shot image acquisition at any later time and can be subtracted from the temporal reference image to form a temporal difference image. This temporal difference image is thus a normalized difference image. The difference between the two images (the temporal difference image) can highlight the target species (gas) within the normalized difference image, since this species was not present in the temporal reference frame. In various embodiments, more than two FPAs can be used both for registering the temporal reference image and a later-acquired difference image to obtain a better SNR figure of merit. For example, if two FPAs are associated with spectral filters having the same spectral characteristic, then the images obtained by the two FPAs can be combined after they have been registered to get a better SNR figure.
While the temporal differencing method can be used to reduce or eliminate some of the shortcomings of the spectral differencing, it can introduce unwanted problems of its own. For example, temporal differencing of imaging data is less sensitive to calibration and parallax induced errors than the spectral differencing of imaging data. However, any change in the imaged scene that is not related to the target species of interest (such as particular gas, for example) is highlighted in a temporally-differenced image. Thus such change in the imaged scene may be erroneously perceived as a location of the target species triggering, therefore, an error in detection of target species. For example, if the temperature of the background against which the gas is being detected changes (due to natural cooling down as the day progresses, or increases due to a person or animal or another object passing through the FOV of the IR imaging system), then such temperature change produces a signal difference as compared to the measurement taken earlier in time. Accordingly, the cause of the scenic temperature change (the cooling object, the person walking, etc.) may appear as the detected target species (such as gas). It follows, therefore, that an attempt to compensate for operational differences among the individual FPAs of a multi-FPA IR imaging system with the use of methods that turn on spectral or temporal differencing can cause additional problems leading to false detection of target species. Among these problems are scene-motion-induced detection errors and parallax-caused errors that are not readily correctable and/or compensatable. Accordingly, there is a need to compensate for image data acquisition and processing errors caused by motion of elements within the scene being imaged. Various embodiments of data processing algorithms described herein address and fulfill the need to compensate for such motion-induced and parallax-induced image detection errors.
In particular, to reduce or minimize parallax-induced differences between the images produced with two or more predetermined FPAs, another difference image can be used that is formed from the images of at least two different FPAs to estimate parallax effects. Parallax error can be determined by comparing the images from two different FPAs where the position between the FPAs is known. The parallax can be calculated from the known relative position difference. Differences between the images from these two FPAs can be attributed to parallax, especially, if the FPA have the same spectral characteristics, for example have the same spectral filter or both have no spectral filters. Parallax error correction, however, can still be obtained from two FPAs that have different spectral characteristics or spectral filters, especially if the different spectral characteristics, e.g., the transmission spectra of the respective filters are known and/or negligible. Use of more than two FPAs or FPAs of different locations such as FPAs spaced farther apart can be useful. For example, when the spectral differencing of the image data is performed with the use of the difference between the images collected by the outermost two cameras in the array (such as, for example, the FPAs corresponding to filters 2 and 3 of the array of filters of
Another capability of the embodiments described herein is the ability to perform the volumetric estimation of a gas cloud. This can be accomplished by using (instead of compensating or negating) the parallax induced effects described above. In this case, the measured parallax between two or more similar spectral response images (e.g., two or more channels or FPAs) can be used to estimate a distance between the imaging system and the gas cloud or between the imaging system and an object in the field of view of the system. The parallax induced transverse image shift, d, between two images is related to the distance, z, between the cloud or object 110 and the imaging system according to the equation z=−sz′/d. Here, s, is the separation between two similar spectral response images, and z′ is the distance to the image plane from the back lens. The value for z′ is typically approximately equal to the focal length f of the lens of the imaging system. Once the distance z between the cloud and the imaging system is calculated, the size of the gas cloud can be determined based on the magnification, m=f/z, where each image pixel on the gas cloud, Δx′, corresponds to a physical size in object space Δx=Δx′/m. To estimate the volume of the gas cloud, a particular symmetry in the thickness of the cloud based on the physical size of the cloud can be assumed. For example, the cloud image can be rotated about a central axis running through the cloud image to create a three dimensional volume estimate of the gas cloud size. It is worth noting that in the embodiments described herein only a single imaging system is required for such volume estimation. Indeed, due to the fact that the information about the angle at which the gas cloud is seen by the system is decoded in the parallax effect, the image data includes the information about the imaged scene viewed by the system in association with at least two angles.
When the temporal differencing algorithm is used for processing the acquired imaging data, a change in the scene that is not caused by the target species can inadvertently be highlighted in the resulting image. In various embodiments, compensation for this error makes use of the temporal differencing between two FPAs that are substantially equally spectrally sensitive to the target species. In this case, the temporal difference image will highlight those pixels the intensity of which have changed in time (and not in wavelength). Therefore, subtracting the data corresponding to these pixels on both FPAs, which are substantially equally spectrally sensitive to the target species, to form the resulting image, excludes the contribution of the target species to the resulting image. The differentiation between (i) changes in the scene due to the presence of target species and (ii) changes in the scene caused by changes in the background not associated with the target species is, therefore, possible. In some embodiments, these two channels having the same or substantially similar spectral response so as to be substantially equally spectrally sensitive to the target species may comprise FPAs that operate using visible light. It should also be noted that, the data acquired with a visible light FPA (when present as part of the otherwise IR imaging system) can also be used to facilitate such differentiation and compensation of the motion-caused imaging errors. Visible cameras generally have much lower noise figure than IR cameras (at least during daytime). Consequently, the temporal difference image obtained with the use of image data from the visible light FPA can be quite accurate. The visible FPA can be used to compensate for motion in the system as well as many potential false-alarms in the scene due to motion caused by people, vehicles, birds, and steam, for example, as long as the moving object can be observed in the visible region of the spectra. This has the added benefit of providing an additional level of false alarm suppression without reducing the sensitivity of the system since many targets such as gas clouds cannot be observed in the visible spectral region. In various implementations, an IR camera can be used to compensate for motion artifacts.
Another method for detection of the gases is to use a spectral unmixing approach. A spectral unmixing approach assumes that the spectrum measured at a detector pixel is composed of a sum of component spectra (e.g., methane and other gases). This approach attempts to estimate the relative weights of these components needed to derive the measurement spectrum. The component spectra are generally taken from a predetermined spectral library (for example, from data collection that has been empirically assembled), though sometimes one can use the scene to estimate these as well (often called “endmember determination”). In various embodiments, the image obtained by the detector pixel is a radiance spectrum and provides information about the brightness of the object. To identify the contents of a gas cloud in the scene and/or to estimate the concentration of the various gases in the gas cloud, an absorption/emission spectrum of the various gases of interest can be obtained by comparing the measured brightness with an estimate of the expected brightness. The spectral unmixing methodology can also benefit from temporal, parallax, and motion compensation techniques.
In various embodiments, a method of identifying the presence of a target species in the object includes obtaining the radiance spectrum (or the absorption spectrum) from the object in a spectral region indicative of the presence of the target species and calculating a correlation (e.g., a correlation coefficient) by correlating the obtained radiance spectrum (or the absorption spectrum) with a reference spectrum for the target species. The presence or absence of the target species can be determined based on an amount of correlation (e.g., a value of correlation coefficient). For example, the presence of the target species in the object can be confirmed if the amount of correlation or the value of correlation coefficient is greater than a threshold. In various implementations, the radiance spectrum (or the absorption spectrum) can be obtained by obtaining a spectral difference image between a filtered optical channel and/or another filtered optical channel/unfiltered optical channel or any combinations thereof.
For example, an embodiment of the system configured to detect the presence of methane in a gas cloud comprises optical components such that one or more of the plurality of optical channels is configured to collect IR radiation to provide spectral data corresponding to a discrete spectral band located in the wavelength range between about 7.9 μm and about 8.4 μm corresponding to an absorption peak of methane. The multispectral data obtained in the one or more optical channels can be correlated with a predetermined absorption spectrum of methane in the wavelength range between about 7.9 μm and 8.4 μm. In various implementations, the predetermined absorption spectrum of methane can be saved in a database or a reference library accessible by the system. Based on an amount of correlation (e.g., a value of correlation coefficient), the presence or absence of methane in the gas cloud can be detected.
The embodiment 300 of
Due to the specifics of operation in the IR range of the spectrum, the use of the so-called noise-equivalent temperature difference (or NETD) is preferred and is analogous to the SNR commonly used in visible spectrum instruments. The array of microbolometer FPAs 336 is characterized to perform at NETD≤72 mK at an f-number of 1.2. Each measurement was carried out by summing four consecutive frames, and the reduction in the NETD value expected due to such summation would be described by corresponding factor of √4=2. Under ideal measurement conditions, therefore, the FPA NETD should be about 36 mK.
It is worth noting that the use of optically-filtered FPAs in various embodiments of the system described herein can provide a system with higher number of pixels. For example, embodiments including a single large format microbolometer FPA array can provide a system with large number of pixels. Various embodiments of the systems described herein can also offer a high optical throughput for a substantially low number of optical channels. For example, the systems described herein can provide a high optical throughput for a number of optical channels between 4 and 50. By having a lower number of optical channels (e.g., between 4 and 50 optical channels), the systems described herein have wider spectral bins which allows the signals acquired within each spectral bin to have a greater integrated intensity.
An advantage of the embodiments described herein over various scanning based hyperspectral systems that are configured for target species detection (for example, gas cloud detection) is that, the entire spectrum can be resolved in a snapshot mode (for example, during one image frame acquisition by the FPA array). This feature enables the embodiments of the imaging systems described herein to take advantage of the compensation algorithms such as the parallax and motion compensation algorithms mentioned above. Indeed, as the imaging data required to implement these algorithms are collected simultaneously with the target-species related data, the compensation algorithms are carried out with respect to target-species related data and not with respect to data acquired at another time interval. This rapid data collection thus improves the accuracy of the data compensation process. In addition, the frame rate of data acquisition is much higher. For example, embodiments of the imaging system described herein can operate at video rates from about 5 Hz and higher. For example, various embodiments described herein can operate at frame rates from about 5 Hz to about 60 Hz or 200 Hz. Thus, the user is able to recognize in the images the wisps and swirls typical of gas mixing without blurring out of these dynamic image features and other artifacts caused by the change of scene (whether spatial or spectral) during the lengthy measurements. In contradistinction, scanning based imaging systems involve image data acquisition over a period of time exceeding a single-snap-shot time and can, therefore, blur the target gas features in the image and inevitably reduce the otherwise achievable sensitivity of the detection. This result is in contrast to embodiments of the imaging system described herein that are capable of detecting the localized concentrations of gas without it being smeared out with the areas of thinner gas concentrations. In addition, the higher frame rate also enables a much faster response rate to a leak of gas (when detecting such leak is the goal). For example, an alarm can trigger within fractions of a second rather than several seconds.
To demonstrate the operation and gas detection capability of the imaging systems described herein, a prototype was constructed in accordance with the embodiment 300 of
The same prototype of the system can also demonstrate the dynamic calibration improvement described above by imaging the scene surrounding the system (the laboratory) with known temperature differences. The result of implementing the dynamic correction procedure is shown in
In
As discussed above, in some embodiments, the reference sources 972a and 972b are imaged onto the detector array 1 and detector array 9, without much blur such that the reference sources 972a and 972b are focused. In contrast, in other embodiments, the image of reference sources 972a and 972b formed on the detector array 1, and detector array 9 are blurred such that the reference sources 972a and 972b are defocused, and thereby provide some averaging, smoothing, and/or low pass filtering. The reference sources 972a and 972b may comprise a surface of known temperature and may or may not include a heater or cooler attached thereto or in thermal communication therewith. For example, the reference source 972a and 972b may comprises heaters and coolers respectively or may comprise a surface with a temperature sensor and a heater and sensor respectively in direct thermal communication therewith to control the temperature of the reference surface. In various implementations, the reference sources 972a and 972b can include a temperature controller configured to maintain the reference sources 972a and 972b at a known temperature. In some implementations, the reference sources 972a and 972b can be associated with one or more sensors that measure the temperature of the reference sources 972a and 972b and communicate the measured temperature to the temperature controller. In some implementations, the one or more sensors can communicate the measured temperature to the data-processing unit. In various implementations, the reference sources 972a and 972b may comprise a surface of unknown temperature. For example, the reference sources may comprise a wall of a housing comprising the imaging system. In some implementations, the reference sources 972a and 972b can comprise a surface that need not be associated with sensors, temperature controllers. However, in other implementations, the reference sources 972a and 972b can comprise a surface that can be associated with sensors, temperature controllers.
In
In the implementations depicted in
The temperature of the reference sources 972b, 972a can be different. For example, the reference source 972a can be at a temperature TA, and the reference source 972b can be at a temperature TB lower than the temperature TA. A heater can be provided under the temperature-controlled element 972a to maintain it at a temperature TA, and a cooler can be provided underneath the temperature-controlled element 972b to maintain it at a temperature TB. In various implementations, the embodiments illustrated in
The reference sources 972a and 972b can be coated with a material to make it behave substantially as a blackbody (for which the emission spectrum is known for any given temperature). If a temperature sensor is used at the location of each reference source, then the temperature can be tracked at these locations. As a result, the regions in the image of each camera (e.g., on the detector arrays 1 and 9) in which the object has such known temperature (and, therefore, spectrum) can be defined. A calibration procedure can thus be used so that most of the cameras (if not every camera) so operated agrees, operationally, with most or every other camera, for objects at the temperatures represented by those two sources. Calibrating infrared cameras using sources at two different temperatures is known as a “two-point” calibration, and assumes that the measured signal at a given pixel is linearly related to the incident irradiance. Since this calibration can be performed during multiple, more, or even every frame of a sequence, it is referred to as a “dynamic calibration”.
An example of the dynamic calibration procedure is as follows. If there is a temperature sensor on the reference sources or reference surface, then the temperature measurements obtained by these temperature sensors can be used to determine their expected emission spectra. These temperature measurements are labeled as TA[R], TB[R], and TC[R] for the “reference temperatures” of sources/surfaces A, B, and C. These temperature measurements can be used as scalar correction factors to apply to the entire image of a given camera, forcing it to agree with the reference temperatures. Correcting the temperature estimate of a given pixel from T to T′ can use formulae analogous to those discussed below in reference to
In the configuration illustrated in
A “static” calibration (a procedure in which the scene is largely blocked with a reference source such as the moving shutters 960 in
This design is an enhancement to the systems 300 and 400 shown in
The imaging elements in the system 1000 (shown as mirrors in
In various implementations, a heater can be provided underneath, adjacent to, or in thermal communication with reference source/surface A to give it a higher temperature TA, and a cooler can be provided underneath, adjacent to, or in thermal communication with reference source B to give it a lower temperature TB. In various implementations, the embodiments illustrated in
The dynamic calibration is used to obtain a corrected temperature T′ from the initial temperature T estimated at each pixel in a camera using the following formulae:
T′[x,y,c]=(T[x,y,c]−TA[R])G[c]+TA[R]
where is TA[R] is a dynamic offset correction factor, and,
is a dynamic gain correction factor. The term c discussed above is a camera index that identifies the camera whose data is being corrected.
Various embodiments of the divided aperture infrared spectral imager (DAISI) disclosed herein (e.g., embodiments illustrated in
For example, the detector arrays 136, 236, 336 and/or 456 can include at least one mid-wave infrared (MWIR) FPA configured to detect infrared radiation in the wavelength range between about 3 microns and about 7 microns and at least one long wave infrared (LWIR) FPA configured to detect infrared radiation in the wavelength range between about 7 microns and about 14 microns. As another example, the detector arrays 136, 236, 336 and/or 456 can include one MWIR FPA configured to detect infrared radiation in the wavelength range between about 3 microns and about 7 microns and a plurality of LWIR FPAs configured to detect infrared radiation in the wavelength range between about 7 microns and about 14 microns. In various implementations, the MWIR FPA can be cooled and/or uncooled. In various implementations, one or more of the LWIR FPAs can be cooled and/or uncooled. The MWIR and/or the LWIR FPAs can be cooled to temperatures below room temperature. For example, the MWIR and/or the LWIR FPAs can include coolers that maintain the FPAs at a temperature between about 200 degree Kelvin and about 273 degree Kelvin, a temperature between about 150 degree Kelvin and about 200 degree Kelvin, a temperature between about 100 degree Kelvin and about 150 degree Kelvin or a temperature between about 50 degree Kelvin and about 150 degree Kelvin. In various implementations, the coolers employed to maintain the MWIR and/or LWIR FPAs at a desired temperature can be a cryogenic cooler. In various implementations, the coolers employed to maintain the MWIR and/or LWIR FPAs at a desired temperature can include pulse tube coolers available from Thales Cryogenics or Canberra Industries, Inc. In some implementations, the coolers employed to maintain the MWIR and/or LWIR FPAs at a desired temperature can include high operating temperature (HOT) coolers that can maintain the MWIR and/or LWIR FPAs at a temperature between about 110 degree Kelvin and 150 degree Kelvin. For example, in some implementations, the HOT coolers can maintain the at least one MWIR and/or LWIR FPAs at a temperature of about 135 degree Kelvin. The use of HOT coolers can facilitate detector arrays comprising novel semiconductor materials that have reduced cooling requirements as compared to detector arrays comprising InSb or Mercury Cadmium Telluride (MCT). The HOT coolers can additionally extend the lifetime of the detector arrays beyond 25000 hours, such as, for example up to 90,000 hours. The coolers can include cryogenic coolers and/or thermo-electric coolers.
Implementations of the dual band DAISI including MWIR and LWIR FPAs can have increased detection sensitivity to chemicals/gases that have stronger spectral features in the mid wave infrared wavelength range than the long wave infrared wavelength range. Additionally, since implementations of the dual band DAISI including MWIR and LWIR FPAs are capable of obtaining spectral information in both the mid-wave infrared wavelength range and the long wave infrared wavelength range, such implementations can have enhanced chemical/gas identification capabilities as compared to implementations that operate only in the mid-wave infrared wavelength range or the long wave infrared wavelength range.
Furthermore, since implementations of the dual band DAISI including MWIR and LWIR FPAs are capable of obtaining an image of a scene by combining spectral information in the mid-wave infrared wavelength range and the long wave infrared wavelength range, the accuracy of detecting various gases/chemicals in the imaged scene can be improved. Additionally, since the implementations of the dual band DAISI including MWIR and LWIR FPAs obtain information in the mid-wave infrared wavelength range and the long wave infrared wavelength range using solar as well as thermal sources for signal, they can be used in different weather conditions (e.g., on sunny days, cloudy days, etc.) and at various times of the day (e.g., during the day or night).
Various implementations of the dual band DAISI system can be used in continuous monitoring of explosive hydrocarbons or hazardous gas leaks and/or any fugitive gas emission. Implementations of the dual band DAISI system used in such applications can provide video imagery identifying the species, size and direction, and concentration of any detected gas cloud. Other implementations of the dual band DAISI system can also be used for exploration, standoff chemical detection, explosive detection, bio-imaging, medical imaging, gas cloud imaging, surveillance, food inspection, and remote sensing applications and other applications including but not limited to biological warfare, gas leaks at refineries, rigs and petroleum plants, imaging for the purpose of reconnaissance, underwater applications, space application, telecommunications and/or optical computing.
Various configurations of detector arrays including MWIR and LWIR FPAs are shown in
Although the embodiment illustrated in
The MWIR FPA can have a similar size and weight as the LWIR FPA. In some implementations, the MWIR FPA can have a smaller size as compared to the LWIR FPA.
The one or more MWIR FPAs can be statically and dynamically calibrated using a procedure similar to the static and dynamic calibration of the one or more LWIR FPAs described above. For example, the one or more MWIR FPAs can image the moveable temperature-controlled reference source 160, the field reference 338, the field reference array 438, the moveable temperature-controlled shutters 460a and 460b, temperature-controlled shutters 960 and/or the reference sources 972a and 972b described above. The static and dynamic calibration procedures described above can maintain agreement among all the FPAs including the LWIR and MWIR FPAs when viewing the same radiant energy. Additionally, the static and dynamic calibration procedures described above can aid in differentiating between thermally-induced signal and solar-reflection-induced signal which can affect the detection capabilities of a MWIR FPA. For example, if a MWIR FPA (or camera) sees a change in signal within the scene, but none in the reference source, then the user can conclude that the change was induced by a change in the scene illumination or a change in the object temperature. The user can confirm with certain degree of confidence that the change was not induced by changes in the response of the detector which would indicate that the detector calibration is in need of adjustment.
One or more optical filters can be disposed in the optical path of each MWIR and LWIR FPA in the detector array similar to the embodiments disclosed in
Cooled MWIR FPAs can advantageously operate at a higher frame rate than an uncooled MWIR/LWIR FPA. Accordingly, for any video frame rate, cooled MWIR FPAs can average data over more frames than an uncooled MWIR/LWIR FPA. This can result in an increase in the signal to noise ratio of the images obtained by the uncooled MWIR FPA.
The increased signal to noise ratio provided by cooled MWIR FPAs can be advantageous in systems that employ one or more uncooled LWIR FPAs. For example, the reduced signal to noise ratio of images obtained from uncooled LWIR FPAs can result in reduced absorption strength of spectral features present in the images obtained from one or more uncooled LWIR FPAs. Accordingly, imaging systems employing one or more uncooled LWIR FPAs only can result in false positive detection of the presence or absence of one or more chemical species. For example, imaging systems employing one or more uncooled LWIR FPAs only can indicate the presence of a chemical species when it is absent in truth or indicate the absence of a chemical species when it is present in truth. Thus, differentiating between true and false chemical species detections can be challenging when imaging systems employing only one or more uncooled LWIR FPAs are used.
A cooled MWIR FPA providing images with increased signal to noise ratio, and utilizing the stronger absorption features of various chemical species in mid-wavelength infra-red spectral range, can be used to primarily detect the presence or absence of a chemical species in a scene while the uncooled LWIR FPAs can be used to remove false positive detections and/or to identify the chemical species.
The one or more MWIR and LWIR FPAs can be configured to output one or more image frames. The one or more image frames can be output at video frame rates. For example, the output of the one or more MWIR and LWIR FPAs can be between 5 image frames/second and 120 image frames/second. The output image frames can be analyzed using hyperspectral video analytics using spectra-temporal algorithms to obtain spectral features of various chemical species that may be present in the scene. The spectral features obtained from the image data output from one or more of the MWIR elements and LWIR elements can be cross-correlated with known spectra of various chemical species that are stored in a reference library in a database to identify the chemical species that may be present in the gas cloud 1505.
In various embodiments, image frames output from the one or more MWIR and LWIR FPAs at the beginning of the measurement period can be used to estimate background features of the scene and image frames acquired later in the measurement period can be used to detect and speciate various chemical species of interest that may be present in the scene. Thus, the one or more MWIR and LWIR FPAs can be used to not only detect and speciate various chemical species of interest that may be present in the scene but to also estimate the dynamic properties of those chemical species. For example, the one or more MWIR and LWIR FPAs can be used to estimate movement of the gas cloud 1505 and/or the region 1507 over time in addition to detecting and speciating various chemical species that may be present in the gas cloud 1505.
The results associated with detecting and speciating various chemical species that may be present in the gas cloud 1505, such as, for example, spectral features, concentration, data regarding movement of the gas cloud, etc. 1505 and/or 1507 can be obtained within 1 second from the start of imaging the scene. The associated results can be updated after every frame thereafter. In various implementations, the results associated with detecting and speciating various chemical species that may be present in the gas cloud 1505 can be obtained in sufficiently real time (e.g., between about 0.01 millisecond and about 1 millisecond from the start of imaging the scene, between about 0.01 millisecond and about 10 milliseconds from the start of imaging the scene, between about 0.01 millisecond and about 50 milliseconds from the start of imaging the scene, between about 0.01 millisecond and about 100 milliseconds from the start of imaging the scene, between about 0.01 millisecond and about 500 milliseconds from the start of imaging the scene, between about 0.01 millisecond and about 1 second from the start of imaging the scene, between about 0.01 millisecond and about 10 seconds from the start of imaging the scene, between about 0.01 millisecond and about 30 seconds from the start of imaging the scene, between about 0.01 millisecond and about 1 minute from the start of imaging the scene, between about 0.01 millisecond and about 5 minutes from the start of imaging the scene, or between about 0.01 millisecond and about 10 minutes from the start of imaging the scene).
The ability of one or more MWIR FPAs (e.g., cooled MWIR FPAs) to aid the detection capabilities of the one or more LWIR FPAs can be enhanced when the image frames output from the one or more MWIR FPAs are synchronized with the image frames output from the one or more LWIR FPAs. In various implementations, a feedback system can be employed to synchronize the image frames output from the one or more LWIR FPAs and the image frames output from the one or more MWIR FPAs.
The inclusion of one or more MWIR FPAs in an array of LWIR FPAs also provides improved chemical speciation due to the extension in the spectral range over which data is collected. For example, sulfur dioxide (SO2) produces a signature in the long-wavelength infra-red spectral range that can be confused with the signature for propylene (C3H6) at very low spectral resolution. However, the spectral features of SO2 and C3H6 do not overlap in the mid-wavelength infra-red spectral range. Thus, the information provided by one or more MWIR FPAs when used in combination with information provided by one or more LWIR FPAs can provide additional information to help differentiate the chemical species that are detected.
The information provided from the one or more MWIR and LWIR FPAs can also provide information that cannot be obtained by either the MWIR or the LWIR FPAs individually. For example, the combined information from MWIR and LWIR FPAs can be used to estimate the illumination of a scene. The LWIR FPAs are more sensitive to thermally emitted radiation and less sensitive to reflected solar radiation, since solar light is weaker in the long-wavelength infra-red spectral range in comparison with terrestrial sources that are much closer. The MWIR FPAs are sensitive to both thermal and reflected solar radiation. Thus, if LWIR FPAs observing a scene record only small and gradual changes in signal, whereas the MWIR FPAs observing the same scene record much sharper changes then it can be concluded with a degree of confidence that the illumination of the scene is changing.
This effect is illustrated in
Some of the plurality of spatially and spectrally distinct optical channels in various implementations of the dual band DAISI including MWIR and LWIR FPAs can obtain information from spatially distinct portions of an object. Some of the plurality of spatially and spectrally distinct optical channels in various implementations of the dual band DAISI including MWIR and LWIR FPAs can have a field of view (FOV) that is different from the field of view (FOV) of some other of the plurality of spatially and spectrally distinct optical channels. Some of the plurality of spatially and spectrally distinct optical channels in various implementations of the dual band DAISI including MWIR and LWIR FPAs can have a field of view (FOV) that is lower than the field of view (FOV) of the entire system.
References throughout this specification to “one embodiment,” “an embodiment,” “a related embodiment,” or similar language mean that a particular feature, structure, or characteristic described in connection with the referred to “embodiment” is included in at least one embodiment of the present invention. Thus, appearances of the phrases “in one embodiment,” “in an embodiment,” and similar language throughout this specification may, but do not necessarily, all refer to the same embodiment. It is to be understood that no portion of disclosure, taken on its own and in possible connection with a figure, is intended to provide a complete description of all features of the invention.
In the drawings like numbers are used to represent the same or similar elements wherever possible. The depicted structural elements are generally not to scale, and certain components are enlarged relative to the other components for purposes of emphasis and understanding. It is to be understood that no single drawing is intended to support a complete description of all features of the invention. In other words, a given drawing is generally descriptive of only some, and generally not all, features of the invention. A given drawing and an associated portion of the disclosure containing a description referencing such drawing do not, generally, contain all elements of a particular view or all features that can be presented is this view, for purposes of simplifying the given drawing and discussion, and to direct the discussion to particular elements that are featured in this drawing. A skilled artisan will recognize that the invention may possibly be practiced without one or more of the specific features, elements, components, structures, details, or characteristics, or with the use of other methods, components, materials, and so forth. Therefore, although a particular detail of an embodiment of the invention may not be necessarily shown in each and every drawing describing such embodiment, the presence of this detail in the drawing may be implied unless the context of the description requires otherwise. In other instances, well known structures, details, materials, or operations may be not shown in a given drawing or described in detail to avoid obscuring aspects of an embodiment of the invention that are being discussed. Furthermore, the described single features, structures, or characteristics of the invention may be combined in any suitable manner in one or more further embodiments.
The features recited in claims appended to this disclosure are intended to be assessed in light of the disclosure as a whole, including features disclosed in prior art to which reference is made.
At least some elements of a device of the invention can be controlled—and at least some steps of a method of the invention can be effectuated, in operation—with a programmable processor governed by instructions stored in a memory. The memory may be random access memory (RAM), read-only memory (ROM), flash memory or any other memory, or combination thereof, suitable for storing control software or other instructions and data. Those skilled in the art should also readily appreciate that instructions or programs defining the functions of the present invention may be delivered to a processor in many forms, including, but not limited to, information permanently stored on non-writable storage media (e.g. read-only memory devices within a computer, such as ROM, or devices readable by a computer I/O attachment, such as CD-ROM or DVD disks), information alterably stored on writable storage media (e.g. floppy disks, removable flash memory and hard drives) or information conveyed to a computer through communication media, including wired or wireless computer networks. In addition, while the invention may be embodied in software, the functions necessary to implement the invention may optionally or alternatively be embodied in part or in whole using firmware and/or hardware components, such as combinatorial logic, Application Specific Integrated Circuits (ASICs), Field-Programmable Gate Arrays (FPGAs) or other hardware or some combination of hardware, software and/or firmware components.
While examples of embodiments of the system and method of the invention have been discussed in reference to the gas-cloud detection, monitoring, and quantification (including but not limited to greenhouse gases such as Carbon Dioxide, Carbon Monoxide, Nitrogen Oxide as well as hydrocarbon gases such as Methane, Ethane, Propane, n-Butane, iso-Butane, n-Pentane, iso-Pentane, neo-Pentane, Hydrogen Sulfide, Sulfur Hexafluoride, Ammonia, Benzene, p- and m-Xylene, Vinyl chloride, Toluene, Propylene oxide, Propylene, Methanol, Hydrazine, Ethanol, 1,2-dichloroethane, 1,1-dichloroethane, Dichlorobenzene, Chlorobenzene, to name just a few), embodiments of the invention can be readily adapted for other chemical detection applications. For example, detection of liquid and solid chemical spills, biological weapons, tracking targets based on their chemical composition, identification of satellites and space debris, ophthalmological imaging, microscopy and cellular imaging, endoscopy, mold detection, fire and flame detection, and pesticide detection are within the scope of the invention.
As used herein, a phrase referring to “at least one of” a list of items refers to any combination of those items, including single members. As an example, “at least one of: a, b, or c” is intended to cover: a, b, c, a-b, a-c, b-c, and a-b-c.
If implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. The steps of a method or algorithm disclosed herein may be implemented in a processor-executable software module which may reside on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that can be enabled to transfer a computer program from one place to another. A storage media may be any available media that may be accessed by a computer. By way of example, and not limitation, such computer-readable media may include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that may be used to store desired program code in the form of instructions or data structures and that may be accessed by a computer. Also, any connection can be properly termed a computer-readable medium. Disk and disc, as used herein, includes compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk, and blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above also may be included within the scope of computer-readable media. Additionally, the operations of a method or algorithm may reside as one or any combination or set of codes and instructions on a machine readable medium and computer-readable medium, which may be incorporated into a computer program product.
Various modifications to the implementations described in this disclosure may be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other implementations without departing from the spirit or scope of this disclosure. Thus, the claims are not intended to be limited to the implementations shown herein, but are to be accorded the widest scope consistent with this disclosure, the principles and the novel features disclosed herein.
Certain features that are described in this specification in the context of separate implementations also can be implemented in combination in a single implementation. Conversely, various features that are described in the context of a single implementation also can be implemented in multiple implementations separately or in any suitable subcombination. Moreover, although features may be described above as acting in certain combinations and even initially claimed as such, one or more features from a claimed combination can in some cases be excised from the combination, and the claimed combination may be directed to a subcombination or variation of a subcombination.
The present application is a continuation of U.S. application Ser. No. 17/115,261 filed on Dec. 8, 2020, which is a continuation of U.S. application Ser. No. 16/256,967 filed on Jan. 24, 2019, which is a continuation of U.S. application Ser. No. 14/700,567 filed on Apr. 30, 2015, which claims benefit under 35 U.S.C. § 119(e) of U.S. Provisional Application No. 61/986,886, filed on May 1, 2014 and titled “Dual Band Divided Aperture Infrared Spectral Imager (DAISI) for Chemical Detection,” and of U.S. Provisional Application No. 62/082,594, filed on Nov. 20, 2014 and titled “Dual-Band Divided-Aperture Infra-Red Spectral Imaging System.” The disclosure of each of the above identified patent application is incorporated by reference herein in its entirety. U.S. application Ser. No. 14/700,567 also claims the benefit under 35 U.S.C. § 119(e) of U.S. Provisional Patent Application No. 61/986,885, filed May 1, 2014, titled “MINIATURE GAS AND CHEMICAL IMAGING CAMERA;” of U.S. Provisional Patent Application No. 62/012,078, filed Jun. 13, 2014, titled “MINIATURE GAS AND CHEMICAL IMAGING CAMERA;” of U.S. Provisional Patent Application No. 62/054,894, filed Sep. 24, 2014, titled “MOBILE GAS AND CHEMICAL IMAGING CAMERA;” of U.S. Provisional Patent Application No. 62/055,342, filed Sep. 25, 2014, titled “MOBILE GAS AND CHEMICAL IMAGING CAMERA;” of U.S. Provisional Patent Application No. 62/055,549, filed Sep. 25, 2014, titled “MOBILE GAS AND CHEMICAL IMAGING CAMERA;” and of U.S. Provisional Patent Application No. 62/082,613, filed Nov. 20, 2014, titled “MOBILE GAS AND CHEMICAL IMAGING CAMERA.” The disclosure of each of the above identified provisional patent applications is incorporated by reference herein in its entirety. U.S. application Ser. No. 14/700,567 also claims the benefit under 35 U.S.C. § 119(e) of U.S. Provisional Patent Application No. 62/021,636, filed Jul. 7, 2014, titled “GAS LEAK EMISSION QUANTIFICATION WITH A GAS CLOUD IMAGER;” of U.S. Provisional Patent Application No. 62/021,907, filed Jul. 8, 2014, titled “GAS LEAK EMISSION QUANTIFICATION WITH A GAS CLOUD IMAGER;” and of U.S. Provisional Patent Application No. 62/083,131, filed Nov. 21, 2014, titled “GAS LEAK EMISSION QUANTIFICATION WITH A GAS CLOUD IMAGER.” The disclosure of each of the above identified provisional patent applications is incorporated by reference herein in its entirety.
| Number | Date | Country | |
|---|---|---|---|
| 61986886 | May 2014 | US | |
| 62082594 | Nov 2014 | US | |
| 61986885 | May 2014 | US | |
| 62012078 | Jun 2014 | US | |
| 62054894 | Sep 2014 | US | |
| 62055342 | Sep 2014 | US | |
| 62055549 | Sep 2014 | US | |
| 62082613 | Nov 2014 | US | |
| 62021636 | Jul 2014 | US | |
| 62021907 | Jul 2014 | US | |
| 62083131 | Nov 2014 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 17115261 | Dec 2020 | US |
| Child | 18472891 | US | |
| Parent | 16256967 | Jan 2019 | US |
| Child | 17115261 | US | |
| Parent | 14700567 | Apr 2015 | US |
| Child | 16256967 | US |
