Not Applicable
Not Applicable
1. Field of the Invention
This application relates to the integration of multiple hyperspectral imagers, lighting and associated hardware in a sealed enclosure for sample examination.
2. Prior Art
The invention is mainly directed to a high spatial and spectral resolution hyperspectral imaging workstation that is capable of capturing hyperspectral images in the ultraviolet (UV), visible, very near infrared (VNIR), and short wave infrared range (SWIR) portions of the electromagnetic spectrum. In particular, the hyperspectral imaging workstation according to the invention includes sensors for acquiring separate image data sets in the 200-400 nanometer range (UV) 400-700 (Visible) in the 400-1000 (VNIR) and 900-2,500 nanometer (SWIR) ranges. The system is a complete enclosure that houses all of the necessary hardware including lighting, imagers, and hardware controls that can be self sufficient, enabling targeted substances under observation to be safely examined. The system according to the invention is capable of performing wavelength specific feature extraction and other spectral comparisons on the resulting data sets.
The present invention possesses many benefits and advantages over known single hyperspectral systems. By incorporating multiple imaging systems and associated controls in one sealed box, samples are able to be viewed in numerous light situations and camera configurations, and since the box is sealed, toxic substances can be viewed and analyzed without fear of contamination. The integrated software is able to take the information from the imagers and process and display an image in a relatively short amount of time. Because the computer is integrated into the system data is processed quickly and effectively. It is difficult to position the camera, lights and sample position, even in the best of circumstances. With this invention, multiple imagers, lights and the arrangement of sample position is controlled by a series of tracks controlled by integrated software.
Hyperspectral imaging, systems in general are known, and have been used for a diverse range of remote sensing and other analytical techniques, such as are disclosed, for example, in U.S. Pat. No. 5,790,188, to Xiuhong Sun, 1998 Aug. 4 and the related U.S. Pat. No. 6,211,906 to Xiuhong Sun, 2001 Apr. 3. Hyperspectral imaging has also been used in conjunction with microscopic optical systems, such as disclosed, for example, in U.S. Pat. No. 6,495,818 to Chengye Mau, 2002, Dec. 17. Dual systems are disclosed in U.S. Pat. Application No. 20090128802, Patrick, J et al, 2009, May 21, yet the pulsed laser doesn't cover the entire spectrum, and a near infrared camera and ambient light source to illuminate the sample and the spectrograph uses Raman to collect and analyze data. In such systems, radiation reflected by or emanating from a target or specimen is detected in a large number of narrow contiguous spectral bands, producing a data set which is distributed not only spatially, but spectrally as well. That is, for each pixel within an image of the target, information is recorded in each of the spectral bands, thereby producing a three-dimensional hyperspectral image cube, in which spectral information for each pixel is distributed across a spectral axis perpendicular to the spatial axis. In U.S. patent application Ser. No. 12/924,831 the system is enclosed and an image is generated by a SWIR hyperspectral imaging device and the camera, a RGB camera and other items that enable the “on the move” explosives detection as well as stationary. This device., although mobile does not provide a sealed environment for examining potentially dangerous substances, as well as the flexibility to choose any number of imaging devices that run the gamut from 200-2500 nm (UV-Shortwave Infrared). In addition, the light source used is tuned to emit one frequency, in a closed and multi-imaging device setup it is optimal to have one light source that can output light across the whole electromagnetic spectrum. Control rests on integrated components, which is essential for integrated operation.
Heretofore, no such workstation has been available which produces highly correlated contiguous spectral band data throughout a range from 200 to 2,500 nanometers; that is, including not only the SWIR range, but the UV and Visible ranges as well. In this cabinet four imaging sensors are seated. Other configurations, such as disclosed in U.S. Pat. Application No. US 2003/0123056, Barnes 2003, Jul. 3, use a mounted digital camera, a thermal sensor and calibrated light sources and radiometric correction. This setup is reasonable for detecting images in a specified spectral range, and with calibrated light sources, instead of full spectrum, images created in a wide spectrum, 200-2500 nanometer spectral range. In addition, capturing images using a digital camera is not desired in a precision system, which captures images using imaging systems and processed using a dedicated computer.
Accordingly, one object of the present invention is to provide a hyperspectral imaging workstation that includes sensors for acquiring separate image data sets in the ultraviolet, the visible and shortwave-infrared ranges of the electromagnetic spectrum.
Another object of the present invention is to provide a sealed system, accessible either directly or via the glove port. In a 4 camera system, integrated computer and associated devices and specialized software that control the unit physically and virtually through the manipulation and display software are not discussed previously in this exact configuration.
These and other objects and advantages are achieved by the imaging apparatus according to the present invention which includes UV, Visible and SWIR sensors together in a single enclosure. Each sensor captures an image of the target or specimen, resulting in respective UV, Visible and SWIR data sets which are then merged into a single imaging data set which includes highly correlated contiguous spectral bands throughout a range of from 200 to 2,500 nanometers, or are provided separately per end-user software settings.
In Patent Application US 2009/128802, Treado, 2009, May, 21, teaches a dual optical system and video capture device for detection of explosives and residue. The sample is excited by a pulsed Nd. YAG laser light source giving an output is plasma emitted photons at 1064 nm, a second wavelength of 532 nm for RAMAN scattered and illuminates the sample at a third wavelength of 266 nm to produce luminescence emitted photons. The device can detect samples above and beneath the ground.
Using a sealed, single light source with a spectrum of light output and 4 imaging devices that cover the entire spectrum generating a hyperspectral datacube for complete coverage of the entire spectrum and an image that is generated by utilizing one or many cameras to create an image is preferential to the above mentioned Patent.
U.S. Pat. No. 7,684,029, Tan, 2010 Mar. 23 teaches that multiple sensors can give you output that can then be used to codify data. However, ambient light is used and the sensors are tied to an emergency response system and produce output based on the ambient light situation. Not only do multiple sensors, tied to imaging devices produce high-quality data used in analysis, but the scope of this system is limited by its open environment. Closed, sealed, supplemental lighting provides a better environment for examining samples than open systems.
An enclosed hyperspectral imaging device that will use a multitude of hyperspectral ranges, fluorescence features, polarized filtration, zoom lenses, and confocal capabilities. The system would also have related imaging attachments, and triggered lights for multiple ranges. This system would have a high throughput and processing computer system with a large volume data storage and redundancy in order to process large data loads quickly and efficiently. The system is setup to analyze samples close up from large quantities to micro quantities and later in gaseous forms so that viable libraries and classification features can he constructed. In addition, this system can be used to examine said micro-quantities of biological material, gaseous chemical components and trace chemicals. Utilizing the included components, libraries of items can be created and these libraries, databases and classification algorithms can then be used by this imaging enclosure as well as ultimately, hand held units in the field as well as to strengthen stand-off imaging procedures that are both new and existing.
The system according to one aspect of the invention permits the detection and analysis of small nuances and information that are otherwise undetectable in systems that use a wide swath filter. Also, the entire said range, from 200 to 2,500 nanometers can be used to identify pertinent wavelengths across a wide yet largely defined region of the electromagnetic spectrum for a wide variety of applications that can be programmed as algorithms within the system, or used to develop derivative systems. For example, certain inks that need to be defined when looking at genuine versus counterfeit documents may show regions of interest in both the UV and IR ranges, while others may be found within the visible portion of the electromagnetic spectrum.
Furthermore, in another aspect of the invention, the combination of a controlled lighting environment and the ability to use National Institute of Standards and Technology (NIST) traceable diffuse reflectance standards with each scan insures consistent and reproducible results.
The system according to the invention is run by a programmed data processor/software or computer that triggers the lights, hyperspectral cameras and computerized translation stage to acquire and process a fully explorable hyperspectral data cube. The translation stage moves beneath the sensors, allowing the line slit on the optical devices to acquire the entire target. The latter process is performed separately by both cameras, within separate ranges. Thereafter, the resulting data sets are combined in a known manner or provided separately per end-user software settings.
Other objects, advantages and novel features of the present invention will become apparent from the following detailed description of the invention when considered in conjunction with the accompanying drawings.
Some of the features, advantages and benefits of the present invention having been stated, others will become apparent as the description proceeds when taken in conjunction with the accompanying drawings in which:
Reference will now be made to the detailed embodiment of the invention. The invention pertains to the creation of an enclosed hyperspectral and/or multi spectral and/or ultraspectral and/or full spectrum and/or full frame and/or scanning imaging device that will use a multitude of spectral ranges, fluorescence features, polarized filtration, zoom lenses, and con-focal capabilities. The system would also have related imaging attachments, and triggered lights for multiple ranges. This system would have a high throughput and processing computer system with large volume data storage and redundancy in order to process large data loads quickly and efficiently. This system would be used to analyze explosives and/or other targets close up from large quantities to micro quantities and feature upgradeable transmission containers for imaging specific targets in their gaseous forms so that viable libraries and classification features can be constructed. These libraries, databases and classification algorithms can then be used by hand held units (such as PDAs and PC tablets) in the field as well as to strengthen stand-off imaging procedures that are both new and existing.
The system collectively will be constructed so that it can hold multiple imaging devices (such as UV, VNIR, SWIR, LWIR). Each device will be on a separate up and down linear stage in order so that the system can be controlled for positioning to the target and will incorporate focus methodologies via software and hardware control and positioning. This focusing method will include standard focusing methods, manual focusing methods, and refined procedures using fine focus algorithms and lithography lines and/or focusing plates.
The device will be fully enclosed from the outside environmental concerns such as lighting, movement, shadows, etc. The imaging systems will be positioned to the front of the enclosure via a rotational stage controlled by the control software. All four linear stage positions will be mounted to and around the rotational stage. All transport ports will be assigned and mounted inside and outside of the enclosure in order to keep out the outside environmental factors. The system will use computer control in the form of large scale, small scale, and/or GPU and FPGA computer processing and control. The device will incorporate intelligent chip features in order to upgrade the classification and processing functionality of the device in order for the device to move from research mode to answer/classification mode. There will be a monitor, keyboard, pointing device. The system will incorporate calibration methodologies including LED, OLED, white reference, radiometric properties, and other standard calibration methodologies including but not limited to spheres, lasers, and reflective/diffusion targets.
The invention will have the imaging enclosure on top and the computer and storage located in the bottom section of the system.
The enclosure will have connection for exhaust fan, ozone eaters, coolant connections, and power. There will also be triggers for shutters and light sources.
Now, referring to
The internal working parts of the system (
The movement of the components of the system is controlled by an integrated computer. This computer not only controls the hardware movements of the system, the software also processes the information gleaned from the imager scans and processes and analyzes it so that the image can be manipulated and viewed at the frequency that has been chosen by the user.
The imaging device performs all the functions that are needed for sample operation and analyization. The enclosure ensures that the sample environment is sealed and the samples are isolated. There are provisions for glove attachment (
Operation involves selecting the imaging devices and positioning them (
The sample needs to be placed on the sample stage (
The entire system is designed to be a complete solution for imaging, for instance hyperspectral imaging with a range of UV to SWIR, sealed, user-defined positioning, computer and ancillary controls and a unique design for manipulating the imaging and specialized lighting devices within the enclosure.
From the above embodiments, it becomes evident that a number of advantages become evident.
Accordingly, the reader will see that the complete research cabinet offers the advantage of a unique design for the imaging unit which provides movement of the imagers and lights in a multitude of directions as controlled by specialized software and an integrated computer housed in the enclosure.
The imagers are flexible—they are chosen based on the application at hand. They can cover the range of UV to SWIR (200 nm-2500 nm). They are manufactured with state-of-the are sensors, including sCMOS and in the future carbon nanotubes. The movement of the focal plane and sensor assembly is under patent consideration.
The entire system is sealed enabling samples that run the gamut from explosives residue, gas, and biological samples. By integrating all of these functions, and using the locking casters, the system can virtually move anywhere these functions are needed.
Although the description above contains much specificity, these should not be construed as limiting the scope of the embodiments but as merely providing illustrations of some of the presently preferred embodiments. For example, as technology progresses the imager make up, shape, size and other parameters could change. In addition, the range of nanometers covered could expand. Specified lighting can be upgraded as well as the physical size and shape of the cabinet enclosure and internal workings for controlling the devices. The computer will be upgraded as well as the internal components of the imagers (
This patent is a continuation-in-part of application 61/331,429 filed May 5, 2010, entitled “Hyperspectral and Multiple Imaging Controlled Enclosure for Explosives and Target Development.” This patent has been incorporated for reference.