Not Applicable
Not Applicable
1. Field of the Invention
This application relates to the field of carbon nanotube pixel-level sensors, emitters, associated electronics and image processing.
2. Prior Art
The field of sensor array based systems have been discussed in detail elsewhere. Sensor arrays have been fabricated out of many materials, including CMOS, sCMOS, carbon nanotubes and others. These systems use each pixel element in the array to capture data, light or other function. Some of these units use multiple layers, or other configurations to capture the light onto each sensor unit in the array. Carbon nanotubes have been used to make many devices, including sensors, FETs, electrochemical, electromechanical as well as conductor applications. These devices take advantage of the fact that the two types of nanotube configurations, SWCNTs (single walled carbon nanotubes), and MWCNTs (multiwalled carbon nanotubes) each have different properties.
Carbon nanotubes are made of a carbon-based tube-shaped material that can be described as graphitic sheets, also called graphene sheets, rolled into a tube that has a diameter measuring on the nanometer scale. A nanometer is one-billionth of a meter, or about one ten-thousandth of the thickness of a human hair. Carbon nanotubes are unique “one dimensional systems” which can be envisioned as rolled single sheets of graphite (or more precisely graphene). This rolling can be done at different angles and curvatures resulting in different nanotube properties. Those tubes, or cylinders, can be closed at both extremities due to the introduction of pentagons into the hexagonal graphitic lattice. The graphite layer appears somewhat like a rolled-up chicken wire with a continuous unbroken hexagonal mesh and carbon molecules at the apexes of the hexagons
Two types of carbon nanotubes are known: Single-Walled Carbon Nanotubes (SWCNT) and Multi-Walled Carbon Nanotubes (MWCNT). Depending on how the grapheme sheet is wrapped into a tube, three different types of single-walled carbon nanotubes are built: zig-zag, armchair, and chiral. This structural feature is called chirality and describes the twist of a tube. In order to determine in which way a tube is twisted, or, in other words, its chirality, one has to count the number carbon atoms moving along the unit vectors a1 (n) and a2 (m) from a carbon atom to its equivalent one on the lattice. A single-wall carbon nanotube can be imagined as graphene sheet rolled at a certain “chiral” angle with respect to a plane perpendicular to the tube's long axis. Photoluminescence from SWCNT, as well as optical absorption and Raman scattering, is linearly polarized along the tube axis.
When the diameter of a nanotube is small, a precise measurement of diameter can reveal its chirality since there is one-to-one correspondence between these two quantities. Consequently, SWCNT can be defined by its diameter and chiral angle. The chiral angle can range from 0 to 30 degrees. However, more conveniently, a pair of indices (n, m) is used instead. The indices refer to equally long unit vectors at 60° angles to each other across a single 6-member carbon ring. In MWCNT their lengths are from hundreds of nanometers to tens of micrometers, with diameter of few to hundreds of nanometers.
The diameter typically varies in the range 0.4-40 nm (i.e. “only” ˜100 times), but the length can vary ˜10,000 times reaching 18.5 cm. Thus the nanotube aspect ratio, or the length-to-diameter ratio, can be as high as 132,000,000 which is unequalled by any other material. Consequently, all the properties of the carbon nanotubes relative to those of typical semiconductors are extremely anisotropic (directionally dependent) and tunable.
Carbon nanotubes have many structures, differing in length, thickness, and in the type of helicity and number of layers. Although they are formed from essentially the same graphite sheet, their electrical characteristics differ depending on these variations, acting either as metals or as semiconductors. As a group, Carbon Nanotubes typically have diameters ranging from <1 nm up to 50 nm. Their lengths are typically several microns, but recent advancements have made the nanotubes much longer, and measured in centimeters. Light-emitting diodes (LEDs) and photo-detectors based on a single nanotube have been produced. For specific information on carbon nanotubes reference “Carbon Nanotubes,” M. S. Dresselhaus, G. Dresselhaus, Ph. Avouris (Eds.), Topics in Applied Physics, 80, ISSN: 0303-4216 (printed version), ISSN 1437-0859 (electronic version).
In reference 1, it is stated that the injected electrons and holes are confined in the nanotube structure, and when they meet, they are neutralized. If their net momentum is zero and they have opposite spin, they can recombine and give off the recombination energy in the form of light, this mode of recombination takes place, and produces a single-molecule, electrically controlled light source. Unlike conventional light-emitting diodes, which involve fixed p-n junctions produced by doping, the SWCNT light source is a three-terminal device that involves no doping and also allows control of the emission intensity and the position of the emitting spot along the length of the CNT.
The diameter of the CNT defines the wavelength of the emitted light, typically in the infrared range. The reverse process of photocurrent generation with a significant yield by photoexcitation of a CNTFET device has also been demonstrated. This single CNT device can function as an electrical switch, a light emitter, or a light detector, depending on the biasing.
In reference 2, the work states that it has been shown that light emission can be observed from a single nanotube by appropriate choice of gate and drain voltage. In that case the number of photons is proportional to the number of electrons (the electron current) and the number of recombination attempts (given by the number of holes, i.e. the hole current). Thus the number of emitted photons is proportional to the product of hole and electron current. Both models lead to an exponential increase of the number of emitted photons with applied drain voltage (at the maximum value for Vg=Vd=2). This follows naturally from the variation of the OFF current because the voltage requirement for maximum light emission is identical to the OFF state.
The manufacture and setup of optical sensors and arrays is discussed elsewhere, such as in U.S. Pat. No. 7,780,918, to Brent M. Segal et al Aug. 24, 2010. In U.S. Pat. No. 7,129,467 to Wincheski et al. Oct. 31, 2006, a description of a carbon nanotube based light sensor is described. This sensor indicates that carbon nanotubes are deposited on a substrate and electrical circuitry provided to use the carbon nanotubes as conductors and has means for detecting the voltage of the nanotube array elements. In addition, it outlays the means for manufacturing the semiconductive base and which substances are used to modify said sensor.
Carbon nanotube devices have been thoroughly discussed and their photoabsorbtion quality known, as in U.S. Pat. No. 7,459,312, to Hongjie Dai and Robert J. Chen, Dec. 2, 2008, that describes a method of desorbing molecules from nanotubes using UV light, as well as applying a voltage across the nanotube to detect the change in the electrical properties of the nanotube.
In U.S. Pat. No. 7,286,210 to John W. Pettit, Oct. 23, 2007, a carbon nanotube passive sensor that operates by causing a wavelength dependent change in the optimal characteristics of CNT material. This patent is for a system that is not dependent on the amplitude of the signal and does not affect encoded material sent through an optical network to be received by this CNT sensor. This invention design describes the carrying of signaling information in a network and provides proper transference of the information regardless of amplitude changes in the signal.
In U.S. Pat. No. 6,632,701, to Richard B. Merrill, Oct. 14, 2003 describes how a multilayer quantum well works and the row and column feeds for the specific detector layer for the three individual well layers. The active pixel sensors in this case are three absorption layers near the semiconductor surface, employing red, green and blue sensitive layers out horizontally in a pattern. The pixel container system utilizes CNT sensors of similar detection value located in each pixel container but collecting the data in a similar manner. The individual spectral sensors located in each pixel container could represent more than just the red, green and blue primaries by having many CNT sensors located in each pixel container. So that a CNT sensor located in all the containers and sensitive to visible light could all be collected as a single layer whereas another CNT sensor sensitive to infrared light and also located in each pixel container could collect data for the infrared frequency represented. These layers and a plurality of many different layers could then be collected and represented in a common hyperspectral data cube for processing.
In U.S. Pat. No. 7,645,497 to Todd M. Spath, Jan. 12, 2010 provides alternatives to conventional substrates and provides a more stable medium for holding the carbon nanotube. Also the layering technology could also support additional functionality the carbon nanotubes when they are in place. The technology described herein is more in line with display systems and how the polymer materials utilized can make a longer lasting display. OLED technology utilizing SWCNT technology is geared towards utilizing mass production polymer technology which utilizes much higher temperatures in producing these substrates.
Sensor processing systems in general are known, and have been used for a diverse range of image sensing processes such as disclosed in, for example, in U.S. Pat. Application No. 2007/0041063 to Kitada and Takashi, Feb. 22, 2007 and the related U.S. Pat. No. 7,646,074 to Anderson, et al., Jan. 5, 2010. 7,661,075 to Anderson, et al., Feb. 9, 2010. Recently, carbon nanotubes have been used as sensor components such as in U.S. Pat. No. 7,642,582 to Cheon-Man Shim, Jan. 12, 2010.
U.S. Pat. Application No. 2009/0302411 to Dominic Massetti, Dec. 10, 2009 incorporates a carbon nanotube sensor, but has chosen to illuminate the sensor from the backside and contains filters to filter out unwanted wavelengths of radiation, such as infrared light. Using a sensor that can capture a wide range of electromagnetic radiation, from a single nanotube or N-number of nanotubes is desirable.
In Pat. Application No. U.S. 2007/0206242, Scott Smith, 2007, Sep. 6, explained that each pixel has a hyperspectral filter, which means a very narrow bandwidth at a specific frequency; which also means that it only gets data for a specific frequency at only that particular location. Even though an image could be produced this is limited to detecting a lot of individual spectral frequencies fast. So each has a lens and HSI filter on each pixel. The main advantage is speed. This system does not produce a DATCUBE, it is impossible to do so because you are not looking at an entire image for each spectral slice only one to a few pixels. It is classed as a multi array image sensor.
In U.S. Patent Application 2008/0225148 Christopher Parks, Sep. 18, 2008, eludes to the fact that there is an image sensor to replace existing ones. Their invention relates to the field of CMOS active pixel images and reducing the size if the pixel, they do not collect the image sensors into a pixel.
In Patent Application No. U.S. 2005/0248768 Nov. 10, 2005 using CNT, their system has the benefits of a passive optical sensor which operates by causing a wavelength-dependent change in the optical characteristics of a carbon nanotube. Both of these do not collect them into a container device to act as a pixel with many spectral frequencies.
In these and other carbon nanotube implementations, nanotubes devices that exhibit flexibility in sensitivity to and emission of electromagnetic radiation in pixel container integrated into an imaging system are desirable. For instance, changing the frequencies to which individual or groups of nanotubes sense electromagnetic radiation enables the collection of a spectrum of light at each pixel container and at each individual pixel element.
These pixel containers hold from 1-N carbon nanotube sensing and emitting units. By using both sensing and emitting elements, it is possible to have both an imaging and range finding capability in one container. By integrating these two capabilities, it is possible to create a 3D image that can be used in many different settings including at the cellular level. In previous implementations, these iterations have been separated and not applicable to imaging systems. In addition, practical applications have been limited, due to the fact that most implementations simply integrate testing protocols with the sensor design.
The present invention is directed to overcoming the above mentioned challenges and others related to carbon nanotube devices and their implementations. The present invention is exelempfied in a number of implementations and applications, some of which are summarized below.
According to the example embodiment of the present invention, the system is receives and/or emits optical electromagnetic radiation using carbon nanotubes in a wide variety of spectral frequencies. The containers that hold at least one to a plurality of carbon nanotubes are the pixel elements, which together make up a complete sensor. The pixel container includes carbon nanotube sensor elements, which are chosen based on the wavelength of light that can be sensed or emitted. They are linked by a row and column scheme throughout the entire sensor, and are accessed when each spectral layer (frequency) is read.
In one embodiment, the nanotube sensor elements receive light and via connections with the integrated electronics, and produce a voltage. This signal is read by the electronics and passed to the other parts of the sensor package. This signal is interpreted by the system, and related to each pixel container in the system which ultimately reads the range of electromagnetic signals and produces a 2D or 3D data cube.
The pixel containers are arranged such that the imager can read one row or one column at a time, or using binning, a group of pixel containers in one location. The model for the imaging system is based on a hyperspectral imager, but could be replaced by another imager as technology progresses.
The sensor setup is composed of two lenses to focus the light, which can be moved as the imaging dictates, a focal plane shutter, either a traditional one, in one embodiment, an iris focal plane, or none at all, for the emitter setup, another focusing lens and the sensor which is composed of one or a plurality of pixel containers in a row and column configuration. The spectral camera system can then be constructed in such a manner that it can contain traditional focal and focus plane adjustments.
In each of these pixel containers one or n number of carbon nanotubes reside, and are grouped based on the electromagnetic frequency they can sense or emit. These nanotubes can be arranged, vertically or horizontally or other configuration. Each pixel container receives a particular spectrum of light and in turn generates voltage. The attached electronics can be layered or sitting next to the pixel containers. They process the voltage and perform AC/DC conversion, or other basic functions. Each nanotube is connected via nanoelectronics to further processing systems.
In another embodiment, the sensor elements emit or fluoresce based on the bias voltage applied to one or a plurality of emitters contained in the pixel container. The sensor elements, carbon nanotubes, when grouped or activated at the same time can produce a particular spectrum of light.
The signal travels along the electronics coupled with the system, which perform functions such as row to column, AC/DC conversion and other functions. This signal then travels to a waiting processing device, via nanowires, such as a computer, which could have 1 to many cores and attached GPGPU. The theorems needed to process the sensor data can be processed by the multiple cores and fed to a ROM that contains all of the theorems and other necessary processing routines. After processing, the resulting image is displayed on a viewing device and manipulated with software
The GPU C programming environment simplifies many-core programming and enhances performance by offloading computationally-intensive activities from the CPU to the GPU. It enables developers to utilize the Graphics Processing Units (GPU's) to solve the most complex computation-intensive challenges.
Other objects, advantages and novel features of the present invention will become apparent from the following detailed description of the invention when considered in conjunction with the accompanying drawings.
Some of the features, advantages and benefits of the present invention having been stated, others will become apparent as the description proceeds when taken in conjunction with the accompanying drawings in which:
In the following detailed description of the embodiments reference is made to the accompanying drawings, that show by way of illustration, specific embodiments of the invention. Reference will now be made to the detailed embodiments of the invention. In the drawings, like numerals describe similar components throughout several views. Other embodiments may be utilized and structural and logical and electrical changes can be made without departing from the scope of this invention. Moreover it is understood that the embodiments of the invention although different are not necessarily mutually exclusive. The following detailed description is therefore, not to be taken in a limiting sense, and the scope of the present invention is defined by the appended claims, along with the full scope of equivalents to which said claims are entitled.
This design contains specific elements that are currently available, but it does not limit future technology developments.
In reference to
In
In
The diagram in
The sixth embodiment of the invention is outlined in
The diagram in
In
The various embodiments described above are provided by illustration only and should not be construed to limit the scope of the invention. In addition, for more information regarding carbon nanotubes, and implementations that may be used in connection with the present invention, reference may be made to the attached references which form a portion of the underlying patent document and are incorporated herein by reference.
From the above embodiments, it becomes evident that a number of advantages become evident.
a) Carbon nanotube technology is just starting to be utilized in the mainstream for displays, FET, ring oscillators, biological, mechanical, gaseous sensors, and a host of other applications.
b) Sensors have morphed from traditional CCD arrays, to CMOS, sCMOS and ultimately carbon nanotubes. By using these sub-micron units; that are virtually stronger than steel, impervious to EMT pulses, and have shown the capability to both absorb light and produce a voltage as well as receive a voltage and fluoresce, sensors have evolved by leaps and bounds.
c) It has been shown using spectroscopy and Raman, that nanotubes can absorb different wavelengths of light depending on the diameter and chirality of the nanotube. This factor in particular makes them a perfect candidate for an optical sensor. A sensor that is combined with an imaging system; takes in light in a wide range of frequencies and converts the signals and output into a 2D or 3D datacube.
d) By using carbon nanotubes, not only is the sensor very small, but it takes the place of the point that slows the system down, the scanning operation and the spectrograph. By replacing these elements in a system, the light impinges, through a series of lenses, directly with the sensor.
e) The sensor is contained of pixel containers, each which has 1-N number of sensor elements, which are carbon nanotubes. These nanotubes produce a voltage that is then manipulated by the sensor electronics and fed into a CPU/GPGPU.
f) By using this sensor system, the slow aspects of imaging that sometimes plagues traditional imaging devices, is eliminated, and is replaced by a fast row and column imaging scheme.
g) By using emitters in the system, carbon nanotubes, that with an applied voltage fluoresce, the entire device can receive light, analyze it and collect the data from the emitters enabling lighting and absorption from the same sensor.
Accordingly, the reader will see that the complete system introduces new technology on a macro and micro-scale.
The units are flexible—they are chosen based on the application at hand. They can be used with existing and future technology. They are manufactured with state-of-the are sensors, including sCMOS and in the future carbon nanotubes. The movement of the focal plane and sensor assembly is under patent consideration.
The entire system is enclosed in a compact footprint, under 3 pounds or less. By integrating all of these functions, the system is able to remove the data burden and move it from the external device to the sensor via high-speed bus.
Although the description above contains much specificity, these should not be construed as limiting the scope of the embodiments but as merely providing illustrations of some of the presently preferred embodiments. For example, as technology progresses the system make up, shape, size and other parameters could change. In addition, as illustrated in figures (
1. Phaedon Avouris and Joerg Appenzeller, “Electronics and Optoelectronics with Carbon Nanotubes”, The Industrial Physicist, 21.
2. Carbon Nanotube Optics and Optoelectronics, S.Heinze et al., Institute of Applied Physics, University of Hamburg, Jungiusstrasse 11, 20355, Hamburg Germany.
3. Achim Hartschum “Simultaneous Fluorescence and Raman Scattering from Single Carbon Nanotubes,” Science, 2003, 301, 1354.
4. A. Mohite, S. Chakraborty, P. Gopinath et al, “Displacement current detection of photoconduction in carbon nanotubes,” Applied Physics Letters, 2005, 86, 061114.
5. The Science and Technology of Carbon Nanotubes, K. Tanaka, T. Yamabe, K. Fukui (Eds.) Elsevier, 1999.
6. R. Martel et al. “Single- and multi-wall carbon nanotube field-effect transistors,” Physics Letters, Vol. 73, No. 17, 26 Oct. 1998.
7. Vasili Perebeinos, J. Tersoff and Phaedon Avouris “Electron-Photon Interaction and Transport in Semiconducting Carbon Nanotubes,” Physical Review Letters, PRL 94, 4 Mar. 2005.
8. Jia. Chen, et al. “Bright Infrared Emission from Electrically Induced Excitons in Carbon Nanotubes,” Science, 310, 1171 2005.
9. Applied Physics of Carbon Nanotubes, Fundamentals of Theory, Optics and Transport Devices. S. V. Rotkin, S. Subramoney (Eds.) Springer-Verlag Berlin Heidelberg, 2005.
10. J. A. Misewich, et al. “Electrically Induced Optical Emission from a Carbon Nanotube FET,” Science 300, 783 2003
This patent is a continuation-in-part of application Ser. No. 61/331,428 filed May 5, 2010, entitled “Real Time Wavelength Selectable Imaging Array and Image Processing System” This patent application has been incorporated for reference.