This application claims the benefit of Japanese Priority Patent Application JP 2013-136220 filed Jun. 28, 2013, the entire contents of which are incorporated herein by reference.
The present technology relates to image capture devices and electronic apparatuses, and more particularly, to an image capture device and an electronic apparatus which are low in cost and simple in configuration and can measure a target object.
As examples of practical use of a filter using surface plasmon polaritons (SPPs) (hereinafter referred to as a “metal thin-film filter”), there have been reports that the filter is used to monitor the growth of viruses or bacteria or test the sensitivity of antibodies (see, for example, Yanik, A. A. et al., Nano Letters 10 (12), 4962-4969 (2010)).
As schematically shown in
Specifically, if, for example, viruses or bacteria are attached to antigens or antibodies immobilized on a surface of the metal thin-film filter to change the refractive index of surroundings of the metal thin-film filter, the spectral distribution of the transmitted light is shifted.
In measurement techniques in the related art, the change amount of the refractive index of surroundings of the metal thin-film filter is obtained by measuring the amount of such a shift of the peak wavelength of the transmission spectrum using a spectrometer, and based on the change amount, the amount of viruses or bacteria present on the metal thin-film filter is determined.
However, in the above measurement technique in the related art, it is necessary to employ a spectrometer for measuring the shift amount of the peak wavelength of the transmission spectrum. In general, devices equipped with a spectrometer are high in cost and complex in configuration. Therefore, there has been a demand for a device which is low in cost and simple in configuration and can measure a target object.
With these circumstances in mind, the present technology has been made to measure a target object using, at low cost and with a simple configuration.
According to a first embodiment of the present disclosure, there is provided an image capture device including a narrow-band optical irradiation system including a light source, a solid-state imaging element including an array of pixels and sensitive to a predetermined range of wavelengths, and a metal thin-film filter provided in an optical path between the optical irradiation system and the solid-state imaging element, and having a periodic microstructural pattern having a period shorter than a wavelength detected by the solid-state imaging element.
The metal thin-film filter may have a property that a spectral distribution of transmitted light is shifted in a wavelength direction due to a difference between the refractive index of a target object tightly attached or located close to the metal thin-film filter and a refractive index of a medium with which a space around the metal thin-film filter is filled. The image capture device may further include a signal processor configured to detect a change in signal intensity of the solid-state imaging element, the change in signal intensity corresponding to a change in transmission efficiency corresponding to the shift of the spectral distribution of transmitted light in the wavelength direction.
The metal thin-film filter may be a thin film of an elemental metal or an alloy and having a thickness of 500 nm or less.
The metal thin-film filter may have at least one periodic microstructural pattern in a surface of the metal thin-film filter, and a fundamental period of the microstructural pattern is not longer than approximately a wavelength of visible light.
The metal thin-film filter may have, as the microstructural pattern, a hole array structure including openings having a diameter of 500 nm or less arranged in a honeycomb array or an orthogonal matrix array.
The metal thin-film filter may have, as the microstructural pattern, a dot array structure including dot-like structures having a diameter of 500 nm or less arranged in a honeycomb array or an orthogonal matrix array.
The metal thin-film filter may have, as the microstructural pattern, a coaxial hole array structure including openings having a diameter of 500 nm or less arranged in a honeycomb array or an orthogonal matrix array, each opening having a coaxial structure in which a dot-like structure is provided at a center of the opening.
The metal thin-film filter may have, as the microstructural pattern, a ring array structure including dot-like structures having a diameter of 500 nm or less arranged in a honeycomb array or an orthogonal matrix array, each dot-like structure having a ring-like structure in which an opening having a diameter smaller than a diameter of the dot-like structure is provided at a center of the dot-like structure.
In the solid-state imaging element, the array of pixels may be divided into a plurality of blocks. In the metal thin-film filter, regions corresponding to adjacent blocks may have the same microstructural pattern. The signal processor may obtain a difference between signals detected by pixels in adjacent blocks to correct an offset between the pixels in the adjacent blocks.
The light source may emit light having a narrow band of wavelengths.
The light source may be a light emitting diode (LED) light source or a laser light source configured to selectively emit electromagnetic waves having a narrow band of wavelengths of a wavelength band to which the solid-state imaging element is sensitive.
The solid-state imaging element may be sensitive to a wavelength range of visible light or near-infrared light.
The metal thin-film filter may be removably attached in the optical path.
The image capture device according to the first embodiment of the present disclosure may include a narrow-band optical irradiation system including a light source, a solid-state imaging element including an array of pixels and sensitive to a predetermined range of wavelengths, and a metal thin-film filter provided in an optical path between the optical irradiation system and the solid-state imaging element, and having a periodic microstructural pattern having a period shorter than a wavelength detected by the solid-state imaging element.
According to a second embodiment of the present disclosure, there is provided an electronic apparatus including an image capture device including a narrow-band optical irradiation system including a light source, a solid-state imaging element including an array of pixels and sensitive to a predetermined range of wavelengths, and a metal thin-film filter provided in an optical path between the optical irradiation system and the solid-state imaging element, and having a periodic microstructural pattern having a period shorter than a wavelength detected by the solid-state imaging element.
The electronic apparatus according to the second embodiment of the present disclosure may include an image capture device including a narrow-band optical irradiation system including a light source, a solid-state imaging element including an array of pixels and sensitive to a predetermined range of wavelengths, and a metal thin-film filter provided in an optical path between the optical irradiation system and the solid-state imaging element, and having a periodic microstructural pattern having a period shorter than a wavelength detected by the solid-state imaging element.
According to the first and second aspects of the present technology, a target object can be measured at low cost and with a simple configuration.
Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the appended drawings. Note that, in this specification and the appended drawings, structural elements that have substantially the same function and structure are denoted with the same reference numerals, and repeated explanation of these structural elements is omitted.
<Configuration of Image Capture Device>
The image capture device 100 of
The light source 111 is included in an optical irradiation system including a lens, a filter, etc. The light source 111 is a monochromatic surface light source which can selectively emit electromagnetic waves having a narrow band of wavelengths, such as a light emitting diode (LED) light source, a laser light source, etc. Light emitted from the light source 111 is transmitted through the metal thin-film filter 112-1, and then received by a light receiving surface of the solid-state imaging element 113.
The metal thin-film filter 112-1 is a thin film of an elemental metal, such as gold (Au), silver (Ag), aluminum (Al), etc., or an alloy thereof, and has a thickness of 500 nm or less. The metal thin-film filter 112-1 has, on a surface thereof, a periodic microstructural pattern on a sub-wavelength scale with respect to a wavelength detected by the solid-state imaging element 113.
Note that, as shown in
The solid-state imaging element 113 is, for example, a two-dimensional solid-state imaging element which includes an array of pixels and is sensitive to a wavelength range of visible or near-infrared light, such as a complementary metal-oxide semiconductor (CMOS) image sensor, a charge coupled device (CDD) image sensor, etc.
The solid-state imaging element 113 receives light which has been emitted from the light source 111 and then transmitted through the metal thin-film filter 112, and outputs a detection signal corresponding to the amount (intensity) of the incident light. The detection signal output from the solid-state imaging element 113 is processed by the DSP 114 and the imaging element controller 115 before being supplied through the bus 116 to the signal processor 117.
The signal processor 117 performs various signal processes described below, such as a process of detecting a change in signal intensity (
The microprocessor 119 controls, via the bus 116, parts of the image capture device 100, such as the imaging element controller 115, the signal processor 117, the light source controller 120, the filter controller 121, etc.
The light source controller 120 controls the light source 111 under the control of the microprocessor 119. As a result, electromagnetic waves having a narrow band of wavelengths are selectively emitted from the light source 111, such as an LED light source etc.
The filter controller 121 controls the metal thin-film filter 112 under the control of the microprocessor 119. As a result, for example, characteristics of the metal thin-film filter 112-1 can be changed.
The user interface 122 receives the user's instruction. The microprocessor 119 controls an operation of each part of the image capture device 100 based on the instruction to the user interface 122.
The image capture device 100 has the above configuration.
<Measurement Method to which the Present Technology is Applied>
As schematically shown in
Here, as shown in
As shown in
Because the metal thin-film filter 112 have such characteristics, if the refractive index of the surroundings in the very vicinity of the metal thin-film filter 112 changes, the spectral distribution of the transmitted light is shifted in the wavelength direction, so that the efficiency of transmission changes with respect to any particular wavelength of interest. If the intensity of light emitted from the light source 111 is the same, the intensity of a signal detected by the solid-state imaging element 113 is proportional to a change in the transmission efficiency. Therefore, by obtaining a change in the signal intensity, it can be determined whether or not viruses or bacteria are attached to antigens or antibodies immobilized on the surface of the metal thin-film filter 112.
In the solid-state imaging element 113, a change in the transmission efficiency is detected in the form of a change in the signal intensity. Specifically, the metal thin-film filter 112 has properties that the spectral distribution of the transmitted light is shifted in the wavelength direction due to a difference between the refractive index of a target object which is tightly attached or located close thereto and the refractive index of a medium with which a space therearound is filled. Therefore, the signal processor 117 detects a change in the signal intensity of the solid-state imaging element 113 as a change in the transmission efficiency which corresponds to the shift of the spectral distribution of the transmitted light in the wavelength direction.
Thus, in the image capture device 100, when a target object is measured, then if the surface light source 111 having a narrow band with a half-width of not more than several tens of nanometers is employed, a shift of the peak wavelength of the transmission spectrum, i.e., a change in the refractive index in the very vicinity of the metal surface of the metal thin-film filter 112, is detected in the form of a change in the signal intensity of the solid-state imaging element 113. Therefore, in the image capture device 100, even when a spectrometer is not provided, it can be determined whether or not viruses etc. are attached to antigens or antibodies immobilized on the surface of the metal thin-film filter 112. Therefore, compared to a device equipped with a spectrometer, a target object can be measured at low cost and with a simple configuration.
<Mapping of Captured Image>
The solid-state imaging element 113 has an array of unit pixels including a photoelectric conversion element which generates an amount of electric charge corresponding to the amount of incident light. In
In
As shown in
Here, it can be seen that, for example, in a pixel P2, 2 of interest in the region of 10×12 pixels shown in
Thus, in the pixel P2, 2, the refractive index changes with time in a corresponding region of the metal thin-film filter 112. This change causes the peak wavelength of the transmission spectrum to be shifted, so that the transmission efficiency proportionately decreases. As a result, in the pixel P2, 2, a detection signal is obtained which has a darker level than those of other pixels corresponding to regions in which a change in the refractive index does not occur.
Here, it can be seen that, for example, in a pixel P6, 9 of interest in the region of 10×12 pixels shown in
Thus, in the pixel P6, 9, a change in the refractive index does not occur in a corresponding region of the metal thin-film filter 112 even after time has passed, and therefore, a corresponding shift in the peak wavelength of the transmission spectrum does not occur. As a result, the transmission efficiency does not substantially change, and in the pixel P6, 9, a detection signal having a constant level is output.
The signal processor 117 obtains a captured image corresponding to such detection signals. Therefore, for example, if smoothing is performed using a plurality of captured images which are obtained at predetermined time intervals, or a difference between each of the captured images is calculated, a change in the signal intensity of a detection signal obtained from a pixel corresponding to a region where a change in the refractive index occurs, can be detected.
Although, in the example of
<Simulation for Verifying Change in Transmission Efficiency>
The transmission wavelength profile of
The change in the transmission efficiency is detected in the form of a change in the signal intensity of the solid-state imaging element 113. Therefore, for example, it can be determined whether or not viruses etc. are attached to antigen or antibodies immobilized on the surface of the metal thin-film filter 112.
<Division of Pixels into Blocks>
In the solid-state imaging element 113, the pixels arranged in the array may be divided into a plurality of blocks. In the metal thin-film filter 112, regions corresponding to adjacent blocks may be caused to have the same microstructural pattern. By calculating differences between signals detected by pixels in adjacent blocks, an offset between pixels may be corrected.
Specifically, for example, as shown in
In this case, the amounts (intensities) of incident light to the blocks B1 and B2 of the solid-state imaging element 113 at time t0 (initial state) and time t1 (e.g., after one hour has passed, etc.) are shown in
At time t0, as shown in
Signal Level(t0)=IR1(t0)−IR2(t0) (1)
Note that, in Expression (1), IR1(t0) and IR2(t0) have substantially the same value, and therefore, Signal Level(t0) is, for example, substantially zero.
Thereafter, at time t1, as shown in
Signal Level(t1)=IR1(t1)−IR2(t1) (2)
Note that, in Expression (2), IR1(t1) and IR2(t1) have different levels of the detection signal detected in the block B1, and therefore, Signal Level(t1) has a value corresponding to a difference between the levels of the detection signal.
Thus, if, during a period of time from time t0 to time t1, for example, a change occurs in ambient temperature, the light intensity of the light source 111, or other conditions, a change occurs in the amount of incident light to the light receiving surface of the solid-state imaging element 113, so that a change occurs in the intensity of light detected at each pixel. Such a change in condition may add noise to a detection signal obtained at each pixel. However, if pixels are divided into blocks, regions corresponding to adjacent blocks are caused to have the same microstructural pattern, and differences between signals (signals corresponding to transmitted light components) detected at pixels in adjacent blocks are calculated, a direct current (DC) offset between pixels in both blocks can be corrected. As a result, a change in the signal intensity at a pixel having a change in the light intensity can be detected with high accuracy, and therefore, a change in the refractive index can be detected at a high S/N ratio, to obtain a captured image.
Although, in the foregoing, for the sake of convenience, it is assumed that each block includes a single pixel, each block may include one or more pixels.
<Specific Example Structure of Metal Thin-Film Filter>
The metal thin-film filter 112 uses the microstructural pattern to generate surface plasmon polaritons which are caused by coupling of free electrons with light at a particular electromagnetic wave wavelength. The metal thin-film filter 112 is a sub-wavelength structure which is obtained by microfabrication of a thin film of a conductive material having a plasma frequency in the wavelength band of ultraviolet light (specifically, preferably, gold (Au), silver (Ag), or aluminum (Al)). The metal thin-film filter 112 also has physical properties of a conductor, and a resonance wavelength which is determined by the period of the pattern, the diameter of the openings, the dot size, the film thickness, and the physical properties of a medium around the structure. Therefore, next, a specific example structure of the metal thin-film filter 112 will be described with reference to
(Hole Array Structure)
As shown in
(Dot Array Structure)
As shown in
(Coaxial Hole Array Structure)
As shown in
(Ring Array Structure)
As shown in
Specific example structures of the metal thin-film filter 112 have been described above. Thus, the metal thin-film filter 112 has at least one periodic microstructural pattern in the surface thereof. The fundamental period of the microstructural pattern is not longer than approximately a wavelength of visible light. The metal thin-film filter 112 may have, as the microstructural pattern, only one of the above structures or a combination of two or more of the above structures.
<Method for Manufacturing Metal Thin-Film Filter>
A method for manufacturing the metal thin-film filter 112 of the image capture device 100 will now be briefly described. Note that the present technology is not limited to the manufacturing method below, and any method that can provide the structure of the metal thin-film filter 112 with high accuracy may be employed.
Initially, a flat and optically transparent substrate is prepared as a base on which the metal thin-film filter 112 is implemented. As a medium of a transparent insulating layer used in the wavelength band of visible light, silicon oxide (SiO2) and a composite material including silicon oxide (SiO2) as a main component are preferably used. In addition to this, magnesium fluoride (MgF2) etc. may be used. Oxides and nitrides, such as silicon nitride (Si3N4), titanium oxide (TiO2), tantalum oxide (Ta2O5), zirconium oxide (ZrO2), niobium oxide (Nb2O5), hafnium oxide (HfO2), etc., may be used although the refractive index increases.
A metal thin-film which is a base of the metal thin-film filter 112 is formed on the substrate by sputtering etc. A microstructure which imparts the filtering function to the metal thin-film is produced by a technique, such as electron beam lithography, EUV or UV lithography, interference exposure, etching, etc. Of the etching techniques, anisotropic dry etching is preferable. As a gas for etching, tetrafluoromethane (CF4)-based etching gas is preferable. Sulfur hexafluoride (SF6), trifluoromethane (CHF3), xenon difluoride (XeF2), etc. are also preferable. Note that a nano-stamper having a basic structure may be produced using electron beam lithography, and the structure may be transferred using a nano-printing technique.
<Configuration of Electronic Apparatus>
The electronic apparatus 300 is, for example, a mobile information apparatus or a mobile communication terminal, such as a mobile telephone, a smartphone, a tablet computer, etc. As shown in
The controller 311 controls each part of the electronic apparatus 300. The memory unit 312 stores various items of data under the control of the controller 311.
The operation unit 313 supplies an operation signal corresponding to the user's operation to the controller 311. The controller 311 controls an operation of each part of the electronic apparatus 300 based on the operation signal from the operation unit 313. Note that the operation unit 313 may be a physical button, or alternatively, for example, a graphical user interface (GUI) image displayed on the screen of the display unit 314 having a touchscreen.
The display unit 314 includes a display device, such as a liquid crystal display (LCD) etc. The display unit 314 displays various items of information, such as a text, an image, etc., under the control of the controller 311.
The wireless communication unit 315 performs wireless communication with a predetermined server via a network, such as the Internet etc., under the control of the controller 311.
The audio processor 316 has devices for performing a conversation, such as a microphone, a loudspeaker, etc. The audio processor 316 performs an audio input process or an audio output process under the control of the controller 311.
The image capture device 100 has the configuration of
The electronic apparatus 300 has the above configuration.
As described above, according to the present technology, when a target object is measured, a shift of the peak wavelength of the transmission spectrum, i.e., a change in the refractive index in the very vicinity of the metal surface of the metal thin-film filter 112, is detected in the form of a change in the signal intensity of the solid-state imaging element 113. Therefore, a target object can be measured without providing a spectrometer.
Specifically, in measurement techniques in the related art, it is necessary to provide a spectrometer for detecting the amount of a shift of the peak wavelength of a transmission spectrum. In the measurement technique of the embodiment of the present technology, an LED light source etc. which emits light having a narrow band of wavelengths is employed as the light source 111, and the two-dimensional high-density solid-state imaging element 113 is provided immediately below the metal thin-film filter 112, whereby pixel information can be independently detected from each of pixels arranged in an array. Therefore, instead of the shift amount of the peak wavelength of a transmission spectrum, a change in state can be detected in the form of a change in signal intensity which corresponds to a change in transmission efficiency at a particular wavelength. Therefore, according to the measurement technique of the embodiment of the present technology, a target object can be measured at low cost and with a simple configuration, compared to measurement techniques in the related art, which use a spectrometer.
Although, in the foregoing, a filter using surface plasmon polaritons is referred to as a “metal thin-film filter,” the filter may also be referred to as a “plasmonic filter.”
It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and alterations may occur depending on design requirements and other factors insofar as they are within the scope of the appended claims or the equivalents thereof.
Additionally, the present technology may also be configured as below.
(1) An image capture device including:
a narrow-band optical irradiation system including a light source;
a solid-state imaging element including an array of pixels and sensitive to a predetermined range of wavelengths; and
a metal thin-film filter provided in an optical path between the optical irradiation system and the solid-state imaging element, and having a periodic microstructural pattern having a period shorter than a wavelength detected by the solid-state imaging element.
(2) The image capture device according to (1), wherein
the metal thin-film filter has a property that a spectral distribution of transmitted light is shifted in a wavelength direction due to a difference between the refractive index of a target object tightly attached or located close to the metal thin-film filter and a refractive index of a medium with which a space around the metal thin-film filter is filled, and
the image capture device further includes a signal processor configured to detect a change in signal intensity of the solid-state imaging element, the change in signal intensity corresponding to a change in transmission efficiency corresponding to the shift of the spectral distribution of transmitted light in the wavelength direction.
(3) The image capture device according to (1) or (2), wherein
the metal thin-film filter is a thin film of an elemental metal or an alloy and having a thickness of 500 nm or less.
(4) The image capture device according to any one of (1) to (3), wherein
the metal thin-film filter has at least one periodic microstructural pattern in a surface of the metal thin-film filter, and a fundamental period of the microstructural pattern is not longer than approximately a wavelength of visible light.
(5) The image capture device according to (4), wherein
the metal thin-film filter has, as the microstructural pattern, a hole array structure including openings having a diameter of 500 nm or less arranged in a honeycomb array or an orthogonal matrix array.
(6) The image capture device according to (4), wherein
the metal thin-film filter has, as the microstructural pattern, a dot array structure including dot-like structures having a diameter of 500 nm or less arranged in a honeycomb array or an orthogonal matrix array.
(7) The image capture device according to (4), wherein
the metal thin-film filter has, as the microstructural pattern, a coaxial hole array structure including openings having a diameter of 500 nm or less arranged in a honeycomb array or an orthogonal matrix array, each opening having a coaxial structure in which a dot-like structure is provided at a center of the opening.
(8) The image capture device according to (4), wherein
the metal thin-film filter has, as the microstructural pattern, a ring array structure including dot-like structures having a diameter of 500 nm or less arranged in a honeycomb array or an orthogonal matrix array, each dot-like structure having a ring-like structure in which an opening having a diameter smaller than a diameter of the dot-like structure is provided at a center of the dot-like structure.
(9) The image capture device according to any one of (4) to (8), wherein
in the solid-state imaging element, the array of pixels is divided into a plurality of blocks,
in the metal thin-film filter, regions corresponding to adjacent blocks have the same microstructural pattern, and
the signal processor obtains a difference between signals detected by pixels in adjacent blocks to correct an offset between the pixels in the adjacent blocks.
(10) The image capture device according to any one of (1) to (9), wherein
the light source emits light having a narrow band of wavelengths.
(11) The image capture device according to (10), wherein
the light source is a light emitting diode (LED) light source or a laser light source configured to selectively emit electromagnetic waves having a narrow band of wavelengths of a wavelength band to which the solid-state imaging element is sensitive.
(12) The image capture device according to any one of (1) to (11), wherein
the solid-state imaging element is sensitive to a wavelength range of visible light or near-infrared light.
(13) The image capture device according to any one of (1) to (12), wherein
the metal thin-film filter is removably attached in the optical path.
(14) An electronic apparatus including:
an image capture device including
Number | Date | Country | Kind |
---|---|---|---|
2013-136220 | Jun 2013 | JP | national |
Number | Name | Date | Kind |
---|---|---|---|
20060279737 | Chinowsky | Dec 2006 | A1 |
20080079938 | Choi | Apr 2008 | A1 |
20120293854 | Zheludev et al. | Nov 2012 | A1 |
20130065777 | Altug et al. | Mar 2013 | A1 |
20140151733 | Koike et al. | Jun 2014 | A1 |
Entry |
---|
Chang, Tsung-Yao, et al. “Large-scale plasmonic microarrays for label-free high-throughput screening.” Lab on a Chip 11.21 (2011): 3596-3602. |
Yanik et al., “An Optofluidic Nanoplasmonic Biosensor for Direct Detection of Live Viruses from Biological Media”, Nano Letters, American Chemical Society, 2010, 8 pages. |
Number | Date | Country | |
---|---|---|---|
20150002843 A1 | Jan 2015 | US |