Patent Application
20230036544
The present invention generally relates to a color filter array, and more particularly to a color filter array with infrared filters.
A color filter array (CFA) is composed of tiny color filters placed over the pixel sensors of an image sensor, and is used to capture color information for digital imaging.
A Bayer filter is one type of CFA for arranging RGB color filters on a square grid of photo sensors. The Bayer filter is widely adapted to image sensors in digital cameras. The pattern of Bayer filter is half green, one quarter red and one quarter blue. That is, within the square grid of four photo sensors, there are two green filters, one red filter and one blue filter.
A modified Bayer filter has been proposed by replacing one green filter with an infrared (IR) filter. Therefore, constituent filters are one quarter green, one quarter red, one quarter blue and one quarter infrared. That is, within the square grid of four photo sensors, there are one green filter, one red filter, one blue filter and one infrared filter.
Another modified Bayer filter has been proposed with constituent filters that are half green, one eighth red, one eighth blue and one quarter infrared. Therefore, within the square grid of four photo sensors, there are two green filters, one red or blue filter, and one infrared filter.
For the conventional modified Bayer filters as mentioned above, an infrared image is obtained by subsampling. That is, the signal corresponding to the IR filter in each 2×2 pixels pattern is read out as the IR signal. It is noted that this read out method suffers limited sensitivity and signal-to-noise ratio. Moreover, a color image obtained from the conventional modified Bayer filters possesses substantive artifact.
A need has thus arisen to propose a novel color filter array with infrared filters to overcome drawbacks of the conventional modified Bayer filters.
In view of the foregoing, it is an object of the embodiment of the present invention to provide a color filter array (CFA) adaptable to an image sensor with higher sensitivity and less artifact, and applicable to artificial intelligence applications. It is another object of the embodiment of the present invention to provide a dual-mode image sensor capable of simultaneously and separately providing infrared image and monochrome/color image, thereby providing cost effective solution and allowing flexibility on video camera.
According to one embodiment, a dual-mode image sensor includes a plurality of pixel sensors and a plurality of pixel filters. The pixel filters are correspondingly aligned with the plurality of pixel sensors, and the pixel filters are arranged in a predetermined pattern composed of 2×2 pixel filters including two infrared filters and two visible filters. Infrared signals from pixel sensors corresponding to the infrared filters and visible signals from pixel sensors corresponding to the white filters are read out separately.
Specifically, the IR signals from the pixel sensors 12 corresponding to the two IR filters within the predetermined pattern are combined (i.e., binning) to result in a combined IR signal within the pattern, thereby getting better sensitivity. The combined IR signals of the entire image sensor 102 constitute an IR image, which is one quarter the resolution of the image sensor 102. For example, the image sensor 102 has resolution of 960×800, and the associated IR image thus has resolution of 480×400.
Simultaneously, the white signals from the pixel sensors 12 corresponding to the two white filters within the predetermined pattern are combined (i.e., binning) to result in a combined white signal within the pattern, thereby getting better sensitivity. The combined white signals of the entire image sensor 102 constitute a visible image (specifically a monochrome image in this embodiment), which is one quarter the resolution of the image sensor 102. For example, the image sensor 102 has resolution of 960×800, and the associated monochrome image thus has resolution of 480×400.
Specifically, the pixel filters 21 of the CFA 200 are arranged in a predetermined pattern composed of 2×2 pixel filters 21 including two infrared (IR) filters and two visible (light) filters. In the embodiment, the two visible filters are (same) color filters that are either red (R) filters, green (G) filters or blue (B) filters. Particularly, the two IR filters are disposed along one diagonal and the two color filters are disposed along another diagonal. It is noted that, in the embodiment, the color filters of the entire CFA 200 are half green, one quarter red and one quarter blue, and are arranged with Bayer arrangement.
Specifically, the IR signals from the pixel sensors 12 corresponding to the two IR filters within the predetermined pattern are combined (i.e., binning) to result in a combined IR signal within the pattern. The combined IR signals of the entire image sensor 102 constitute an IR image, which is one quarter the resolution of the image sensor 102. For example, the image sensor 102 has resolution of 960×800, and the associated IR image thus has resolution of 480×400.
Simultaneously, the color signals from the pixel sensors 12 corresponding to the two color filters within the predetermined pattern are combined (i.e., binning) to result in a combined color signal within the pattern. The combined color signals of the entire image sensor 102 constitute a visible image (specifically a color (or RGB) image in this embodiment), which is one quarter the resolution of the image sensor 102. For example, the image sensor 102 has resolution of 960×800, and the associated color image thus has resolution of 480×400.
According to the CFA 100 or the CFA 200 with the predetermined pattern and the associated read out method as described above, higher sensitivity and signal-to-noise ratio (for the IR image) and less artifact (for the monochrome or color image) can be achieved after being processed by an image signal processor (ISP) as compared with conventional CFAs.
It is noted that the infrared image and the monochrome image in the first embodiment may be simultaneously and separately obtained for different applications, thereby realizing a dual mode image sensor. Similarly, the infrared image and the color image in the second embodiment may be simultaneously and separately obtained for different applications, thereby realizing a dual mode image sensor.
The CFA 100 or the CFA 200 in companion with the image sensor 102 may constitute an artificial intelligence smart sensor adaptable to artificial intelligence (AI) applications. Specifically, the IR image obtained in the embodiment, in companion with an IR light source for enhancing image quality, may be used for biometric recognition (e.g., facial recognition) capable of identifying individuals by human characteristics. For example, the IR image obtained in the embodiment may be used in Windows Hello, a biometrics-based technology that authenticates secure access with a fingerprint, iris scan or facial recognition. On the other hand, the monochrome image or the color image obtained in the embodiment may be used for surveillance capable of monitoring behavior or activities for the purpose of information gathering. For example, the monochrome image or the color image obtained in the embodiment may be used to detect an approaching or leaving person, based on which an electronic device (e.g., computer) may accordingly wake up or sleep. Therefore, the dual-mode image sensor disclosed in the embodiments can simultaneously and separately provide the infrared image and the monochrome/color image, thereby providing cost effective solution and allowing flexibility on video camera.
Although specific embodiments have been illustrated and described, it will be appreciated by those skilled in the art that various modifications may be made without departing from the scope of the present invention, which is intended to be limited solely by the appended claims.
