The present disclosure relates to an electronic apparatus.
A typical electronic apparatus such as a smartphone, a tablet, a game machine, and a PC (Personal Computer) includes a camera mounted on a bezel of a display unit. This camera is called a front camera and is used for video calling or selfie capturing.
A user who uses an electronic apparatus often carries the electronic apparatus in a pocket or a bag. Accordingly, there has been a demand for an electronic apparatus having a compact housing. Moreover, there has also been a demand for an electronic apparatus which enlarges a screen size to increase visibility of tent and display a high-resolution image. For meeting these demands, an electronic apparatus having a reduced bezel width and an electronic apparatus of a no-bezel type have currently been developed.
A front camera is often mounted on a bezel. In this case, a bezel width of an electronic apparatus cannot be reduced to a size smaller than an outside diameter size of the camera. Moreover, a visual line of the user is often directed toward the vicinity of the center of a display screen during imaging. Accordingly, an unnatural image including a person whose visual line is not directed toward the front is likely to be formed when the camera disposed on the bezel is used for imaging.
For avoiding the problem described above, it has been proposed to provide a camera module on the side opposite to a display surface of a display unit and capture an image with use of light having passed through the display unit.
PCT Patent Publication No. WO2013/187132
However, light having passed through the display unit is attenuated in a wavelength band including blue light as a result of absorption or reflection of the light. Therefore, there has been a problem that image quality of a captured image deteriorates in comparison with cameras disposed at other positions.
Accordingly, the present disclosure provides an electronic apparatus capable of preventing image quality deterioration of an image captured by a camera while reducing a bezel width.
An electronic apparatus according to one aspect of the present disclosure includes a display unit disposed on a first surface, a first imaging unit disposed on a side opposite to a display surface of the display unit, and a second imaging unit disposed on a second surface on a side opposite to the first surface. Sensitivity of the first imaging unit to a first wavelength band that includes blue light may be higher than sensitivity of the second imaging unit to the first wavelength band.
The first imaging unit may receive light having passed through the display unit.
A ratio of blue light detection pixels in a pixel array of the first imaging unit may be higher than a ratio of blue light detection pixels in a pixel array of the second imaging unit.
The blue light detection pixels may include at least any of a blue pixel, a magenta pixel, and a cyan pixel.
The first imaging unit may include at least any of a cyan pixel, a magenta pixel, and a yellow pixel.
A first light source disposed on the first surface and configured to emit blue light during imaging by the first imaging unit may be further provided.
A second light source disposed on the first surface and configured to emit white light during imaging by the first imaging unit may be further provided. A processing circuit configured to generate an image by synthesizing a first image and a second image, the first image being captured by the first imaging unit during light emission from the first light source, the second image being captured by the first imaging unit during light emission from the second light source, may be further provided.
A first light source disposed on the first surface and configured to emit light during imaging by the first imaging unit may be further provided. The second imaging unit disposed on the second surface on the side opposite to the first surface may be provided. A third light source disposed on the second surface and configured to emit light during imaging by the second imaging unit may be further provided. A color temperature of the first light source may be higher than a color temperature of the third light source.
A third imaging unit that is disposed on the side opposite to the display surface of the display unit and has lower sensitivity to the first wavelength band than the sensitivity of the first imaging unit to the first wavelength band may be further provided. A processing circuit configured to generate an image by synthesizing a third image captured by the first imaging unit and a fourth image captured by the third imaging unit may be further provided.
The first imaging unit may have multiple photoelectric conversion units arranged in a depth direction of a substrate.
At least any one of the multiple photoelectric conversion units may include an organic photoelectric conversion film.
An electronic apparatus according to one aspect of the present disclosure includes a display unit disposed on a first surface, and a first imaging unit that is disposed on a side opposite to a display surface of the display unit and includes multiple pixels for photoelectrically converting light having entered via the display unit. A ratio of blue light detection pixels included in the multiple pixels may be higher than ¼.
The blue light detection pixels may include at least any of a blue pixel, a magenta pixel, and a cyan pixel.
The first imaging unit may include at least any of a cyan pixel, a magenta pixel, and a yellow pixel.
A first light source disposed on the first surface and configured to emit blue light during imaging by the first imaging unit may be further provided.
A second light source disposed on the first surface and configured to emit white light during imaging by the first imaging unit may be further provided. A processing circuit configured to Generate an image by synthesizing a first image and a second image, the first image being captured by the first imaging unit during light emission from the first light source, the second image being captured by the first imaging unit during light emission from the second light source, may be further provided.
A first light source disposed on the first surface and configured to emit light during imaging by the first imaging unit may be further provided. A second imaging unit disposed on a second surface on a side opposite to the first surface may be further provided. A third light source disposed on the second surface and configured to emit light during imaging by the second imaging unit may be further provided. A color temperature of the first light source may be higher than a color temperature of the third light source.
A third imaging unit that is disposed on the side opposite to the display surface of the display unit and has a lower ratio of the blue light detection pixels than a ratio of the blue light detection pixels of the first imaging unit may be further provided. A processing circuit configured to generate an image by synthesizing a third image captured by the first imaging unit and a fourth image captured by the third imaging unit may be further provided.
The first imaging unit may have multiple photoelectric conversion units arranged in a depth direction of a substrate.
At least any one of the multiple photoelectric conversion units may include an organic photoelectric conversion film.
Preferred embodiments of the present disclosure will hereinafter be described in detail with reference to the accompanying drawings. Note that constituent elements having substantially identical functional configurations are given identical reference signs in the present description and the drawings to omit repetitive explanation.
The electronic apparatus 1 in
Note that the camera module 3 in
As depicted in
Generally, the display panel 4 such as an OLED and a liquid crystal panel has multiple layers. For example, the display panel 4 of some types includes a component which lowers light transmittance, such as a color filter layer. Accordingly, as depicted in
For example, the circularly polarized plate 5 is mounted for purposes of reduction of glares, improvement of visibility, and others. The touch panel 6 is a plate-shaped structure into which a touch sensor is incorporated. For example, the touch sensor is a capacitance type touch sensor or a resistive film type touch sensor. However, any type of touch sensor may be used. Note that the electronic apparatus of the present disclosure may include a display panel having an integrated function of a touch panel. The cover glass 7 is provided to protect the display panel 4 from the outside.
Note that the display unit 2 may include a fingerprint sensor 6A. For example, an optical fingerprint sensor or an ultrasonic fingerprint sensor can be used as the fingerprint sensor 6A. However, the fingerprint sensor is riot limited to any type. For example, the fingerprint sensor 6A may be mounted in at least any one of the layers of the display unit 2. Moreover, the fingerprint sensor 6A may be mounted within the camera module 3.
For example, the camera module 3 includes an imaging unit 8 and an optical system 9. The optical system 9 is provided between the display unit 2 and the imaging unit 8. The optical system 9 concentrates light having passed through the display unit 2 on the imaging unit 8. The optical system 9 may include multiple lenses.
For example, the display unit 2 includes a material such as polyimide, acryl, or epoxy. Some of these materials have a property of absorbing and reflecting light in a wavelength band including blue light. Accordingly, the imaging unit 8 which captures an image with use of light having passed through the display unit 2 has lower sensitivity to the wavelength band including blue light than that sensitivity of imaging units disposed at other positions.
The imaging unit (e.g., imaging unit 8) which performs imaging with use of light having passed through the display unit 2 will hereinafter be referred to as a first imaging unit. Moreover, the imaging unit disposed on the surface opposite to the display unit 2 of the electronic apparatus 1 will be referred to as a second imaging unit. The camera module 10 described above corresponds to the second imaging unit. Note that the camera module 10 disposed on the surface opposite to the display unit 2 of the electronic apparatus 1 will also be referred to as a rear camera.
Moreover, an interlayer dielectric film 13 is formed on a surface 11a (upper side) of the substrate 11. Multiple wiring layers 12 are disposed within the interlayer dielectric film 13. At least either contacts or through electrodes (not depicted) may be provided between the photoelectric conversion units 8a and the wiring layers 12. Similarly, at least either contacts or through electrodes may be provided between the wiring layers 12.
Meanwhile, a flattening layer 14 is formed on a second surface 11b (lower side) of the substrate 11. A base insulation layer 16 is formed on the flattening layer 14. Moreover, a light shield layer 15 may be formed on a part of the flattening layer 14. The light shield. layer 15 is disposed on a boundary of pixels or in the vicinity of the pixels. At least a part of a surface of the light shield layer 15 may be in contact with the base insulation layer 16. Further, an insulation layer 17 is formed on the base insulation layer 16. Polarizers may be formed within the insulation layer 17. For example, the polarizers are wire grid polarizers having a line-and-space structure. However, there are no limitations on the structure and the arrangement direction of the polarizers.
Protection layers 18 and 19 are formed on the insulation layer 17 including multiple polarizers 8b. Further, a flattening layer 20 is formed on the protection layer 19. A color filter layer 21 is disposed on the flattening layer 20. The color filter layer 21 selectively transmits light in some wavelength bands such that the photoelectric conversion unit disposed below can detect light in a predetermined wavelength band.
In addition, an on-chip lens 22 is disposed on the color filter layer 21. The on-chip lens 22 is disposed on each of the multiple polarizers 8b in the cross-sectional structure in
The imaging unit 8 may include the photoelectric conversion units 8a discretely formed for each pixel. Each of the photoelectric conversion units 8a photoelectrically converts light entering via the display unit 2, and outputs a color signal of any of colors. Specifically, the imaging unit 8 is considered as a set of multiple pixels each performing photoelectric conversion and outputting a color signal. For example, the color signal is a red, green, or blue color signal. However, the color signal output from each pixel of the imaging unit 8 may be a signal indicating a color other than three primary colors of light. For example, each pixel of the imaging unit 8 may output a color signal of at least any one of cyan, magenta, and yellow which are complementary colors of three primary colors of light. Moreover, each pixel of the imaging unit 8 may output a white color signal.
The imaging unit 8 can include multiple pixels each having sensitivity to a different wavelength band. Each of the pixels of the imaging unit 8 outputs a color signal associated with a wavelength band corresponding to sensitivity. For example, as depicted in
Note that the pixels each having sensitivity to the predetermined wavelength band may be formed by a method different from the foregoing method. For example, a photoelectric conversion unit having sensitivity to a predetermined wavelength band may be used instead of each of the color filters. For example, each of the photoelectric conversion units having sensitivity to the predetermined wavelength band may be formed by using an organic photoelectric conversion material. Such a photoelectric conversion unit (organic photoelectric conversion unit) is capable of detecting light in a wavelength hand different for each type or combination of the organic photoelectric conversion materials.
Moreover, it is known that an absorbed wavelength band of electromagnetic waves varies for each depth of a silicon substrate. Accordingly, the photoelectric conversion unit may be disposed at each of different depths within the silicon substrate to detect light in multiple wavelength bands. Note that an imaging unit which has multiple photoelectric conversion units (light reception surfaces) having different detection wavelength bands in a depth direction of a substrate is called a vertical spectral diffraction type imaging unit. The imaging unit of the electronic apparatus according to the present disclosure may detect light in different wavelength bands by a combination of multiple methods. For example, the imaging unit may use a combination of at least any methods selected from a color filter, a photoelectric conversion unit having sensitivity to a selective wavelength band, and vertical spectral diffraction.
The pixel array of the imaging unit specifies a light wavelength band (color) corresponding to a detection target of each pixel. Specifically, the photoelectric conversion unit 8a of each pixel outputs a color signal corresponding to a wavelength band specified in the pixel array. A Bayer array depicted in a plan diagram of
As the imaging unit (e.g., the imaging unit 8A of the camera module 10) which does not perform imaging with use of light having passed through the display unit 2, an imaging unit having a Bayer array can be used. Note that an example of a pixel array capable of compensating for the wavelength band including blue light will be described below.
Note that the imaging unit according to the present disclosure may include at least any of a cyan pixel having sensitivity to a wavelength band including cyan, a magenta pixel having sensitivity to a wavelength band including magenta, and a yellow pixel having sensitivity to a wavelength band including yellow. For example, the color filter layer 21 for transmitting light in the wavelength band including cyan can be disposed on each of the photoelectric conversion units 8a to form cyan pixels. Magenta pixels and yellow pixels are allowed to be formed by similar methods. Moreover, at least any of a red pixel, a green pixel, a blue pixel, a cyan pixel, a magenta pixel, and a yellow pixel may be formed by photoelectric conversion units each having sensitivity to a selective wavelength band, or by vertical spectral diffraction.
Described above are the examples of red pixels, green pixels, blue pixels, cyan pixels, magenta pixels, and yellow pixels. However, the pixels of the imaging unit according to the present disclosure are not necessarily required to detect these typical colors. For example, the pixels of the imaging unit of the present disclosure may output signals of intermediate colors of the colors described above, such as an emerald green signal. Moreover, the imaging unit according to the present disclosure may include white pixels for detecting visible light. For example, pixels each having no color filter layer 21 are available as white pixels.
A graph in
A graph in
Referring to the spectral sensitivity characteristics of the magenta pixels, the magenta pixels reveal that there are two peaks in this characteristic. The magenta pixel has a first peak of sensitivity around a wavelength of 460 nm. Further, the magenta pixel has a second peak of sensitivity around a wavelength of 620 nm. Accordingly, both blue light and red light are detectable by use of the magenta pixel. The spectral sensitivity characteristics of the pixels in.
As described above, blue light is similarly detectable by use of pixels other than a typical blue pixel, such as a cyan pixel and a magenta pixel. It can be said that the blue pixel, the cyan pixel, and the magenta pixel are each a pixel having sensitivity to blue (blue light detection pixel). According to the electronic apparatus of the present disclosure, a ratio of the blue light detection pixels of the first imaging unit may be made higher than that of the second imaging unit to compensate for sensitivity of the first imaging unit (imaging unit 8) to the wavelength band including blue light. Moreover, according to the electronic apparatus of the present disclosure, the ratio of the blue light detection pixels of the first imaging unit may be made higher than ¼ which is a value of that ratio of a Bayer array.
For example, as the blue light detection pixel, a pixel including a color filter having a light transmittance of 40% or higher in a wavelength band from 450 to 470 nm and a photoelectric conversion unit for detecting light transmitted by this color filter can be used. Moreover, as the blue light detection pixel, a pixel including a photoelectric conversion unit having quantum efficiency of 40% or higher in a wavelength band from 450 to 470 nm can be used. In this case, the photoelectric conversion unit may include an organic photoelectric conversion film, or may include a photodiode including an inorganic material. Note that the quantum efficiency refers to a ratio of conversion of a photon having entered the photoelectric conversion unit into an electron.
Note that the imaging unit may include a pixel that detects electromagnetic waves other than visible light as a detection target. For example, the imaging unit may use a filter that transmits light other than visible light, such as infrared light. Moreover, the imaging unit may include a photoelectric conversion unit that detects light other than visible light, such as infrared light. In This manner, the electronic apparatus can acquire depth information from the imaging unit and generate a range image.
For example, the optical system 9 includes one or more lenses 9a and an IR (Infrared Ray) cut filter 9b. However, the IR cut filter 9b may be omitted. As described above, the imaging unit 8 includes multiple pixels each performing photoelectric conversion and outputting a color signal.
The color signal output from each of the pixels is input to the A/D converter 31. The A/D converter 31 generates digital pixel data obtained by digitizing color signals of the multiple pixels.
The clamp unit 32 executes a process for specifying a black level. For example, the clamp unit 32 subtracts black level data from the digital pixel data. The data output from the clamp unit 32 is input to the color output unit 33. For example, the color output unit 33 classifies the digital pixel data into pieces of color information. For example, the defect correction unit 34 performs a correction process such as removable of noise components and correction of signal levels. For example, the noise components are flare components or diffraction light components. For example, the defect correction unit 34 may interpolate data regarding polarized pixels with use of digital pixel data of surrounding no-change pixels. However, there are no limitations on details of the correction process co be executed by the defect correction unit 34.
The linear matrix unit 35 performs matrix calculation for color information (e.g., RGB). In this manner, color reproducibility of images can be raised. The linear matrix unit 35 is also called a color matrix unit. For example, an imaging unit including at least any of a cyan pixel, a yellow pixel, or a magenta pixel is assumed to be adopted. In this case, color information associated with at least any one of cyan, yellow, or magenta is input to the linear matrix unit 35. The linear matrix unit 35 can convert color information associated with at least any one of cyan, yellow, or magenta into color information in an RGB (Red/Green/Blue) system by performing matrix calculation.
The gamma correction unit 36 performs gamma correction for the color information output from the linear matrix unit 35. For example, the gamma correction unit 36 performs gamma correction according to display characteristics of the display unit 2 to improve visibility of a captured image on the display unit 2. The luminance chroma signal generation unit 37 generates a luminance chroma signal on the basis of output data from the gamma correction unit 36. The luminance chroma signal is a signal used for display on the display unit 2. The output unit 38 transfers image data to the display unit 2, etc.
Note that at least a part of signal processing performed by the defect correction unit 34, the linear matrix unit 35, the gamma correction unit 36, or the luminance chroma signal generation unit 37 in
The storage unit 41 is a memory or a storage capable of storing data of images captured by the imaging unit 8. For example, the memory is a volatile memory such as a SRAM and a DRAM, or a non-volatile memory such as a NAND flash memory and a NOR flash memory. For example, the storage is a hard disk or an. SSD. However, the memory or the storage used as the storage unit 41 is not limited to any type. For example, the linear matrix unit 35 is allowed to perform image synthesis or correction for multiple images stored in the storage unit 41. However, a constituent element other than the linear matrix unit 35 may synthesize or correct the images.
The flash 42 is a light source which applies light to an object in linkage with an imaging operation performed by the imaging unit 8. For example, a white LED can be used as the flash 42. However, the light source to be used as the flash 42 is not limited to any type.
The flash 43 is a light source which applies blue light to the object in linkage with the imaging operation performed by the imaging unit 8. For example, a blue LED can be used as the flash 43. However, the light source to be used as the flash 43 is not limited to any type. For example, as the flash 43, a light source capable of applying light having a higher color temperature than that of the flash 44 disposed on the opposite side of the electronic apparatus 1 can be used.
Note that each of the flash 42, the flash 43, and the storage unit 41 described above is an optional constituent element. Accordingly, at least any of these constituent elements may be omitted.
According to the example of
As will be described below, the flash 43 applies blue light to an object to compensate for sensitivity to a wavelength band including blue light. Note that the flash 42 and the flash 43 may each be controlled by a hardware circuit, or by software operating in the electronic apparatus 1.
Described hereinafter will be an example of a pixel array adopted by the first imaging unit (imaging unit 8) which performs imaging with use of light having passed through the display unit 2. In this example, X (X: color name) of an X pixel indicates a wavelength band corresponding to a detection target of each pixel. For example, the X pixel detects light in a wavelength band including any of colors. Moreover, the name of the X pixel is not intended to limit implementation of the pixel. The implementation of pixels herein refers to presence or absence of the color filter, the type of the photoelectric conversion unit, and presence or absence of vertical spectral diffraction, for example. Accordingly, pixels that detect the same color as a detection target can be implemented using multiple methods.
In a case where sensitivity of the imaging unit 8 to the wavelength band including blue light is desired to be made higher than that of an imaging unit adopting a Bayer array, a ratio of blue light detection pixels included in all pixels can be raised to a value larger than ¼ which is the ratio of the Bayer array. For compensating for the sensitivity to the wavelength band including blue light, the ratio of the blue light detection pixels in the imaging unit 8 (first imaging unit) may be set to a value larger than that ratio of the imaging unit 8A (second imaging unit).
As described above, sensitivity to the wavelength band including blue light in the first imaging unit may be raised by replacing at least either green pixels or red pixels in a Bayer array with pixels of a color having a shorter wavelength.
Note that the pixel array of the first imaging unit (imaging unit 8) may be produced by repeating an array of 2×2. Moreover, the pixel array of the first imaging unit according to the present disclosure may be produced by repeating an array of 4×4. However, there are no limitations on the size and the shape of the array corresponding to a minimum unit for specifying the pixel array. For example, the pixel array of the first imaging unit may be produced by repeating a linear array, an shaped array, or a rectangular array.
Note that RGB color information can be generated even in a case where the imaging unit 8 (first imaging unit) uses the pixel array 105. For example, the linear matrix unit 35 can subtract green color information from cyan color information and perform correction according to magenta colorinformation to generate blue color information. Moreover, the linear matrix unit 35 can subtract green color information from yellow color information to generate red color information. Note that the linear matrix unit 35 may correct red color information with use of a value of magenta color information.
The electronic apparatus according to the present disclosure may include a display unit disposed on a first surface, a first imaging unit disposed on the side opposite to a display surface of the display unit, and a second imaging unit disposed on a second surface on the side opposite to the first surface. Sensitivity of the first imaging unit to a first wavelength band including blue light can be made higher than that of the second imaging unit. For example, a ratio of blue light detection pixels of a pixel array of the first imaging unit may be made higher than that of the second imaging unit. The first imaging unit may receive light having passed through the display unit.
Moreover, the electronic apparatus according to the present disclosure may include the display unit disposed on the first surface and a first imaging unit that is disposed on the side opposite to the display surface of the display unit and that includes multiple pixels for photoelectrically converting light having entered via the display unit. In this case, a ratio of blue light detection pixels of the multiple pixels may be made higher than ¼.
The blue light detection pixels may include at least any of a blue pixel, a magenta pixel, and a cyan pixel. However, the blue light detection pixels are not limited to these pixels. As described above, the first imaging unit may include at least any of a cyan pixel, a magenta pixel, and a yellow pixel. Moreover, the first imaging unit may have a pixel array where at least either green pixels or red pixels in a Bayer array are replaced with pixels of a color having a shorter wavelength.
Each pixel of the imaging unit (first imaging unit and second imaging unit) according to the present disclosure may include one photoelectric conversion unit (light reception surface). Alternatively, each pixel of the imaging unit according to the present disclosure may include multiple photoelectric conversion units (light reception surfaces). For example, in a case where a vertical spectral diffraction type imaging unit is adopted, multiple photoelectric conversion units of each pixel are arranged in a depth (z-axis) direction of a substrate. Accordingly, each pixel of the vertical spectral diffraction type imaging unit has multiple photoelectric conversion units for detecting light in different wavelength bands. An example of a pixel having multiple photoelectric conversion units will be described with reference to
In the pixel array 106, each pixel has a light reception surface capable of detecting a wavelength band including blue light. Accordingly, it can be said that in the pixel array 106, blue light detection pixels are disposed on the entire surface. Similarly, in the pixel array 106, each pixel has a light reception surface capable of detecting a wavelength band including red light and a light reception surface capable of detecting a wavelength band including blue light. Accordingly, it can be said that in the pixel array 106, red pixels and green pixels are disposed on the entire surface. When the pixel array 106 as used, it as possible to compensate for sensitivity to the wavelength band including blue light and to secure at the same time sensitivity to light in the other wavelength bands.
The wavelength bands corresponding to detection targets for the respective light reception surfaces depicted in.
Moreover, the electronic apparatus according to the present disclosure may perform imaging multiple times with use of different types of flashes to achieve image synthesis and image correction. An example of a case where the electronic apparatus 1A in
For example, the electronic apparatus 1A applies blue light to an object with use of the flash 43 during the first imaging. At this time, the white pixels operate substantially as blue pixels. Accordingly, sensitivity for detecting light in a wavelength band including blue can be raised. An image (first image) that is captured by the electronic apparatus 1A in the first imaging and that emphasizes blue color information is stored in the storage unit 41.
Thereafter, the electronic apparatus 1A applies white light to an object with use of the flash 42 during the second imaging. At the second imaging, an image (second image) less emphasizing blue color information than the image captured in the first imaging can be obtained. Then, the linear matrix unit 35 can generate an image obtained by synthesizing the first image and the second image and by compensating for information regarding the blue color attenuated due to the display unit 2. Moreover, the linear matrix unit 35 may correct the second image with use of the first image, or may correct the first image with use of the second image. By combining images captured under different conditions to perform image processing, a high-quality still image can be obtained.
According to the case described above, the flash 43 (blue flash) is caused to emit light during the first imaging, and the flash 42 (white flash) is caused to emit light during the second imaging. However, there is no limitation on the order of light emissions from the respective flashes. For example, the flash 42 (white flash) may be caused to emit light during the first imaging, and the flash 43 (blue flash) may be caused to emit light during the second imaging.
Moreover, in a case where imaging is performed multiple times with use of different types of flashes to achieve image synthesis or correction, the imaging unit 8 (first imaging unit) may adopt a pixel array different from the pixel array 107 described above. For example, as in a pixel array 108 depicted in
As described above, the electronic apparatus according to the present disclosure may further include a first light source disposed on the first surface and configured to emit blue light during imaging by the first imaging unit. Moreover, the electronic apparatus according to the present disclosure may include a second light source disposed on the first surface and configured to emit white light during imaging of the first imaging unit, and a processing circuit configured to generate an image obtained by synthesizing a first image and a second image, the first image being captured by the first imaging unit during light emission from the first light source, the second image being captured by the first imaging unit during light emission from the second light source.
Further, the electronic apparatus according to the present disclosure may include the first light source disposed on the first surface and configured to emit light during imaging of the first imaging unit, the second imaging unit disposed on a second surface on the side opposite to the first surface, and a third light source disposed on the second surface and configured to emit light during imaging by the second imaging unit. In this case, a color temperature of the first light source may be higher than a color temperature of the third light source.
The flash 43 described above is an example of the first light source. In addition, the flash 42 is an example of the second light source. The flash 44 in
On the other hand, the camera module 3a is a camera module that does not compensate for sensitivity particularly to a wavelength band including blue light, similarly to a camera module which performs imaging with use of light that has not passed through the display unit 2 (e.g., camera module 10 in
The electronic apparatus 1B depicted in
A block diagram in
For example, the A/D converter 31, the clamp unit 32, the color output unit 33, the defect correction unit 34, the linear matrix unit 35, the gamma correction unit 36, the luminance chroma signal generation unit 37, the output unit 38, the A/D converter 31B, the clamp unit 32B, the color output unit 33B, the defect correction unit 34B, and the image conversion unit 40 can be mounted on a processing circuit 201.
The image conversion unit 40 performs image conversion in such a manner as to cancel disparity between an image (third image) captured by the imaging unit 8 and an image (fourth image) captured by the imaging unit 8B. For example, the image conversion unit 40 can cancel the disparity between the third image and the fourth image with use of various types of geometrical conversion algorithms. However, algorithm used by the image conversion unit 40 is not limited to any type. According to the block diagram of
In addition, the linear matrix unit 35 can generate a fifth image by synthesizing data of the fourth image and data of the third image output from the image conversion unit 40. The fourth image is an image in which sensitivity to blue light has been compensated for. The third image is available as an image for securing sufficient resolution. The linear matrix unit 35 can generate an image which accurately expresses colors while preventing deterioration of resolution, by using images captured by both the imaging units.
Note that in
As described above, the electronic apparatus according to the present disclosure may further include a third imaging unit that is disposed on the side opposite to the display surface of the display unit and that has lower sensitivity to the first wavelength band than that of the first imaging unit, and a processing circuit configured to form an image by synthesizing a third image captured by the first imaging unit and a fourth image captured by the third imaging unit.
An organic photoelectric conversion unit 511G is provided on the rear surface side (upper side) of the semiconductor substrate. On the other hand, inorganic photoelectric conversion units 511B and 511R are laminated in a thickness direction (z-axis direction) of a semiconductor substrate 511. For example, each of the inorganic photoelectric conversion units 511B and 511R can be embedded in the semiconductor substrate 511.
For example, the organic photoelectric conversion layer 516 includes bulk-heterojunction structure of a p-type semiconductor and an n-type semiconductor (p/n unction surface) including an organic semiconductor material. For example, the semiconductor substrate 511 is an n-type silicon substrate. A surface 511S1 of the semiconductor substrate 511 corresponds to a surface facing in a light entrance direction of the semiconductor substrate 511. On the other hand, a surface 511S2 of the semiconductor substrate 511 corresponds to an opposite side surface with respect to the light entrance direction of the semiconductor substrate 511. For example, a p-well, a floating diffusion layer, a transistor, etc., can be formed in the semiconductor substrate 511. Wiring layers 570 can be formed in an insulation layer 574.
For example, a PIN-type photodiode is available as each of the inorganic photoelectric conversion units 511B and 511R. In this case, each of the inorganic photoelectric conversion units 511B and 511R has a pn-junction at a different depth (z-coordinates) of the semiconductor substrate 511. An absorbed wavelength band of electromagnetic waves varies for each depth of a silicon substrate. Accordingly, light in different wavelength bands is detectable by the inorganic photoelectric conversion units disposed at different depths within the semiconductor substrate 511.
The inorganic photoelectric conversion unit 511B is disposed at a depth where photoelectric conversion of blue light (e.g., wavelength ranging from 450 to 495 nm) is achievable. On the other hand, the inorganic photoelectric conversion unit 511R is disposed at a depth where photoelectric conversion of red light (e.g., wavelength ranging from 620 to 750 nm) is achievable. Accordingly, a blue color signal is output from the inorganic photoelectric conversion unit 511B. A red color signal is output from the inorganic photoelectric conversion unit 511R.
Each of the inorganic photoelectric conversion units 511B and 511R includes a hole accumulation layer (p-region in
A p-well 530, floating diffusion layers 521 to 523, and transistors 520 and 524 to 526 are formed along the surface 511S2 of the semiconductor substrate 511. The transistor 520 is configured in such a manner as to transfer a signal charge of the inorganic photoelectric conversion unit 511B to the floating diffusion layer 521. The transistor 524 is configured in such a manner as to transfer a signal charge of the inorganic photoelectric conversion unit 511R to the floating diffusion layer 522.
The transistor 525 is configured in such a manner as to convert a charge Generated in the organic photoelectric conversion unit 511G into a voltage signal. The transistor 526 is configured in such a manner as to reset a charge transferred from the organic photoelectric conversion unit 511G to the floating diffusion layer 523.
A contact 513 includes a conductive material such as various types of metal or doped silicon.
The organic photoelectric conversion unit 511G includes an upper electrode 517, an organic photoelectric conversion layer 516, and a lower electrode 515. For example, the upper electrode 517, the organic photoelectric conversion layer 516, and the lower electrode 515 can be formed in this order as the layers in the organic photoelectric conversion unit 511G. However, there is no limitation on the order of formation of the layers in the organic photoelectric conversion unit 511G. For example, the lower electrode 515 is formed discretely for each of the imaging units 500. On the other hand, the organic photoelectric conversion layer 516 and the lower electrode 515 may each constitute a common connection layer shared by multiple imaging units 500.
For example, the organic photoelectric conversion layer 516 includes at least either a p-type semiconductor or an n-type semiconductor. In a case where the organic photoelectric conversion layer 516 includes both an organic photoelectric conversion material as a p-type semiconductor and an organic photoelectric conversion material as an n-type semiconductor, a material that transmits visible light can be selected as one of these materials, and a material that photoelectrically converts light in a particular wavelength range can be selected as the other material. Alternatively, the organic photoelectric conversion layer 516 may include three types of materials, a material that photoelectrically converts light in a particular wavelength range (light absorber), an n-type semiconductor having transmissibility to visible light, and a p-type semiconductor having transmissibility to visible light. For example, the n-type semiconductor functions as an electron transportation material of the organic photoelectric conversion layer 516. In addition, the p-type semiconductor functions as a hole transportation material of the organic photoelectric conversion layer 516.
For example, as the organic photoelectric conversion layer 516, an organic semiconductor material such as sub-phthalocyanine, fullerene C60, fullerene C70, or derivatives of these can be used. However, there are no limitations on types or combinations of the materials to be used as the organic photoelectric conversion layer 516.
For example, the lower electrode 515 and the upper electrode 517 are each a conductive film exhibiting light transmissibility. For example, each of the lower electrode 515 and the upper electrode 517 can include, as its material, metallic oxide such as ITO, IZO, IFO, ATO, and FTO. However, there are no limitations on the materials of the lower electrode 515 and the upper electrode 517.
An insulation layer 512 and an insulation layer 514 are formed between the surface 511S1 of the semiconductor substrate 511 and the lower electrode 515 of the organic photoelectric conversion unit 511G. For example, the insulation layer 514 and the insulation layer 512 can be sequentially formed on the lower electrode 515. A fixed charge layer and an insulating dielectric layer may be alternately laminated within the insulation layer 512. Moreover, a protection layer 518 is formed between an on-chip lens layer 519 and the upper electrode 517 of the organic photoelectric conversion unit 511G. For example, the on-chip lens 519 includes on-chip lenses and a flattening layer.
The protection layer 518 includes a material exhibiting light transmissibility. For example, the protection layer 518 is a single layer film including at least any one of silicon oxide, silicon nitride, silicon oxynitride, and the like. Alternatively, the protection layer 518 may be a laminated film including two or more of these materials.
A fixed charge in the fixed charge layer included in the insulation layer 512 may be either positive or negative. For example, various types of metallic oxide or nitride are available as the fixed charge layer. For example, the dielectric layer within the insulation layer 512 includes silicon oxide, TEOS, or silicon nitride. However, there is no limitation on the material of the dielectric layer. Moreover, the fixed charge layer may be produced by laminating two or more types of films.
For example, the on-chip lens layer 519 covers the entire surface of the protection layer 516. Multiple on-chip lenses (micro-lenses) are provided on the surface of the on-chip lens layer 519. Each of the on-chip lenses concentrates incident light on each of the light reception surfaces of the organic photoelectric conversion unit 511G and the inorganic photoelectric conversion units 511B and 511R. According to the example in
A through electrode 563 is provided between the surface 511S1 and the surface 511S2 of the semiconductor substrate 511. The organic photoelectric conversion unit 511G is connected to the floating diffusion layer 523 and the transistor 525 via the through electrode 563. In this manner, a charge of the organic photoelectric conversion unit 511G can be transferred to a circuit in a following stage. In a case where the imaging unit 500 includes multiple organic photoelectric conversion units 511G, for example, the through electrode 563 can be prepared for each of the organic photoelectric conversion units 511G.
Wiring and contacts for connection are provided between the through electrode 563 and the floating diffusion layer 523 and between the through electrode 563 and the transistor 525. For example, the through electrode 563 has a substantially cylindrical shape. However, a through electrode having other shapes such as a tapered shape may be used. Note that the transistor 526 disposed near the floating diffusion layer 523 is configured to reset a charge accumulated in the floating diffusion layer 523.
The organic photoelectric conversion layer 516 absorbs light in a predetermined wavelength range to form pairs of an electron and a hole. A charge including electrons and holes shifts to a corresponding electrode by an inner electric field and diffusion generated and caused by a difference in the work function of the electrodes. For example, holes shift to the upper electrode 517. In this case, electrons shift to the lower electrode 515. However, the shift of the charge is controllably by applying a potential to a portion between the upper electrode 517 and the lower electrode 515.
In a case of use of the organic photoelectric conversion layer 516 that is a single layer, at least either a p-type semiconductor or an n-type semiconductor is available. In a case of use of both a p-type semiconductor and an n-type semiconductor, the two types of semiconductors may be mixed to form a hulk-hetero structure within the organic photoelectric conversion layer 516. Moreover, the organic photoelectric conversion layer 516 may further include a material that photoelectrically converts light in a particular wavelength range (light absorber).
The organic photoelectric conversion layer 516 may have a laminated structure. For example, a two-layer structure including a u-type semiconductor layer and an n-type semiconductor layer, a p-type semiconductor layer and a mixed layer (bulk-hetero layer) , or an n-type semiconductor layer and a mixed layer (bulk-hetero layer) may be formed. A three-layer structure including a p-type semiconductor layer, a mixed layer (hulk-hetero layer), and an n-type semiconductor layer may be formed. Moreover, a combination of multiple types of materials may be used to constitute at least either the p-type semiconductor or the n-type semiconductor.
Note that the p-type or the n-type of the organic semiconductor indicates a type of charge easily transported. For example, the p-type organic semiconductor is characterized by easy hole transport. On the other hand, the n-type organic semiconductor is characterized by easy electron transport. In such a manner, the p-type or the n-type of the organic semiconductor is not limited to a type including holes or electrons as majority carriers for thermal excitation unlike an inorganic semiconductor.
Note that other layers may be formed between the organic photoelectric conversion layer 516 and the lower electrode 515 and between the organic photoelectric conversion layer 516 and the upper electrode 517. For example, an undercoating layer, a hole transportation layer, an electron blocking layer, an organic photoelectric conversion layer, a hole blocking layer, a buffer layer, an electron transportation layer, and a work function adjustment layer may be sequentially laminated below the lower electrode 515.
Moreover, the lower electrode 515 and the upper electrode 517 may be covered with an insulating material. For example, the material that covers the lower electrode 515 and the upper electrode 517 is metallic oxide such as a silicon oxide material, a silicon nitride (SiNx), and aluminum oxide (Al2O3). However, other types of inorganic insulating materials may be used. For example, the coating layer can be formed by a dry coating method or a wet coating method.
Red, green, and blue color signals are acquirable from respective pixels by use of the imaging unit 500 having organic photoelectric conversion films.
A surface 611S1 of a semiconductor substrate 611 corresponds to a surface in a light entrance direction of the semiconductor substrate 611 (z-axis positive direction). Moreover, a surface 611S2 of a semiconductor substrate 611 corresponds to a surface in the direction opposite to the light entrance direction of the semiconductor substrate 611 (z-axis negative direction). It is assumed in the following description that a z-axis positive direction is referred to as “upper” and that a z-axis negative direction is referred to as “lower.”
Above the semiconductor substrate 611 (surface 611S1 side), an organic photoelectric conversion unit 611B, an organic photoelectric conversion unit 611G, and an organic photoelectric conversion unit 611R are formed in this order from above. An insulation layer 642 is formed between the surface 611S1 and the organic photoelectric conversion unit 611R of the semiconductor substrate 611. Moreover, an insulation layer 641 is formed between the organic photoelectric conversion unit 611B and the organic photoelectric conversion unit 611G. Further, an insulation layer 640 is formed between the organic photoelectric conversion unit 611G and the organic photoelectric conversion unit 611B.
On the other hand, an insulation layer 674 is disposed below the semiconductor substrate 611 (surface 611S2 side). Wiring layers 670 can be formed in the insulation layer 674. Such transistor and floating diffusion layer as depicted in
Further, a protection layer 618 including a material exhibiting light transmissibility is formed on the organic photoelectric conversion unit 611B. An on-chip lens layer 619 is formed on the protection layer 618. For example, the on-chip lens layer 619 includes multiple on-chip lenses (micro-lenses) and a flattening layer. Each of the on-chip lenses concentrates incident light on each of light reception surfaces of the organic photoelectric conversion unit 611R, the organic photoelectric conversion unit 611G, and the organic photoelectric conversion unit 611B.
According to the imaging unit 600, the inorganic photoelectric conversion unit 511B and the inorganic photoelectric conversion unit 511R of the imaging unit 500 are replaced with the organic photoelectric conversion unit 611B and the organic photoelectric conversion unit 611R, respectively. Accordingly, the imaging unit 600 uses an organic photoelectric conversion film for detection of all of red, light, green light, and blue light.
The organic photoelectric conversion unit 611B includes an upper electrode 617, an organic photoelectric conversion layer 616, and a lower electrode 615. The lower electrode 615 and the upper electrode 617 are each a conductive film exhibiting light transmissibility, similarly to the lower electrode 515 and the upper electrode 517 in
The organic photoelectric conversion unit 611G includes an upper electrode 627, an organic photoelectric conversion layer 626, and a lower electrode 625. The upper electrode 627 and the lower electrode 625 are each a conductive film exhibiting light transmissibility, similarly to the lower electrode 515 and the upper electrode 517 in
The organic photoelectric conversion unit 611R includes an upper electrode 637, an organic photoelectric conversion layer 636, and a lower electrode 635. The upper electrode 637 and the lower electrode 635 are each a conductive film exhibiting light transmissibility, similarly to the lower electrode 515 and the upper electrode 517 in
For example, the upper electrode and the lower electrode described above can include metallic oxide such as ITO, IZO, IFO, ATO, and FTO. However, there are no limitations on the materials of the lower electrode and the upper electrode. Moreover, the lower electrode may be formed discretely for each of the imaging units as depicted in
Note that, similarly to
Each of the organic photoelectric conversion layers absorbs light in a predetermined wavelength range to form pairs of an electron and a hole. For example, holes shift to the upper electrode, and electrons shift to the lower electrode. The shift of the charge is controllable by applying a potential between the upper electrode and the lower electrode, similarly to the case of
Red, green, and blue color signals are acquirable from respective pixels by use of the imaging unit 600 including the organic photoelectric conversion films.
As described above, the first imaging unit of the electronic apparatus according to the present disclosure may include multiple photoelectric conversion units disposed in the depth direction of the substrate. At least one of the multiple photoelectric conversion units may include an organic photoelectric conversion film. Specifically, the first imaging unit of the electronic apparatus according to the present disclosure may include multiple light reception surfaces. Each of the light reception surfaces may detect light in different wavelength band. Moreover, at least any one of the light reception surfaces of the first imaging unit may include an organic photoelectric conversion film.
According to the electronic apparatus of the present disclosure, the necessity of providing a front camera on a bezel is eliminated by providing the imaging unit on the side opposite to the display unit. Accordingly, an electronic apparatus having a reduced bezel width or a bezel-less type electronic apparatus is providable. Moreover, a larger-sized display unit is allowed to be mounted without increasing the size of the housing of the electronic apparatus. Accordingly, demands for both miniaturization of the electronic apparatus and screen enlargement can be met.
Further, according to the electronic apparatus of the present disclosure, a ratio of blue light detection pixels of the first imaging unit disposed on the side opposite to the display unit can be made higher than that of the second imaging unit disposed on the surface on the side opposite to the display unit. In addition, according to the electronic apparatus of the present disclosure, the ratio of the blue light detection pixels of the first imaging unit disposed on the side opposite to the display unit can be made higher than ¼. In this manner, it is achievable to compensate for sensitivity to a wavelength band including attenuated blue light which is included in light having passed through the display unit and to prevent image quality deterioration of a captured image.
Note that compensation for sensitivity to the wavelength band including blue light may be achieved using a blue light flash during imaging in the electronic apparatus according to the present disclosure. Moreover, multiple imaging units may be disposed on the side opposite to the display unit in the electronic apparatus according to the present disclosure. In this case, the imaging units each having a different pixel array may be disposed on the side opposite to the display unit. For example, an imaging unit having a higher ratio of blue light detection pixels than that of a Bayer array and an imaging unit having sensitivity to a wavelength band including blue light at a level similar to that of sensitivity of a Bayer array can be combined. Compensation for sensitivity to the wavelength band including blue light is achievable while sufficient resolution of images is secured, by performing image synthesis or image correction with use of images captured by the multiple imaging units.
There are various types considered to be specific possible candidates of the electronic apparatus configured as described above. For example,
Moreover, a CPU (Central Processing Unit) 56 and a coil (magnetic force and current conversion coil) 57 are provided within the housing 51. The CPU 56 controls imaging using the camera 52 and an operation for data accumulation in the memory 53, and controls transmission of data from the memory 53 to a data reception device (not depicted) outside the housing 51 with use of the wireless transmitter 55. The coil 57 supplies power to the camera 52, the memory 53, the wireless transmitter 55, the antenna 54, and light sources 52b which will be described below,
Moreover, a magnetic (lead) switch 58 is provided in the housing 51 to detect the capsule endoscope 50 when the capsule endoscope 50 is set on the data reception device. At the time when the lead switch 58 detects that the capsule endoscope 50 is set on the data reception device and data transmission is allowed, the CPU 56 supplies power from the coil 57 to the wireless transmitter 55.
For example, the camera 52 includes an imaging element 52a including the objective optical system 9 for capturing an image of the inside of the body cavity, and multiple light sources 52b for illuminating the inside of the body cavity. Specifically, for example, the camera 52 includes a CMOS (Complementary Metal Oxide Semiconductor) sensor including an LED (Light Emitting Diode), a CCD (Charge Coupled Device), or the like to function as the Tight sources 52b.
The display unit 2 included in the electronic apparatus according to the above embodiments is a concept including such a light emitter as the light sources 52b depicted in
Further,
Accordingly, the example depicted in
In the case of
As described above, the electronic apparatus according to the present disclosure is applicable to various use purposes. Accordingly, utility values of the apparatus are allowed to increase.
Note that the present technology can have following configurations.
An electronic apparatus including:
a display unit disposed on a first surface;
a first imaging unit disposed on a side opposite to a display surface of the display unit; and
a second imaging unit disposed on a second surface on a side opposite to the first surface,
in which sensitivity of the first imaging unit to a first wavelength band that includes blue light is higher than sensitivity of the second imaging unit to the first wavelength band.
The electronic apparatus according to (1), in which the first imaging unit receives light having passed through the display unit.
The electronic apparatus according to (1) or (2), in which a ratio of blue light detection pixels in a pixel array of the first imaging unit is higher than a ratio of blue light detection pixels in a pixel array of the second imaging unit.
The electronic apparatus according to (3), in which the blue light detection pixels include at least any of a blue pixel, a magenta pixel, and a cyan pixel.
The electronic apparatus according to any one of (1) to (3), in which the first imaging unit includes at least any of a cyan pixel, a magenta pixel, and a yellow pixel.
The electronic apparatus according to any one of (1) to (5), further including:
a first light source disposed on the first surface and configured to emit blue light during imaging by the first imaging unit.
The electronic apparatus according to (6), further including:
a second light source disposed on the first surface and configured to emit white light during imaging by the first imaging unit; and
a processing circuit configured to generate an image by synthesizing a first image and a second image, the first image being captured by the first imaging unit during light emission from the first light source, the second image being captured by the first imaging unit during light emission from the second light source.
The electronic apparatus according to any one of (1) to (5), further including:
a first light source disposed on the first surface and configured to emit light during imaging by the first imaging unit;
the second imaging unit disposed on the second surface on the side opposite to the first surface; and
a third light source disposed on the second surface and configured to emit light during imaging by the second imaging unit,
in which a color temperature of the first light source is higher than a color temperature of the third light source.
The electronic apparatus according to any one of (1) to (8), further including:
a third imaging unit that is disposed on the side opposite to the display surface of the display unit and has lower sensitivity to the first wavelength band than the sensitivity of the first imaging unit to the first wavelength band; and
a processing circuit configured to generate an image by synthesizing a third image captured by the first imaging unit and a fourth image captured by the third imaging unit.
The electronic apparatus according to any one of (1) to (9), in which the first imaging unit has multiple photoelectric conversion units arranged in a depth direction of a substrate.
The electronic apparatus according to (10), in which at least any one of the multiple photoelectric conversion units includes an organic photoelectric conversion film.
An electronic apparatus including:
a display unit disposed on a first surface; and
first imaging unit that is disposed on a side opposite to a display surface of the display unit and includes multiple pixels for photoelectrically converting light having entered via the display unit,
in which a ratio of blue light detection pixels included in the multiple pixels is higher than ¼.
The electronic apparatus according to (12), in which the blue light detection pixels include at least any of a blue pixel, a magenta pixel, and a cyan pixel.
The electronic apparatus according to (12) or (13), in which the first imaging unit includes at least any of a cyan pixel, a magenta pixel, and a yellow pixel.
The electronic apparatus according to any one of (12) to (14), further including:
a first light source disposed on the first surface and configured to emit blue light during imaging by the first imaging unit.
The electronic apparatus according to (15), further including:
a second light source disposed on the first surface and configured to emit white light during imaging by the first imaging unit; and
a processing circuit configured to generate an image by synthesizing a first image and a second image, the first image being captured by the first imaging unit during light emission from the first light source, the second image being captured by the first imaging unit during light emission from the second light source.
The electronic apparatus according to any one of (12) to (14), further including:
a first light source disposed on the first surface and configured to emit light during imaging by the first imaging unit;
a second imaging unit disposed on a second surface on a side opposite to the first surface; and
a third light source disposed on the second surface and configured to emit light during imaging by the second imaging unit,
in which a color temperature of the first light source is higher than a color temperature of the third light source.
The electronic apparatus according to any one of (12) to (17), further including:
a third imaging unit that is disposed on the side opposite to the display surface of the display unit and has a lower ratio of the blue light detection pixels than a ratio of the blue light detection pixels of the first imaging unit; and
a processing circuit configured to generate an image by synthesizing a third image captured by the first imaging unit and a fourth image captured by the third imaging unit.
The electronic apparatus according to any one of (12) to (18), in which the first imaging unit has multiple photoelectric conversion units arranged in a depth direction of a substrate.
The electronic apparatus according to (19), in which at least any one of the multiple photoelectric conversion units includes an organic photoelectric conversion film.
The electronic apparatus according to any one of (12) to (20), in which the first imaging unit has a pixel array where at least either green pixels or red pixels in a Bayer array are replaced with pixels in a color having a shorter wavelength.
The electronic apparatus according to any one of (1) to (11), in which the first imaging unit has a pixel array where at least either green pixels or red pixels in a Bayer array are replaced with pixels in a color having a shorter wavelength.
Modes of the present disclosure are not limited to the individual embodiments described above, and also include various modifications which may be conceived of by those skilled in the art. In addition, advantageous effects of the present disclosure are not limited to the contents described above. Specifically, various additions, changes, and partial deletions can be made without departing from the scope of conceptual spirits and purposes of the present disclosure derived from the contents and equivalents of those specified in the claims
Number | Date | Country | Kind |
---|---|---|---|
2019-219864 | Dec 2019 | JP | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2020/043896 | 11/25/2020 | WO |