The present disclosure related to an imaging device and an electric device.
Nowadays, a display of an electric device can be transparent and therefore a camera to take pictures can also be placed behind the display to make a wider area for the display on a front surface of the electric device. However, a light from the display to camera is influenced by optical characteristics of the display. Therefore, if pictures are taken by the camera behind the display, a quality of image of the pictures will be degraded due to the optical disturbance caused by the display.
The disturbance is mainly reflection at the display or diffraction due to wires of a wiring layer of the display. Particularly, the diffraction causes severe ugly artifact on the image captured by the camera and now there is no effective solutions to resolve this problem.
An imaging device may include:
An electric device may include:
These and/or other aspects and advantages of embodiments of the present disclosure will become apparent and more readily appreciated from the following descriptions made with reference to the drawings, in which:
Embodiments of the present disclosure will be described in detail and examples of the embodiments will be illustrated in the accompanying drawings. The same or similar elements and the elements having same or similar functions are denoted by like reference numerals throughout the descriptions. The embodiments described herein with reference to the drawings are explanatory, which aim to illustrate the present disclosure, but shall not be construed to limit the present disclosure.
As shown in
In the embodiments of the present disclosure, the electric device 10 is a mobile device, particularly a smartphone device. However, the electric device 10 may be various kinds of devices such a multifunctional mobile device, a laptop computer, a desktop computer, a tablet computer and so on.
The display 20 may be made of organic light emitting diodes (OLED) in the embodiments. The display 20 is substantially transparent and covers substantially all area of a front surface of the electric device 10. The display 20 may include a light emitting layer 22 and a wiring layer 24. The light emitting layer 22 emits lights in red, green and blue to create various kinds of image and characters on the front surface of the display 20. The front surface of the display 20 may be coated by an antireflection material. That is, an antireflection layer may be formed on the front surface of the display 20.
The wiring layer 24 is a substrate to form the display 20 and includes a plurality of wires in a predetermined wiring pattern. That is, wires are arranged in the wiring layer 24 to provide electric power to the organic light emitting diodes of the light emitting layer 22. In the embodiments, the wires are arranged in a latticed pattern.
The display 20 is not limited to a display formed of the organic light emitting diodes but may be formed of other kinds of transparent display such as a liquid crystal display (LCD) or the like.
The camera 30 is located behind the display 20. Therefore, the camera 30 is an embedded camera invisible for users of the electric device 10. The camera 30 may be placed anywhere under the display 20. In the embodiments, the camera is located at a back side of the display 20 and located on the center of an upper area of the electric device 10 of
The camera 30 includes an optical lens 32 and an imaging sensor 34. The optical lens 32 gathers the light which has passed through the display 20 and focuses the light on the imaging sensor 34. The imaging sensor 34 senses the light to create an image.
Moreover, the electric device 10 according to the embodiments may further include an optical element 40 between the display 20 and the camera 30. In other words, the optical element 40 is interposed between the display 20 and the camera 30. The optical element 40 filters the light through the display 20 and passes the filtered light to the camera 30. Furthermore, the optical element 40 reduces optical disturbance based on the display 20. More specifically, in the embodiments, the optical element 40 has an optical mask with a special masking pattern or optical characteristics to attenuate diffraction due to the wiring layer 24 of the display 20. The display 20, the camera 30 and the optical element 40 constitute an imaging device in the embodiments. Of course, the imaging device may include other elements than the display 20, the camera 30 and the optical element 40.
In addition, the electric device 10 according to the embodiments may further include an image processing circuit 50 which processes the image acquired by the imaging sensor 34 of the camera 30. That is, the image acquired by the camera 30 is subjected to an image correction process of the image processing circuit 50.
The sharpness of the image would be degraded due to the optical element 40, the optical lens 32 and/or the display 20. In the embodiments, the image correction process of the image processing circuit 50 restores degradation of the image to improve sharpness.
The image correction circuit 50 may be placed either inside the electric device 10 or outside the electric device 10. When the image correction circuit 50 is inside the electric device 10, the image correction circuit 50 may be incorporated in the wiring layer 24 as shown in
When the image correction circuit 50 is outside the electric device 10, a computer connected to the electric device 10 may execute the image correction process. In this case, the computer connected to the electric device 10 constitutes the image correction circuit 50.
During the image correction process, in order to improve the sharpness of the image generated by the camera 30, a sharpening process is executed by using PSF (Point Spread Function) which is also called as an inverse filtering process. In more detail, the image correction circuit 50 may execute an image sharpening process based on the optical characteristics of the optical element 40 which can be represented by PSF. The blur of the image captured by the camera 30 can be improved by the image sharpening process. For example, the image sharpening process emphasizes edges of the image by using the inverse filter which is made from the PSF based on the optical characteristics of the optical element 40. In addition, during the image correction process, in order to improve the brightness of the image generated by the camera 30, a global contrast adjustment is also executed.
In the embodiments of the present disclosure, the image correction circuit 50 is not always necessary. That is, the image correction circuit 50 may be omitted in the embodiments of the present disclosure. For example, if the degradation of the image generated by the imaging sensor 34 is not so strong and the quality of the image is good enough for users, the image correction circuit 50 can be omitted. A basic structure of the electric device 10 according to the embodiments of the present disclosure has been explained, and next, several embodiments of the optical element 40 for the electric device 10 will be explained hereinafter.
In a first embodiment, the optical element 40 of the electric device 10 is configured to include an optical mask which has a transparent region, a gradation region and a mask region and a masking pattern of which corresponds to a wiring pattern of the wires of the wiring layer 24. More detailed will be described below.
As shown in
Naturally, the light passing through the display 20 is influenced by the optical characteristics of the display 20, particularly, the obstacles of the wires 26. That is, the light has a property of the waves and the waves have an interference with each other after they pass the wiring layer 24 including the wires 26. The interference causes the diffraction artifact on the image created by the camera 30. That is, if a user takes a picture by the camera 30 behind the display 20, the quality of the image will unfortunately degraded due to the optical disturbance caused by the display 20.
Under the normal conditions, the disturbance is mainly diffraction at the obstacles of the wires 26 in the wiring layer 24. The diffraction causes severe ugly artifact on the image generated by the camera 30. Therefore, if the diffraction of the light can be reduced before the camera 30 senses the light, it would be technically advantageous to improve the quality of the image captured by the camera 30.
Therefore, the electric device 10 according to the first embodiment includes the optical element 40 to filters the light through the display 20 and passes the filtered light to the camera 30. The optical element 40 reduces the diffraction of the light due to the wires 26 of the wiring layer 24.
As shown in
Particularly, as shown in
Moreover, as shown in
As shown in
The masking pattern of the optical element 40 is not limited to that of
Generally, the mask region 46 of the masking pattern may be provided for a plurality of the wires 26 of the wiring pattern of the wiring layer 24. That is, one line of the mask region 46 of the masking pattern can be provided for every three, four and more wires 26 of the wiring pattern of the wiring layer 24.
For another example, as shown in
It is considered that the intersections of the wires 26 causes more significant diffraction than the other part of the wires 26 does. Therefore, the optical element 40 of
For still another example, as shown in
Although the reduction of the diffraction caused by the optical element 40 of
As understood from description of the optical element 40 mentioned above, the masking pattern of the mask region 46 corresponding to the wiring pattern of the wires 26 does not mean that the masking pattern of the mask region 46 is completely congruent with the wiring pattern of the wires 26. In the present disclosure, the masking pattern of the mask region 46 corresponding to the wiring pattern of the wires 26 means that the masking pattern of the mask region 46 is associated with the wiring pattern of the wires 26 so as to attenuate the diffraction.
Furthermore, in the embodiments of the present disclosure, although the optical element 40 is located between the display 20 and the camera 30, the position of the optical element 40 is optional choice between the display 20 and the camera 30. For example, as shown in
On the other hand, as shown in
In addition, the transparent region 42 may be made of space between the gradation region 44. That is, nothing is printed on the back surface of the wiring layer 24 in the transparent region 42.
In the optical element 40 of
As mentioned above, since the optical mask of the optical element 40 is interposed between the display 20 and the camera 30, the diffraction due to the wires 26 of the wiring layer 24 can be decreased. Therefore, it is possible to reduce the diffraction artifact generated on the image obtained by the camera 30.
Incidentally, the number of layers of the optical element 40 is not limited to one. Namely, the optical element 40 may include superimposed a plurality of optical masks, each of which has the transparent region 42, the gradation region 44 and the mask region 46.
In an electric device 10 according to a second embodiment, the optical element 40 includes a diffuser to reduce the diffraction instead of the optical mask whose masking pattern corresponds to that of the wires 26. Hereinafter, an explanation will be made for differentials from the first embodiment.
As shown in
On the other hand, in accordance with the optical element 40 shown in
More specifically, the image correction circuit 50 executes the sharpening process by using the PSF, which is an inversing filtering process. In addition, the image correction circuit 50 also executes the global contrast adjustment for the image. In other words, a combination of the diffuser of the optical element 40 and the compensation process of the image correction circuit 50 is necessary to create a clear image in the second embodiment.
However, if the diffusion of the optical element 40 is not significant, the compensation process by the image correction circuit 50 can be omitted.
As mentioned above, since the optical element 40 includes the diffuser, the optical element 40 can prevent the diffraction due to the wires 26 of the wiring layer 24. Therefore, it is possible to reduce the diffraction artifact generated on the image obtained by the camera 30.
Incidentally, the number of layers of the optical element 40 is not limited to one. Namely, the optical element 40 may include superimposed a plurality of diffusion layers, each of which diffuses the light through the display 20.
In addition, the imaging device of the second embodiment can be combined with the imaging device of the first embodiment. In the combination of the first embodiment and the second embodiment, as shown in
In contrast with the electric device 10 of
In an electric device 10 according to a third embodiment, the optical element 40 is incorporated in the wiring layer 24 of the display 20. Hereinafter, an explanation will be made for differentials from the first embodiment.
Therefore, in electric device 10 of the third embodiment, the optical element 40 is interposed between the display 20 and the camera 30 but the optical element 40 is incorporated in the display 20. Also here, it can be explained that the optical element 40 is placed between the display 20 and the camera 30.
The optical element 40 covers the uneven back surface of the wiring layer 24 of the display 20. In other words, the concave parts of the wiring layer 24 are filled with the optical element 40. The optical element 40 is made of the transparent material to pass and filter the light from the display 20 to the camera 30.
The material of the optical element 40 may be filled to the concave parts of the wiring layer 24 but the material in the concave parts of the wiring layer 24 can be connected with each other as shown in
In contrast with
As mentioned above, since the optical element 40 flattens the back surface of the display 20, the optical element 40 can prevent the diffraction due to the uneven back surface formed by the wires 26. Therefore, it is possible to reduce the diffraction artifact generated on the image obtained by the camera 30.
Since the display 20 is composed of the transparent display, the camera 30 can be placed in the electric device 10 anywhere. For example, as shown in
In accordance with the electric device 10 according to the first through third embodiments, the camera 30 can be mounted behind the display 20 without ugly artifacts caused by the diffraction. This enables to set the camera 30 anywhere behind the display 20, and this makes it possible to take natural eye point selfie without any costly computation.
More specifically, if the camera 30 is mounted in an upper area of the electric device 10 as shown in
Moreover, the electric device 10 of
In the description of embodiments of the present disclosure, it is to be understood that terms such as “central”, “longitudinal”, “transverse”, “length”, “width”, “thickness”, “upper”, “lower”, “front”, “rear”, “left”, “right”, “vertical”, “horizontal”, “top”, “bottom”, “inner”, “outer”, “clockwise” and “counterclockwise” should be construed to refer to the orientation or the position as described or as shown in the drawings under discussion. These relative terms are only used to simplify description of the present disclosure, and do not indicate or imply that the device or element referred to must have a particular orientation, or constructed or operated in a particular orientation. Thus, these terms cannot be constructed to limit the present disclosure.
In addition, terms such as “first” and “second” are used herein for purposes of description and are not intended to indicate or imply relative importance or significance or to imply the number of indicated technical features. Thus, the feature defined with “first” and “second” may comprise one or more of this feature. In the description of the present disclosure, “a plurality of” means two or more than two, unless specified otherwise.
In the description of embodiments of the present disclosure, unless specified or limited otherwise, the terms “mounted”, “connected”, “coupled” and the like are used broadly, and may be, for example, fixed connections, detachable connections, or integral connections; may also be mechanical or electrical connections; may also be direct connections or indirect connections via intervening structures; may also be inner communications of two elements, which can be understood by those skilled in the art according to specific situations.
In the embodiments of the present disclosure, unless specified or limited otherwise, a structure in which a first feature is “on” or “below” a second feature may include an embodiment in which the first feature is in direct contact with the second feature, and may also include an embodiment in which the first feature and the second feature are not in direct contact with each other, but are contacted via an additional feature formed therebetween. Furthermore, a first feature “on”, “above” or “on top of” a second feature may include an embodiment in which the first feature is right or obliquely “on”, “above” or “on top of” the second feature, or just means that the first feature is at a height higher than that of the second feature; while a first feature “below”, “under” or “on bottom of” a second feature may include an embodiment in which the first feature is right or obliquely “below”, “under” or “on bottom of” the second feature, or just means that the first feature is at a height lower than that of the second feature.
Various embodiments and examples are provided in the above description to implement different structures of the present disclosure. In order to simplify the present disclosure, certain elements and settings are described in the above. However, these elements and settings are only by way of example and are not intended to limit the present disclosure. In addition, reference numbers and/or reference letters may be repeated in different examples in the present disclosure. This repetition is for the purpose of simplification and clarity and does not refer to relations between different embodiments and/or settings. Furthermore, examples of different processes and materials are provided in the present disclosure. However, it would be appreciated by those skilled in the art that other processes and/or materials may be also applied.
Reference throughout this specification to “an embodiment”, “some embodiments”, “an exemplary embodiment”, “an example”, “a specific example” or “some examples” means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present disclosure. Thus, the appearances of the above phrases throughout this specification are not necessarily referring to the same embodiment or example of the present disclosure. Furthermore, the particular features, structures, materials, or characteristics may be combined in any suitable manner in one or more embodiments or examples.
Any process or method described in a flow chart or described herein in other ways may be understood to include one or more modules, segments or portions of codes of executable instructions for achieving specific logical functions or steps in the process, and the scope of a preferred embodiment of the present disclosure includes other implementations, in which it should be understood by those skilled in the art that functions may be implemented in a sequence other than the sequences shown or discussed, including in a substantially identical sequence or in an opposite sequence.
The logic and/or step described in other manners herein or shown in the flow chart, for example, a particular sequence table of executable instructions for realizing the logical function, may be specifically achieved in any computer readable medium to be used by the instruction execution system, device or equipment (such as the system based on computers, the system comprising processors or other systems capable of obtaining the instruction from the instruction execution system, device and equipment and executing the instruction), or to be used in combination with the instruction execution system, device and equipment. As to the specification, “the computer readable medium” may be any device adaptive for including, storing, communicating, propagating or transferring programs to be used by or in combination with the instruction execution system, device or equipment. More specific examples of the computer readable medium comprise but are not limited to: an electronic connection (an electronic device) with one or more wires, a portable computer enclosure (a magnetic device), a random access memory (RAM), a read only memory (ROM), an erasable programmable read-only memory (EPROM or a flash memory), an optical fiber device and a portable compact disk read-only memory (CDROM). In addition, the computer readable medium may even be a paper or other appropriate medium capable of printing programs thereon, this is because, for example, the paper or other appropriate medium may be optically scanned and then edited, decrypted or processed with other appropriate methods when necessary to obtain the programs in an electric manner, and then the programs may be stored in the computer memories.
It should be understood that each part of the present disclosure may be realized by the hardware, software, firmware or their combination. In the above embodiments, a plurality of steps or methods may be realized by the software or firmware stored in the memory and executed by the appropriate instruction execution system. For example, if it is realized by the hardware, likewise in another embodiment, the steps or methods may be realized by one or a combination of the following techniques known in the art: a discrete logic circuit having a logic gate circuit for realizing a logic function of a data signal, an application-specific integrated circuit having an appropriate combination logic gate circuit, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.
Those skilled in the art shall understand that all or parts of the steps in the above exemplifying method of the present disclosure may be achieved by commanding the related hardware with programs. The programs may be stored in a computer readable storage medium, and the programs comprise one or a combination of the steps in the method embodiments of the present disclosure when run on a computer.
In addition, each function cell of the embodiments of the present disclosure may be integrated in a processing module, or these cells may be separate physical existence, or two or more cells are integrated in a processing module. The integrated module may be realized in a form of hardware or in a form of software function modules. When the integrated module is realized in a form of software function module and is sold or used as a standalone product, the integrated module may be stored in a computer readable storage medium.
The storage medium mentioned above may be read-only memories, magnetic disks, CD, etc.
Although embodiments of the present disclosure have been shown and described, it would be appreciated by those skilled in the art that the embodiments are explanatory and cannot be construed to limit the present disclosure, and changes, modifications, alternatives and variations can be made in the embodiments without departing from the scope of the present disclosure.
This application is a continuation application of International Application No. PCT/CN2018/107719, filed on Sep. 26, 2018, the entire contents of which are incorporated herein by reference.
Number | Name | Date | Kind |
---|---|---|---|
8022977 | Kanade | Sep 2011 | B2 |
20080106628 | Cok | May 2008 | A1 |
20090009628 | Janicek | Jan 2009 | A1 |
20090102763 | Border | Apr 2009 | A1 |
20100309285 | Bolle | Dec 2010 | A1 |
20120105400 | Mathew et al. | May 2012 | A1 |
20140111749 | Won et al. | Apr 2014 | A1 |
Number | Date | Country |
---|---|---|
104181725 | Dec 2014 | CN |
105094307 | Nov 2015 | CN |
106850897 | Jun 2017 | CN |
107065370 | Aug 2017 | CN |
108376696 | Aug 2018 | CN |
108551544 | Sep 2018 | CN |
H08254604 | Oct 1996 | JP |
2006039097 | Feb 2006 | JP |
2011107379 | Jun 2011 | JP |
Entry |
---|
Communication pursuant to Article 94(3) EPC for EP Application 18934631.5 dated Mar. 25, 2022. (7 pages). |
International Search Report for PCT/CN2018/107719 dated Dec. 18, 2018. |
Extended European Search Report for EP Application 18934631.5 dated Aug. 16, 2021. (10 pages). |
Communication pursuant to Article 94(3) EPC for EP Application 18934631.5 dated Aug. 11, 2022. (6 pages). |
Chinese Office Action with English Translation for CN Application 201880097133.1 dated Aug. 25, 2022. (30 pages). |
Number | Date | Country | |
---|---|---|---|
20210210533 A1 | Jul 2021 | US |
Number | Date | Country | |
---|---|---|---|
Parent | PCT/CN2018/107719 | Sep 2018 | US |
Child | 17210089 | US |