This disclosure is based upon and claims priority to Chinese Patent Application No. 202010549854.0, filed on Jun. 16, 2020, and entitled “Method and Apparatus for Controlling Camera, and Under-display Camera Structure”, the entire contents of which are incorporated herein by reference.
Embodiments of the present disclosure relate to the field of intelligent terminals, and particularly relate to a method and an apparatus for controlling a camera, and an under-display camera structure.
Full-display literally means a display covering the entire front surface of a mobile phone, without bezels at four sides of the mobile phone and with a screen-to-body ratio close to 100%. However, limited by the prior art, only mobile phones having an ultra-high display-to-body ratio are commercially available for the time being, while ones having a display-to-body ratio of 100% are still unavailable. Nowadays, a full-display mobile phone actually is a mobile phone having a display-to-body ratio of 90% or above and designed with ultra-narrow bezels.
All full-display mobile phone manufacturers have to face and solve the common problem: since a receiver, a front camera and various sensors have to be placed on a front surface of a mobile phone so as to satisfy daily demands of users, these devices will inevitably occupy part of a display area when being placed on the front surface of the mobile phone. As a consequence, all mobile phone manufacturers are seeking to reduce an area occupied by these functional devices, and various full-display solutions such as “Bang-like display”, “water drop-like display” and “hole-like display” have successively emerged one after another.
In the related technology, provided is an under-display camera. The under-display camera includes: a display panel, a backlight module, a light guide component and a light source component. The backlight module is arranged at one side of the display panel, and is provided with a first opening corresponding to the under-display camera. The light guide component is inserted into the first opening, and is configured to guide a light beam entering the light guide component to a display panel area corresponding to the first opening. The light source component is configured to provide a light source for the light guide component. When the under-display camera is turned on, the light source component is turned off. When the under-display camera is not turned on, the light source component is turned on or off. Therefore, a through hole or blind hole on the display panel can repossess display capability, and image quality that can be obtained by the under-display camera can still be maintained.
As a light source is provided by a side light guide component, a direction of light cannot be adjusted and concentrated, and most of the light cannot be upward incident on a glass area, thereby affecting backlight efficiency. Meanwhile, light cannot be supplemented when a front camera is used.
There is a problem of a poor photographing effect when ambient light is weak due to limited light entering an under-display camera in the related technology.
Embodiments of the present disclosure provide a method and an apparatus for controlling a camera, and an under-display camera structure, so as to at least solve a problem of a poor photographing effect when ambient light is weak due to limited light entering an under-display camera in the related technology.
An embodiment of the present disclosure provides an under-display camera structure. The under-display camera structure includes: a display and a camera arranged under the display. The display includes display glass and display area backlight. An opening area is configured in the display area backlight above the camera. The display glass forms convex glass in a direction of the opening area curving towards the camera. A flexible printed circuit board having an annular conical structure is connected between the convex glass and the camera, so as to surround a viewing angle of the camera. A plurality of lamp beads are sequentially arranged on the flexible printed circuit board from a camera end to a convex glass end.
When the camera is in a turned-on state, first-type lamp beads which are pre-determined in the plurality of lamp beads and are close to the camera end are in a turned off state, predetermined second-type lamp beads far away from the camera are controlled to be in a lighting state, and light emitted by the second-type lamp beads forms a circle of light on the convex glass after being refracted by the convex glass, so as to make the convex glass display no images.
When the camera is in a turned-off state, the plurality of lamp beads are in a lighting state, and backlight is provided for the convex glass after refraction by the convex glass, so as to make the convex glass display images.
In an exemplary embodiment, the second-type lamp beads are at a maximum brightness value.
In an exemplary embodiment, an inclination angle of the annular conical structure is determined according to a light incident angle of the camera, pixels of the camera, a brightness of the display, a thickness of the display area backlight and a size of the opening area.
In another exemplary embodiment, the flexible printed circuit board is configured to conduct the plurality of lamp beads and is connected to a backlight chip, wherein the backlight chip is configured to control brightness of the plurality of lamp beads.
Another embodiment of the present disclosure provides a method for controlling an under-display camera. The method includes:
when a camera is detected to be in a turned-on state, predetermined first-type lamp beads close to a camera end are turned off and predetermined second-type lamp beads away from the camera are controlled to be in a lighting state, and light emitted by the second-type lamp beads forms a circle of light on the convex glass after being refracted by the convex glass, so as to make the convex glass display no images, wherein a display is arranged above the camera, the display includes display glass and display area backlight, an opening area is configured in the display area backlight above the camera, the display glass forms convex glass in a direction of the opening area curving towards the camera, a flexible printed circuit board having an annular conical structure is connected between the convex glass and the camera, so as to surround a viewing angle of the camera, and a plurality of lamp beads are sequentially arranged on the flexible printed circuit board from the camera end to a convex glass end; and
when the camera is detected to be in a turned-off state, the plurality of lamp beads are controlled to be in a lighting state, and backlight is provided for the convex glass after being refracted by the convex glass, so as to make the convex glass display images.
In an exemplary embodiment, before the predetermined first-type lamp beads close to a camera end are turned off and the predetermined second-type lamp beads away from the camera are controlled to be in a lighting state, the method further includes:
an inclination angle of the annular conical structure is determined;
a light angle of light emitted by the lamp beads after reflection by the convex glass is determined according to the inclination angle of the annular conical structure, a radian of the convex glass and a light-emitting angle of the lamp beads; and
the first-type lamp beads and the second-type lamp beads are determined according to the light angle, the light-emitting angle of the lamp beads and a light incident angle of the camera.
In an exemplary embodiment, the inclination angle of the annular conical structure is determined includes:
the light incident angle of the camera, pixels of the camera, a brightness of the display, a thickness of the display area backlight and a size of the opening area are obtained; and
the inclination angle of the annular conical structure is determined according to the light incident angle of the camera, the pixels of the camera, the brightness of the display, the thickness of the display area backlight and the size of the opening area.
In an exemplary embodiment, after the inclination angle of the annular conical structure is determined, the method further includes:
the number of the plurality of lamp beads and an arrangement mode of the plurality of lamp beads are determined according to the brightness of the display, the inclination angle of the annular conical structure and the size of the opening area.
In an exemplary embodiment, after the predetermined second-type lamp beads away from the camera is controlled to be in a lighting state, the method further includes:
the second-type lamp beads are adjusted to a maximum brightness value.
In another exemplary embodiment, brightness of the plurality of lamp beads are controlled includes:
the brightness of the plurality of lamp beads are controlled by a backlight chip , wherein the flexible printed circuit board is configured to conduct the plurality of lamp beads and is connected to the backlight chip.
Another embodiment of the present disclosure provides an apparatus for controlling an under-display camera. The device includes:
a first control module, configured to turn off predetermined first-type lamp beads close to a camera end and control predetermined second-type lamp beads away from the camera to be in a lighting state when a camera is detected to be in a turned-on state, and light emitted by the second-type lamp beads forms a circle of light on the convex glass after being refracted by the convex glass, so as to make the convex glass display no images, wherein a display is arranged above the camera, the display includes display glass and display area backlight, an opening area is configured in the display area backlight above the camera, the display glass forms convex glass in a direction of the opening area curving towards the camera, a flexible printed circuit board having an annular conical structure is connected between the convex glass and the camera, so as to surround a viewing angle of the camera, and a plurality of lamp beads are sequentially arranged on the flexible printed circuit board from the camera end to a convex glass end; and
a second control module, configured to control the plurality of lamp beads to be in a lighting state when the camera is detected to be in a turned-off state, backlight being provided for the convex glass after being refracted by the convex glass, so as to make the convex glass display images.
In an exemplary embodiment, the device further includes:
a first determination module, configured to determine an inclination angle of the annular conical structure;
a second determination module, configured to determine a light angle of light emitted by the lamp beads after being reflected by the convex glass according to the inclination angle of the annular conical structure, a radian of the convex glass and a light-emitting angle of the lamp beads; and
a third determination module, configured to determine the first-type lamp beads and the second-type lamp beads according to the light angle, the light-emitting angle of the lamp beads and a light incident angle of the camera.
In an exemplary embodiment, the first determination module includes:
an obtaining sub-module, configured to obtain the light incident angle of the camera, pixels of the camera, a brightness of the display, a thickness of the display area backlight and a size of the opening area; and
a determination sub-module, configured to determine the inclination angle of the annular conical structure according to the light incident angle of the camera, the pixels of the camera, the brightness of the display, the thickness of the display area backlight and the size of the opening area.
In an exemplary embodiment, after determining an inclination angle of the annular conical structure, the device further includes:
a fourth determination module, configured to determine the number of the plurality of lamp beads and an arrangement mode of the plurality of lamp beads according to the brightness of the display, the inclination angle of the annular conical structure and the size of the opening area.
In an exemplary embodiment, the device further includes:
an adjustment module, configured to adjust the second-type lamp beads to a maximum brightness value.
In another exemplary embodiment, the second control module is further configured to
control brightness of the plurality of lamp beads by a backlight chip, wherein the flexible printed circuit board is configured to conduct the plurality of lamp beads and is connected to the backlight chip.
Another embodiment of the present disclosure further provides a computer-readable storage medium that stores a computer program. The computer program is configured to execute steps of any one of the above-described method embodiments at runtime.
Another embodiment of the present disclosure further provides an electronic device. The electronic device includes a memory and a processor. The memory stores a computer program. The processor is configured to run the computer program so as to execute steps of any one of the above-described method embodiments.
According to the present disclosure, the convex glass is arranged below the display glass, a plurality of lamp beads are arranged below the convex glass, and the camera is arranged below the display glass. When the camera is turned off, the convex glass is normal display glass. When the camera is turned on, some the lamp beads are turned off, no images are displayed by the convex glass, and the light emitted by the lamp beads far away from the camera forms a circle of light on the convex glass after being refracted by the convex glass, so as to supplement light of the camera, thereby solving a problem of a poor photographing effect when ambient light is weak due to limited light entering an under-display camera in the related technology, and improving a photographing effect when the ambient light is weak.
Embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings in conjunction with the embodiments.
It should be noted that “first”, “second”, etc. in the description, claims and above-mentioned accompanying drawings of the present disclosure are used for distinguishing similar subjects instead of describing a specific order or precedence order.
The method embodiments provided by the embodiments of the disclosure may be executed in a mobile terminal, a computer terminal or a similar computing device. With running on a mobile terminal as an example,
The memory 104 may be configured to store a computer program such as a software program and module of application software, for example, a computer program corresponding to a method for controlling an under-display camera in an embodiment of the present disclosure. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, thereby implementing the method. The memory 104 may include a high-speed random access memory, and may further include a non-volatile memory, for example, one or more magnetic storage devices, flash memories, or other non-volatile solid-state memories. In some examples, the memory 104 may further include a memory remotely arranged with respect to the processor 102, and the remote memory may be connected to the mobile terminal by means of a network. Examples of networks include, but are not limited to, the Internet, enterprise intranets, local area networks, mobile communication networks, and combinations thereof.
A transmission device 106 is configured to receive or transmit data by means of one network. Specific examples of the network may include a wireless network provided by a communication provider of the mobile terminal. In an example, the transmission device 106 includes a network interface controller (NIC) that may be connected with other network apparatuses by means of a base station so as to communicate with the Internet. In an example, the transmission device 106 may be a radio frequency (RF) module that is configured to communicate wirelessly with the Internet.
The embodiment provides a method for controlling an under-display camera, which runs on the mobile terminal or network structure.
S202, when a camera is detected to be in a turned-on state, first-type lamp beads which are pre-determined in the plurality of lamp beads and are close to the camera end are turned off, predetermined second-type lamp beads far away from the camera are controlled to be in a lighting state, and light emitted by the second-type lamp beads forms a circle of light on the convex glass after being refracted by the convex glass, so as to make the convex glass display no images. Wherein a display is arranged above the camera. The display includes display glass and display area backlight. An opening area is configured in the display area backlight above the camera. The display glass forms convex glass in a direction of the opening area curving towards the camera. A flexible printed circuit board having an annular conical structure is connected between the convex glass and the camera, so as to surround a viewing angle of the camera. A plurality of lamp beads are sequentially arranged on the flexible printed circuit board from the camera end to a convex glass end.
In an exemplary embodiment, S202 may specifically include the following step that predetermined first-type lamp beads close to the camera end are turned off according to a preset rule, and predetermined second-type lamp beads far away from the camera are controlled to be in a lighting state.
S204, when the camera is detected to be in a turned-off state, the plurality of lamp beads are controlled to be in a lighting state, and backlight is provided for the convex glass after refraction by the convex glass, so as to make the convex glass display images.
In an exemplary embodiment, S204 may specifically include the following step that brightness of the plurality of lamp beads is controlled by a backlight chip, wherein the flexible printed circuit board is configured to conduct the plurality of lamp beads and is connected to the backlight chip.
Through S202-S208, the convex glass is arranged below the display glass, and a plurality of lamp beads are arranged below the convex glass, such that the camera is arranged below the display glass. When the camera is turned off, the convex glass is normal display glass. When the camera is turned on, some of the lamp beads are turned off, no images are displayed by the convex glass, and the light emitted by the lamp beads far away from the camera forms a circle of light on the convex glass after being refracted by the convex glass, so as to supplement light of the camera, thereby solving a problem of a poor photographing effect when ambient light is weak due to limited light entering an under-display camera in the related technology, and improving a photographing effect when the ambient light is weak.
In an exemplary embodiment, after predetermined second-type lamp beads far away from the camera are controlled to be in a lighting state, the second-type lamp beads are adjusted to a maximum brightness value.
In an exemplary embodiment, before predetermined first-type lamp beads close to the camera end are turned off, and predetermined second-type lamp beads far away from the camera are controlled to be in a lighting state, an inclination angle of the annular conical structure is determined. Furthermore, a light incident angle of the camera, pixels of the camera, a brightness of the display, a thickness of the display area backlight and a size of the opening area are obtained. The inclination angle of the annular conical structure is determined according to the light incident angle of the camera, the pixels of the camera, the brightness of the display, the thickness of the display area backlight and the size of the opening area.
A light angle of light emitted by the lamp beads after reflection by the convex glass is determined according to the inclination angle of the annular conical structure, a radian of the convex glass and a light-emitting angle of the lamp beads. The first-type lamp beads and the second-type lamp beads are determined according to the light angle, the light-emitting angle of the lamp beads and the light incident angle of the camera.
In another exemplary embodiment, after the inclination angle of the annular conical structure is determined, the number of the plurality of lamp beads and an arrangement mode of the plurality of lamp beads are determined according to the brightness of the display, the inclination angle of the annular conical structure and the size of the opening area.
From the description of the above implementations, it may be apparent to those skilled in the art that the methods according to the above-described embodiments may be implemented by means of software plus a necessary general-purpose hardware platform, and certainly may also be implemented by means of hardware, but in many cases the former is a better implementation. With such understanding, the technical solution of the present disclosure, in essence or from the view of part contributing to the prior art, may be embodied in the form of a software product. The computer software product is stored in a storage medium (such as a read only memory (ROM)/a random access memory (RAM), a magnetic disk and an optical disk) and includes several instructions configured to make a terminal apparatus (which may be a mobile phone, a computer, a server, a network apparatus, etc.) conduct the method in each of the embodiments of the present disclosure.
The embodiment further provides an under-display camera structure.
When the camera 2 is in a turned-on state, lamp beads close to the camera 2 end among the plurality of lamp beads are in a turned-off state, lamp beads far away from the camera 2 are in a lighting state, and light emitted by the lamp beads away from the camera 2 forms a circle of light on the convex glass 13 after being refracted by the convex glass 13, so as to make the convex glass 13 display no images.
When the camera 2 is in a turned-off state, the plurality of lamp beads are in a lighting state, and backlight is provided for the convex glass 13 after refraction by the convex glass 13, so as to make the convex glass 13 display images.
In an exemplary embodiment, the lamp beads away from the camera 2 are at a maximum brightness value.
In an exemplary embodiment, an angle of the annular conical structure of the flexible printed circuit board 3 is determined according to the viewing angle of the camera 2, pixels of the camera 2, a brightness of the display, a thickness of the display area backlight and a size of the opening area.
In another exemplary embodiment, the flexible printed circuit board 3 is configured to conduct the plurality of lamp beads and is connected to a backlight chip, wherein the backlight chip is configured to control brightness of the plurality of lamp beads.
In the embodiment, the display glass 11 is divided into plain glass 12 in a normal display area and the convex glass 13 in a front camera area. A light incident angle of a front camera 2 is a viewing angle 301. Normal display area backlight 12 may use an existing backlight structure solution, which will not be described in detail. Front camera area backlight 4 is divided into a plurality of small light-emitting diode (LED) lamp beads and the flexible printed circuit board 3. The flexible printed circuit board 3 conducts the LED lamp beads and may independently control brightness of each bead by means of the backlight chip. The whole front camera area backlight 4 has an annular conical structure, and is provided with a central opening so as to avoid a viewing angle of the front camera 2.
When the 3D simulated computation is performed, the two most important factors are the light angle e of the light emitted by the lamp beads after being reflected by the convex glass and the transverse distance h from the lamp beads to the front camera center. The smaller the light angle e is, the less easy the light enter the front camera. The larger the transverse distance h from the lamp beads to the center of the front camera is, the less easy the light enter the front camera.
According to a relation between dimensions marked in
In practice, a preliminary LED lamp bead design solution is obtained through 3D simulated computation. It is necessary to conduct detailed debugging in a black box so as to finally determine LED lamp beads to be turned on when the front camera is used. The whole machine is placed in the black box, and some of lamp beads to be turned on that are obtained through 3D simulated computation are turned on. At the same time, the front camera is turned on. If a photosensitive device of the front camera may sense light, it is necessary to turn off another row of lamp beads close to the front camera until the photosensitive device of the front camera cannot sense the light reflected by the LED lamp beads.
The embodiment further provides an apparatus for controlling a camera. The device is configured to implement the above embodiments and preferred embodiments, and what has been described will not be repeated herein. The term “module”, as used below, may implement a combination of software and/or hardware having predetermined functions. While the device described in the following embodiments is preferably implemented in software, implementation in hardware, or a combination of software and hardware is also possible and conceivable.
a first control module 92, configured to turn off predetermined first-type lamp beads close to a camera end and control predetermined second-type lamp beads far away from the camera to be in a lighting state when a camera is detected to be in a turned-on state, and light emitted by the second-type lamp beads forms a circle of light on the convex glass after being refracted by the convex glass, so as to make the convex glass display no images, wherein a display is arranged above the camera, the display includes display glass and display area backlight, an opening area is configured in the display area backlight above the camera, the display glass forms convex glass in a direction of the opening area curving towards the camera, a flexible printed circuit board having an annular conical structure is connected between the convex glass and the camera, so as to surround a viewing angle of the camera, and a plurality of lamp beads are sequentially arranged on the flexible printed circuit board from the camera end to a convex glass end; and a second control module 94, configured to control the plurality of lamp beads to be in a lighting state when the camera is detected to be in a turned-off state, backlight being provided for the convex glass after being refracted by the convex glass, so as to make the convex glass display images.
In an exemplary embodiment, the device further includes:
a first determination module, configured to determine an inclination angle of the annular conical structure;
a second determination module, configured to determine a light angle of light emitted by the lamp beads after being reflected by the convex glass according to the inclination angle of the annular conical structure, a radian of the convex glass and a light-emitting angle of the lamp beads; and
a third determination module, configured to determine the first-type lamp beads and the second-type lamp beads according to the light angle, the light-emitting angle of the lamp beads and a light incident angle of the camera.
In an exemplary embodiment, the first determination module includes:
an obtaining sub-module, configured to obtain the light incident angle of the camera, pixels of the camera, a brightness of the display, a thickness of the display area backlight and a size of the opening area; and
a determination sub-module, configured to determine the inclination angle of the annular conical structure according to the light incident angle of the camera, the pixels of the camera, the brightness of the display, the thickness of the display area backlight and the size of the opening area.
In an exemplary embodiment, after an inclination angle of the annular conical structure is determined, the device further includes:
a fourth determination module, configured to determine the number of the plurality of lamp beads and an arrangement mode of the plurality of lamp beads according to the brightness of the display, the inclination angle of the annular conical structure and the size of the opening area.
In an exemplary embodiment, the device further includes:
an adjustment module configured to adjust the second-type lamp beads to a maximum brightness value.
In another exemplary embodiment, the second control module 84 is further configured to control brightness of the plurality of lamp beads by a backlight chip, wherein the flexible printed circuit board is configured to conduct the plurality of lamp beads and is connected to the backlight chip.
It should be noted that various above-described modules may be implemented by software or hardware; in the case of implementation by hardware, the modules may be implemented in such a way that the modules are located in the same processor, but are not limited to the way; or the modules are separately located in different processors in any combination form.
An embodiment of the present disclosure further provides a computer-readable storage medium that stores a computer program. The computer program is configured to run to execute steps of any one of the above-described method embodiments.
In an exemplary embodiment, the computer-readable storage medium may include, but may be not limited to, a universal serial bus (USB) flash disk, ROM, RAM, a mobile hard disk, a magnetic disk, an optical disk, and various media that may store computer programs.
An embodiment of the present disclosure further provides an electronic device that includes a memory and a processor. The memory stores a computer program, and the processor is configured to run a computer program so as to execute steps of any one of the above-described method embodiments.
In an exemplary embodiment, the electronic device may further include a transmission apparatus and an input/output apparatus. The transmission apparatus is connected to the processor, and the input/output apparatus is connected to the processor.
Specific examples in the embodiment may be referred to the examples described in the above-described embodiments and exemplary implementations, which are not described in detail herein.
Obviously, those skilled in the art should be understand that the above-described modules or steps of the present disclosure may be implemented by a general-purpose computation device, and may be centralized on a single computation device or distributed on a network composed of a plurality of computation devices. They may be implemented by program codes executable by the computation device, such that they may be stored in a storage device to be executed by the computation device. Under some conditions, the steps shown or described may be executed in an order different from that herein, or they may be fabricated separately as individual integrated circuit modules, or a plurality of modules or steps thereof may be fabricated as a single integrated circuit module to be implemented. In this way, the present disclosure is not limited to any particular combination of hardware and software.
The above has been described only as preferred embodiments of the present disclosure and is not intended to limit the present disclosure, which may be modified and changed, for those skilled in the art. Any modifications, equivalent replacements, improvements, etc. made within the principles of the present disclosure should fall within the scope of protection of the present disclosure.
The embodiments are used in the field of intelligent terminals, and may solve a problem of a poor photographing effect when ambient light is weak due to limited light entering an under-display camera in the related technology, and improve a photographing effect when the ambient light is weak.
Number | Date | Country | Kind |
---|---|---|---|
202010549854.0 | Jun 2020 | CN | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/CN2021/094304 | 5/18/2021 | WO |