Patent Grant
12107627
The present invention relates to a display apparatus for an electronic device with at least one integrated opto-electronic component, for example a display apparatus for an electronic device with an integrated optical wireless communication transceiver.
Many electro-optical components may require light reception and/or light transmission for their operation. Such components may include, but are not limited to, optical wireless communication (OWC) transceivers, light-based motion detectors, cameras, optical sensors, solar cells, proximity sensors, or flashlights.
Electro-optical components that require light reception and/or light transmission for their operation may require a sufficiently unobstructed path between an optical detector or transmitter and an outside environment.
Visible light captured by a sensor of a camera may require a substantially unobstructed path between the image that is being captured and the sensor. Infrared (IR) light emitted and received by a proximity sensor may require a sufficiently unobstructed path between the proximity sensor and incoming IR radiation in order to make a detection. An OWC transmitter may require a sufficiently unobstructed path to successfully emit radiation (for example, IR light) that is used for uplink (UL) communication. An OWC receiver may require a sufficiently unobstructed path to successfully receive radiation (for example, visible light radiation) that is used for downlink (DL) communication.
In many known devices, electro-optical components are placed at or near the surface of an electronic device (for example, a mobile phone, tablet, laptop or other computer). For example, optics for a camera, proximity sensor, OWC transmitter or OWC receiver, or other light-receiving or light-emitting components, may be integrated at a surface of a user device into which the components are embedded. Electro-optical components may be placed towards the edge of a device to avoid blocking or being blocked by other components of the device.
The display screen region 12 may comprise, for example, a display comprising a liquid crystal (LCD) layer and an array of LEDs positioned behind the LCD layer. The LEDs are configured to provide backlighting of the LCD layer (which does not itself produce light).
Optics for the camera 18 and proximity sensor 20 are integrated at the surface of the mobile phone 10. As a consequence, the camera 18 and the proximity sensor 20 are integrated at the side of the screen (i.e. outside the display screen region 12) in a bezel region (first bezel region 14), where there is available space for components of the camera 18 and proximity sensor 20.
An OWC module may be integrated into a bezel region of a mobile phone in a similar fashion such that light incident on the mobile phone may be collected by an optical detector of the OWC module. Light emitted by an optical transmitter of the OWC module may need to be able to escape from the device and radiate as desired by an optical front-end designer. Transmitter (TX) and/or receiver (RX) optics of the OWC device may be positioned at the surface of the bezel analogously to the camera 18 and proximity sensor 20 depicted in
There may be limited space in the bezel regions 14, 16. The limited space in the bezel 14, 16 may put a significant constraint on the size of an OWC module and on additional modules that may be placed in the bezel.
Recent phone designs have seen a tendency to decrease the size of the bezel region or regions, and it is thought that some designers may wish to eliminate the bezel entirely (for example, by creating a design in which the display screen covers the entirety of a front surface of the phone).
It is known to provide a transparent solar cell module that may be integrated on top of a mobile phone screen such that the mobile phone may still be used as intended while energy is harvested by the solar cell. It has been suggested that the solar cell may potentially be used as an OWC detector. However, the nature of a transparent solar cell is that most of the light is passed through the solar cell, while harvesting only a small amount of the incident light. If this were not the case, then the solar cell would not be transparent, which may lead to a degradation of the display image emitted by the display underneath the solar cell. Solar cells may be too slow for the high-speed data rates used in modern wireless communication standards, which may limit the use of a transparent solar cell as an OWC detector.
In a first aspect of the invention, there is provided a display apparatus comprising: an at least partially transparent display; and at least one light-transmitting and/or light-receiving device positioned behind the display; wherein the at least one light-transmitting and/or light-receiving device is configured to transmit and/or receive light through at least part of the display. The display may be configured to generate light to form an image for display to a user, for example a user positioned in front of the display. The at least one light-transmitting and/or light-receiving device may comprise or form part of an optical wireless communications (OWC) apparatus configured to transmit and/or receive the light through the at least part of the display.
The at least one light-transmitting device may be configured to transmit modulated light comprising an uplink data signal to a further OWC device. The OWC apparatus, for example a transceiver of the OWC apparatus, may be configured to encode the uplink data signal in the transmitted modulated light. The at least one light-receiving device may be configured to receive modulated light comprising a downlink data signal from the further OWC device. The OWC apparatus, for example a transceiver of the OWC apparatus, may be configured to decode the received modulated light to obtain the downlink data signal encoded in the received modulated light.
The display may comprise one or more layers. For example, the display may comprise a plurality of sub-layers that together provide display functionality. The at least one light-receiving device may comprise at least one light detector.
The at least partial transparency of the display allows light to pass through at least part of the display. Therefore, a light-transmitting and/or light-receiving device may be placed behind the display layer rather than being placed in a region outside the display (for example, a bezel region). In some circumstances, placing one or more light-transmitting and/or light-receiving devices behind the display rather than in a bezel may allow the size of the bezel to be reduced, or may allow the bezel to be removed entirely.
A light-transmitting and/or light-receiving device may in some circumstances be made larger than if it were to be placed in a bezel. The light-transmitting and/or light-receiving device or devices may be placed over an area that comprises a substantial part of the display screen area.
A plurality of light-transmitting and/or light-receiving devices may be positioned on a single layer behind the display screen. Different light-transmitting and/or light-receiving devices may be positioned on different layers behind the display screen. In some circumstances, the light-receiving and/or light-receiving devices may be separate modules. The separate modules may be positioned next to each other behind the display screen. The separate modules may be positioned behind the display screen such that there is no clear definition of layers to which the separate modules belong.
The light-transmitting and/or light-receiving device may be camouflaged by the presence of the display. An image may be displayed on the display that may obscure a user's view of the light-transmitting and/or light-receiving device behind the display.
The display may be substantially planar. The positioning of the at least one light-transmitting and/or light-receiving device behind the display may comprise positioning the at least one light-transmitting and/or light-receiving device on an opposite side of a plane of the display from a side from which the display is viewed by the user.
The at least partially transparent display may be at least partially transparent to at least one of visible light, ultraviolet light, infrared light.
The transparency of the display may be independent of the image displayed on the display. The extent to which the display is transparent may not vary in dependence on image content, for example image colour and/or intensity.
The display may comprise a plurality of at least partially transparent display elements.
The plurality of at least partially transparent display elements may each provide a respective pixel of an image displayed by the display. The plurality of display elements may comprise display elements of different colours, for example red, green and blue display elements. The display screen may further comprise a plurality of non-transparent display elements.
The at least partially transparent display elements may comprise transparent organic light-emitting diodes (TOLEDs).
The at least partially transparent display elements comprise at least one of: microLEDs, quantum dot LEDs or lightfield display elements.
The at least one light-transmitting and/or light-receiving device may be independent of the at least partially transparent display elements. The at least one light-transmitting and/or light receiving device may operate at a different wavelength and/or modulation speed and/or power output from the at least partially transparent display elements.
The at least one light-transmitting and/or light-receiving device may comprise at least one electro-optic device, optionally an array of electro-optic devices. The at least one light transmitting and/or light receiving device may comprises at least one of: at least one transceiver; at least one LED, optionally at least one microLED, quantum dot LED or lightfield display element.
The at least one light-transmitting and/or light-receiving device may comprise or form part of an optical wireless communications (OWC) apparatus, for example an OWC transceiver, an OWC receiver, an OWC transmitter. The at least one light-transmitting and/or light-receiving device may comprise a light-based motion detector, a camera, a solar cell, a proximity sensor, a flashlight, a light level detector.
Light transmitted and/or received by the at least one light-transmitting and/or light-receiving device may comprise at least one of visible light, infrared light, ultraviolet light.
Light transmitted by the at least one light-transmitting and/or light-receiving device may have the same wavelength as light generated by the display. For example, the display may be configured to generate light in the visible spectrum and the at least one light-transmitting and/or light-receiving device may also be configured to transmit visible light. The transmitting of light by the at least one light-transmitting and/or light-receiving device may be independent of the generating of light by the display.
Light transmitted by the at least one light-transmitting and/or light-receiving device may be different from light generated by the display. For example, the display may generate visible light, and the at least one light-transmitting and/or light-receiving device may transmit infrared light. The transmitted infrared light may not be perceived by the user. As a further example, the display may generate visible light, and the at least one light-transmitting and/or light-receiving device may transmit non-visible light.
By using at least one light-transmitting and/or light-receiving device which is not part of the display to transmit light, the light transmitted may be independent of an image displayed on the screen. Parameters of the light transmitted by the at least one light-transmitting and/or light-receiving device may not be affected by changes in the image displayed on the screen, for example by changes in image colour or intensity. For example, the light transmitted by the at least one light-transmitting and/or light-receiving device may have a wavelength and/or intensity that does not vary with image content.
LEDs that are part of the display may in some circumstances not be suitable for communication. Using a separate light-transmitting device may allow communication to be implemented without affecting the display.
Light transmitted and/or received by the OWC transmitter and/or receiver may comprise at least one of visible light, ultraviolet light, infrared light. Light transmitted by the OWC transmitter may comprise infrared light. Light received by the OWC receiver may comprise visible light.
The OWC transmitter and/or receiver may comprise a light fidelity (LiFi) transmitter and/or receiver. Light transmitted by the OWC transmitter may comprise a LiFi uplink signal. Light received by the OWC receiver may comprise a LiFi downlink signal.
The OWC transmitter and/or receiver may be configured to modulate the light transmitted through the at least part of the display to encode data in the transmitted light, for example in accordance with a modulation scheme. The OWC transmitter and/or receiver may be configured to demodulate the light received through the at least part of the display to obtain data encoded in the received light, for example data encoded in accordance with the or a modulation scheme.
The modulation scheme may comprise at least one of on-off keying (OOK), phase shift keying (PSK), M-ary pulse amplitude modulation (M-PAM), M-ary quadrature amplitude modulation (M-QAM) or orthogonal frequency division multiplexing (OFDM).
The at least one light-transmitting and/or light-receiving device may comprise at least one solar cell.
The at least one solar cell may be configured to at least partially power the display apparatus. The at least one solar cell may be configured to at least partially power an electronic device into which the display apparatus is incorporated. The at least one solar cell may be configured to charge a battery.
The at least one solar cell may be configured to detect light signals. The light signals may comprise communication signals. The at least one solar cell may be configured to detect light level. The light level may comprise an ambient light level.
By placing a solar cell behind the display, the solar cell may be made larger than if it were placed in a non-display region, for example in a bezel. The solar cell or cells may occupy a large proportion of the display region, for example more than 20% of the display region, optionally more than 50% of the display region, further optionally more than 80% of the display region. An increased solar cell area may result in increased solar power being captured. Battery life of the electronic device may be extended.
The at least one light-receiving and/or light-transmitting device may comprise at least one of a light-based motion detector, a camera, a proximity sensor, a flashlight, a light level detector.
The at least one light-receiving and/or light-transmitting device may comprise at least one large area photodetector. The at least one large area photodetector may occupy an area of at least 10 mm2, optionally at least 20 mm2, further optionally at least 50 mm2, further optionally at least 100 mm2, further optionally at least 200 mm2. The at least one large area photodetector may occupy at least 10% of the display region, optionally at least 20% of the display region, further optionally at least 50% of the display region.
The at least one light-receiving and/or light-transmitting device may comprise a plurality of photodetectors.
The use of large area and/or multiple photodetectors may allow light to be captured over a larger area than in some existing systems. In some circumstances, the use of large area and/or multiple photodetectors may lead to a reduction or elimination of optics associated with the at least one light-receiving and/or light-transmitting device.
The at least one light-transmitting and/or light-receiving device may be positioned such that no additional optical components are positioned between the at least one light-transmitting and/or light-receiving device and the display.
The at least one light-receiving and/or light-transmitting device may comprise a plurality of transmitters. The transmitters may be scattered across the display region.
The at least one light-receiving and/or light-transmitting device may comprise at least one large area transmitter. The at least one large area transmitter may occupy an area of at least 10 mm2, optionally at least 20 mm2, further optionally at least 50 mm2, further optionally at least 100 mm2, further optionally at least 200 mm2. The at least one large area transmitter may occupy at least 10% of the display region, optionally at least 20% of the display region, further optionally at least 50% of the display region.
Using scattered and/or large area transmitters may distribute radiated light (for example, radiated infrared light) over a larger area. Distributing radiated light over a larger area may allow the relaxation of constraints relating to eye safety. For example, it may be possible to radiate a higher total amount of light than would be possible if the light were to be radiated from a smaller transmitter or from fewer transmitters.
The display apparatus may further comprise means for processing signals representative of light received by the at least one light-transmitting and/or light-receiving device.
The means for processing, for example a processor, software and/or hardware arrangement, may be configured to process the signals representative of light received by the at least one light-transmitting and/or light-receiving device to identify, compensate for and/or at least partially remove a component of the signals that is representative of light emitted by at least part of the display.
At least part of the display may emit light backwards. At least part of the display may emit light towards the light-transmitting and/or light-receiving device as well as emitting light towards the user. The processor may distinguish between light received through the display (which may comprise a desired signal) and light that has been emitted by the display (which may comprise unwanted interference). The processor may process light received by any light-transmitting and/or light-receiving device that has at least one photosensitive element, for example a communication receiver, camera sensor, or proximity sensor.
The processing of the signals may be based on at least one of: a wavelength of the signals; a frequency of modulation of the signals. Interference may be estimated as it is slowly changing relative to the speed of a communication system, and may be removed or reduced with digital processing.
The processing of the signals may comprise filtering the signals by wavelength. The processing of the signals may comprise filtering the signals by a frequency of modulation. A light transmitting and/or light-receiving device may comprise an OWC device configured to receive a modulated light signal, for example a baseband modulated signal modulated at a modulation frequency between 1 Hz and 100 GHz, optionally between 1 MHz and 100 GHz, optionally between 100 kHz and 1 PHz. Light emitted by the display may appear to the processor as a low-frequency interference signal added to a received OWC signal. For example, an image displayed on the display may be displayed at a refresh rate of between 30 Hz and 200 Hz.
The display apparatus may be configured to at least partly compensate for optical effects of the display, for example the display apparatus may comprise means for at least partly compensating for optical effects arising from the display.
Optical effects of the display may be such as to change a propagation profile of light passing through the display. Optical effects of the display may comprise a change in at least one parameter of light transmitted and/or received through the at least part of the display. The at least one parameter may comprise at least one of: a propagation profile parameter, a wavelength, a polarisation parameter, a direction, an aberration parameter, a dispersion parameter, a refraction parameter, a diffraction parameter.
The display apparatus may comprise at least one optical component configured to compensate for optical effects of the display. The compensating of the optical effects of the display may comprise altering, by at least one optical component of the display, a value for at least one parameter of the light transmitted and/or received by the at least one light-transmitting and/or light-receiving device.
For example, the at least one optical component may comprise at least one lens. As a further example, the at least one optical component may comprise at least one of: a lens array, a microlens array, liquid crystal displays, polarizers.
The at least one optical component may comprise one or more filters. For example, the one or more filters may comprises at least one of: an absorption filter; an interference filter; a Fabry-Perot filter; a dichroic filter; a band-pass filter; a tuneable filter; a plasmonic filter.
The compensating of the optical effects of the display may comprise performing, by the or a processor of the display apparatus, signal processing of light transmitted and/or received by the at least one light-transmitting and/or light-receiving device. The signal processing may comprise digital signal processing. The signal processing may comprise analogue signal processing.
The compensating of the optical effects of the display may allow the at least one light-transmitting and/or light-receiving device to perform as if, or almost as if, the display were not present. As a result of the compensating, the transmitting or receiving of signals may not be substantially affected by the presence of the display in front of the at least one light-transmitting and/or light-receiving device.
The display apparatus may be configured to alter at least one property of light emitted by at least part of the display and/or to alter operation of the display, during a time period in which light is transmitted and/or received by the at least one light-transmitting and/or light-receiving device through at least part of the display. The at least one property may comprise intensity. The altering of the at least one property of the light may comprise at least one of reducing the intensity of the light emitted by the at least part of the display, and/or turning off the at least part of the display. The display apparatus may be configured to turn off at least part of the display during a time period in which light is received by the at least one light-transmitting and/or light-receiving device through at least part of the display.
Altering an intensity of light emitted by at least part of the display while light is received through the display may prevent light emitted backwards from the display from affecting the light received by the at least one light-transmitting and/or light-receiving device through the display. In some circumstances, turning off the at least part of the screen may remove light originating from the display in a more effective manner than using signal processing to remove that light. The display apparatus may be configured such that the at least part of the display is only turned off, or has its intensity reduced, for a short time period. For example, the time period may be between 0.001 seconds and 1 second, optionally between 0.001 seconds and 0.1 second, further optionally between 0.01 second and 0.1 second.
The altering of the intensity of the at least part of the display may be synchronised with a modulation of a signal that is being transmitted or received.
The at least one light-transmitting and/or light-receiving device may comprise sensor elements of a camera. The time period may comprise a time period in which an image is acquired by the camera.
By turning off at least part of the display during image acquisition by the camera, the image may be acquired without requiring signal processing to remove light originating from the display. The received light may comprise less interference than if the display were to be switched on during image acquisition.
The at least one light-transmitting and/or light-receiving device and the plurality of display elements may be configured such that light from the plurality of display elements does not saturate the at least one light-transmitting and/or light-receiving device.
The at least one light-transmitting and/or light-receiving device may be configured to receive both light passing through the display and light originating from the display, without saturating.
The display apparatus may further comprise an at least partially transparent cover layer positioned in front of the display. The display apparatus may further comprise a capacitive layer positioned in front of the display. The display apparatus may further comprise a backplane layer on which the at least one light-transmitting and/or light-receiving device is mounted.
The display may be part of an integrated display screen. The at least one light-transmitting and/or light-receiving device may be positioned behind the integrated display screen. The integrated display screen may comprise at least one of: an at least partially transparent cover layer, a capacitive layer, a backplane layer. The integrated display screen may be packaged in a package that does not contain the at least one light-transmitting and/or light-receiving device.
Positioning the at least one light-transmitting and/or light-receiving device behind the integrated display screen may camouflage the at least one light-transmitting and/or light-receiving device behind the integrated display screen such that they are not visible to a user.
Using an at least partially transparent display screen may allow the at least one light-transmitting and/or light-receiving device to be fabricated separately from the display screen and then placed behind the display screen at an assembly stage.
The at least one light-transmitting and/or light-receiving device may comprise a plurality of different light-transmitting and/or light-receiving devices.
Several different types of device may be integrated behind a single display. For example, an OWC transceiver, a proximity sensor and a solar cell may be integrated into a single device. By integrating several light-transmitting and/or light-receiving devices into a display region, a non-display region (for example a bezel region) may be reduced or eliminated.
In a second aspect of the invention, which may be provided independently, there is provided a method of operating a display apparatus comprising an at least partially transparent display and at least one light-transmitting and/or light-receiving device positioned behind the display, the method comprising: by the at least one light-transmitting and/or light-receiving device, transmitting and/or receiving light through at least part of the display, for example thereby to provide optical wireless communication (OWC) using the modulated light. The method may comprise displaying by the display an image, for example to a user positioned in front of the display.
In a further aspect of the invention, which may be provided independently, there is provided a display apparatus comprising an optical wireless communication (OWC) apparatus and a display, the display comprising an array of elements comprising:
a plurality of display elements comprising red, green and blue elements configured to display an image to a user; and
a plurality of light-transmitting elements configured to transmit modulated light comprising a data signal, for example an uplink data signal, to a further OWC device, wherein the OWC apparatus is configured to encode the data signal in the transmitted modulated light; and/or
a plurality of light-receiving elements configured to receive modulated light comprising a data signal, for example a downlink data signal, from the or a further OWC device, wherein the OWC apparatus is configured to decode the received modulated light to obtain the data signal encoded in the received modulated light;
wherein at least one of a) or b):
a) the light-transmitting and/or light-receiving elements are distributed in the display in groups of one or more light-transmitting and/or light-receiving elements, wherein one or more said groups are at least partially surrounded by display elements, such that the array of elements comprises a repeating arrangement of unit cells, each unit cell comprising at least one light-transmitting and/or light-receiving element, at least one red element, and least one green element and at least one blue element; or
b) the light-transmitting and/or light-receiving elements are arranged in one or more rows or columns within or at the edge of the display.
In a further aspect of the invention, which may be provided independently, there is provided a display apparatus comprising a display, the display comprising an array of elements comprising: a plurality of display elements configured to display an image to a user; and a plurality of light-transmitting and/or light-receiving elements; wherein the light-transmitting and/or light-receiving elements are: distributed in the display in groups of one or more light-transmitting and/or light-receiving elements, wherein one or more said groups are at least partially surrounded by display elements; or arranged in one or more rows or columns within or at the edge of the display.
By interspersing light-transmitting and/or light-receiving elements between display elements, the light-transmitting and/or light-receiving elements may be integrated into a display region without the display elements being transparent.
The plurality of light-transmitting and/or light-receiving elements may comprise a plurality of photodiodes and/or a plurality of LEDs.
The plurality of light-transmitting and/or light-receiving devices may comprise at least one of avalanche photodiodes (APDs), single-photon avalanche photodiodes (SPADs), photomultiplier tubes, solar cells, photodiodes operated in a solar cell mode (forward biased).
The plurality of light-transmitting and/or light-receiving devices may comprise at least one of LEDs, laser diodes.
The array may comprise a repeating arrangement of unit cells, each unit cell comprising at least one light-transmitting and/or light-receiving element and a plurality of display elements.
The light transmitting and/or light-receiving elements may be distributed in the display in groups of one or more light-transmitting and/or light-receiving elements, wherein one or more said groups are at least partially surrounded by display elements, such that the array of elements comprises a repeating arrangement of unit cells, each unit cell comprising at least one light-transmitting and/or light-receiving element, at least one red element, and least one green element and at least one blue element.
The plurality of light-transmitting elements may be configured to transmit modulated light comprising an uplink data signal to a further OWC device, wherein the OWC transceiver is configured to encode the uplink data signal in the transmitted modulated light. The plurality of light-receiving elements may be configured to receive modulated light comprising a downlink data signal from the further OWC device, wherein the OWC transceiver is configured to decode the received modulated light to obtain the downlink data signal encoded in the received modulated light.
A modulation frequency of the transmitted modulated light may be between 100 KHz and 1 PHz. A modulation frequency of the received modulated light may be between 100 KHz and 1 PHz.
A modulation frequency of the transmitted modulated light may be between 1 MHz and 100 GHz. A modulation frequency of the received modulated light may be between 1 MHz and 100 GHz.
The transmitted modulated light may have a wavelength that is different from wavelengths of the visible light emitted by the display elements. The transmitted modulated light may be non-visible light. The transmitted modulated light may be infrared light.
Each of the light-transmitting elements may have a different output power than each of the display elements.
The light-receiving elements may be arranged in more than one light-receiving regions, such that each light-receiving region is configured to receive light having a different wavelength.
The display apparatus may comprise signal collection circuitry for each light-receiving region configured to collect detection signals from each light-receiving element in the light-receiving region and further configured to synchronize collection of detection signals over the light-receiving region.
A modulation scheme used to encode the transmitted modulated light and/or a modulation scheme used to decode the received modulated light may comprise at least one of: on-off keying (OOK), phase shift keying (PSK), M-ary pulse amplitude modulation (M-PAM), M-ary quadrature amplitude modulation (M-QAM) or orthogonal frequency division multiplexing (OFDM).
The plurality of light-receiving elements may comprise a plurality of photodiodes and the plurality of transmitting elements may comprise a plurality of LEDs and/or laser diodes.
The display may comprise one or more layers. For example, the display may comprise a plurality of sub-layers that together provide display functionality.
The display may comprise a plurality of at least partially transparent display elements.
The at least partially transparent display elements may comprise transparent organic light-emitting diodes (TOLEDs).
The at least partially transparent display elements may comprise at least one of: microLEDs, quantum dot LEDs or lightfield display elements.
The display apparatus further may comprise a plurality of non-transparent display elements.
The array of elements may further comprise a plurality of optical front end circuitry elements.
Each unit cell may comprise at least one optical front end circuitry element. At least one of the optical front end circuitry elements may be arranged in one or more rows or columns within or at the edge of the display.
The at least one of optical front end circuitry element may comprise: amplifying circuitry elements, buffering circuitry elements or multiplexing circuitry elements.
The at least some of the display elements may be at least partially transparent. The display apparatus may further comprise at least one further light-transmitting device and/or light-receiving device positioned behind the display. The at least one further light-transmitting and/or light-receiving device may be configured to transmit and/or receive light through at least part of the display.
The red, green and blue elements may be configured to transmit modulated light comprising an uplink data signal to a further OWC device.
The plurality of light-transmitting elements and plurality of light-receiving elements may comprise at least one solar cell.
The at least one solar cell may be configured to at least partially power the display apparatus. The at least one solar cell may be configured to at least partially power an electronic device into which the display apparatus is incorporated. The at least one solar cell may be configured to charge at least one battery.
The at least one solar cell may be configured to detect light signals. For example, the light signals may comprise communication signals. The at least one solar cell may be configured to detect light levels. For example, the light levels may comprise ambient light levels.
The display apparatus may further comprise a means for processing signals representative of light received by the at least one light-receiving device to identify, compensate for and/or at least partially remove a component of the signals that is representative of light emitted by at least part of the display.
The display apparatus may comprise means for at least partly compensating for optical effects arising from the display. The means for at least partly compensating for optical effects arising from the display may comprise at least one optical component configured to compensate for optical effects of the display.
The at least one optical component may comprise at least one of: a lens, a lens array, a microlens array, liquid crystal displays, polarizers.
The at least one optical component may comprise one or more filters. For example, the at least one optical component may comprise at least one of: an absorption filter; an interference filter; a Fabry-Perot filter; a dichroic filter; a band-pass filter; a tuneable filter; a plasmonic filter.
The compensating of the optical effects of the display may comprise at least one of: a) altering, by at least one optical component of the display, a value for at least one parameter of the light transmitted and/or received by the at least one light-transmitting and/or light-receiving device; b) performing, by a processor of the display apparatus, signal processing of light transmitted and/or received by the at least one light-transmitting and/or light-receiving device, for example, wherein the signal processing comprises analogue or digital signal processing.
The display apparatus may be configured to alter at least one property of light emitted by at least part of the display. The display apparatus may be configured to alter operation of the display during a time period in which light is transmitted by the at least one light-transmitting device through at least part of the display. The display apparatus may be configured to alter operation of the display during a time period in which light is received by the at least one light-receiving device through at least part of the display.
The display apparatus may be configured such that the at least part of the display is only turned off, or has its intensity reduced, for a short time period. The display apparatus may be configured such that the at least part of the display is only turned off, or has its intensity reduced, for a short time period in synchronisation with a modulation of a signal that is being transmitted or receiver. The time period may be between 0.001 seconds and 1 second. The time period may be between 0.001 seconds and 0.1 second. The time period may be between 0.01 second and 0.1 second.
The light-transmitting device may be camouflaged by the presence of the display. The light-receiving device may be camouflaged by the presence of the display.
There may be provided an electronic device comprising a display apparatus as claimed or described herein. There may be provided an electronic device comprising a display apparatus in accordance with the first aspect or the third aspect. The electronic device may comprise at least one of a mobile phone, a tablet, a computer, a laptop. The electronic device may comprise at least one of an automotive display, an aviation cockpit display, a television, a financial transaction terminal, an industrial control panel.
In a further aspect, which may be provided independently, there is provided a method of providing optical wireless communication (OWC) comprising:
providing a plurality of display elements comprising red, green and blue elements configured to display an image to a user; and
providing a plurality of light-transmitting elements configured to transmit modulated light comprising a data signal, for example an uplink data signal, to a further OWC device, wherein the OWC apparatus is configured to encode the data signal in the transmitted modulated light; and/or
providing a plurality of light-receiving elements configured to receive modulated light comprising a data signal, for example a downlink data signal, from the or a further OWC device, wherein the OWC apparatus is configured to decode the received modulated light to obtain the data signal encoded in the received modulated light;
wherein at least one of a) or b):
c) the light-transmitting and/or light-receiving elements are distributed in the display in groups of one or more light-transmitting and/or light-receiving elements, wherein one or more said groups are at least partially surrounded by display elements, such that the array of elements comprises a repeating arrangement of unit cells, each unit cell comprising at least one light-transmitting and/or light-receiving element, at least one red element, and least one green element and at least one blue element; or
d) the light-transmitting and/or light-receiving elements are arranged in one or more rows or columns within or at the edge of the display.
There may also be provided an apparatus or method substantially as described herein with reference to the accompanying drawings.
Any feature in one aspect of the invention may be applied to other aspects of the invention, in any appropriate combination. For example, features of the first aspect may be applied to features of the third aspect and vice versa. For example, apparatus features may be applied to method features and vice versa.
Embodiments of the invention are now described, by way of non-limiting examples, and are illustrated in the following figures, in which:
The LiFi enabled screen 30 comprises a plurality of substantially planar layers.
In the embodiment of
The cover layer 32 is positioned at the front surface of the mobile phone, is substantially transparent, and is configured to protect components of the mobile phone. In the present embodiment, the cover layer 32 is a protective glass layer 32. In other embodiments, any suitable material may be used.
In the present embodiment, the capacitive layer 34 is a capacitive circuit plane 34 positioned directly behind the cover glass 32, and may be used to provide touch screen functionality.
The display layer 36 is positioned directly behind the capacitive layer 36 and comprises a matrix of transparent organic light-emitting devices (TOLEDs). The matrix of TOLEDs forms a display configured to generate light to form an image. The matrix of TOLEDs is an array of red, blue and green TOLEDs, which may also be referred to as display elements or pixels. Each of the TOLEDs is substantially transparent to visible light and may also be substantially transparent to infrared light. The TOLEDs may emit light backwards into the mobile phone as well as forwards towards a user.
TOLEDs have made a commercial appearance over the past 5 years, where different electronics companies have begun offering fully or near-fully transparent displays employing TOLED technology. A difference between a TOLED and some other types of OLED or LED is that the materials used to build the TOLED are almost completely transparent. A transparent LED display matrix may be built using TOLEDs. TOLED technology may be used in transparent display devices and display window products.
In other embodiments, the display layer may be formed of any material that is at least partially transparent. The display layer may be formed using any technology that enables a transparent display layer to be built.
In some embodiments, the display layer comprises an array of any suitable red, green and blue display elements that are each at least partially transparent. In some embodiments, the display layer comprises some transparent and some non-transparent display elements. For example, transparent red LEDs may be used in combination with non-transparent blue LEDs. The display layer may comprise a plurality of sub-layers.
The backplane layer 38 is positioned directly behind the TOLED matrix 36. A plurality of electro-optical devices are mounted on an upper surface of backplane layer 38. In the present embodiment, the electro-optical devices comprise an IR LED 40 and a plurality of photodiodes 42. The IR LED 40 and plurality of photodiodes 42 are coupled to an OWC transceiver 52 (not shown in
Although in the present embodiment, the screen 30 comprises a cover layer 32, capacitive layer 34, display layer 36 and backplane layer 38, in other embodiments, additional layers may be included. One or more of the layers of the embodiment of
The wiring of the electro-optical devices and/or the wiring of other components may be performed using any suitable techniques, practices and materials, for example using established techniques, practices and materials from the field of display manufacturing.
In some embodiments, the screen 30 further comprises at least one optical filter and/or optical amplifier positioned on top of the photodiodes 42. At least one optical filter and/or optical amplifier may be positioned directly in front of the photodiodes 42, or between or in front of any layers that are in front of the photodiodes 42. Optical filters and/or optical amplifiers may be positioned in any order.
Some principles of optical wireless communication are now described. A transmitter apparatus is configured to send wireless optical signals in which information is encoded through an optical communication channel to a receiver apparatus. The optical communication channel may be a free-space communication channel. The optical communications channel has a characteristic optical wavelength. A channel may established and/or operated by way of transmission and/or reception of uplink and/or downlink signals.
Free space communication channels include transmission of optical signals through air, space, vacuum, liquid such as water or similar. Free space communication may exclude communication through solid material.
Transmitters and receivers may be provided on different devices. One type of device that is used is an access point. Access points may provide access to a further network. Another type of device is a station. Stations may be portable or fixed. Without limitation, examples of stations include personal computers, desktops, laptops and smart devices, including mobile devices. Portable stations may be powered by their own battery resource.
An access point may provide data transmission to and/or from a wired network or a Wi-Fi™ (wireless fidelity) or other wireless network and/or other optical wireless communications network, optionally a LiFi network.
The transmitter apparatus includes a light emitting diode (LED), laser or other suitable light source, and an associated driving circuit to drive the LED or laser to produce the optical signal. The associated driving circuitry includes a digital to analogue convertor configured to provide a modulation signal at a frequency characteristic of an optical light communication signal. A further processor, provided as part of the transmitter apparatus or associated with the transmitter apparatus, modulates data onto a drive current and the driving circuitry provides the drive current to the LED or laser. The LED or laser then produces an outgoing modulated optical wireless communication signal that carries the data.
The receiver apparatus includes a photodiode, or other suitable light detector, with associated circuitry to condition any received signal. The photodiode converts received light to an electronic signal which is then conditioned by the conditioning circuitry. Conditioning may include one or more filter steps; amplification of a weak electrical signal; equalisation of received signals and converting the analogue signals into digital signals using an analogue to digital convertor. The digital signals can then be provided to a further processor, provided as part of the receiver apparatus or associated with the receiver apparatus, to be demodulated to extract communication data. An example of a typical receiver apparatus is described in more detail with reference to
Any suitable modulation scheme may be used, for example orthogonal frequency division multiplexing (OFDM) modulation schemes are used in some embodiments, and the demodulation is a demodulation from the OFDM modulation scheme. In some embodiments, other modulation schemes may be used. An optical wireless communication transmitter and receiver can be provided together as a transceiver.
The OWC transceiver may form part of an OWC apparatus included in the display apparatus that may include further components to provide OWC transmission or detection in accordance with known OWC techniques, for example any suitable arrangement (not shown) of one or more of digital to analog and/or analog to digital converters, amplifiers, filter adjustable gain/attenuation component, LED driving circuitry.
In the present embodiment, the OWC transceiver 52 is a LiFi transceiver which is configured to receive data from, and send data to, other LiFi devices using modulated light. The OWC transceiver 52 may be considered to act as a station.
Methods that use light to transmit data wirelessly by modulation of the light may be referred to as optical wireless communications (OWC). LiFi (light fidelity) is a form of OWC which may in some circumstances be considered to be analogous to Wi-Fi in radio-frequency communications for at least some applications. There are however significant technical differences between LiFi and Wi-Fi. Any suitable LiFi protocol may be used, for example any protocol complying with a suitable standard.
An embodiment is now described in which mobile phone 50 comprising screen 30 communicates with AP 56 using LiFi. However, in other embodiments, mobile phone 50 may communicate with any suitable device using optical wireless communications. In some embodiments, mobile phone 50 may communicate with multiple devices simultaneously or near-simultaneously. In some further embodiments, the OWC transceiver 52 is replaced with an OWC receiver without a transmitter, and mobile phone 50 is configured to receive, but not to transmit, OWC signals.
In use, an image is displayed to a user on display layer 36. The image may comprise, for example, a user interface of the mobile phone, a web browser, or content (for example, text content or video content) that is being viewed by the user. In some circumstances, the image may be a simple image, for example an image comprising a single colour, a limited range of colours, or a logo. In the present embodiment, a refresh rate of the image displayed to the user is 60 Hz (60 frames per second). In other embodiments, the refresh rate may be any suitable rate, for example between 30 and 200 Hz.
The AP 56 receives input data (for example, Ethernet data). A processor of the AP 56 encodes the input data using on-off keying. In other embodiments, any suitable modulation scheme may be used. Driving circuitry of the AP 56 drives a visible light source of the AP 56 (which in the present embodiment comprises at least one LED) to transmit the encoded data by modulation of an intensity of the light source. The modulated light from the AP 56 is thereby used to transmit a downlink data signal using modulated visible light.
Part of the light transmitted by the AP 56 is incident on the front of the screen 30. A direction of incidence of the light on the screen 30 is illustrated by arrow 44 in
The light incident on the screen 30 passes through the protective glass layer 32, the capacitive circuit plane 34, and the display layer 36. Some of the light incident on the screen may be lost to reflection or absorption when light passes through the protective glass layer 32, the capacitive circuit plane 34, and the TOLED matrix layer 36. However, in the present embodiment, most of the light that is incident on the screen 30 passes through the TOLED matrix layer 36 onto the backplane layer 38. At least part of the light that is incident on the screen 30 is received by the photodiodes 42. In some embodiments, the light received by the photodiodes 42 is filtered by at least one optical filter and/or amplified by at least one optical amplifier. The photodiodes also receive some light that is emitted by the TOLEDs of the display layer 36.
Light received by the photodiodes 42 is converted into electrical signals and passed to the processor 54 of the OWC transceiver 52. The processor 54 processes the electrical signals to obtain the downlink data signal that was transmitted by the AP 56.
The processor 54 is configured to process the electrical signals to distinguish light emitted from the TOLEDs from the light received from the AP 56. Since a TOLED may emit light in both directions, light emitted from TOLED display elements of the display layer 36 may arrive at the photodiodes 42 along with the light received from the AP 56. In the present embodiment, light from the display layer 36 appears to the OWC transceiver 52 as a low-frequency interference signal. The frequency spectrum of the interference signal is around the refresh rate of 60 Hz, which is much lower than a frequency of modulation of the modulated visible light. The processor 54 of the OWC transceiver 52 removes the light that originated from the display layer 36 by using signal processing techniques. In other embodiments, any suitable method may be used to distinguish light emitted from the display layer 36 from light received through the display layer. For example, the light may be filtered by wavelength, or the undesired low-frequency signal may be filtered electrically in the analog electronics part of the receiver system.
In the present embodiment, a propagation profile of the light received by the photodiodes 42 is changed by passing through the TOLED matrix of display layer 36. (In other embodiments, the propagation profile may be changed by passing through the cover layer 32, the capacitive layer 34, or any other layer that is in front of the photodiodes 42.) The change in the propagation profile may comprise a change in frequency, direction, or polarisation of the light. The change in propagation profile may comprise aberration, dispersion, refraction or diffraction. The change in the propagation profile may result in a distortion of communication coverage.
The processor 54 is configured to compensate for the change in the propagation profile using digital signal processing techniques. In other embodiments, optics of the photodiodes 40 may be configured to at least partially correct for the change in the propagation profile. For example, at least one optical component (for example, at least one lens) may be used to compensate for a change in propagation profile.
The processor 54 demodulates the received signals to obtain the downlink data signal that was transmitted by the AP 56.
In addition to receiving downlink data from the AP 56 using modulated visible light, the OWC transceiver 52 is configured to drive the IR LED 40 to emit an uplink data signal using modulated infrared light. The OWC transceiver encodes uplink data using a suitable modulation scheme and drives the IR LED 40 to transmit the encoded uplink data by modulation of the IR light emitted by the IR LED 40.
The IR LED 40 is independent of the TOLEDs that are used to form the image on the display layer 36. In the present embodiment, the IR LED 40 operates at different frequencies from the TOLEDs of display layer 36.
Infrared light from the IR LED 40 is emitted through the TOLED matrix display layer 36. For example, the infrared light from IR LED 40 may travel in a direction opposite to that of arrow 44. The infrared light passes through the display layer 36, capacitive layer 34 and cover layer 32 to exit the screen 30. The uplink data signal may be emitted while an image is being displayed on display layer 36. The light from IR LED 40 is received and by an optical detector of the AP 56 and processed by AP 56 to obtain the uplink data signal by demodulation of the IR light transmitted by IR LED 40.
Using infrared light for uplink may avoid a bright visible light being produced while uplink data is being transmitted, for example a bright visible light which may shine into the user's face.
Although a single AP 56 and mobile device 30 are described above, in other embodiments a mobile device 30 may transmit signals to and/or receive signals from a plurality of APs or other computing devices. An AP may transmit signals to and/or receive signals from a plurality of mobile devices 30 or other computing devices.
By integrating the optical transceiver 52 behind a transparent display matrix, the optical transceiver 52 may become inconspicuous from the user perspective. Using the transparent display matrix, the OWC transceiver 52 may be provided with a sufficiently unobstructed path to successfully emit the radiation (IR light in the embodiment of
Furthermore, the technology used in the embodiment of
In embodiments, any suitable light-transmitting and/or light-receiving OWC device may be positioned behind the display layer 36, for example mounted on backplane 38. For example, the light-transmitting and/or light-receiving device may be an optical wireless communications (OWC) transceiver, an OWC receiver, an OWC transmitter, a light-based motion detector, a camera, a solar cell, a proximity sensor, or a flashlight. In some embodiments, more than one type of light-transmitting and/or light-receiving device is positioned behind a single display layer 36. For example, different devices may be positioned behind different regions of the display layer 36.
The light-transmitting and/or light-receiving device may comprise any suitable light detector, for example a photodiode, avalanche photodiode (APDs), single-photon avalanche photodiode (SPADs), photomultiplier tube, solar cell, photodiode operated in a solar cell mode (forward biased), vertical cavity surface-emitting laser (VCSEL), silicon photomultiplier (SiPM) and multi pixel photon counter (MPPC). The light-transmitting and/or light-receiving device may comprise any suitable light source, for example an LED or laser diode.
Light that is incident on the TOLED matrix of the display layer 36 passes through the LEDs (excluding any light lost due to reflections and absorption when light passes through the different materials) and reaches an optical detector or optical detector optics under the TOLED matrix. Any light-receiving device may be used as an optical detector. The light-receiving device may or may not include photodiodes.
Light from any light-emitting device positioned behind the display layer 36 (for example, light from the IR light from a LiFi transmitter or the IR light from a proximity sensor) may pass through the TOLED matrix of the display layer 36 and be emitted outward from the device. Changes to the received or transmitted light propagation profile may be corrected by respective adjustments in the optics of the emitter/detector and/or by digital signal processing techniques. Received data may be processed using any suitable processor, which may or may not be part of an OWC transceiver. In some embodiments, multiple processors of the mobile device 50 may be used to process data received by a light-receiving device.
A light-transmitting device positioned behind a display layer may be independent of the light sources (for example, the TOLEDs of the display layer) whose light is used to form the image for display. The light sources used to form the display image may be different from light sources used for communication (for example, for OWC communication).
In one embodiment, sensor elements of a camera (for example, CCD or CMOS elements) are positioned on the backplane surface 38. The sensor elements receive light that passes through the display layer 36, and use that light to form an image.
Changes to the propagation profile of the light passing through the display layer 36 may cause distortion of the image that is captured by the imaging camera. Such changes may be corrected by at least one optical component and/or by signal processing in a processor. The processor may or may not be part of the camera. In one embodiment, signal processing by a processor is also used to remove the effects of any light emitted backwards by the TOLEDs and received by the sensor elements of the camera.
In another embodiment, a processor is configured to switch off TOLEDs potentially affecting the camera module (for example, TOLEDs that are in front of the sensor elements) for a brief moment while a picture is being taken by the camera. For example, part or all of the display layer may be switched off for 1/30 or 1/60 of a second. In some embodiments, a time period for which at least part of the display layer is switched off may be between 0.001 seconds and 1 second, for example depending on an acquisition time of the camera. In other embodiments, some or all of the display elements may be turned off or reduced in intensity for any time period during which any suitable device behind the display layer is receiving and/or transmitting light. In some embodiments, the switching on and off (or intensity reduction) of the display screen may be synchronised with pulsed signals, for example with LiFi pulses. The switching on and off (or intensity reduction) of the display screen may be synchronised with a modulation of light transmitted by a device behind the display layer.
In one embodiment, an IR LED and photodiodes mounted on the backplane 38 are used as a proximity detector. IR light emitted from IR LED passes through layers 36, 34 and 32 and is emitted from the screen 30, for example in a direction substantially perpendicular to the plane of the screen 30. Part of the IR light is reflected from an object situated in front of the screen 30. The reflected IR light passes into the screen 30 through layers 32, 34 and 36 and is detected by the photodiodes. The photodiodes convert the reflected IR light into electrical signals. The mobile device into which the screen 30 is integrated comprises a processor that is configured to use the signals from the photodiodes that are representative of the reflected LED light to determine the proximity of the object. In some embodiments, an optical wireless communications transceiver is configured to act as a proximity detector.
In another embodiment, a solar cell is positioned on the backplane surface 38. For example, the solar cell may comprise a plurality of photodiodes. The solar cell may be configured to receive visible, infrared and/or ultraviolet light through the display layer.
The solar cell is configured to convert received light into power which is used to power the mobile device. In some embodiments, the solar cell is used as an optical wireless communications detector and/or as a proximity sensor detector. In some embodiments, the solar cell is configured to detect light levels, for example ambient light levels.
By positioning light-transmitting and/or light-receiving devices behind the display layer, it may be possible to take advantage of the entire mobile device display area for placing opto-electronic components, for example opto-electronic components suitable for OWC, optical sensing, or solar power generation. In the electronic device described above with reference to
A commercial example may be the integrated camera module and the proximity sensor on a mobile phone, which using the technique above may be integrated behind a display matrix in a display region instead of in a non-display region such as a bezel. Using the transparent display, visible light captured by the camera sensor may have a sufficiently unobstructed path between the image that is being captured and the sensor itself, while the infrared light emitted and received by the proximity sensor may have a sufficiently unobstructed path between the sensor and incoming IR radiation to make the detection.
In some circumstances, components can be made inconspicuous irrespective of their size by positioning them behind the display.
Benefits may be provided with regard to the limited space that may become available for other optical components due to the tendency to reduce the mobile device screen bezel. In some circumstances, by positioning light-transmitting and/or light-receiving devices behind the display layer instead of in regions outside the display region of a mobile device, the bezel of the mobile device could potentially be removed completely.
Integrating a solar cell into a mobile device, for example by placing the solar cell behind the display layer, may in some circumstances significantly increase the battery life of the mobile device. In some embodiments, the entire screen area may become available for the integration of a solar cell, for example a high-efficiency solar cell. An amount of power that may be captured by a solar cell may be dependent on a size of the solar cell.
In some embodiments, positioning photodetectors behind the display layer may enable the use of large area photodetectors and/or the use of multiple photodetectors, due to the large area available behind the display layer. When the photodetector or photodetectors are not confined to the bezel, larger photodetectors or a greater number of photodetectors may be used.
In some embodiments, the use of large area and/or multiple photodetectors may lead to significant reduction or removal of any receiver and/or transmitter optics. In some systems, receiver and/or transmitter optics may be positioned in front of a receiver and/or transmitter in order to collect more light. When the effective area of the photodetector or photodetectors is large enough, then in some circumstances enough light may be captured without using such optics, or the optics used may be reduced.
In some embodiments, positioning transmitters behind the display layer may enable the use of scattered and/or large area transmitters. For example, a transmitter may occupy a larger area when placed behind the display layer than when placed in a bezel. In some embodiments, a plurality of transmitters are placed at locations across the display region. In some embodiments, one or more large area transmitters occupies a significant proportion of the display region, for example 10% of the display region.
The use of scattered and/or large area transmitters may alleviate constraints due to eye safety. If a single, small light source is used, eye safety regulations may set limits on the amount of light that may be emitted from that light source. For example, a level of emitted infrared light may be restricted to prevent eye damage. When the effective area of the transmitter or transmitters is larger, then radiated light (for example, radiated infrared light) is distributed over a larger area, which may relax eye safety constraints. For example, a higher total amount of light may be emitted when it is distributed over an entire display region than when it is emitted from a single, small light source.
In the embodiment of
By using a light-transmitting device that is separate from the light sources that form the display, a device may be adapted for both display and communication (for example, OWC communication). In some circumstances, screen LEDs (for example, TOLEDs) that form a display may have relatively low modulation speeds and low power output. In some circumstances, screen LEDs may not be suitable for communication, or may be suitable for communication only over short distances.
If the screen LEDs were to be used for communication, they may be very bright in order to deliver high data rates at distances used for communication, for example at practical distances that are suitable for LiFi type of connectivity. The use of infrared light for uplink communication may avoid the situation where there is a bright light shining into a user's face.
In
The transparent display screen 60 may comprise a cover layer, capacitive layer, backplane and/or other layers. The transparent display screen 60 is already packaged without the optical sensor and/or communication devices being integrated into the display package. The display screen 60 may also comprise connectors configured to connect the display screen to other components of the mobile phone. In the embodiment of
In the embodiment illustrated in
In the embodiment of
Placing light-transmitting and/or light-receiving devices behind a separate complete transparent screen may allow the screen to be fabricated separately from the light-transmitting and/or light-receiving devices.
In the embodiments of
In the embodiment of
The display matrix comprises a plurality of display elements, which may also be called pixels. In the embodiment of
The plurality of display elements comprises a plurality of red display elements 72, a plurality of green display elements 74, and a plurality of blue display elements 76. In
Between the display elements are positioned a plurality of photodiodes 78 and a plurality of IR LEDs 80. In
The part of the display layer illustrated in
Starting from the top left hand side of the unit cell, a first row comprises in order from left to right a red display element 72, a green display element 74, a further red display element 72 and a further green display element 74. A second row comprises a blue display element 76, a photodiode 78, a further blue display element 76 and a further photodiode 78. A third row is the same as the first row. A fourth row comprises a blue display element 76, a photodiode 78, a further blue display element 76 and an IR LED 80.
Photodiodes 78 and LEDs 80 are interspersed within the display elements 72, 74, 76 such that each photodiode 78 or LED 80 is surrounded by display elements 72, 74, 76.
In other embodiments, if an RGB display comprises red, green and blue LEDs in a repeating pixel configuration, then a fourth IR LED or a sensor (for example, a photodiode) may be integrated in as part of the pixel configuration.
In further embodiments, the photodiodes and/or LEDs are arranged in one or more rows or columns. In such embodiments, instead of each photodiode 78 or LED 80 being surrounded by display elements 72, 74, 76, each photodiode 78 or LED 80 may be adjacent to at least one further photodiode 78 or LED 80. In some embodiments, one or more rows or columns of photodiodes and/or LEDs are placed along one or more edges of an array of display elements 72, 74, 76. In some embodiments, one or more rows or columns of photodiodes 78 and/or LEDs 80 are placed within an array of display elements 72, 74, 76. For example, a row of photodiodes 78 and/or LEDs 80 may be placed between two rows of display elements 72, 74, 76.
Although
The photodiodes may be replaced or supplemented by any suitable photodetectors, for example avalanche photodiodes (APDs), single-photon avalanche photodiodes (SPADs), photomultiplier tubes, solar cells, photodiodes operated in a solar cell mode (forward biased), vertical cavity surface-emitting laser (VCSEL), silicon photomultiplier (SiPM) and multi pixel photon counter (MPPC). The LEDs may be replaced or supplemented by any suitable light emitters, for example laser diodes.
By integrating light-transmitting and/or light-receiving devices into the display layer rather than into a further layer, the devices may have a substantially unobstructed light path into or out of the screen. The devices may be integrated into the display screen rather than taking up space in a non-display region, for example a bezel of a mobile phone. This may allow a bezel to be reduced in size or eliminated.
A light-transmitting device that is integrated into the display layer may have a different wavelength, modulation speed and/or power to that of the light sources used to form the image. In some circumstances, light sources used to form an image may have low modulation speeds and/or low power output. The light-transmitting device may have a higher power output and/or a faster modulation speed.
As in
In some embodiments, each pixel of a display apparatus comprises an OWC transmitter and receiver, together with usual pixel circuitry and display elements.
The above pixel structure allows OWC functionality to be integrated into any display technology, for example LCD, OLED or RGB LED. By utilizing a plurality of these pixel structures in a display, the entire display area may be used to transmit and receive data thus minimizing any risk of the signal being lost. The pixel structure may also allow OWC to be integrated into any device with a display, including TVs, smart banners, monitors etc. The pixel structure of
In some embodiments, OWC signals may be generated by using light emitting devices that are used for display. For example, one or more of the display LEDs may be modulated to send optical signals by the display. Data transmission may be synchronised with display signals. For example, if a scene or image that is being displayed on the display screen is mostly red, then the red LEDs may be modulated to send optical communication signals. Should the scene move to a scene that is mostly blue, for example, then the blue LEDs may be modulated to send optical communication signals. In such a case, photodiodes may be provided as part of the display screen itself or behind the display screen.
Further embodiments of the screen, illustrated in
In a first example embodiment, more than one OWC receiving region is provided. The more than one OWC receiving regions may be provided on a separate layer to the display, for example, on the backplane of the screen, illustrated in
Each of the receiving regions is configured to receive OWC signals on a different optical wavelength. This may be achieved by providing appropriate filters or other optical elements that permit only light of a certain wavelength to pass to the photodiodes of the receiving region. A plurality of filters or other optical elements or a single filter or optical element may be used. Alternatively, a first OWC receiving region may comprise photodiodes of a first photodiode type and a second OWC receiving region may comprise photodiodes of a second photodiode type, such that the first and second photodiode types are different and the first and second photodiode types are sensitive to light of a first and a second wavelength, respectively. In some embodiments, more than two OWC regions with corresponding photodiode types can be provided.
In some embodiments, each receiving region is sensitive to light having a distinct wavelength in the IR spectrum.
In some embodiments, each receiving region is provided with associated signal collection circuitry for collecting and summing analogue detection signals from each of the photodiodes in the receiving region. The collection circuitry thus produces a summed, or otherwise combined, signal(s) for each receiving region. Signals from photodiodes arranged at different distances from the collection circuitry may take different times to arrive at the collecting circuitry. Therefore, the collection circuitry may have a processor or further synchronisation circuitry configured to off-set collection times from different diodes so that the collected signal of the collection circuitry corresponds to a sum of received signals at one moment in time.
In addition, in some embodiments, the collection circuitry for each receiving region may have an associated amplifier per receiving region. The amplifier per receiving region may be arranged to amplify the summed signal and to provide the amplified signal to an ADC.
By providing different receiving regions, multiplexing of received signals may be achieved allowing the apparatus to receive signals over more than one optical wavelength channel. Thus, data rate and/or bandwidth of received signals may be increased.
Returning to the LiFi enabled screen, as shown in
In a further embodiment, different epitaxy layers or films may be used to provide a transparent RGB transmitter and IR detector.
As an example, within the semiconductor, the upper layers may be shallower and hence more sensitive to shorter wavelengths of light such as ultra violet (UV) or blue wavelengths whereas deeper within the semiconductor, the device may be more sensitive for longer wavelengths, for example, infrared. In some embodiments, a thin film OLED may be provided as a laminated layer on the back of the display for receiving infrared.
Although, in some embodiments described above, the display apparatus is configured to emit infrared light for uplink communication and receive visible light for downlink communication, it should be understood that alternative embodiments can provide uplink communication using visible light and downlink communication using infrared light. Such functionality can be achieved by using a photodiode sensitive to IR light or suitable filters configured to filter infrared light for the photodiode. Also, visible LEDs can be driven to produce modulated optical signals.
It should be further understood that alternative embodiments can provide both uplink communication and downlink communication using infrared light. Such functionality can be achieved by using a photodiode sensitive to infrared light or suitable filters configured to filter infrared light for the photodiode and infrared LEDs or suitable filters configured to filter infrared light for the LED. In further alternative embodiments, both uplink communication and downlink communication can use visible light. Also, in further alternative embodiments, UV light can be used for at least one of the uplink communication and/or downlink communication.
In some embodiments, transmitting and receiving optical communication signals may be operated in half duplex or in full duplex mode.
In some embodiments, when receiving elements are provided on the backplane layer, filter elements may be provided on the display layer to filter the light as it passes through the display layer.
It will be understood that appropriate features from the display matrix embodiments may be combined with appropriate features from the display screen embodiments.
As described above, TOLED technology is used to address the issue of integrating optical detectors and emitters in electronic devices that employ a display. However, other LED technology may be used. In some embodiments, arrays of microLEDs may be provided. In some embodiments, microLED arrays may be implemented as part of the display matrix. In further embodiments, microLED arrays may be incorporated as part of the at least partially transparent display screen. In particular, as part of embodiment of
Further discussion of microLEDs is hereby provided. The following provides some non-limiting examples of microLEDs suitable for optical wireless communication (OWC).
The following provides a focus on properties of mircoLEDs which are most useful for optical wireless communication.
Discussion of microLEDs can be found in: “Towards 10 Gb/s orthogonal frequency division multiplexing-based visible light communication using a GaN violet micro-LED”, Vol. 5, No. 2, April 2017, Photonics Research by Islim et al; “A review of gallium nitride LEDs for multigigabit-per-second visible light data communications” by Rajbhandari et al., Semicond. Sci. Technol. 32 (2017) 023001; “A 3-Gb/s Single-LED OFDM-Based Wireless VLC Link Using a Gallium Nitride μLED” by Tsonev et al., IEEE PHOTONICS TECHNOLOGY LETTERS, VOL. 26, NO. 7, Apr. 1, 2014; and “High Bandwidth GaN-Based Micro-LEDs for Multi-Gb/s Visible Light Communications” by Ferreira et al., IEEE PHOTONICS TECHNOLOGY LETTERS, VOL. 28, NO. 19, Oct. 1, 2016.
Some parameters for a successful OWC system can include suitable values for electrical bandwidth; total radiant flux; thickness; beam output cone angle, and wallplug efficiency (electrical-optical efficiency). MicroLEDs may achieve suitable values of these parameters, as detailed below, by providing one or more arrays of microLEDs on a chip. MicroLEDs may provide a single low profile light source.
MicroLEDs may be used as a source, as follows. A first option is to provide a source comprising an microLED array with total output power of 0.1 W in an area of 1×1 mm2 and with a tailored output angle distribution. A second option is to provide a multi-wavelength microLED array with different wavelength bands in subarrays with a total power and area similar to option 1. A third option is to combine red, green, blue and infrared microLEDs in a structured array while maintaining the bandwidth advantages of single microLEDs.
The microLED array of
To achieve a tailored output angle, a number of microLEDs can be combined to give the required peak output power of, for example, 100 mW from the array within the given target cone angle. For example, the desired wavelength of operation may be 900 nm. The system also needs to retain the advantages of microLEDs for LiFi applications of a high electrical bandwidth.
An initial list of design parameters and possible values of said parameters for the microLED array is as follows. Radiant flux may have a typical value of 0.1 W which covers the combined output from the array. The maximum thickness of die and carrier may be 5 mm, optionally 1 mm, optionally 0.5 mm. The array may have a width with a typical value of 5 mm, optionally 1 mm. The array may have a length with a typical value of 5 mm, optionally 1 mm. A typical desired wavelength of operation may be 900 nm and a typical wavelength range may be 880 to 920 nm. The spectral bandwidth may have a typical value of 50 nm. The electrical bandwidth, at 3 dB, may have typical minimum value of greater than 250 MHz, optionally 500 MHz. The wallplug efficiency may have a target value of 50%.
A second option for a microLED array is shown in
An initial list of design parameters and possible typical values of said parameters for the microLED array may be as follows. Radiant flux may have a typical value of 0.1 W which covers the combined output from the array. The maximum thickness of die and carrier may be 5 mm, optionally 1 mm, optionally 0.5 mm. The array may have a width with a typical value of 5 mm, optionally 1 mm. The array may have a length with a typical value of 5 mm, optionally 1 mm. The cone angle, full-width half maximum, may have a typical value of 60 degrees. The spectral bandwidth of each wavelength band may have a typical value of 25 nm. The electrical bandwidth, at 3 dB, may have a typical minimum value of greater than 250 MHz, optionally 500 MHz. The wallplug efficiency may have a target value of 50%.
As an example, for the array of
A third option is illustrated in
An initial list of design parameters and typical values of said parameters for the structured microLED array is as follows. Radiant flux may have a typical value of 0.1 W which covers the combined output from the array. The maximum thickness of die and carrier may be 5 mm, optionally 1 mm, optionally 0.5 mm. The array may have a width with a typical value of 7 cm. The array may have a length with a typical value of 11 cm. Each unit cell may have a size of 10 μm by 10 μm. The cone angle, full-width at half maximum, may have a typical value of 120 degrees. The electrical bandwidth, at 3 dB, may have a typical minimum value of greater than 250 MHz, optionally 500 MHz. The wallplug efficiency may have a target value of 50%.
In some embodiments, a typical value for power output of a single pixel with a diameter of 40-50 μm is about 2-5 mW from. In some embodiments, a pixel of approximately 10 μm in diameter has a typical value of power output of 0.1 mW.
As an example, for the array in
In further embodiments, different light source technology may be used as part of the screen. A discussion is presented of different display technology that may be used. These technologies may be used as part of a display screen, behind which LiFi transmitter and/or receivers can be placed, for example, the screen of
In some embodiments, TOLEDs, microLEDs, quantum dot LEDs (qLED) and lightfield displays may be used as part of the display screen, behind which LiFi transmitter and/or receivers can be placed. TOLEDs may offer the advantage that a standard LiFi platform may be used that does not incorporate emissive display elements and/or the display area can be curved. In addition, LiFi performance works in favour of display performance by enhancing contrast. TOLEDs also offer the advantage of allowing a modular solution that can be fitted to different displays. This is advantageous if the physical placement is important to obtain an improved field of view. In these embodiments, MicroLED arrays may offer a small form factor and arrays may offer selective directivity. MicroLEDs also offer high bandwidth and multiple wavelength options. In these embodiments, qLED displays may provide the advantage that their use would enable increased uplink strength. qLED display uses wavelength converting elements to broaden gamut for example. As the qLED is typically placed in the backlight, it's easy to modulate and send out as a LiFi uplink signal. A power penalty may be that the efficiency of the emitter driver compared to standard backlighting. qLED would ultimately enable increased UL signal. Lightfield displays may offer the advantage of enabling bidirectional directivity.
As described above, different display technology can be provided in an array that incorporates LiFi elements. In such embodiments, microLEDs may offer the advantage that the LiFI platform can be integrated into a backplane and may offer high optical power uplink per pixel. In such embodiments, qLED display technology may offer the advantage that the LiFi components may be integrated into a backlight of the qLED display. In addition, qLED technology may provide a low complexity and low cost alternative. A lightfield display may offer the advantage that uplink and/or downlink efficiency could be increased.
Although embodiments above have been described in relation to a mobile phone, they may be implemented in any appropriate device having a display screen, for example a mobile phone, tablet, laptop or desktop computer, household appliance or point of sale device.
Embodiments have been described in which visible light is received and infrared light is transmitted. However, in other embodiments, any suitable wavelength of light may be transmitted and/or received, for example visible, infrared or ultraviolet light.
Whilst components of the embodiments described herein have been implemented in software, it will be understood that any such components can be implemented in hardware, for example in the form of ASICs or FPGAs, or in a combination of hardware and software. Similarly, some or all of the hardware components of embodiments described herein may be implemented in software or in a suitable combination of software and hardware.
It will be understood that the present invention has been described above purely by way of example, and modifications of detail can be made within the scope of the invention. Each feature disclosed in the description, and (where appropriate) the claims and drawings may be provided independently or in any appropriate combination.
| Number | Date | Country | Kind |
|---|---|---|---|
| 1700530 | Jan 2017 | GB | national |
This application is a continuation of, claims priority to and the benefit of, U.S. Ser. No. 17/524,957 filed on Nov. 12, 2021 and entitled “Display Apparatus.” The '957 application is a continuation of, claims priority to and the benefit of, U.S. Ser. No. 16/476,286 filed on Jul. 6, 2019, now U.S. Pat. No. 11,283,520 issued Mar. 22, 2022 and entitled “Display Apparatus.” The '286 application claims priority to and the benefit of PCT Application No. PCT/GB2018/050093 filed on Jan. 12, 2018 and entitled “Display Apparatus.” The '093 PCT application claims priority to and the benefit of United Kingdom Provisional Patent Application No. 1700530.7, filed Jan. 12, 2017. All of the foregoing disclosures are hereby incorporated by reference for all purposes in their entirety.
| Number | Name | Date | Kind |
|---|---|---|---|
| 8890773 | Pederson | Nov 2014 | B1 |
| 9460332 | Bussat | Oct 2016 | B1 |
| 9466653 | de Jong et al. | Oct 2016 | B2 |
| 11283520 | Tsonev | Mar 2022 | B2 |
| 20090219273 | Nathan | Sep 2009 | A1 |
| 20100302194 | Park | Dec 2010 | A1 |
| 20110043487 | Huang | Feb 2011 | A1 |
| 20130135328 | Rappoport | May 2013 | A1 |
| 20130308073 | Yamazaki | Nov 2013 | A1 |
| 20130341659 | Lin | Dec 2013 | A1 |
| 20140010549 | Kang | Jan 2014 | A1 |
| 20140023378 | Bae | Jan 2014 | A1 |
| 20140176514 | Lin | Jun 2014 | A1 |
| 20150228089 | Perdices-Gonzalez | Aug 2015 | A1 |
| 20160308614 | Tsonev et al. | Oct 2016 | A1 |
| 20170092228 | Cote | Mar 2017 | A1 |
| 20170294488 | Lin | Oct 2017 | A1 |
| 20190096966 | Rappoport | Mar 2019 | A1 |
| 20190363792 | Tsonev | Nov 2019 | A1 |
| Number | Date | Country |
|---|---|---|
| 1607819 | Apr 2005 | CN |
| 102592543 | Jul 2012 | CN |
| 103681774 | Mar 2014 | CN |
| 104766572 | Jul 2015 | CN |
| 2129103 | Feb 2009 | EP |
| 2342522 | Apr 2000 | GB |
| 2009153117 | Jul 2009 | JP |
| 2015082907 | Jun 2015 | WO |
| 2015116217 | Aug 2015 | WO |
| 2016129945 | Aug 2016 | WO |
| Entry |
|---|
| ISA; International Preliminary Report on Patentability dated Jul. 16, 2019 in Application No. PCT/GB2018/050093. |
| IEEE International Conference on Wireless for Space and Extreme Environments (WiSEE), 2016, IEEE, pp. 37-41, Bialic et al “Semi-trasparent solar cells indifferent to ambient lighting for Li Fi Application.” |
| Anonymous: “Method for Li-Fi Network Encoded Video Streams on LED TVs Broadcasting to Mobile Devices”, IP.com journal, Apr. 26, 2016. |
| Zeng et al, “Visible light communication system for mobile device”, Sixth International Conference on Ubiquitous and Future Networks (ICUFN), 2014, pp. 26-28. |
| International Searching Authority, International Search Report and Written Opinion dated Jan. 12, 2018 in Application No. PCT/GB2018/050093. |
| UKIPO, United Kingdom Search Report dated May 16, 2017 in Application No. GB1700530.7. |
| UKIPO, United Kingdom Search Report dated Mar. 8, 2018 in Application No. GB1800563. 7. |
| UKIPO, United Kingdom Combined Search and Exam Report dated Mar. 6, 2018 in Application No. GB1800564.5. |
| UKIPO, United Kingdom Search Report dated Oct. 29, 2018 in Application No. GB1800564.5. |
| UKIPO, United Kingdom Search Report dated Oct. 19, 2017 in Application No. GB1700530.7. |
| UKIPO, United Kingdom Search Report dated Oct. 29, 2018 in Application No. GB1800563.7. |
| USPTO, Non-Final Office Action dated Jun. 26, 2020 in U.S. Appl. No. 16/476,286. |
| USPTO, Final Office Action dated Apr. 15, 2021 in U.S. Appl. No. 16/476,286. |
| USPTO, Notice of Allowance dated Aug. 11, 2021 in U.S. Appl. No. 16/476,286. |
| USPTO, Notice of Allowance dated Sep. 2, 2022 in U.S. Appl. No. 17/524,957. |
| USPTO, Notice of Allowance dated Jan. 12, 2023 in U.S. Appl. No. 17/524,957. |
| UKIPO, United Kingdom Exam Report dated Jan. 7, 2019 in Application No. GB1800563.7. |
| UKIPO, United Kingdom Exam Report dated Mar. 7, 2019 in Application No. GB1800563.7. |
| UKIPO, United Kingdom Exam Report dated Apr. 2, 2019 in Application No. GB1800563.7. |
| UKIPO, United Kingdom Exam Report dated Jan. 7, 2018 in Application No. GB1800564.5. |
| UKIPO, United Kingdom Exam Report dated Mar. 12, 2019 in Application No. GB1800564.5. |
| European Patent Office, European Office Action dated Jul. 16, 2021 in Application No. 18700824.8. |
| Sunpartner Technologies, “Mobile Devices”, https://sunpartnertechnologies.com/mobile-devices/, retrieved Feb. 12, 2022, 4 pages. |
| CNIPA, Chinese Office Action dated Dec. 5, 2022 in Application No. 201880006367.0. |
| Number | Date | Country | |
|---|---|---|---|
| 20230246711 A1 | Aug 2023 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 17524957 | Nov 2021 | US |
| Child | 18296305 | US | |
| Parent | 16476286 | US | |
| Child | 17524957 | US |
