Patent Application
20240395184
Embodiments generally relate to a display device. More particularly, embodiments relate to a display device applied to various electronic apparatuses and a display panel included in the display device.
As information technology develops, a demand for a display device for displaying an image is increasing. For example, the display device may be applied to various electronic apparatuses such as a smart phone, a digital camera, a notebook computer, a navigation system, a smart television, or the like.
Recently, artificial intelligence has been applied in various fields. The artificial intelligence may be implemented in software or hardware. In order to implement the artificial intelligence in hardware, a neuromorphic system that mimics a human nervous system is being studied.
The artificial intelligence may be used for image processing, deterioration prediction, or the like of the display device. In the display device, the neuromorphic system may be implemented as a neural processing unit (NPU). However, as the display device includes the neural processing unit, power consumption and cost of the display device may increase.
Embodiments provide a display device in which a neuromorphic system is implemented with low power consumption and low cost.
A display panel according to an embodiment may include: a pixel array including a plurality of pixels connected to scan lines and data lines; a photonic synapse block including a plurality of photonic synapse elements, electrically connected to the pixel array; and a neuron block including a plurality of neuron elements, each of the plurality of neuron elements electrically connected to each of the plurality of photonic synapse elements.
In an embodiment, the photonic synapse block may be disposed between the pixel array and the neuron block.
In an embodiment, a photo conductivity of each of the plurality of photonic synapse elements may be fixed.
In an embodiment, data voltages, which are transmitted through the data lines, may be inputted to the photonic synapse block.
In an embodiment, the photonic synapse block may overlap the pixel array.
In an embodiment, the photonic synapse block may be disposed under the pixel array.
In an embodiment, the plurality of photonic synapse elements may include a plurality of first photonic synapse elements and a plurality of second photonic synapse elements which receive signals from the plurality of first photonic synapse elements as input signals.
In an embodiment, a photo conductivity of each of the plurality of first photonic synapse elements may change by an image displayed by the pixel array.
In an embodiment, a photo conductivity of each of the plurality of second photonic synapse elements may be fixed.
In an embodiment, a number of the plurality of second photonic synapse elements may be greater than a number of the plurality of first photonic synapse elements per a unit area of the pixel array.
In an embodiment, the plurality of first photonic synapse elements may sense an image displayed by the pixel array, and the plurality of second photonic synapse elements may perform a neural network operation based on the input signals.
In an embodiment, the pixel array may include a first pixel array which displays an image and a second pixel array which does not display the image, and the photonic synapse block may overlap the second pixel array.
In an embodiment, the photonic synapse block may be disposed under the second pixel array.
In an embodiment, a photo conductivity of each of the plurality of photonic synapse elements may change by a light emitted by the second pixel array.
In an embodiment, each of the plurality of photonic synapse elements may include a ferroelectric layer and a semiconductor layer disposed on the ferroelectric layer.
In an embodiment, the ferroelectric layer may include hafnium-zirconium oxide (HfZrO), and the semiconductor layer may include indium-gallium-zinc oxide (IGZO).
In an embodiment, each of the plurality of neuron elements may include an operational amplifier.
A display device according to an embodiment may include: a display panel which includes a pixel array including a plurality of pixels connected to scan lines and data lines, a photonic synapse block including a plurality of photonic synapse elements electrically connected to the pixel array, and a neuron block including a plurality of neuron elements, each of the plurality of neuron elements electrically connected to each of the plurality of photonic synapse elements; and a memory electrically connected to the neuron block.
In an embodiment, the memory may receive an output signal of the neuron block, and the photonic synapse block may receive an output signal of the memory.
In an embodiment, the display device may further include a driver configured to provide scan signals to the scan lines and providing data voltages to the data lines respectively, and the driver may include the memory.
In the display device according to the embodiments, the display panel may include the photonic synapse block and the neuron block, so that the neuromorphic system may be implemented in the display device with low power consumption and low cost.
Illustrative, non-limiting embodiments will be more clearly understood from the following detailed description taken in conjunction with the accompanying drawings.
Hereinafter, display panels and display devices in accordance with embodiments will be explained in detail with reference to the accompanying drawings.
Referring to
The processor 40 may control an operation of the driving controller 20. The processor 40 may provide image data to the driving controller 20. The processor 40 may include a central processing unit (CPU). In an embodiment, the processor 40 may be an application processor (AP) for mobile.
The driving controller 20 may convert the image data into data voltages, and provide the data voltages to the display unit 10. The driving controller 20 may include a timing controller 21 and a driver 22.
The timing controller 21 may generate data signals, a data control signal, and a scan control signal based on the image data.
The driver 22 may generate the data voltages based on the data signals and the data control signal. Further, the driver 22 may generate scan signals based on the scan control signal. In an embodiment, the driver 22 may include a data driver generating the data voltages and a scan driver generating the scan signals.
The display unit 10 may receive the data voltages and the scan signals from the driver 22. The display unit 10 may include a plurality of pixels that display an image. The pixels may emit light based on the data voltages and the scan signals.
The driver 22 may include a memory 30. The memory 30 may store data necessary for an operation of the driver 22 and an operation of the neuromorphic system 50. The memory 30 may include a volatile memory or a non-volatile memory. The volatile memory may include dynamic random access memory (DRAM), static random access memory (SRAM), mobile DRAM, or the like. The non-volatile memory may include erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), flash memory, phase change random access memory (PRAM), resistance random access memory (RRAM), nano floating gate memory (NFGM), polymer random access memory (PoRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), or the like.
The neuromorphic system 50 may perform a neural network operation using an artificial intelligence. For example, the neuromorphic system 50 may perform image processing using the artificial intelligence, deterioration prediction using the artificial intelligence, or the like. The neuromorphic system 50 may include a photonic synapse block SB in
Referring to
The display panel 110 may include a first substrate 111 and a second substrate 112. The first substrate 111 may be a thin film transistor substrate including a plastic substrate or a glass substrate. The first substrate 111 may include a thin film transistor and a light emitting element connected to the thin film transistor.
In an embodiment, the driver 22 of the driving controller 20 may be mounted on the first substrate 111 in the form of an integrated circuit.
The second substrate 112 may be an encapsulation substrate including a plastic film, a glass film, or a protective film, or may be a window substrate. The second substrate 112 may protect the thin film transistor and the light emitting element included in the first substrate 111 from external moisture, oxygen, or the like.
The flexible circuit film 120 may be connected to the first substrate 111 of the display panel 110 and the printed circuit board 130. The flexible circuit film 120 may be bent. The flexible circuit film 120 may be implemented by a chip on film (COF) method, a chip on plastic (COP) method, or the like. The flexible circuit film 120 may include a base film including polyimide or the like and a plurality of lead lines disposed on the base film.
In an embodiment, the driving controller 20 may be mounted on the flexible circuit film 120 in the form of an integrated circuit IC1.
The printed circuit board 130 may be connected to the flexible circuit film 120. For example, the printed circuit board 130 may be a flexible printed circuit board (FPCB).
In an embodiment, the driving controller 20 and the processor 40 may be mounted on the printed circuit board 130 in the form of an integrated circuit IC2.
Referring to
The pixel array PA may include a plurality of pixels PX. The pixels PX may be connected to scan lines SL and data lines DL. The scan lines SL may extend in a first direction X, and may be arranged in a second direction Y crossing the first direction X. The data lines DL may extend in the second direction Y, and may be arranged in the first direction X. The scan lines SL may receive the scan signals from the scan driver of the driver 22, and the data lines DL may receive the data voltages from the data driver of the driver 22. The pixels PX may emit light based on the scan signals transmitted from the scan lines SL and the data voltages transmitted from the data lines DL. The pixel array PA may display an image based on light emitted from the pixels PX.
The photonic synapse block SB may not overlap the pixel array PA. The photonic synapse block SB may be disposed in the second direction Y from the pixel array PA. The photonic synapse block SB may be disposed between the pixel array PA and the neuron block NB in a plan view.
As depicted in
A photoconductivity of each of the photonic synapse elements SE may be fixed. The photo conductivity of the photonic synapse element SE may correspond to the weight for the neural network operation. The photo conductivity of the photonic synapse element SE may be fixed when the display panel 110 is manufactured. The photo conductivity of the photonic synapse element SE may correspond to a weight obtained by learning using artificial intelligence before the display panel 110 is manufactured.
In an embodiment, the photo conductivity of the photonic synapse element SE may be set by irradiating the photonic synapse element SE with ultraviolet light. For example, the photo conductivity of the photonic synapse element SE may be set based on the number of times of irradiation of ultraviolet light.
The neuron block NB may be disposed in the second direction Y from the photonic synapse block SB. The neuron block NB may include a plurality of neuron elements NE. The neuron elements NE may be electrically connected to the photonic synapse elements SE. Each of the neuron elements NE may be connected to the output line OL. Each of the neuron elements NE may accumulate the operation result transmitted through the output line OL, and may provide an accumulated operation result to the memory 30.
In an embodiment, each of the neuron elements NE may include an operational amplifier (op-amp).
The memory 30 may be electrically connected to the neuromorphic system 50. That is, the memory 30 may be electrically connected to the neuron block NB. The memory 30 may receive output signals of the neuron block NB, and may provide signals generated based on the output signals of the neuron block NB to the photonic synapse block SB. In other words, the photonic synapse block SB may receive output signals of the memory 30.
In an embodiment, as depicted in
An output signal of a k-th (k is a natural number) neuron layer NLk may be transmitted to a (k+1)-th photonic synapse layer SLk+1 through the memory 30. For example, an output signal of a first neuron layer NL1 may be transmitted to a second photonic synapse layer SL2 through the memory 30, and an output signal of an (n−1)-th neuron layer NLn−1 may be transmitted to an n-th photonic synapse layer SLn through the memory 30.
In an embodiment, the neuromorphic system 50 may perform an image processing operation using the data voltages provided to the pixel array PA. The image processing operation may include object detection, segmentation, motion estimation and motion compensation (MEMC) deblur, or the like.
In an embodiment, the data voltages transmitted by the data lines DL may be inputted to the photonic synapse block SB. For example, the data voltages may be sampled in units of n scan lines SL, and the sampled data voltages may be provided to the photonic synapse block SB.
In the embodiment described with reference to
Referring to
The semiconductor layer SM may be disposed on the ferroelectric layer FL. The semiconductor layer SM may include an oxide semiconductor. In an embodiment, the semiconductor layer SM may include indium-gallium-zinc oxide (IGZO).
The ferroelectric layer FL and the semiconductor layer SM may be formed by an atomic layer deposition. When an optical stimulation by light such as ultraviolet light, visible light, or the like is applied to the semiconductor layer SM from the outside, the ferroelectric layer FL may maintain polarization characteristics without external electrical stimulation. Accordingly, the photonic synapse element SE may control current, and may store photoconductivity. The photonic synapse element SE driven by the optical stimulation may have a driving speed faster than that of an electronic synaptic element, such as a memristor or the like, driven by an electrical stimulation, and may have a power consumption lower than that of the electronic synaptic element.
The input electrode IE and the output electrode OE may be disposed on the semiconductor layer SM. In an embodiment, the input electrode IE and the output electrode OE may include aluminum (Al). The input electrode IE may receive the input signal transmitted from the input line IL, and the output electrode OE may transmit the output signal to the output line OL.
The gate electrode GE may be disposed under the ferroelectric layer FL. In an embodiment, the gate electrode GE may include titanium nitride (TiN).
Referring to
The pixel array PA may include a plurality of pixels PX. The pixels PX may be connected to the scan lines SL and the data lines DL. The pixels PX may emit light based on the scan signals transmitted from the scan lines SL and the data voltages transmitted from the data lines DL. The pixel array PA may display an image based on light emitted from the pixels PX.
The photonic synapse block SB may overlap the pixel array PA. In an embodiment, the photonic synapse block SB may be disposed under the pixel array PA. The photonic synapse block SB may be disposed in a third direction Z crossing the first direction X and the second direction Y from the pixel array PA.
The photonic synapse block SB may include a plurality of photonic synapse elements SE. The photonic synapse elements SE may include a plurality of first photonic synapse elements SE1 and a plurality of second photonic synapse elements SE2. Each of the second photonic synapse elements SE2 may receive a signal from each of the first photonic synapse elements SE1 as an input signal.
The number of the second photonic synapse elements SE2 may be greater than the number of the first photonic synapse elements SE1. One first photonic synapse element SE1 may be disposed per a unit area of the pixel array PA. In an embodiment, as illustrated in
Each of the first photonic synapse elements SE1 may be connected to the input line IL. Each of the first photonic synapse elements SE1 may be turned on or turned off based on an optical signal. Each of the first photonic synapse elements SE1 may provide an output signal to the input line IL.
A photo conductivity of each of the first photonic synapse elements SE1 may be variable. The photo conductivity of the first photonic synapse element SE1 may change by an image displayed by the pixel array PA. The pixel array PA may emit light in the third direction Z, and the photo conductivity of the first photonic synapse element SE1 may change by the light emitted from the pixel array PA.
In an embodiment, the photo conductivity of the first photonic synapse element SE1 may change by visible light. For example, the photo conductivity of the first photonic synapse element SE1 may be set based on the number of times of irradiation of visible light.
The first photonic synapse elements SE1 may sense an image displayed by the pixel array PA. Since the photo conductivity of the first photonic synapse element SE1 changes by the image displayed by the pixel array PA, the first photonic synapse element SE1 may generate an output signal including information related to the generation of light in a unit area of the pixel array PA.
Each of the second photonic synapse elements SE2 may be connected to the input line IL and the output line OL. Each of the second photonic synapse elements SE2 may be turned on or turned off based on an electrical signal. Each of the second photonic synapse elements SE2 may perform a neural network operation based on an input signal transmitted from the input line IL, and may provide an operation result to the output line OL. In an embodiment, each of the second photonic synapse elements SE2 may generate the output signal by multiplying the input signal by a weight.
A photo conductivity of each of the second photonic synapse elements SE2 may be fixed. The photo conductivity of the second photonic synapse element SE2 may be fixed when the display panel 210 is manufactured. The photo conductivity of the second photonic synapse element SE2 may correspond to a weight obtained by learning using artificial intelligence before the display panel 210 is manufactured.
In an embodiment, the photo conductivity of the second photonic synapse element SE2 may be set by irradiating the second photonic synapse element SE2 with ultraviolet light. For example, the photo conductivity of the second photonic synapse element SE2 may be set based on the number of times of irradiation of ultraviolet light.
The second photonic synapse elements SE2 may perform a neural network operation based on input signals corresponding to the output signals of the first photonic synapse elements SE1. Since the photo conductivity of the second photonic synapse element SE2 is fixed, the second photonic synapse element SE2 may perform a neural network operation based on a weight corresponding to the fixed photo conductivity.
The neuron block NB may be disposed in the second direction Y from the photonic synapse block SB. The neuron block NB may include a plurality of neuron elements NE. The neuron elements NE may be electrically connected to the second photonic synapse elements SE2. Each of the neuron elements NE may be connected to the output line OL. Each of the neuron elements NE may accumulate the operation result transmitted through the output line OL, and may provide an accumulated operation result to the memory 30.
The memory 30 may be electrically connected to the neuron block NB. The memory 30 may receive output signals of the neuron block NB, and may provide signals generated based on the output signals of the neuron block NB to the photonic synapse block SB. In other words, the photonic synapse block SB may receive output signals of the memory 30.
In an embodiment, the neuromorphic system 50 may perform a deterioration prediction operation using an image displayed by the pixel array PA. A stress may be calculated using an image displayed by the pixel array PA, and deterioration of the pixels PX may be predicted based on the stress.
In the embodiment described with reference to
Referring to
The first pixel array PA1 may include a plurality of first pixels PX. The first pixels PX may be connected to the scan lines SL and the data lines DL. The first pixels PX may emit light based on the scan signals transmitted from the scan lines SL and the data voltages transmitted from the data lines DL. The first pixel array PA1 may display an image based on light emitted from the first pixels PX.
The second pixel array PA2 may be disposed in the second direction Y from the first pixel array PA1. The second pixel array PA2 may include a plurality of second pixels PX2. The second pixels PX2 may be connected to the scan lines SL and the data lines DL. The second pixels PX2 may emit light based on the scan signals transmitted from the scan lines SL and the data voltages transmitted from the data lines DL. The light emitted from the second pixels PX2 may be provided to the photonic synapse block SB. The second pixel array PA2 may not display an image.
As depicted in
The photonic synapse block SB may include a plurality of photonic synapse elements SE. Each of the photonic synapse elements SE may be connected to the input line IL and the output line OL. Each of the photonic synapse elements SE may be turned on or turned off based on an optical signal or an electrical signal. Each of the photonic synapse elements SE may perform a neural network operation based on an input signal transmitted from the input line IL, and may provide an operation result to the output line OL. In an embodiment, each of the photonic synapse elements SE may generate an output signal by multiplying the input signal by a weight.
A photo conductivity of each of the photonic synapse elements SE may be variable. The photo conductivity of the photonic synapse element SE may change by light emitted from the second pixel array PA2. The second pixel array PA2 may emit light in the third direction Z, and the photo conductivity of the photonic synapse element SE may change by the light emitted from the second pixel array PA2.
In an embodiment, the photo conductivity of the photonic synapse element SE may change by visible light. For example, the photo conductivity of the photonic synapse element SE may be set based on the number of times of irradiation of visible light.
The photonic synapse elements SE may sense the light emitted from the second pixel array PA2. Since the photoconductivity of the photonic synapse element SE change by the light emitted from the second pixel array PA2, the weight of the photonic synapse element SE may change depending on the light emitted from the second pixel array PA2.
The neuron block NB may be disposed in the second direction Y from the photonic synapse block SB. The neuron block NB may include a plurality of neuron elements NE. The neuron elements NE may be electrically connected to the photonic synapse elements SE. Each of the neuron elements NE may be connected to the output line OL. Each of the neuron elements NE may accumulate the operation result transmitted through the output line OL, and may provide an accumulated operation result to the memory 30.
The memory 30 may be electrically connected to the neuron block NB. The memory 30 may receive output signals of the neuron block NB, and may provide signals generated based on the output signals of the neuron block NB to the photonic synapse block SB. In other words, the photonic synapse block SB may receive output signals of the memory 30.
The neuromorphic system 50 may change or update a weight of a neural network by using the light emitted from the second pixel array PA2. In driving the display device 1, one frame period may include a porch period in which the data voltages are not applied to the first pixel array PA1. As the data voltages are applied to the second pixel array PA2 in the porch period, the second pixel array PA2 may emit light in the porch period, and the photo conductivities of the photonic synapse elements SE may change.
In the embodiment described with reference to
The display panel and the display device according to the embodiments may be applied to a display device included in a computer, a notebook, a mobile phone, a smartphone, a smart pad, a PMP, a PDA, an MP3 player, or the like.
Although the display panels and the display devices according to the embodiments have been described with reference to the drawings, the illustrated embodiments are examples, and may be modified and changed by a person having ordinary knowledge in the relevant technical field without departing from the technical spirit described in the following claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10-2021-0139325 | Oct 2021 | KR | national |
This application is a divisional application of U.S. patent application Ser. No. 17/828,305 filed on May 31, 2022, which claims priority under 35 USC § 119 to Korean Patent Application No. 10-2021-0139325 filed on Oct. 19, 2021 in the Korean Intellectual Property Office (KIPO). All of above patent applications are incorporated herein by reference.
| Number | Date | Country | |
|---|---|---|---|
| Parent | 17828305 | May 2022 | US |
| Child | 18794004 | US |
