Patent Grant
11703720
The present invention generally relates to the area of display devices and more particularly relates to method and architecture of modulating both amplitude and phase simultaneously within a pixel or within a single array of pixels, method and apparatus for creating embossed microstructures or specific alignment cells to control the amplitude modulation and the phase modulation, method and apparatus for controlling the optical characteristics of liquid crystals using photo alignment, nano-imprinting lithograph (NIL) and E-beam, and method and apparatus for controlling voltage being applied to a liquid crystal layer to realize the modulations of both amplitude and phase at substantively the same time.
In a computing world, a display usually means two different things, a showing device or a presentation. A showing device or a display device is an output mechanism that shows text and often graphic images to users while the outcome from such a display device is a display. The meaning of a display is well understood to those skilled in the art given a context. Depending on application, a display can be realized on a display device using a cathode ray tube (CRT), liquid crystal display (LCD), light-emitting diode, gas plasma, or other image projection technology (e.g., front or back projection, and holography).
A display is usually considered to include a screen or a projection medium (e.g., a surface or a 3D space) and supporting electronics that produce the information for display on the screen. One of the important components in a display is a device, sometime referred to as an imaging device, to form images to be displayed or projected on the display. An example of the device is a spatial light modulator (SLM). It is an object that imposes some form of spatially varying modulation on a beam of light. A simple example is an overhead projector transparency.
Usually, an SLM modulates the intensity of the incident light. However, it is also possible to produce devices that modulate the phase of the light or both the intensity and the phase simultaneously. SLMs are used extensively in holographic data storage setups to encode information into an incident light in exactly the same way as a transparency does for an overhead projector. They can also be used as part of a holographic display technology.
Depending on implementation, images can be created on an SLM electronically or optically, hence electrically addressed spatial light modulator (EASLM) and optically addressed spatial light modulator (OASLM). This current disclosure is directed to an EASLM. As its name implies, images on an electrically addressed spatial light modulator (EASLM) are created and changed electronically, as in most electronic displays. An example of an EASLM is the Digital Micromirror Device or DMD at the heart of DLP displays or Liquid crystal on silicon (LCoS or LCOS) using ferroelectric liquid crystals (FLCoS) or nematic liquid crystals (electrically controlled birefringence effect).
Currently most daily watched displays and their related technologies, either at home or office, such as old CRT, LCD, OLED, LED billboard, camera, office projector, home theatre projector or even digital cinema projector in movie theatre, are only related to amplitude modulated intensity of images which are direct or indirect reproduced images as amplitude modulated display. As such a display is only dealing with amplitude or intensity of images, it is a two-dimensional image without depth of view. When an auto-stereoscopic method is used to create a 3D display, such as images in 3D movies based on binocularity of human eyes to create the 3D effect, it can cause fatigue on the eyes and would not have the true three dimensional scenes with multiple focuses of natural view.
As far as images displayed in 3D are concerned, there are significantly differences between “natural viewing or holographic 3D-display” and “autostereoscopic viewing with 3-D stereo display” due to depth cue mismatch of convergence and accommodation, resulting in the eye strain and fatigue.
The motion of head leads to different perspectives, which is commonly referred to as motion parallax. Both depth perception and motion parallax are needed in the real 3D displays. Any unreal 3D display can cause conflict in brain, leading to discomfort and possibly headache (fatigue). The current autostereoscopic viewing is missing depth perception and motion parallax.
In human vision, there are another two factors that determine natural 3D viewing: convergence and accommodation. In ophthalmology, convergence is the simultaneous inward movement of both eyes toward each other, usually in an effort to maintain single binocular vision when viewing an object. Accommodation is the process by which a human eye changes optical power to maintain a clear image or focus on an object as its distance varies.
Autostereoscopy is any method of displaying stereoscopic images (adding binocular perception of 3D depth) without the use of special headgear or glasses on the part of the viewer. As one can see from
Multi-windows, image integral types, or holographic displays with images of continuous depth of focus or multiple focuses can achieve real 3D display like natural viewing. Such multi-focus depth images display often requires processing images with phase modulation to generate the real 3D display. However, such a technology is still at experimental level and not matured enough for real applications. Also, it is well known that the phase only modulation is in general not generating good image quality, often leading to mosaic-like images in low resolution.
In order to combine both AM and PM, there are many researches and experiments by utilizing two SLM devices, one to perform the AM, and the other to perform the PM only to establish an optical complicated system trying to achieve the good result. Although it is somehow successful in certain relative degree with a tedious and complicated set up in an optical lab to generate either reproduced holographic display or computer generated holography (CGH) display but still it is unable to overcome the problem of image superimposed issues and poor image quality due to two separate SLM devices located apart, resulting in differences in light traveling path, pixel to pixel alignment, wavelength deviation, and color aberration, besides a complicated and precision set-up of optical systems, such as 4f SLM optical systems or simply 4f systems in the industry.
As a result, there is a strong need for a technique that can perform both AM and PM in a single SLM device or panel. Such a technique is strongly welcomed in many applications, especially in 3D holographics with clear, compact volume, high light efficiency, high contrast and high resolution real 3D holographic display.
In holographic displays, the extent of angular view-ability remains one of the most important factors affecting the experience of observing optically reconstructed holographic images. Due to the rapid progress in liquid crystal display technologies, spatial light modulators (SLM), such as LCoS devices, provide high accuracy in optical wave reproduction. However, the resolution of the display is often limited by a number of pixels and the finite pixel pitch of a particular SLM device used in the display implementation. Thus there is a further need for techniques that can display 3D holographics in higher resolution than the original resolution of an SLM device.
This section is for the purpose of summarizing some aspects of the present invention and to briefly introduce some preferred embodiments. Simplifications or omissions in this section as well as in the abstract and the title may be made to avoid obscuring the purpose of this section, the abstract and the title. Such simplifications or omissions are not intended to limit the scope of the present invention.
The present invention is generally related to architecture and designs of modulating both amplitude and phase in spatial light modulation without using two independent modulations coupled in series. According to one aspect of the present invention, light propagation is controlled in two different directions (e.g., 45 and 0 degrees) to perform both amplitude modulation (AM) and phase modulation (PM) at the same time in liquid crystals. According to another aspect of the present invention, a mask is used to form an array of embossed microstructures or a pattern, where the pattern includes an array of alignment cells, a first group of the cells are aligned in the first direction and a second group of the cells are aligned in the second direction. Depending on applications, two cells from the first group and the second group may correspond to a single pixel or two neighboring pixels, resulting in amplitude modulation and phase modulation within the pixel or within an array of pixels.
According to still another aspect of the present invention, the pattern in the mask includes a plurality of two differently aligned cells, one for the AM and the other for the PM. Each of the cells corresponding to a single pixel, causing light to be modulated in amplitude and phase at the same time within an array of pixels. Depending on implementation, the two differently aligned cells may be arranged in different ways including alternating across the entire array, between columns or rows of pixels, or according to a predefined pattern.
According to still another aspect of the present invention, the pattern in the mask includes groups of four pairs, each pair having two differently aligned cells, corresponding to a single pixel, causing light to be modulated in amplitude and phase, respectively in quadruple, at the same time within the pixel.
According to still another aspect of the present invention, the mask is created by using a similar process in semiconductor including deposition, etching and curing to create a designated pattern, where embossed microstructures or specific alignment cells are created and deposed on top of an alignment layer.
According to still another aspect of the present invention, the embossed microstructures or specific alignment cells are created with an e-beam technique to create very small structures in a resist that can be subsequently used or transferred to a substrate material to facilitate the modulations of both AM and PM in the liquid crystals.
According to still another aspect of the present invention, instead of using a photo mask, a nano-stamping technique, also referred to herein as nano-imprinting lithograph (NIL), is used to create two gratings to cause light modulations in amplitude and phase. Such two gratings may be applied to a single pixel or every two pixels across an entire array.
According to still another aspect of the present invention, instead of using a photo mask or nano-stamping technique, the voltage applied or coupled across liquid crystals is so controlled that the liquid crystals are caused to perform the AM in a range and the PM in another range when the voltage is gradually increased, where the characteristics of the liquid crystals is significant, for example, by increasing the thickness or gap of a layer of liquid crystals.
According to still another aspect of the present invention, an input image is first expanded into two frames based on the architecture of sub-pixels. A first frame is derived from the input image while the second frame is generated based on the first frame. These two frames are of equal size to the input image and displayed as AM image and PM image alternatively at twice the refresh rate originally set for the input image.
According to yet another aspect of the present invention, driving circuits in analog and digital are described, where each of the driving circuits may be used to apply a controlled voltage across one or more liquid crystals (as a pixel) to facilitate the AM and/or PM modulations in the liquid crystals.
The present invention may be implemented as an apparatus, a method, and a part of system. Different implementations may yield different benefits, objects and advantages. According to one embodiment, the present invention is a method in a spatial light modulator (SLM), the method comprises designating a first group of pixels performing amplitude modulation (AM); and designating a second group of pixels performing phase modulation (PM), wherein both of the AM and the PM take place substantially at the same time, the first group of pixels and the second group of pixels are within a single array, both of the AM and the PM are performed via a layer of liquid crystals sandwiched between a transparent electrode layer and a electrode layer, where the electrode comprises an array of pixel electrodes, each controlling one of the pixels, and is built on a silicon substrate.
According to another embodiment, the present invention is a spatial light modulator (SLM) comprising a first group of pixels performing amplitude modulation (AM); and a second group of pixels performing phase modulation (PM), wherein both of the AM and the PM take place simultaneously, wherein the first group of pixels and the second group of pixels are within a single array, both of the AM and the PM are performed via a layer of liquid crystals sandwiched between a transparent electrode layer and an electrode layer, where the electrode comprises an array of pixel electrodes, each controlling one of the pixels, and is built on a silicon substrate.
According to still another embodiment, the present invention is a spatial light modulator comprising a layer of liquid crystals of a predefine thickness sandwiched between a transparent electrode layer and an electrode layer, an alignment layer deposed on top of the layer of liquid crystals, and a photo mask including a plurality of alignment cells in rows and columns and deposed on the alignment layer, wherein the electrode comprises an array of pixel electrodes, each controlling one of pixels in two-dimensional (2D) array, and is built on a silicon substrate, a first group of the alignment cells are oriented in a first direction and a second group of the alignment cells are oriented in a second direction, light going through the first group of the alignment cells is modulated in amplitude thereof and the light going through the second group of the alignment cells is modulated in phase thereof, all via the liquid crystals and at the same time.
According to still another embodiment, the present invention is a method in a spatial light modulator, the method comprises deposing a mask on top of an alignment layer, wherein the alignment layer is provided to a layer of liquid crystals, with a predefined thickness, sandwiched between a transparent electrode layer and an electrode layer, the electrode comprises an array of pixel electrodes, each controlling one of pixels in two-dimensional (2D) array, and is built on a silicon substrate, and wherein the mask includes a plurality of alignment cells in rows and columns, a first group of the alignment cells are oriented in a first direction and a second group of the alignment cells are oriented in a second direction, light going through the first group of the alignment cells is modulated in amplitude thereof and the light going through the second group of the alignment cells is modulated in phase thereof, all via the liquid crystals and at the same time.
According to still another embodiment, the present invention is a spatial light modulator comprising: a layer of liquid crystals, with a predefined thickness, sandwiched between a transparent electrode layer and an electrode layer, wherein the electrode comprises an array of pixel electrodes, each controlling one of pixels in two-dimensional (2D) array, and is built on a silicon substrate; and at least a first layer of grating attached to the layer of liquid crystals, wherein the first layer of grating is formed by a layer of transparent material imprinted with a stamp, wherein the first layer of grating includes a shallow or short-pitch grating for liquid crystal alignment superimposed onto a deeper or large-pitch grating so as to cause light modulations in amplitude and phase.
According to still another embodiment, the present invention is a method for making a spatial light modulator, the method comprising: providing a layer of monomer liquid on a transparent substrate; pressing a stamper onto the monomer liquid to create imprints in the monomer liquid; curing the monomer liquid to create the first layer of grating with a short-pitch grating and a large-pitch grating; and forming on top of the first layer of grating a layer of liquid crystals, with a predefined thickness, wherein light is modulated in amplitude and phase with the short-pitch grating and the large-pitch grating via the liquid crystals.
According to still another embodiment, the present invention is a method for modulating light in amplitude and phase simultaneously in liquid crystals, the method comprises: coupling a voltage across a layer of liquid crystals, where the voltage is supplied from a driving circuit, the voltage includes a plurality of step volts from a voltage level VL to VH and is impulsively increased to VP, VL is at least above Vth, a threshold voltage, VH is a voltage level that causes to twist the liquid crystals, and VP is a voltage level greater than the voltage level VH for a moment to minimize or eliminate a free relaxation time that would otherwise happen when the voltage level VH drops. The method further comprises increasing the voltage level to twist the liquid crystals gradually from substantially blocking the incident light to fully passing incident light therethrough and again from substantially blocking the incident light to fully passing the incident light therethrough.
According to yet another embodiment, the present invention is a spatial light modulator for modulating light in amplitude and phase simultaneously in liquid crystals, the spatial light modulator comprises: a layer of liquid crystals; a power source generating a voltage coupled across the layer of liquid crystals, where the voltage includes a plurality of step volts from a voltage level VL to VH and is impulsively increased to VP, VL is at least above Vth, a threshold voltage, VH is a voltage level causing to twist the liquid crystals, and VP is a voltage level greater than the voltage level VH for a moment to minimize or eliminate a free relaxation time that would otherwise happen when the voltage level VH drops; and a controller to control the power source to increase the voltage level VP to twist the liquid crystals gradually from substantially blocking an incident light to fully passing the incident light therethrough and again from substantially blocking the incident light to fully passing the incident light therethrough.
There are many other objects, together with the foregoing attained in the exercise of the invention in the following description and resulting in the embodiment illustrated in the accompanying drawings.
These and other features, aspects, and advantages of the present invention will become better understood with regard to the following description, appended claims, and accompanying drawings where:
The detailed description of the invention is presented largely in terms of procedures, steps, logic blocks, processing, and other symbolic representations that directly or indirectly resemble the operations of optical signals, light, signals or data processing devices. These process descriptions and representations are typically used by those skilled in the art to most effectively convey the substance of their work to others skilled in the art.
Reference herein to “one embodiment” or “an embodiment” means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the invention. The appearances of the phrase “in one embodiment” in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Further, the order of blocks in process flowcharts or diagrams representing one or more embodiments of the invention do not inherently indicate any particular order nor imply any limitations in the invention.
The present invention is generally related to devices that can be advantageously used in holographic displays of high quality images based on two simultaneous spatial light modulations (SLM), where the modulations include both amplitude modulation (AM) and phase modulation (PM) that occur simultaneously in a single device or panel (e.g., a microdisplay) or even within each of the individual pixels in a single SLM microdisplay panel. Various implementations are described. Supporting circuitry is also described herein to support such simultaneous AM and PM.
The present invention may be implemented in a single SLM device or panel (microdisplay). To facilitate the description of the present invention, an example of such SLM microdisplay, LCoS, is used herein for illustration. Those skilled in the art can appreciate that the description herein is equally applicable for other types of display devices demonstrating similar characteristics as in SLM device or LCoS.
LCoS or LCOS stands for liquid crystal on silicon, a miniaturized active-matrix liquid-crystal display or “microdisplay” using a liquid crystal layer on top of a silicon backplane. It is also referred to as a spatial light modulator. In an LCoS display, a semiconductor chip (e.g., CMOS) controls the voltage on square reflective aluminum electrodes buried just below the chip surface, each controlling one pixel. For example, a chip with XGA resolution will have 1024×768 plates, each with an independently addressable voltage. Typical cells are about 1-3 centimeters square and about 2 mm thick, with pixel pitch as small as 2.79 μm or smaller, and a (LC) layer with cell (gap) thickness being 1˜3 μm. A common voltage for all the pixels is supplied by a transparent conductive layer made of, for example, indium tin oxide (ITO) on a cover glass.
LCoS can be a transmissive or reflective device, generating modulated light from a light source (e.g., white, RGB lights or lasers) for a lens or prism to collect, where the light is then displayed on a medium as an image. To facilitate the description of the present invention, the LCoS is deemed as a reflective device, namely an incident light is impinged upon thereon and reflected by the LCoS to form an optical image (a.k.a., modulated light). One of the important advantages, benefits and objectives in the present invention is that the modulated light is from two simultaneous modulations in amplitude and the phase.
A liquid crystal (LC) is a substance that is in mesomorphic state (not exactly a liquid or a solid). Its molecules usually hold their shape, like a solid, but they can also move around, like a liquid. Nematic liquid crystals, for example, arrange themselves in loose parallel lines. A layer of liquid crystals (or a LC layer) is positioned, sandwiched or coupled between a transparent electrode layer and a reflecting electrode layer, where the reflecting electrode comprises an array of pixel electrodes and is built on a silicon substrate. It should be noted that there are other layers integrated with the LC layer between the transparent electrode layer and the reflecting electrode layer. As used herein, the term “positioned”, “sandwiched” or “coupled” between two layers does not mean there is only one item between the two layers. Other layers of materials or components may be added on top of the item or sandwich the item to alter, modify or enhance the behavior, performance or characteristics of the item, all between the two layers. When placed between two polarized layers, the twisted crystals guide the path of light. When a voltage difference is applied between the transparent electrode layer and one pixel electrode, LC molecules therebetween are re-orientated with an applied electric field. By changing the direction of the light, the crystals allow or prevent its passage therethrough.
The molecules of liquid crystals are usually much longer than they are wide. In a rod-like liquid crystal, the molecules are oriented in the same direction locally, giving rise to optical birefringence, i.e., the index of refraction along the long axis of the molecule is significantly different than the optical index perpendicular to it. In another words, birefringence is the optical property of a material having a refractive index that depends on the polarization and propagation direction of light. Without further getting into the details of the molecules and/or the liquid crystals and how they affect the birefringence, which beyond the scope of the present invention, it is known that controlling how the light or the polarization and propagation direction of light entering the liquid crystals dictates the reflectance or transmittance of the light going through the LC layer.
When a voltage difference is applied between the transparent electrode layer and one pixel electrode, LC molecules therebetween are re-orientated with an applied electric field. By changing the direction of the light, the crystals allow or prevent its passage therethrough. Since the LC is birefringent, the orientation results in a phase shift, commonly known phase retardation, to the light, where the phase retardation is controllable by the voltage difference due to the Electric Controlled Birefringence Effect, ECB Mode).
When a linear polarized incident light enters the LC layer at an angle of ϕ to the director axis of the liquid crystal, it is split into two beams with different polarizations, namely the extraordinary wave (E-light), in which the polarization direction is parallel to the liquid crystal axis, and the ordinary wave (O-light), in which the polarization direction is perpendicular to the axis. Since the E-light and the O-light pass through the liquid crystal with different velocities, their indices of refraction are different. Consequently, a phase difference 6 exists between the two waves when they emerge from the liquid crystal, i.e.:
where d is the cell gap (i.e., the thickness of the LC layer), Δn depends on the applied voltage, the temperature, and the wavelength of the incident light λv, and is given by Δn=ne−no, which is also referred to as birefringence.
When a homogeneous cell is sandwiched between two polarizers, the normalized light transmittance is governed by the following equation:
T=cos2 X−sin 2β sin 2(β−X)sin2(/2); Eq. (2)
where X is the angle between the polarizer and an analyzer, β is the angle between the polarizer and the LC directors, and is the phase retardation expressed in the Equation 1. For the simplest case that β=45 degrees and the two polarizers are either parallel (X=0) or crossed (X=90), the normalized light transmittances are simplified to:
T∥=cos2(/2); Eq. (3)
T⊥=sin2(/2); Eq. (4)
As further shown in
Referring now to
It shall be noted, throughput the description herein, that an alignment layer is used as a substrate to form or hold the alignment cells (or embossed microstructures). Those skilled in the art can appreciate from the description herein that the alignment cells being described may very well be incorporated into the alignment layer when it is designed or formed. To facilitate the description of the present invention, the alignment cells are assumed to be formed on top of an alignment layer.
According to one embodiment of the present invention, the two differently aligned cells are arranged in such a way 206 that their alignments alternate across the entire alignment layer, namely the alignment of each cell is different from that of its neighboring cells. In other words, the alignments of the cells are alternating from AM to PM. In operation, both AM and PM happen simultaneously when a light goes through these cells and the LC layer is applied with proper voltages or currents. One of the advantages, benefits and objectives in the present invention is to have both AM and PM happen at the same time in an SLM device (e.g., LCoS panel). As all of the light is simultaneously modulated in phase and amplitude, a holographic image reproduced from such an implementation can be in high resolution with high efficiency.
According to another embodiment shown in
As far as light efficiency is concerned, it is estimated according to one prior art system that the holographic display based on amplitude modulation is very low (e.g., roughly only 5%) while the efficiency is increased (e.g., to 95%) based on phase modulation. With the integrated AM and PM, the light efficiency can be considerably increased without losing the resolutions.
An SLM device, such as LCoS, includes an LC layer to control the pass of the reflected (or transmitted) light. As described above, one embodiment is to modify or add an alignment layer on top of the LC layer. Depending on the resolution of the SLM, there are a plurality of alignment cells, each responsible for a pixel. These cells need to be controlled uniquely to facilitate the LCs in the LC layer to modulate the reflected light in amplitude and phase, given the characteristics of the underlying LCs.
At 282, a photo mask is laid over the alignment layer. As described above with respect to
At 284, the process 280 determines how to design or configure the photo mask via print or lithography. If it is decided to have the cell-based simultaneous modulations, the process 280 goes to 286, where a corresponding pattern can be printed on the photo mask. According to one embodiment, all the cells shall have the same pattern across the array. According to another embodiment, all the cells in a row have the same pattern across the row while the neighboring rows have a half-pixel shift pattern in view of
The pattern may be varying depending on what performance is being desired. In general, the ratio of the AM and PM within one cell is 50/50, but the ratio of the AM and the PM may be adjusted to any number if desired. Once the pattern is decided, the pattern may be imprinted onto the photo mask. The detail of making or imprinting a pattern onto a photo mask is not to be further described herein as it is well known in the art (e.g., in semiconductor manufacturing). The process 280 now goes to 290, where the photo mask is etched. There are many ways to etch a photo mask. Again, the detail of etching a photo mask is not to be further described herein as it is well known in the art (e.g., in semiconductor manufacturing). As a result of the alignment layer with the designated aligned cells, an SLM device performing the AM and the PM simultaneously within a cell is created at 292 or an SLM device performing the AM and the PM simultaneously within an array is created at 294.
Referring now to
One of the advantages, benefits and objectives using a smaller pixel size by the subcell concept via the photo mask is to provide a larger field of view (FOV). In a perspective, Bragg's law may be used to explain the result. It is well known that the diffraction formula is sin ϕ=nλ/2p, where n is a positive integer and λ is the wavelength of the incident wave, p is a pitch size. ϕ would be increased when the pitch size p is reduced. Since FOV is approximated by 2ϕmax, a smaller pixel size will increase the FOV.
According to one embodiment which is also referred to as nano-imprinting lithograph (NIL), it includes two gratings: a shallow, short-pitch grating for liquid crystal alignment superimposed onto a deeper and a larger-pitch resonant grating. Both gratings are patterned onto a silicon nitride (SiN) thin-film layer. The two gratings are in parallel. Nematic liquid crystals are introduced on top of the superimposed gratings. The two indium tin oxide (ITO) layers serve as the low optical loss electrodes to apply an electric field across the liquid crystal cells.
According to one embodiment, the acrylic used in sculpted gratings is formed by the reaction of a monomer liquid with a polymer powder. The monomers (“mono” meaning “one”) contained in the liquid are microscopic chemical units which react together when mixed with chemicals in the powder.
The same process 400 is applied to create two alignments for the AM and PM. As shown in
According to another embodiment, a focused beam of electrons is used to draw custom shapes on a surface covered with an electron-sensitive film called a resist (exposing). The electron beam changes the solubility of the resist, enabling selective removal of either the exposed or non-exposed regions of the resist by immersing it in a solvent (developing). The purpose, as with photolithography, is to create embossed microstructures (specific alignment cells) to facilitate the modulations of both AM and PM in the liquid crystals.
. The “d”, as cell gap of thickness of liquid crystal (LC) layer for light such R, G, and B to travel or propagate through and bounce light back returning total distance as 2d. The “Δn” as birefringence based on diffractive index on liquid crystal characteristics and the “
” as wavelength of light wave such as red, green and blue in difference wavelength of light selected.
As a comparison,
Now referring to
In general, there are two driving methods, analog and digital, to provide a gray level to a pixel, namely an image element or pixel in an array. As used herein, gray or a gray level implies a brightness or intensity level, not necessarily an achromatic gray level between black and white. For example, a red color is being displayed, in which case a gray level of the color means how much red (e.g., a brightness level in red) to be displayed. To facilitate the description of the present invention, the word gray will be used throughout the description herein. In the analog driving method, the gray level is determined by a voltage level stored in a storage node. In the digital driving method, the gray level is determined by a pulse width modulation (PWM), where the mixture of an ON state voltage duration and an OFF state voltage duration results in a gray level through the temporal filtering of human eyes.
There are two ways to feed video signals to the pixels in a spatial light modulator (e.g., an LCoS device): analog driving method and digital driving method . . . . Two functional diagrams 702 and 704 for the analog driving method and digital driving method are shown. For the analog driving scheme, one pixel includes a pass device 706 and one capacitor 708, with a storage node connected to a mirror circuit 710 to control a corresponding liquid crystal or a set of liquid crystals in a LC layer. For the digital driving method, pulse width modulation (PWM) is used to control the gray level of an image element. A static memory cell 712 (e.g., SRAM cell) is provided to store the logic “1” or logic “0” signal periodically. The logic “1” or logic “0” signal determines that the associated element transmits the light fully or absorbs the light completely, resulting in white and black. A various mixture of the logic “1” duration and the logic “0” duration decides a perceived gray level of the element. Via the gate 714, a mirror circuit 716 controls a corresponding liquid crystal or a set of liquid crystals in a LC layer.
As described above,
It is assumed that an input image 810 is of 500×500 in resolution. Through a data process 812 (e.g., upscaling and sharpening), the input image 810 is expanded to reach an image 814 in dimension of 1000×1000.
The processed image 820 is then separated into two images 822 and 824 by the separation process 825. Both 822 and 824 have a resolution same as that of the input image (e.g., 500×500), where the sub-pixel elements of images 822 and 824 are all written or stored with the same value. The boundaries of pixel elements in the image 822 are purposely to be different from the boundaries of pixel elements in the image 824. In one embodiment, the boundaries of pixel elements are offset by half-pixel (one sub-pixel in a 2×2 sub-pixel array) vertically and by half-pixel (one sub-pixel in a 2×2 sub-pixel array) horizontally. The separation process 825 is done in a way that, when overlapping images 822 and 824, the combined image can best match the image 820 of quadruple resolution of the input image 816. For the example in
Depending on implementation, the separation process 825 may be performed based on an image algorithm or one-pixel shifting, wherein one-pixel shifting really means one sub-pixel in the sub-pixel structure as shown in
Referring now to
Referring now to
The resolution of the input image is determined at 842. The resolution may be given, set or detected win the input image. In one case, the resolution of the input image is passed along. In another case, the resolution is given in a head file of the input image, where the head file is read first to obtain the resolution. In still another case, the resolution is set for a display device. In any case, the resolution is compared to a limit of a display device at 844, where the limit is defined to be the maximum resolution the display device can display according to one embodiment of the present invention.
It is assumed that the limit is greater than 2 times the resolution obtained at 842. That means a display device with the limit can “double” the resolution of the input image. In other words, the input image can be displayed in much improved perceived resolution than the original or obtained resolution. The process 840 moves to 846 where the pixels values are written into pixel elements, where each of the pixel elements has a group of sub-pixels. In operation, it is essentially an upscale process. At 848, applicable image processing is applied to the expanded image. Depending on implementation, exemplary image processing may include sharpening, edge detection, filtering and etc. The purpose of the image processing at this stage is to minimize errors that may have been introduced in the upscale operation when separating the expanded image into two frames. It should also be noted that the upscale process or the image processing may involve the generation of a second frame based on a first frame (the original or processed thereof) as illustrated in
At 850, the expanded image is going under image separation to form two independent two frames. In connection with the description above, one of the two images is for the AM and the other of the two images is for the PM, all via the LC layer with the photo mask. As described above, there are ways to separate an image across the intensity into two frames of equal size to the image. In other words if the image is of M×N, each of the two frames is also of M×N, where only the intensity of the image is separated. Regardless of whatever an algorithm is used, the objective is to keep the same perceived intensity and minimize any artifacts in the perceived image when the two frames are alternatively displayed at the twice refresh rate (e.g., from 50 frames/sec to 100 frames/sec) at 852.
Back to 844, now it is assumed the limit is less than 2 times the resolution obtained at 842. That means a display device with the limit cannot “double” the resolution of the input image. In other words, it is practically meaningless to display an image in a resolution exceeding that of the display device unless some portions of the image are meant to be chopped off from display. The process 840 now goes to 854 to display the image in native resolution. One of the objectives, benefits and advantages in the present invention is the inherent mechanism to display images in their native resolutions while significantly improving the perceived resolution of an image when the native resolution is not of high.
It should be noted that the process 840 of
Referring now to
As an example shown in
Referring back to
Referring now to
As further shown in
It can be observed that the pivoting pixel 1014 needs to be updated by either one of the two pixel elements A and B, and is always selected. As a result, the circuit 1000 of
The present invention has been described in sufficient detail with a certain degree of particularity. It is understood to those skilled in the art that the present disclosure of embodiments has been made by way of examples only and that numerous changes in the arrangement and combination of parts may be resorted without departing from the spirit and scope of the invention as claimed. Accordingly, the scope of the present invention is defined by the appended claims rather than the forgoing description of embodiments.
| Number | Name | Date | Kind |
|---|---|---|---|
| 20050248705 | Smith | Nov 2005 | A1 |
| 20090279033 | Yoneya | Nov 2009 | A1 |
| 20170277003 | Zhu | Sep 2017 | A1 |
| 20180259904 | Georgiou | Sep 2018 | A1 |
| Number | Date | Country | |
|---|---|---|---|
| 20200333668 A1 | Oct 2020 | US |
