Patent Application
20130147696
The exemplary and non-limiting embodiments of this invention relate generally to image display systems, methods, devices and computer programs and, more specifically, relate to displaying moving images.
This section is intended to provide a background or context to the invention that is recited in the claims. The description herein may include concepts that could be pursued, but are not necessarily ones that have been previously conceived or pursued. Therefore, unless otherwise indicated herein, what is described in this section is not prior art to the description and claims in this application and is not admitted to be prior art by inclusion in this section.
The following abbreviations that may be found in the specification and/or the drawing figures are defined as follows:
CRT cathode ray tube
FPS frames per second
IC integrated circuit
ITO Indium Tin Oxide
LC liquid crystal
LCD liquid crystal display
MiQ moving image quality
MQ motion quality
OLED organic light-emitting diode
A liquid crystal display (LCD) is a hold type display creating hold type images. In contrast, a cathode ray tube (CRT) produces impulse type images. The human eye is more sensitive to impulse type image than hold type image. Thus, the human eye can see a moving impulse type image more sharply than a moving hold type image.
In the LCD display technology area different methods have been used to improve perceived motion quality (MQ), also referred to as moving image quality (MiQ), in TV and gaming applications. Liquid crystal (LC) material typically requires some time to stabilize in response to instructions. This delay may be interpreted as a blurring in moving images.
In mobile device systems, MQ improvements are still being developed. However, such improvements face additional difficulties when being implemented in a mobile-friendly way. In other words, methods usable in larger device, e.g., TVs, may require extensive image processing and power to work efficiently. These resources are scarcer in a mobile environment. Also, some methods (e.g., localized backlight or scanning backlight), may be mechanically challenging to be implement in the limited space of a mobile display.
Various motion quality methods currently exist. For example, LCD pixel overdrive, black frame insertion (or backlight blinking), scanning backlight and generation of additional artificial frames in the data stream to increase the display frame rate
Operation of the backlight blinking method emulates the behavior of an impulse type display (e.g., “old” CRT TV). First, an image is uploaded to a display panel. Then the image is allowed to stabilize. Only after the pixels have been stabilized, a backlight is quickly blinked on (this may occur many times in one second). Since this simulates an impulse image, the human eye can track the ‘motion’ displayed more clearly than in a traditional hold type display.
The scanning backlight method (similar to the blinking backlight) may operate on one row (or set of rows) of the display at a time. For example, each row (or set of rows) may be displayed in a ‘top-to-bottom’ technique. In this technique, one horizontal row may be displayed while the next row vertically down from that row is stabilizing. Once the lower row is stabilized, the backlight for that row is blinked on. This process may begin from the top of the display and proceed down to the bottom.
The scanning backlight method has quite a few downsides. It requires a complex and difficult mechanical construction. For example, only a limited number of LEDs may be available due to mechanical size. The scanning backlight method also uses individual light sources (e.g., LEDs) operated in synchronization. There are also optical challenges, for example, maintaining backlight uniformity in white content.
What is needed is an efficient technique to display moving images on hold type displays.
The below summary section is intended to be merely exemplary and non-limiting.
The foregoing and other problems are overcome, and other advantages are realized, by the use of the exemplary embodiments of this invention.
In a first aspect thereof an exemplary embodiment of this invention provides a method to display moving images. The method includes shuttering one or more display pixels in a plurality of display pixels, where shuttering blocks substantially all light emanating from the display pixel. The method also includes, while shuttered, refreshing the one or more display pixels and allowing the one or more display pixels to stabilize. After the one or more display pixels have substantially stabilized, unshuttering the one or more display pixels is included in the method. Unshuttering allows light to emanate from the display pixel.
In another aspect thereof an exemplary embodiment of this invention provides an apparatus to display moving images. The apparatus includes at least one processor; and at least one memory including computer program code. The at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to perform actions. The actions include shuttering one or more display pixels in a plurality of display pixels. The actions also include, while shuttered, refreshing the one or more display pixels and allowing the one or more display pixels to stabilize. After the one or more display pixels have substantially stabilized, unshuttering the one or more display pixels is included in the actions.
In a further aspect thereof an exemplary embodiment of this invention provides a computer readable medium to display moving images. The computer readable medium is tangibly encoded with a computer program executable by a processor to perform actions. The actions include shuttering one or more display pixels in a plurality of display pixels. The actions also include, while shuttered, refreshing the one or more display pixels and allowing the one or more display pixels to stabilize. After the one or more display pixels have substantially stabilized, unshuttering the one or more display pixels is included in the actions.
In another aspect thereof an exemplary embodiment of this invention provides an apparatus to display moving images. The apparatus includes means for shuttering one or more display pixels in a plurality of display pixels. The apparatus also includes means for refreshing the one or more display pixels while shuttered and means for allowing the one or more display pixels to stabilize while shuttered. Means for unshuttering the one or more display pixels after the one or more display pixels have substantially stabilized are included in the apparatus.
The foregoing and other aspects of exemplary embodiments of this invention are made more evident in the following Detailed Description, when read in conjunction with the attached Drawing Figures, wherein:
Various exemplary embodiments in accordance with this invention provide a means for displaying moving images. In one, non-limiting example, a series of shutters may be used to ‘shutter’ a portion of the display (e.g., by blocking most of the light emitting from that portion) while display elements (e.g., LCDs) are allowed to stabilize. This produces a similar effect to the backlight blinking method and the scanning backlight technology. Additionally, lighting elements (e.g., LEDs) may be turned off while the shutters are closed in order to save energy. Alternatively, the display elements may include organic light-emitting diodes (OLED) which also function as lighting elements.
As used herein, ‘shuttering’ may refer to blocking light from a display element (e.g., an OLED, LED, a backlit LCD, etc.) and/or light directed to a display element (e.g., to an LCD pixel). Similarly, ‘unshuttering’ refers to unblocking light from a display element and/or directed to a display element.
Before describing in further detail various exemplary embodiments of this invention, reference is made to
The PROGs 118 is assumed to include program instructions that, when executed by the associated DP 114, enable the device to operate in accordance with exemplary embodiments of this invention, as will be discussed below in greater detail.
That is, various exemplary embodiments of this invention may be implemented at least in part by computer software executable by the DP 114 of the device 110, or by hardware, or by a combination of software and hardware (and firmware). The device 110 may also include dedicated processors, for example image processor 115.
In general, the various embodiments of the device 110 can include, but are not limited to, cellular telephones, tablets, personal digital assistants (PDAs), portable computers having wireless communication capabilities, image capture devices such as digital cameras, gaming devices, music storage and playback appliances having display capabilities, Internet appliances permitting wireless Internet access and browsing, as well as portable units or terminals that incorporate combinations of such functions.
The computer readable MEM 116 may be of any type suitable to the local technical environment and may be implemented using any suitable data storage technology, such as semiconductor based memory devices, flash memory, magnetic memory devices and systems, optical memory devices and systems, fixed memory and removable memory. The DP 114 may be of any type suitable to the local technical environment, and may include one or more of general purpose computers, special purpose computers, microprocessors, digital signal processors (DSPs) and processors based on a multicore processor architecture, as non-limiting examples. The wireless interface (e.g., RF transceivers 112) may be of any type suitable to the local technical environment and may be implemented using any suitable communication technology such as individual transmitters, receivers, transceivers or a combination of such components.
Within the sectional view of
Signals to and from the camera 228 pass through an image/video processor 244 which encodes and decodes the various image frames. A separate audio processor 246 may also be present controlling signals to and from the speakers 234 and the microphone 224. The graphical display interface 220 is refreshed from a frame memory 248 as controlled by a user interface chip 250 which may process signals to and from the display interface 220 and/or additionally process user inputs from the keypad 222 and elsewhere.
Certain embodiments of the device 110 may also include one or more secondary radios such as a wireless local area network radio WLAN 237 and a Bluetooth® radio 239, which may incorporate an antenna on-chip or be coupled to an off-chip antenna. Throughout the apparatus are various memories such as random access memory RAM 243, read only memory ROM 245, and in some embodiments removable memory such as the illustrated memory card 247. The various programs 118 are stored in one or more of these memories. All of these components within the device 110 are normally powered by a portable power supply such as a battery 249.
Processors 238, 240, 242, 244, 246, 250, if embodied as separate entities in a device 110, may operate in a slave relationship to the main processor 114, which may then be in a master relationship to them. Embodiments of this invention are most relevant to the image processor 115, graphical display interface 220, frame memory 248 and user interface chip 250, though it is noted that other embodiments need not be disposed there but may be disposed across various chips and memories as shown or disposed within another processor that combines some of the functions described above for
Note that the various chips (e.g., 238, 240, 242, etc.) that were described above may be combined into a fewer number than described and, in a most compact case, may all be embodied physically within a single chip.
Recent developments in 3-dimensional (3D) displays use parallax barrier networks to limit visibility of parts of a display. For example, some pixels may be visible only when viewed at the correct angle. The parallax barrier network may be located between a light emitting display element (e.g., a LED-lit backlight) and a viewer. In some designs the barrier is between the light emitting display elements and other display elements (e.g., LCDs, etc.). In such a way, light from some pixels is blocked from view by one eye of the viewer (e.g., left) while still remaining visible to the other eye (e.g., right). The parallax barrier network may include a series of parallel barriers which run vertical to the orientation of the display. Some parallax barrier networks may be multi-orienational where the parallax barriers are arranged in both horizontal and vertical directions. The barriers may then be activated depending on the orientation of the display (e.g., portrait or landscape). Note that a parallax barrier network generally allows some light to be visible (e.g., to only one eye).
Overlaying the pixels is a cross-hatch pattern of shutters which may be used to block light when closed (or shuttered). These shutters include horizontal (or portrait) shutters 310 and 315 and vertical (or landscape) shutters 330. Shutters 330 may also be used as a parallax barrier network in order to provide a 3D effect to images displayed. Horizontal (or portrait) shutters 310 and 315 and vertical (or landscape) shutters 330 may be used depending on if the display is configured for multi-orientation 3D or single orientation 3D. Additional vertical shutters (not shown) may be located between shutters 330 similar to shutters 310 and 315. Shutters 310, 315 and 330 may be formulated from invisible ITO conductor on glass with a LC shell.
While the following description of the exemplary embodiment illustrated in
In an exemplary embodiment in accordance with this invention, a LCD pixel is refreshed while barriers affecting that pixel are turned ‘on’ (shuttered). The LCD pixel is allowed some time until the LC material has stabilized. Then the barriers for the LCD pixel are turned “off” (unshuttered). This process is repeated for each LCD pixels (or row of LCD pixels) in the display.
Images displayed using the exemplary embodiment allow the viewer to see an impulse effect in moving image content. Additionally, since the display is allowed to stabilize, motion blur is minimized or removed entirely.
The shutters may be implemented using 3D circuitry, for example, a modified parallax barrier network. The parallax barrier network may include additional barriers allowing full blockage of light from portions of the display. The barriers of the parallax barrier network may be individually controlled in order to block almost all the light from different portions of the display while allowing light from other portions. The barriers may also be able to shutter very quickly in order to meet FPS demands. The height of an area where the barriers are open may be configurable and may also dependent on the display pixel physical properties.
As a non-limiting example, the first display area and the second display area are lit by a first backlight area. The additional display areas may be lit by one or more additional backlight areas. Each backlight area provides light from a single source (e.g., a single LED) or a jointly controlled set of sources (e.g., a set of LEDs operated in unison).
In
As shown, the first backlight area is providing light for the first display area and the second display area. Since the shutters for the first display area are open, the first display area is visible. The second display area is not visible due to the associated shutters are closed. The additional backlight areas may be turned off as the shutters for these areas are closed.
In
As shown, the first backlight area continues to providing light for the first display area and the second display area. Since the shutters for the first display area are now closed, the first display area is no longer visible. The second display area is now visible due to the associated shutters have been opened. Since the additional display areas are still not visible, the additional backlight areas may be left off. Alternatively, one or more of the additional backlight areas may be starting up in anticipation of the associated display areas being unshuttered.
While the above is described in relation to a ‘top-to-bottom’ technique, it should be appreciated that the exemplary embodiments of this invention are not limited for use with only this one particular technique. Other techniques may also be used, for example, ‘bottom-to-top’, where rows are first refreshed from the bottom of the display to the top; ‘left-to-right’, where columns are refreshed from the left side of the display to the right; ‘right-to-left’, where columns are refreshed from the right side of the display to the left; etc.
Note that the embodiment of the display in
Another embodiment may also use shuttering for a sub-set of rows on the display. For example, when only the top half of the display is used for showing a moving image, only those rows in the top half of the display are scanned using the shuttering technique described. The static area of the image may be displayed in the convention manner.
In a LCD display, brightness uniformity may suffer due to the unshuttered area(s) being brighter. In an OLED display, this may be compensated as the brightness of each area may be independently addressed.
In a further embodiment of the display above, vertical barriers may be used simultaneously with the described shuttering. The additional barriers may also block any light that is not blocked by the horizontal barriers creating a more effective shutter.
LEDs for an area being shuttered may be turned off in order to provide additional power saving. Since the barriers prevent visibility of the area lit by the LEDs, the LEDs may be less precise than those required for backlight scanning. For example, the shutters may be sufficiently fast to block light from the LED while the LED is powering down. Likewise, the LEDs can be turned on prior to unshuttering.
Furthermore, a backlight for multiple display areas may be turned on (or off) based on the display areas needs. For example, if a first set of pixels are shuttered but a second set of pixels are to be visible the backlight may be turned on even though some pixels lit by the backlight are shuttered. Similarly, if a set of pixels are unshuttered but are not to be visible the backlight may be turned off (assuming no other pixels lit by the backlight are to be visible).
Additionally, the arrangement of shutters 310, 315 and 330 is a non-limiting example. As described above, the shutters 310, 315 and 330 may be disposed between the display pixels 320 and the light emitting display elements 610.
Based on the foregoing it should be apparent that the exemplary embodiments of this invention provide a method, apparatus and computer program(s) to display moving images.
The various blocks shown in
An exemplary embodiment in accordance with the invention is a method to display moving images. The method includes shuttering (e.g., by a processor controlling shutters) one or more display pixels in a plurality of display pixels. Shuttering blocks substantially all light emanating from the display pixel. The method also includes, while shuttered, refreshing (e.g., by a processor) the one or more display pixels and allowing the one or more display pixels to stabilize. After the one or more display pixels have substantially stabilized, unshuttering (e.g., by a processor controlling shutters) the one or more display pixels is included in the method. Unshuttering allows light to emanate from the display pixel.
In a further exemplary embodiment of the method above, the method includes when shuttering the one or more display pixels, turning off a backlight area for the one or more display pixels; and, when unshuttering the one or more display pixels, turning on the backlight area for the one or more display pixels. The backlight may be at least one light emitting diode. The backlight area may be turned off in response to shuttering the one or more display pixels. Likewise, the backlight area may be turned on prior to unshuttering the one or more display pixels.
In an additional exemplary embodiment of any one of the methods above, display pixels in the plurality of display pixels are liquid crystal display pixels or organic light emitting diode pixels.
In a further exemplary embodiment of any one of the methods above, shuttering includes activating one or more barriers in a parallax barrier network. The one or more barriers may be one or more horizontal barriers.
In an additional exemplary embodiment of any one of the methods above, the one or more display pixels includes a horizontal row of display pixels.
In a further exemplary embodiment of any one of the methods above, the one or more display pixels includes a first set of display pixels. The method also includes, while the first set of display pixels are unshuttered, shuttering a second set of display pixel in the plurality of display pixels and refreshing the second set of display pixel.
An additional exemplary embodiment in accordance with the invention is an apparatus to display moving images. The apparatus includes at least one processor; and at least one memory including computer program code. The at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to perform actions. The actions include shuttering one or more display pixels in a plurality of display pixels. Shuttering blocks substantially all light emanating from the display pixel. The actions also include, while shuttered, refreshing the one or more display pixels and allowing the one or more display pixels to stabilize. After the one or more display pixels have substantially stabilized, unshuttering the one or more display pixels is included in the actions. Unshuttering allows light to emanate from the display pixel.
In a further exemplary embodiment of the apparatus above, the actions include when shuttering the one or more display pixels, turning off a backlight area for the one or more display pixels; and, when unshuttering the one or more display pixels, turning on the backlight area for the one or more display pixels. The backlight may be at least one light emitting diode. The backlight area may be turned off in response to shuttering the one or more display pixels. Likewise, the backlight area may be turned on prior to unshuttering the one or more display pixels.
In an additional exemplary embodiment of any one of the apparatus above, display pixels in the plurality of display pixels are liquid crystal display pixels or organic light emitting diode pixels.
In a further exemplary embodiment of any one of the apparatus above, shuttering includes activating one or more barriers in a parallax barrier network. The one or more barriers may be one or more horizontal barriers.
In an additional exemplary embodiment of any one of the apparatus above, the one or more display pixels includes a horizontal row of display pixels.
In a further exemplary embodiment of any one of the apparatus above, the one or more display pixels includes a first set of display pixels. The actions also include, while the first set of display pixels are unshuttered, shuttering a second set of display pixel in the plurality of display pixels and refreshing the second set of display pixel.
In an additional exemplary embodiment of any one of the apparatus above, the apparatus is embodied in an integrated circuit.
In a further exemplary embodiment of any one of the apparatus above, the apparatus is embodied in a mobile device.
An additional exemplary embodiment in accordance with the invention is a computer readable medium to display moving images. The computer readable medium is tangibly encoded with a computer program executable by a processor to perform actions. The actions include shuttering one or more display pixels in a plurality of display pixels. Shuttering blocks substantially all light emanating from the display pixel. The actions also include, while shuttered, refreshing the one or more display pixels and allowing the one or more display pixels to stabilize. After the one or more display pixels have substantially stabilized, unshuttering the one or more display pixels is included in the actions. Unshuttering allows light to emanate from the display pixel.
In a further exemplary embodiment of the computer readable medium above, the actions include when shuttering the one or more display pixels, turning off a backlight area for the one or more display pixels; and, when unshuttering the one or more display pixels, turning on the backlight area for the one or more display pixels. The backlight may be at least one light emitting diode. The backlight area may be turned off in response to shuttering the one or more display pixels. Likewise, the backlight area may be turned on prior to unshuttering the one or more display pixels.
In an additional exemplary embodiment of any one of the computer readable medium above, display pixels in the plurality of display pixels are liquid crystal display pixels or organic light emitting diode pixels.
In a further exemplary embodiment of any one of the computer readable medium above, shuttering includes activating one or more barriers in a parallax barrier network. The one or more barriers may be one or more horizontal barriers.
In an additional exemplary embodiment of any one of the computer readable medium above, the one or more display pixels includes a horizontal row of display pixels.
In a further exemplary embodiment of any one of the computer readable medium above, the one or more display pixels includes a first set of display pixels. The actions also include, while the first set of display pixels are unshuttered, shuttering a second set of display pixel in the plurality of display pixels and refreshing the second set of display pixel.
In an additional exemplary embodiment of any one of the computer readable medium above, the computer readable medium is a non-transitory computer readable medium (e.g., CD-ROM, flash memory, RAM, etc.).
A further exemplary embodiment in accordance with the invention is an apparatus to display moving images. The apparatus includes means for shuttering (e.g., a processor controlling shutters) one or more display pixels in a plurality of display pixels. Shuttering blocks substantially all light emanating from the display pixel. The apparatus also includes means for refreshing (e.g., by a processor) the one or more display pixels while shuttered and means for allowing (e.g., a processor) the one or more display pixels to stabilize while shuttered. Means for unshuttering (e.g., a processor controlling shutters) the one or more display pixels after the one or more display pixels have substantially stabilized are included in the apparatus. Unshuttering allows light to emanate from the display pixel.
In an additional exemplary embodiment of the method above, the apparatus includes means for turning off a backlight area for the one or more display pixels when shuttering the one or more display pixels; and means for turning on the backlight area for the one or more display pixels when unshuttering the one or more display pixels. The backlight may be at least one light emitting diode. The backlight area may be turned off in response to shuttering the one or more display pixels. Likewise, the backlight area may be turned on prior to unshuttering the one or more display pixels.
In a further exemplary embodiment of any one of the apparatus above, display pixels in the plurality of display pixels are liquid crystal display pixels or organic light emitting diode pixels.
In an additional exemplary embodiment of any one of the apparatus above, the shuttering means includes means for activating one or more barriers in a parallax barrier network. The one or more barriers may be one or more horizontal barriers.
In a further exemplary embodiment of any one of the apparatus above, the one or more display pixels includes a horizontal row of display pixels.
In an additional exemplary embodiment of any one of the apparatus above, the one or more display pixels includes a first set of display pixels. The apparatus also includes means for shuttering a second set of display pixel in the plurality of display pixels while the first set of display pixels are unshuttered and means for refreshing the second set of display pixel while the first set of display pixels are unshuttered.
In general, the various exemplary embodiments may be implemented in hardware or special purpose circuits, software, logic or any combination thereof. For example, some aspects may be implemented in hardware, while other aspects may be implemented in firmware or software which may be executed by a controller, microprocessor or other computing device, although the invention is not limited thereto. While various aspects of the exemplary embodiments of this invention may be illustrated and described as block diagrams, flow charts, or using some other pictorial representation, it is well understood that these blocks, apparatus, systems, techniques or methods described herein may be implemented in, as nonlimiting examples, hardware, software, firmware, special purpose circuits or logic, general purpose hardware or controller or other computing devices, or some combination thereof.
It should thus be appreciated that at least some aspects of the exemplary embodiments of the inventions may be practiced in various components such as integrated circuit chips and modules, and that the exemplary embodiments of this invention may be realized in an apparatus that is embodied as an integrated circuit. The integrated circuit, or circuits, may comprise circuitry (as well as possibly firmware) for embodying at least one or more of a data processor or data processors, a digital signal processor or processors, baseband circuitry and radio frequency circuitry that are configurable so as to operate in accordance with the exemplary embodiments of this invention.
Various modifications and adaptations to the foregoing exemplary embodiments of this invention may become apparent to those skilled in the relevant arts in view of the foregoing description, when read in conjunction with the accompanying drawings. However, any and all modifications will still fall within the scope of the non-limiting and exemplary embodiments of this invention.
It should be noted that the terms “connected,” “coupled,” or any variant thereof, mean any connection or coupling, either direct or indirect, between two or more elements, and may encompass the presence of one or more intermediate elements between two elements that are “connected” or “coupled” together. The coupling or connection between the elements can be physical, logical, or a combination thereof. As employed herein two elements may be considered to be “connected” or “coupled” together by the use of one or more wires, cables and/or printed electrical connections, as well as by the use of electromagnetic energy, such as electromagnetic energy having wavelengths in the radio frequency region, the microwave region and the optical (both visible and invisible) region, as several non-limiting and non-exhaustive examples.
Furthermore, some of the features of the various non-limiting and exemplary embodiments of this invention may be used to advantage without the corresponding use of other features. As such, the foregoing description should be considered as merely illustrative of the principles, teachings and exemplary embodiments of this invention, and not in limitation thereof.
