1. Field of Art
The disclosure generally relates to the field of electronic paper displays. More particularly, the invention relates to reducing visual artifacts on bi-stable displays.
2. Description of the Related Art
Several technologies have been introduced recently that provide some of the properties of paper in a display that can be updated electronically. Some of the desirable properties of paper that this type of display tries to achieve include: flexibility, wide viewing angle, low cost, light weight, low power consumption, high resolution, high contrast and readability indoors and outdoors. Because these displays attempt to mimic the characteristics of paper, they are referred to as Electronic Paper Displays (EPDs) in this application. Other names for this type of display include: paper-like displays, zero power displays, e-paper and bi-stable displays.
A comparison of EPDs to Cathode Ray Tube (CRT) displays or Liquid Crystal Displays (LCDs) reveals that in general, EPDs require much less power and have higher spatial resolution, but have the disadvantages of slower update rates, less accurate gray level control, and lower color resolution. Many electronic paper displays are currently only grayscale devices. Color devices are becoming available often through the addition of a color filter, which tends to reduce the spatial resolution and the contrast.
Electronic Paper Displays are typically reflective rather than transmissive. Thus they are able to use ambient light rather than requiring a lighting source in the device. This allows EPDs to maintain an image without using power. They are sometimes referred to as “bi-stable” because black or white pixels can be displayed continuously, and power is only needed when changing from one state to another. However, many EPD devices are stable at multiple states and thus support multiple gray levels without power consumption.
The low power usage of EPDs makes them especially useful for mobile devices where battery power is at a premium. Electronic books are a common application for EPDs in part because the slow update rate is similar to the time required to turn a page, and therefore is acceptable to users. EPDs have similar characteristics to paper, which also makes electronic books a common application.
While electronic paper displays have many benefits there are two problems: (1) slow update speed (also called update latency); and (2) visibility of previously displayed images, called ghosting.
The first problem is that most EPD technologies require a relatively long time to update the image as compared with conventional CRT or LCD displays. A typical LCD takes approximately 5 milliseconds to change to the correct value, supporting frame rates of up to 200 frames per second (the achievable frame rate is typically limited by the ability of the display driver electronics to modify all the pixels in the display). In contrast, many electronic paper displays, e.g. the E-Ink displays, take on the order of 300-1000 milliseconds to change a pixel value from white to black. While this update time is certainly sufficient for the page turning needed by electronic books, it is problematic for interactive applications like pen tracking, user interfaces and the display of video.
One type of EPD called a microencapsulated electrophoretic (MEP) display moves hundreds of particles through a viscous fluid to update a single pixel. The viscous fluid limits the movement of the particles when no electric field is applied and gives the EPD its property of being able to retain an image without power. This fluid also restricts the particle movement when an electric field is applied and causes the display to be very slow to update compared to other types of displays.
When displaying a video or animation, each pixel should ideally be at the desired reflectance for the duration of the video frame, i.e. until the next requested reflectance is received. However, every display exhibits some latency between the request for a particular reflectance and the time when that reflectance is achieved. If a video is running at 10 frames per second and the time required to change a pixel is 10 milliseconds, the pixel will display the correct reflectance for 90 milliseconds and the effect will be as desired. If it takes 100 milliseconds to change the pixel, it will be time to change the pixel to another reflectance just as the pixel achieves the correct reflectance of the prior frame. Finally, if it takes 200 milliseconds for the pixel to change, the pixel will never have the correct reflectance except in the circumstance where the pixel was very near the correct reflectance already, i.e. slowly changing imagery.
The second problem of some EPDs is that an old image can persist even after the display is updated to show a new image. This effect is referred to as “ghosting” because a faint impression of the previous image is still visible. The ghosting effect can be particularly distracting with text images because text from a previous image may actually be readable in the current image. A human reader faced with “ghosting” artifacts has a natural tendency to try to decode meaning making displays with ghosting very difficult to read.
Setting pixels to white or black values helps to align the optical state because all pixels will tend to saturate at the same point regardless of the initial state. Some prior art ghost reduction methods drive the pixels with more power than should be required in theory to reach the black state or white state. The extra power insures that regardless of the previous state a fully saturated state is obtained. In some cases, long term frequent over-saturation of the pixels may lead to some change in the physical media, which may make it less controllable.
One of the reasons that the prior art ghosting reduction techniques are objectionable is that the artifacts in the current image are meaningful portions of a previous image. This is especially problematic when the content of both the desired and current image is text. In this case, letters or words from a previous image are especially noticeable in the blank areas of the current image. For a human reader, there is a natural tendency to try to read this ghosted text, and this interferes with the comprehension of the current image. Prior art ghosting reduction techniques attempt to reduce these artifacts by minimizing the difference between two pixels that are supposed to have the same value in the final image.
It would therefore be highly desirable to produce an electronic paper display that requires a relatively short time to update a displayed image and displays less “ghosting” artifacts when a new image is updated on the display screen.
One embodiment of a system for updating an image on a bi-stable display includes a module for determining a final optical state, estimating a current optical state and determining a desired intermediate state on the bi-stable display. The system also includes a control module for generating a control signal for driving the bi-stable display from the current optical state to the intermediate state, then to the final optical state.
One embodiment of a method for updating a bi-stable display includes determining a final optical state and estimating a current optical state on the bi-stable display. The method also includes determining a desired intermediate state. In some embodiments, an intermediate value is chosen for each pixel in a pseudo-random way. The intermediate value is applied to the bi-stable display to remove noise and other artifacts from the end resulting images. A control signal for driving the bi-stable display from the current optical state toward the intermediate state then toward a final optical state is also determined. The determined control signal is applied to the bi-stable display to drive the bi-stable display toward the intermediate state then toward the final optical state. The final image is displayed on the bi-stable display.
The features and advantages described in the specification are not all inclusive and, in particular, many additional features and advantages will be apparent to one of ordinary skill in the art in view of the drawings, specification and claims. Moreover, it should be noted that the language used in the specification has been principally selected for readability and instructional purposes, and may not have been selected to delineate or circumscribe the disclosed subject matter.
The disclosed embodiments have other advantages and features which will be more readily apparent from the detailed description, the appended claims and the accompanying figures (or drawings).
The Figures (FIGS.) and the following description relate to preferred embodiments by way of illustration only. It should be noted that from the following discussion, alternative embodiments of the structures and methods disclosed herein will be readily recognized as viable alternatives that may be employed without departing from the principles of what is claimed.
As used herein any reference to “one embodiment,” “an embodiment,” or “some embodiments” means that a particular element, feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment. The appearances of the phrase “in one embodiment” in various places in the specification are not necessarily all referring to the same embodiment.
Some embodiments may be described using the expression “coupled” and “connected” along with their derivatives. It should be understood that these terms are not intended as synonyms for each other. For example, some embodiments may be described using the term “connected” to indicate that two or more elements are in direct physical or electrical contact with each other. In another example, some embodiments may be described using the term “coupled” to indicate that two or more elements are in direct physical or electrical contact. The term “coupled,” however, may also mean that two or more elements are not in direct contact with each other, but yet still co-operate or interact with each other. The embodiments are not limited in this context.
As used herein, the terms “comprises,” “comprising,” “includes,” “including,” “has,” “having” or any other variation thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, article or apparatus that comprises a list of elements is not necessarily limited to only those elements but may include other elements not expressly listed or inherent to such process, method, article or apparatus. Further, unless expressly stated to the contrary, “or” refers to an inclusive or and not to an exclusive or. For example, a condition A or B is satisfied by any one of the following: A is true (or present) and B is false (or not present), A is false (or not present) and B is true (or present), and both A and B are true (or present).
In addition, use of the “a” or “an” are employed to describe elements and components of the embodiments herein. This is done merely for convenience and to give a general sense of the invention. This description should be read to include one or at least one and the singular also includes the plural unless it is obvious that it is meant otherwise.
Reference will now be made in detail to several embodiments, examples of which are illustrated in the accompanying figures. It is noted that wherever practicable similar or like reference numbers may be used in the figures and may indicate similar or like functionality. The figures depict embodiments of the disclosed system (or method) for purposes of illustration only. One skilled in the art will readily recognize from the following description that alternative embodiments of the structures and methods illustrated herein may be employed without departing from the principles described herein.
Electronic Paper Displays have some physical media capable of maintaining a state. In the physical media 220 of electrophoretic displays, the state is the position of a particle or particles 206 in a fluid, e.g. a white particle in a dark liquid. In other embodiments that use other types of displays, the state might be determined by the relative position of two fluids, or by rotation of a particle or by the orientation of some structure. In
Regardless of the exact device, for zero power consumption, it is necessary that this state can be maintained without any power. Thus, the control signal 230 as shown in
The reflectance of a pixel in an EPD changes as voltage is applied. The amount the pixel's reflectance changes may depend on both the amount of voltage the length of time for which it is applied, with zero voltage leaving the pixel's reflectance unchanged.
The desired image data 402 is sent and stored in current desired image buffer 404 which includes information associated with the current desired image. The previous desired image buffer 406 stores at least one previous image in order to determine how to change the display 416 to the new desired image. The previous desired image buffer 406 is coupled to receive the current image from the current desired image buffer 404 once the display 416 has been updated to show the current desired image. The waveform storage 408 is for storing a plurality of waveforms. A waveform is a sequence of values that indicate the control signal voltage that should be applied over time. The waveform storage 408 outputs a waveform responsive to a request from the display controller 410. There are a variety of different waveforms, each designed to transition the pixel from one state to another depending on the value of the previous pixel, the value of the current pixel, and the time allowed for transition. The waveform generated by waveform storage 408 is sent to a display controller 410 and converted to a control signal by the display controller 410. The display controller 410 applies the converted control signal to the physical media. The control signal is applied to the physical media 412 in order to move the particles to their appropriate states to achieve the desired image. The control signal generated by the display controller 410 is applied at the appropriate voltage and for the determined amount of time in order to drive the physical media 412 to a desired state.
For a traditional display like a CRT or LCD, the input image could be used to select the voltage to drive the display, and the same voltage would be applied continuously at each pixel until a new input image was provided. In the case of displays with state, however, the correct voltage to apply depends on the current state. For example, no voltage need be applied if the previous image is the same as the desired image. However, if the previous image is different than the desired image, a voltage needs to be applied based on the state of the current image, a desired state to achieve the desired image, and the amount of time to reach the desired state. For example, if the previous image is black and the desired image is white, a positive voltage may be applied for some length of time in order to achieve the white image, and if the previous image is white and the desired image is black, a negative voltage may be applied in order to achieve the desired black image. Thus, the display controller 410 in
In some embodiments, the required waveforms used to achieve multiple states can be obtained by connecting the waveform used to go from the initial state to an intermediate state to the waveform used to go from the intermediate state to the final state. Because there will now be multiple waveforms for each transition, it may be useful to have hardware capable of storing more waveforms. In some embodiments, hardware capable of storing waveforms for any one of sixteen levels to any other one of sixteen gray levels requires 256 waveforms. If the imagery is limited to 4 levels, then only 16 waveforms are needed without using intermediate levels, and thus there could be 16 different waveforms stored for each transition.
According to some embodiments, it may require a long time to complete an update. Some of the waveforms used to reduce the ghosting problem are very long and even short waveforms may require 300 ms to update the display. Because it is necessary to keep track of the optical state of a pixel to know how to change it to the next desired image, some controllers do not allow the desired image to be changed during an update. Thus, if an application is attempting to change the display in response to human input, such as input from a pen, mouse, or other input device, once the first display update is started, the next update cannot begin for 300 ms. New input received immediately after a display update is started will not be seen for 300 ms, this is intolerable for many interactive applications, like drawing, or even scrolling a display.
With most current hardware there is no way to directly read the current reflectance values from the image reflectance 414; therefore, their values can be estimated using empirical data or a model of the physical media 412 of the display characteristics of image reflectance 414 and knowledge of previous voltages that have been applied. In other words, the update process for image reflectance 414 is an open-loop control system.
The control signal generated by the display controller 410 and the current state of the display stored in the previous image buffer 406 determine the next display state. The control signal is applied to the physical media 412 in order to move the particles to their appropriate states to achieve the desired image. The control signal generated by the display controller 410 is applied at the appropriate voltage and for the determined amount of time in order to drive the physical media 412 to a desired state. The display controller 410 determines pseudo-random noise values and applies those control signal values to move the physical media 412 to random values to produce an intermediate state. The intermediate state is displayed accordingly on the image reflectance 414 and visible by a human observer through the physical display 416.
In some embodiments, the environment the display is in, in particular the lighting, and how a human observer views the reflectance image 414 through the physical media 416 determine the final image 418. Usually, the display is intended for a human user and the human visual system plays a large role on the perceived image quality. Thus some artifacts that are only small differences between desired reflectance and actual reflectance can be more objectionable than some larger changes in the reflectance image that are less perceivable by a human. Some embodiments are designed to produce images that have large differences with the desired reflectance image, but better perceived images. Halftoned images are one such example.
In some embodiments, pixels are adjusted to different intermediate values before moving them to the final image as a means to eliminate objectionable artifacts. Technically, this method produces ghosting artifacts from a different image. In accordance with some embodiments, the appropriate intermediate image is chosen and the ghosting artifacts are much less objectionable than the previous image. This can be achieved by driving the pixels to an intermediate values, such that the intermediate values for the pixels are chosen in a pseudo-random manner. While evidence of this intermediate image may be present in the final image, the human visual system is less sensitive because it averages pixels that are spatially close.
This can be seen by comparing the images of prior art in
As shown in
Depending on the hardware and software available, this update to an intermediate noise image can be accomplished in a variety of ways. Any system that allows the developer to choose an image can use this technique to reduce visible ghosting by interspersing pseudo-random noise images between the desired images. Using an intermediate image without modification to the system 400 reduces the potential frame rate by a factor of two compared with a direct update solution.
In other hardware and software environments, it is possible to combine the intermediate image with the control signal. In this case, two nominally black pixels that are being updated to become white pixels will be sent different control signals. For example, one might be sent directly to white, and another might be sent to an intermediate value and then sent to white.
The choice of the pseudo-random image can also be different depending on the goals of the application or the display. Pseudo-random images with specially chosen frequencies may be used. In particular it can be best to choose the “noise image” such that the human visual system is not sensitive to the frequencies. For example, no low frequencies should be present. Intermediate images like the masks used in some forms of half toning may be useful, e.g. the “blue noise mask.”
In some embodiments, the intermediate pseudo-random image is selected based on the content of the previous displayed image and the desired displayed image. For example the pseudo-random noise image could be filtered by the edges of the previous image. Thus the artifacts that would normally appear would be less visible because of the pseudo random noise, while constant color areas that would not show ghosting would be moved to a constant color intermediate image, therefore reducing the visibility of pseudo random noise in constant regions.
In some embodiments, as shown in
As shown in
In an alternate embodiment, another means to achieve the adjustment of pixels to different intermediate values is to use different waveforms. Consider the case where three pixels are currently black and the desired image has all three pixels as dark gray. One of these pixels can be changed according to a first process 702 first to white, then to dark gray. The second pixel can be changed according to a second process 704 first to light gray, then to dark gray. The final pixel may be changed according to a third process 706 directly to dark gray. Images 708-712 show the waveforms of a control signal required to move each pixel toward the desired states. The waveform 708 is used to move the pixel in 702 from black to white to dark gray. The waveform 710 is used to move the pixel in 704 from black to light gray to dark gray. The waveform 712 is used to move the pixel in 706 from black to dark gray. A system can store waveforms corresponding to these different control signals (and similar control signals for other pixel transitions). Given the current image and the desired image, the controller can select different waveforms for pixels with the same initial state and desired final state.
Upon reading this disclosure, those of skill in the art will appreciate still additional alternative structural and functional designs for a system and a process for updating a bi-stable display through the disclosed principles herein. Thus, while particular embodiments and applications have been illustrated and described, it is to be understood that the disclosed embodiments are not limited to the precise construction and components disclosed herein. Various modifications, changes and variations, which will be apparent to those skilled in the art, may be made in the arrangement, operation and details of the method and apparatus disclosed herein without departing from the spirit and scope defined in the appended claims.
This application claims the benefit of U.S. Provisional Patent Application No. 60/944,415, filed Jun. 15, 2007, entitled “Systems and Methods for Improving the Display Characteristics of Electronic Paper Displays,” the contents of which are hereby incorporated by reference in its entirety.
Number | Date | Country | |
---|---|---|---|
60944415 | Jun 2007 | US |