Patent Grant
8416149
This invention describes a method to enhance the viewing experience of a flat panel display of any video or still imagery through the localized dynamic control of the background lighting level of a specific area or areas of a scene or succession of video frames. This can be accomplished using a unique arrangement of two stacked flat panel displays, one of which would control backlight brightness values synchronized to appropriate areas within the scenes or images of the visual content being presented on the other display. This control could be provided over the video signal cable (DDC), serial, USB or a customized type of interface protocol.
Multi-layered display (MLD) units provide a significant improvement over existing single layer display (SLD) units or displays. MLD units may be used to nest display content over spacially displaced or stacked layers to provide an enhanced mechanism for information absorption and analysis by users. An example of an existing multi-layer display is discussed for example in WO9942889A.
Reference throughout this specification will also be made to the present invention being used in conjunction with multi-layer displays of the type disclosed in WO9942889A. However, those skilled in the art should appreciate that the present invention may also be adapted for use with other types of MLD units and reference to the above only throughout this specification should in no way be seen as limiting.
The frequency spectrum of radiation incident upon a detector depends on the properties of the light source, the transmission medium and possibly the properties of the reflecting medium. If one considers the eye as a detector the human visual system can sense radiation that has a wavelength between 700 nm and 380 nm. Hence this is described as the visual part of the electromagnetic spectrum. Humans perceive certain frequency distributions as having different colours and brightness. A scheme was devised to describe any perceived colour and brightness via adding three basis spectral distributions with various weights. For example in the 1931 CIE colour space any perceivable colour may be described by the following equation:
C=xrX+yrY+zrZ
Where C is the colour being described, Xr, Yr and Zr are the weights and X, Y and Z are 1931 CIE tristimulis curves which are graphs of the relative sensitivity of the eye Vs wavelength. For any given colour, the weights may be determined by the following equations:
xr=∫C(λ)X(λ)d(λ)
yr=∫C(λ)Y(λ)d(λ)
zr=∫C(λ)Z(λ)d(λ)
The 1931 co-ordinates are formed via the following normalisation:
These may be plotted on the 1931 CIE diagram. The spectral locus defines the pure spectral colours, that is the perception of radiation with a specific wavelength. Colour co-ordinates that are closer or farther from pure spectral colours are described as being more or less saturated respectively. The value of the y coordinate is also referred to as the luminance or the variable L.
Pixels on a transmissive display, that is a display that channels light from a rear mounted source, will be capable of maximum and minimum luminous states. If one labels the maximum state as Lb and the minimum as Ld then the contrast ratio is described by
The perception model described above accurately predicts that colours on displays can be formed by mixing small areas of three basis colours with modulated intensities which are close in either spatial or temporal proximity. If the basis colours are plotted on the CIE diagram then the enclosed triangle contains all the colours producible by the system. The enclosed area is called the colour gamut and hence a display with a larger area can display a greater variation in colour and has a greater colour gamut.
There are two main types of Liquid Crystal Displays used in computer monitors, passive matrix and active matrix. Passive-matrix Liquid Crystal Displays use a simple grid addressing system to supply the charge to a particular pixel on the display. Creating the grid starts with two glass layers called substrates. One substrate is given columns and the other is given rows made from a transparent conductive material. This is usually indium tin oxide. The rows or columns are connected to integrated circuits that control when a charge is sent down a particular column or row. The liquid crystal material is sandwiched between the two glass substrates, and a polarizing film is added to the outer side of each substrate.
A pixel is defined as the smallest resolvable area of an image, either on a screen or stored in memory. Each pixel in a monochrome image has its own brightness, from 0 for black to the maximum value (e.g. 255 for an eight-bit pixel) for white. In a colour image, each pixel has its own brightness and colour, usually represented as a triple of red, green and blue intensities. To turn on a pixel, the integrated circuit sends a charge down the correct column of one substrate and a ground activated on the correct row of the other. The row and column intersect at the designated pixel and that delivers the voltage to untwist the liquid crystals at that pixel.
The passive matrix system has significant drawbacks, notably slow response time and imprecise voltage control. Response time refers to the Liquid Crystal Displays ability to refresh the image displayed. Imprecise voltage control hinders the passive matrix's ability to influence only one pixel at a time. When voltage is applied to untwist one pixel, the pixels around it also partially untwist, which makes images appear fuzzy and lacking in contrast.
Active-matrix Liquid Crystal Displays depend on thin film transistors (TFT). Thin film transistors are tiny switching transistors and capacitors. They are arranged in a matrix on a glass substrate. To address a particular pixel, the proper row is switched on, and then a charge is sent down the correct column. Since all of the other rows that the column intersects are turned off, only the capacitor at the designated pixel receives a charge. The capacitor is able to hold the charge until the next refresh cycle. And if the amount of voltage supplied to the crystal is carefully controlled, it can be made to untwist only enough to allow some light through. By doing this in very exact, very small increments, Liquid Crystal Displays can create a grey scale. Most displays today offer 256 levels of brightness per pixel.
A Liquid Crystal Display that can show colours must have three subpixels with red, green and blue colour filters to create each colour pixel. Through the careful control and variation of the voltage applied, the intensity of each subpixel can range over 256 shades. Combining the subpixel produces a possible palette of 16.8 million colours (256 shades of red×256 shades of green×256 shades of blue).
Liquid Crystal Displays employ several variations of liquid crystal technology, including super twisted nematics, dual scan twisted nematics, ferroelectric liquid crystal and surface stabilized ferroelectric liquid crystal. They can be lit using ambient light in which case they are termed as reflective, or backlit and termed Transmissive. There are also emissive technologies such as Organic Light Emitting Diodes, which are addressed in the same manner as Liquid Crystal Displays. These devices are described hereafter as image planes.
Another subset of LCDs, known as “transflective” or partially reflective displays, is important to consider. In this application, a portion of the rear part of the liquid crystal subpixel cell (either internally or externally) is coated with a light reflecting material. The coverage achieved by this reflector material may comprise from 20% to 30% or more of the total active (light transmitting) area of a given subpixel. Any incident light on this part of the cell coming from a rear-mounted backlight would not be able to reach the viewer's eye unless it were diffused and re-reflected in another spot. However, the equivalent portion of ambient light from overhead fluorescent lighting or even the sun would pass through the cell's colour filter and liquid crystal layer to be reflected (after appropriate greyscale modification) back to the user. This system allows portable colour (or even monochromatic) displays such as Tablet PCs, PDAs, and even cell phones to be easily readable even in the harshest of ambient lighting environments without requiring the energy drain on a battery produced by an emissive backlight.
Common to the display marketplace are “emissive” displays such as CRTs where the luminance of a characteristic colour, shade and brightness is derived from electronically excited photon emission at the subpixel site itself. There are other emissive display technologies which are consistent with this description such as those based on Organic Light Emitting Diodes (OLEDs), Electroluminesce (EL), and plasma. Each of these technologies can be used in conjunction with an overlying transmissive (or even transflective) liquid crystal display to achieve a Multi-Layer configuration.
No known reproduction process can exactly capture the original elements in a given situation (e.g. the brightness of the sun shining down on a landscape). All colour reproduction systems can hope to do is replicate the relative differences between objects in the original view. The ratio of the whitest point to the blackest point in a scene is know as its dynamic range, which must be reproduced on some medium such as film, a CRT, an LCD, or paper. The characteristics of this medium, or its “native response,” will determine the level of success a given reproduction achieves. The number of steps, or grayscale, into which this dynamic range can be subdivided determines the resolution of a particular primary colour. A typical monitor system will have the ability to display 8-bits, or 256 shades per primary colour for a total of over 16.7 million colours (256×256×256). This is known as the colour depth or image palette of the display system.
All display mediums, especially CRTs, introduce some amount of distortion, which has to be corrected to make the reproduced image look “proper.” The human eye sees logarithmically. To compensate for this, playback or image reproduction media must mimic the human visual response curve so that the display shows information in a way we are used to seeing. The resulting response curve varies in an exponential manner known as the “gamma curve” which is a polynomial equation describing any point on a curve native to a particular monitor. In a typical imaging system, the brightness changes very little at the lower energy grey levels causing some compression of the shadow detail where our eyes are the most sensitive. So instead of a straight-line, linear response where there is an equal amount of output for every value of input, the curve has a long, shallow beginning before it begins to climb.
Video or static images or scenes that are created, edited, stored, and then presented on flat panel media which displays them according to the luminance or brightness values which the author or editor imparts to them. Once they are imprinted and/or duplicated, further changes to the luminance properties of the content being displayed are only possible if applied to ALL the content. Until now, no method has been devised for controlling individual portions of a given scene, frame, or series of frames in a prescribed, dynamic fashion. Such a device or method would be useful.
All references, including any patents or patent applications cited in this specification are hereby incorporated by reference. No admission is made that any reference constitutes prior art. The discussion of the references states what their authors assert, and the applicants reserve the right to challenge the accuracy and pertinency of the cited documents. It will be clearly understood that, although a number of prior art publications are referred to herein, this reference does not constitute an admission that any of these documents form part of the common general knowledge in the art, in New Zealand or in any other country.
It is acknowledged that the term ‘comprise’ may, under varying jurisdictions, be attributed with either an exclusive or an inclusive meaning. For the purpose of this specification, and unless otherwise noted, the term ‘comprise’ shall have an inclusive meaning—i.e. that it will be taken to mean an inclusion of not only the listed components it directly references, but also other non-specified components or elements. This rationale will also be used when the term ‘comprised’ or ‘comprising’ is used in relation to one or more steps in a method or process.
It is an object of the present invention to go at least some way towards addressing the foregoing problems or to at least provide the public with a useful choice.
Further aspects and advantages of the present invention will become apparent from the ensuing description which is given by way of example only.
The processes and tools described here are intended to describe the implementation of a visual imaging system capable of offering an enhanced video viewing experience when used with a multi-layer display arrangement. It accomplishes this by employing hardware and software techniques to adjust the parameters of the components of a portion or portions of the image on one display such as the gamma response, contrast ratio, colour temperature, and brightness—frame by frame—by varying the complementary parameters of the selected portion or portions of the frame being displayed on the other (under- or over-lying) image plane. A software utility can be designed so as to capture a frame of video information and calculate the values of the aforementioned parameters and adjust them accordingly through the use of special algorithms which then pass that value or values to a software lookup table (LUT) adjustable by the viewer wishing to create an enhanced or modified visual experience of the content being viewed. The values will be accepted by custom hardware and software driven devices which will then translate the commands into the subpixel chromaticity and brightness settings on one display that are required to modify the image being displayed on the other display. The controller device, with suitable switching adjustments, will be able to control the desired areas of either component of a multi-layer display stack.
Accordingly in a first aspect of the invention may broadly said to consist in an image appearance controller for controlling brightness, colour, hue, colour temperature, gamma response or contrast of at least one image for display on a multi layer display device comprising:
A further aspect of the current invention may broadly said to consist in an image appearance control system for controlling brightness, colour, hue, colour temperature, gamma response or contrast of at least one image for display on a multi layer display device carrying out the steps of:
As such the current invention is a method to or apparatus designed to control and enhance the brightness, colour, hue, colour temperature, gamma response or contrast of at least one image to be displayed on a multi layer display device by controlling the transmissivity of the layers of said multi layered device in the localised area of said image(s).
The term ‘transmissivity’ as used herein should be interpreted as meaning the degree of transmission of light through a transmissive layer or item. In particular the transmissivity should be interpreted as the transmission in terms of colour or chromaticity and brightness of light passing through that layer or item.
The term ‘image’ as used herein should be interpreted as meaning any type of image for example (without limitation) any content, display element, image, scene, ranging from static to video images or any part there-of.
Preferably the receiving means or the step or receiving the image(s) is adapted to receive full scenes and video images.
Preferably the receiving means or the step of receiving the image(s) is able to receive the brightness and colour of each pixel of the image(s).
Preferably the detecting means or the step of detecting brightness, colour, hue, colour temperature, gamma response and/or contrast step detects the overall brightness, colour, hue, colour temperature, gamma response and/or contrast of the image(s) to be display and preferably it is implemented for example by means of software or hardware which is controlled by a user who interacts with it to define the level of contrast, brightness and/or colour of said image(s) desired. Alternatively the brightness, colour, hue, colour temperature, gamma response and/or contrast may be determined by a software application.
Preferably the determining means or the step of determining calculates the transmissivity of each pixel of the image on each layer by reference to the brightness and colour of each pixel of the image, the brightness, colour, hue, colour temperature, gamma response and/or contrast to be determined and then by reference to a pre-defined algorithm or look-up table or alternatively an algorithm or look up table which can be adjusted by the user or software developer the transmissivity of each pixel on each layer of the multi layer display is determined. Typically this will involve one layer displaying the image received and a second layer controlling the brightness, colour, hue, colour temperature, gamma response and/or contrast.
Preferably the determining means or the step of determining throughout this specification is definable by a user/content developer to allow customisation to allow the particular gamma response of each layer of the intended multi layer display device or alternatively any preferred gamma curve to be factored in which calculating the transmissivity of each layer of the multi layer display device in the localised area of each image.
Preferably the image appearance control system or image appearance controller is attached to a multi layer display device upon which, by utilising appearance control system or image appearance controller, images can be displayed with enhanced or controlled brightness, colour, hue, colour temperature, gamma response and/or contrast of said image(s).
Preferably the means of communication or communicating step can communicate with individual display layers of multi layer display device or alternatively can communicate with a recording or storage device such as a CPU that is able to record or store the level of transmissivity of each display layer for subsequent retrieval and display of images with enhanced or controlled contrast.
Accordingly in a first aspect of the invention may broadly said to consist in a brightness, colour, hue, colour temperature, gamma response or contrast controller for controlling brightness, colour, hue, colour temperature, gamma response or contrast of at least one image for display on a multi layer display device comprising:
A further aspect of the current invention may broadly said to consist in a brightness, colour, hue, colour temperature, gamma response or contrast control system for controlling brightness, colour, hue, colour temperature, gamma response or contrast of at least one image for display on a multi layer display device carrying out the steps of:
The term ‘non-display layers’ as used herein should be interpreted as the layers capable of controlling brightness, colour, hue, colour temperature, gamma response or contrast on which the image as originally received is not displayed. So in a two layered multi layer display consisting of two LCDs which are backlit, one layer would be a display layer on which images are displayed and the other layer would be a ‘non display layer’ with which brightness, colour, hue, colour temperature, gamma response and/or contrast of images is controlled.
As such the invention is a method of controlling brightness, colour, hue, colour temperature, gamma response or contrast of an image which is to be displayed on a display as received, unaltered. So the image(s) received can be displayed without altering the transmissivity of the layer on which it is (they are) to be displayed and their appearance (brightness, colour, hue, colour temperature, gamma response or contrast) can be controlled and enhanced through the control of transmissivity of the other layers in the localised area of said image(s).
Accordingly in another aspect of the current invent can broadly be said to consist in an image appearance controller or an image appearance control system which controls at least two of the following attributes of an image (or images) in combination utilising the methods or steps described here-in: brightness, colour, hue, colour temperature, gamma response or contrast.
As such the current invention is a method to or apparatus designed to control the controlling brightness, colour, hue, colour temperature, gamma response or contrast in combination, of at least one image to be displayed on a multi layer display device by controlling the transmissivity of the layers of said multi layered device in the localised area of said image(s).
Preferably the means of detecting means or step of detecting is able to detect information as to brightness, colour, hue, colour temperature, gamma response or contrast of an image or image(s) in combination.
Preferably the current invention is embodied in software or hardware whereby the user or content developer defines brightness, colour, hue, colour temperature, gamma response or contrast of each image he or she desires to display which is detected by the means of detecting or the detecting step, the determining step or means of determining calculates the localised transmissivity of each layer of the multi layer display for each image and the communicating step or means of communicating stores communicates that information for storage or display on an multi layer display system.
Accordingly in another aspect of the current invention can broadly be said to consist in an image appearance controller or an image appearance control system for use with a multi layer display device utilising the methods or apparatus of controlling the contrast of an image or images as described here-in while brightness of said image(s) is maintained utilising the methods or apparatus described here-in such that net brightness perceived of the image(s) is maintained despite any change to contrast.
As such the current invention is a method to alter contrast of an image or images without giving the viewer the perception of any change in brightness. That is, while a change in contrast of an image or image(s) at the detecting step or the means of detecting causes the determining means to increase or reduce overall brightness (depending on the contrast change) of said image(s), the determining means would additionally determine the transmissivity of each layer of the multi layer display in the localised are of images so controlled in order that the overall brightness of said images would be maintained.
Preferably the determining step or the means of determining will determine or calculate the transmissivity of brightness to remain the same despite any adjustment to or control of contrast. In this manner the user is able to define the contrast of an image or images without having to additionally adjust the brightness of such image(s). The automatic control of the brightness is performed using the methods or apparatus of controlling brightness as described here-in.
Equally a contrast can be maintained despite any change in brightness of an image.
Preferably the determining means or the step if determining can determine the transmissivity of each layer independently, such that the transmissivity determined of each layer in the localised area of the image(s) to be subsequently displayed can be different, or independently determined.
According to a further aspect of the current invention, a device is implemented to carry out the methods of controlling brightness, colour, hue, colour temperature, gamma response or contrast utilising the methods set out here-in.
Preferably the embodiment of the invention comprises a software which carries out the step of receiving or detecting the desired or specified brightness, colour, hue, colour temperature, gamma response or contrast of the image to be displayed and on this basis the determining means or the step of determining, determines the transmissivity of each layer of the MLD.
This device is further described in the best modes of carrying out the invention below.
Accordingly in a further aspect of the invention may broadly said to consist in a display with enhanced image control comprising:
The term ‘backlight system’ as used herein should be interpreted as meaning any type of system which illuminates a display device at least in part from behind that display device by any means including for example (but without limitation) phosphorous tubes as seen in typical Liquid Crystal Display arrangements. For the avoidance of doubt, the source of the light need not be or need not solely be behind the display.
In a preferred embodiment of the current invention the at least one display device in the current invention is a (are) Liquid Crystal Display panel(s).
In a preferred embodiment of the current invention the at least one transmissivity control device in the current invention is a (are) Liquid Crystal Display panel(s).
Accordingly a further aspect of the present invention consists is a display comprising of:
A display comprising of:
Preferably the at least one display device is adapted to display video images and preferably it is adapted to be attached to a CPU or other device from which it can receive images to be displayed such as a DVD player. Preferably the at least one display device may be driven through software code of computer based instructions loaded into a programmable logic device such as a computer or a microprocessor.
Preferably the at least one transmissivity control device it is adapted to be attached to a CPU or other device from which it can receive transmission levels such as a DVD player. Preferably the at least one transmissivity control device may be driven through software code of computer based instructions loaded into a programmable logic device such as a computer or a microprocessor.
Preferably the at least one transmissivity control device and the at least one display device same device are adapted to be driven or controlled by the same device.
Preferably the at least one transmissivity control device is adapted to selectively control the transmission of light on the basis of user or software defined preferences associated with the image to be displayed on the display device. For example a user, content developer or publisher may define the level of transmission of light associated with a particular image.
Preferably the at least one transmissivity control device is adapted to control the transmission of light specific to the shape of the image or images being displayed.
Preferably the at least one transmissivity control device and the at least one display device display are adapted to be driven in conjunction so that the transmissivity control device controls the transmission of light associated with the image(s) on the display device.
Adding the extra dimension of control imparted by a second display vertically stacked behind the panel displaying the video content allows this brightness adjustment to occur in a localized area or areas rather than being applied to the entire scene in a given frame. Appropriate and selective blockage of the backlight luminance level can be accomplished by applying variously darker neutral grey levels (at 50% transmission, for instance) to the pixels of the second display directly behind the portions of the scene one might wish to be de-emphasized or occluded. Conversely, the pixels behind areas of the image one wishes to be made brighter can be driven at grey levels corresponding to full or 100% transmission so as to allow all the backlight power to illuminate those areas.
The control of colour or “chromaticity” for example allows the image to be saturated (or less saturated as the case may be) with colour.
In addition to brightness levels, recorded levels for image attributes such as hue, saturation, and colour temperature may also be present.
Regardless of the type of display device utilised as described here-in, the display is capable of controlling the brightness, colour, hue, colour temperature, gamma response or contrast of an image or images by way of the transmissivity control device selectively controlling the brightness, colour, hue, colour temperature and/or contrast of said image(s) to be displayed in the localised area.
The visual digital media applications that could be enhanced with this method include DV, HDTV, eCinema, DVD, QuickTime, AVI, RealVideo, etc; vector animation such as Flash; presentation software such as PowerPoint, slide-show software etc; tagged static image file formats such as JPEG or GIF images in web pages, PhotoCD, TIFF, PhotoShop, etc. Enhancements to the viewing experience described herein will be particularly valuable to the entertainment and publishing industries.
Methods are possible to one skilled in the art whereby the brightness of the display can be synchronized to the static or video image content being displayed on a flat panel device. Software can be written to examine the grey scale content of a frame or a series of frames to compute, for instance, an arithmetic mean of the changing (dynamic) brightness level. Depending on present values from a given group of parameters, the software can cause instructions to be transmitted through a suitable application programming interface (API) to a backlight driver to dynamically adjust the brightness level of the display by controlling the voltage levels of lamp or lamps illuminating the display.
Accordingly, in a further aspect of the invention may broadly said to consist in an enhanced method of controlling transmissivity of light in the localised area of image(s) where the at least one transmissivity control device and the transmissivity of the at least one display device being controlled in conjunction to maintain the same or a similar level of luminance of said image(s) as would be experienced by the viewer when no transmissivity control device is present or was present but was not acting to block or filter light.
In the first case where the backlight luminance is partially blocked, the gamma response curve of the pixels of the corresponding area on the display showing the video content may now be altered so as to increase their transmissivity. This increase, while not altering the net brightness level reaching the observer, will allow for an increased level of actinic stimulus of his visual cortex. Hence, by synchronously lowering the backlight brightness level through the use of a transmissivity control device and decreasing the gamma value of an image so that the same resultant luminance level is maintained, a more vibrant colour impact can be achieved than before possible with non-dynamic playback.
Preferably the current invention is adapted such that the net luminance level is maintained or approximately maintained such that the viewer's viewing experience is enhanced through improved contrast by limiting the transmission of light to the display device through the use of the transmissivity control device while at the same time increasing the transmissivity of the display device.
The present invention may provide many potential advantages over the prior art.
Further aspects of the present invention will become apparent from the following description which is given by way of example only and with reference to the accompanying drawings in which:
In the instance shown, a transparent LCD layer or panel acting as a display device (1) and a further transparent LCD layer or panel acting as an transmissivity control device (2) are arranged and displaced in a line with respect to one another, however, in use, the display device and transmissivity control device are aligned directly in front of the next to form a stacked or sandwiched construction. The scene to be displayed consists of a hilltop, the moon, and the nights sky (3a, b and c), which are displayed upon the display device. Light enters from a backlighting system (not illustrated) behind the transmissivity control device (4). The transmissivity control device controls this light, selectively in the localised area of the images. As such the resultant light exiting the transmissivity control device in the case of the moon (5a) is bright and saturated in yellow colour (colour not illustrated), and in the case of the hilltop the resultant light less intense and less saturated in colour (5b). Light entering the transmissivity control device in the localised area of the night's sky is blocked to the greatest degree possible (if not completely) by both the transmissivity control device and the display device. The resultant image displayed on the display device has increased contrast ratio particularly between the moon and the night's sky and additionally the colour of the images is more vibrant.
In the preferred embodiment illustrated the display comprises two LCDs which are stacked in construction. Those LCDs are preferably colour LCDs, although alternatively it is less expensive to use a grey-scale LCDs. In particular a grey-scale LCD acting as an transmissivity control device can be used in combination with a colour LCD acting as a display device. This colour LCD/grey-scale LCD combination or multiple grey-scale LCD combination will effectively control illumination of the images but will add little to the colour enhancement attributes described in the current invention and as such contrast ration is effectively controlled but not colour saturation or other colour characteristics.
In this preferred embodiment of two layered LCDs moiré interference may result due to the layering of like patterns and this may be overcome or limited through the use of a light diffusing device such as an random homogenous layer placed between the LCDs and such interstitial layers need to be factored in which determining the transmissivity of layers of the multi layer display device.
Alternatively the LCD in front (from the viewer's perspective) is used as the illumination controlling device and the LCD in the rear is used as the display device.
Preferably the LCD layers are constructed so that there is as little distance as possible between the two layers.
In this preferred embodiment of two stacked LCD layers can be used in their normal way as addressable image display devices and can be attached to a CPU or other device driver. As such the many software applications for content production and editing can be used in conjunction with the present invention.
In this preferred embodiment of two stacked LCD layers the rear layer can be used as both for the purpose contrast and colour enhancement as described in this invention and also if those layers are displaced by distance the embodiment can be used for the purpose independent image display such that different images can be displayed on the front and rear layers with depth enhanced perception.
In a further preferred embodiment, the enhancement of contrast ratio and colour takes place on the basis of user interaction. This user interaction embodiment involves attaching the display to a CPU or other device driver such that the user can determine the level of illumination control he or she requires to enhance the images displayed on the display device—in terms of brightness, contrast, hue, colour temperature and of colour. The user is able to interact with a software application, specifying the brightness and colour he or she wishes to be perceived when the image is viewed and the software application drives both the transmissivity control device and the display layer to display an image with those specified characteristics. He or she may preferably control the gamma curve of each layer utilised in calculating transmissivity of that layer. Preferably the level of illumination and colour control the transmissivity control device exhibits is controlled by a sliding scale controlled for example by a mouse of key-strokes with which the user interacts. Alternatively the device with which the user interacts can be hardwired and the user interacts with physical sliders or knobs.
Utilising this preferred embodiment of user interaction, colour and contrast enhanced images or indeed entire movies could be pre-recorded for playback using a CPU or other device driver such as a DVD. The viewer of this preferred embodiment would largely be unaware of the mechanisms controlling such enhancement of colour and contrast but would enjoy an improved viewing experience.
The calculated value is the average grey level of the subpixels in the area intended to be changed or modified. Gray is calculated using:
grey=red*0.3+green*0.59+blue*0.11
The calculation is performed according to a timer which can be initiated, for instance, every 100 milliseconds. However, if the calculation takes longer than 100 milliseconds then the calculation is done less frequently. The time for each frame calculation is displayed in the “Time to compute frame” readout in the sample control panel figure (
For instance, as a default setting, the application could be set to read every eighth pixel, horizontally and vertically. That is, one out of every 8×8 or 64 pixels is used to compute the grey value for the gamma determination. This can be adjusted using the Skip Pixels option. There are settings for 1, 2, 4, 8, and 16 pixels. When set to 1, every pixel on the screen is read.
The calculated gamma response, for instance, can be affected by a lookup table. This is a table of, say, 256 floating point values, normally in the range 1.0 to about 2.3, that can adjust the brightness of each subpixel or groupie of subpixels in a single area or multiple areas in response to a measured value. The table can be edited by changing the text file named “gamlut.txt” which could be located in the same directory as the application. If “Use gamma lut” is checked in the application (as illustrated), then the adjusted brightness is run through the gamma lut table to produce a floating point value which is output to the device gamma table. For example if the adjusted brightness is 125 and a certain gridpoint location, and the gamma lut contains the value 1.5 at location 125, then a gamma 1.5 table is computed and the windows display device is updated. Unchecking “Use gamma lut” in the application (as illustrated) would set a gamma of 1.0.
The brightness and gamma lookup tables are reloaded from their text files at the time the Start button is pressed. This makes it more convenient to change the luts and see the effect. The files must each contain 256 values separated by carriage return and line feed (CR LF, or the Enter key).
To edit the lookup tables, one can use any text editor such as Notepad, or even Microsoft Excel. For example, the original values might read:
In order to obtain a gain of, for instance, 2×, the operator would modify the table to read:
A library of similar algorithms for the other parameters such as colour temperature, brightness, etc. can be available for a user to perform modifications to them in selected portions of the image.
Aspects of the present invention have been described by way of example only and it should be appreciated that modifications and additions may be made thereto without departing from the scope thereof.
| Number | Date | Country | Kind |
|---|---|---|---|
| 517713 | Jun 2002 | NZ | national |
| Filing Document | Filing Date | Country | Kind | 371c Date |
|---|---|---|---|---|
| PCT/NZ03/00132 | 6/25/2003 | WO | 00 | 10/26/2005 |
| Publishing Document | Publishing Date | Country | Kind |
|---|---|---|---|
| WO04/002143 | 12/31/2003 | WO | A |
| Number | Name | Date | Kind |
|---|---|---|---|
| 3863246 | Trcka et al. | Jan 1975 | A |
| 3967881 | Moriyama et al. | Jul 1976 | A |
| 4294516 | Brooks | Oct 1981 | A |
| 4333715 | Brooks | Jun 1982 | A |
| 4364039 | Penz | Dec 1982 | A |
| 4371870 | Biferno | Feb 1983 | A |
| 4472737 | Iwasaki | Sep 1984 | A |
| 4485376 | Noble | Nov 1984 | A |
| 4523848 | Gorman et al. | Jun 1985 | A |
| 4568928 | Biferno | Feb 1986 | A |
| 4649425 | Pund | Mar 1987 | A |
| 4757626 | Weinreich | Jul 1988 | A |
| 4768300 | Rutili | Sep 1988 | A |
| 4815742 | Augustine | Mar 1989 | A |
| 5050965 | Conner et al. | Sep 1991 | A |
| 5075993 | Weinreich | Dec 1991 | A |
| 5112121 | Chang et al. | May 1992 | A |
| 5113272 | Reamey | May 1992 | A |
| 5124803 | Troxel | Jun 1992 | A |
| 5198936 | Stringfellow | Mar 1993 | A |
| 5298892 | Shapiro et al. | Mar 1994 | A |
| 5300942 | Dolgoff | Apr 1994 | A |
| 5302946 | Shapiro et al. | Apr 1994 | A |
| 5361165 | Stringfellow et al. | Nov 1994 | A |
| 5367801 | Ahn | Nov 1994 | A |
| 5369450 | Haseltine et al. | Nov 1994 | A |
| 5473344 | Bacon et al. | Dec 1995 | A |
| 5515484 | Sfarti et al. | May 1996 | A |
| 5585821 | Ishikura et al. | Dec 1996 | A |
| 5675755 | Trueblood | Oct 1997 | A |
| 5694532 | Carey et al. | Dec 1997 | A |
| 5695346 | Sekiguchi et al. | Dec 1997 | A |
| 5745197 | Leung et al. | Apr 1998 | A |
| 5764317 | Sadovnik et al. | Jun 1998 | A |
| 5805163 | Bagnas | Sep 1998 | A |
| 5825436 | Knight | Oct 1998 | A |
| 5924870 | Brosh et al. | Jul 1999 | A |
| 5982417 | Blonde | Nov 1999 | A |
| 5990990 | Crabtree | Nov 1999 | A |
| 5999191 | Frank et al. | Dec 1999 | A |
| 6005654 | Kipfer et al. | Dec 1999 | A |
| 6054969 | Haisma | Apr 2000 | A |
| 6215490 | Kaply | Apr 2001 | B1 |
| 6215538 | Narutaki et al. | Apr 2001 | B1 |
| 6341439 | Lennerstad | Jan 2002 | B1 |
| 6356281 | Isenman | Mar 2002 | B1 |
| 6369830 | Brunner et al. | Apr 2002 | B1 |
| 6388648 | Clifton et al. | May 2002 | B1 |
| 6438515 | Crawford et al. | Aug 2002 | B1 |
| 6443579 | Myers | Sep 2002 | B1 |
| 6525699 | Suyama et al. | Feb 2003 | B1 |
| 6538660 | Celi, Jr. et al. | Mar 2003 | B1 |
| 6587118 | Yoneda | Jul 2003 | B1 |
| 6593904 | Marz et al. | Jul 2003 | B1 |
| 6609799 | Myers | Aug 2003 | B1 |
| 6661425 | Hiroaki | Dec 2003 | B1 |
| 6697135 | Baek et al. | Feb 2004 | B1 |
| 6717728 | Putilin | Apr 2004 | B2 |
| 6720961 | Tracy | Apr 2004 | B2 |
| 6845578 | Lucas | Jan 2005 | B1 |
| 6906762 | Witehira et al. | Jun 2005 | B1 |
| 6940507 | Repin et al. | Sep 2005 | B2 |
| 6958748 | Fukui et al. | Oct 2005 | B1 |
| 7113188 | Kuroda et al. | Sep 2006 | B2 |
| 20020001055 | Kimura et al. | Jan 2002 | A1 |
| 20020093516 | Brunner et al. | Jul 2002 | A1 |
| 20020105516 | Tracy | Aug 2002 | A1 |
| 20020126115 | Ijntema | Sep 2002 | A1 |
| 20020126396 | Dolgoff | Sep 2002 | A1 |
| 20020163728 | Myers | Nov 2002 | A1 |
| 20020163729 | Myers | Nov 2002 | A1 |
| 20030090455 | Daly | May 2003 | A1 |
| 20030132895 | Berstis | Jul 2003 | A1 |
| 20030184665 | Berstis | Oct 2003 | A1 |
| 20040239582 | Seymour | Dec 2004 | A1 |
| 20050062897 | Lei | Mar 2005 | A1 |
| 20050146787 | Lukyanitsa | Jul 2005 | A1 |
| 20060227249 | Chen et al. | Oct 2006 | A1 |
| Number | Date | Country |
|---|---|---|
| 2480600 | Jul 2000 | AU |
| 2453800 | Aug 2000 | AU |
| 6821901 | Dec 2001 | AU |
| 2009960 | Sep 1990 | CA |
| 2075807 | Aug 1991 | CA |
| 1293805 | May 2001 | CN |
| 1294695 | May 2001 | CN |
| 2730785 | Jan 1979 | DE |
| 29912074 | Nov 1999 | DE |
| 19920789 | May 2000 | DE |
| 0389123 | Sep 1990 | EP |
| 454423 | Oct 1991 | EP |
| 0460314 | Dec 1991 | EP |
| 595387 | May 1994 | EP |
| 0605945 | Jul 1994 | EP |
| 0703563 | Mar 1996 | EP |
| 0732669 | Sep 1996 | EP |
| 0802684 | Oct 1997 | EP |
| 0999088 | May 2000 | EP |
| 1151430 | Aug 2000 | EP |
| 1177527 | Nov 2000 | EP |
| 1093008 | Apr 2001 | EP |
| 1287401 | Mar 2003 | EP |
| 2609941 | Jul 1988 | FR |
| 2312584 | Oct 1997 | GB |
| 2347003 | Aug 2000 | GB |
| 2372618 | Aug 2002 | GB |
| 93472 | Nov 1994 | IL |
| 61248083 | Nov 1986 | JP |
| 63158587 | Jul 1988 | JP |
| 3021902 | Jan 1991 | JP |
| 3174580 | Jul 1991 | JP |
| 3186894 | Aug 1991 | JP |
| 3226095 | Oct 1991 | JP |
| 3282586 | Dec 1991 | JP |
| 4191755 | Jul 1992 | JP |
| 4220691 | Aug 1992 | JP |
| 4251219 | Sep 1992 | JP |
| 5040449 | Feb 1993 | JP |
| 6317488 | Nov 1994 | JP |
| 8036375 | Feb 1996 | JP |
| 8095741 | Apr 1996 | JP |
| 09-033858 | Feb 1997 | JP |
| 9146751 | Jun 1997 | JP |
| 9244057 | Sep 1997 | JP |
| 9282357 | Oct 1997 | JP |
| 9308769 | Dec 1997 | JP |
| 10003355 | Jan 1998 | JP |
| 10039821 | Feb 1998 | JP |
| 10105829 | Apr 1998 | JP |
| 10228347 | Aug 1998 | JP |
| 10-334275 | Dec 1998 | JP |
| 11205822 | Jul 1999 | JP |
| 11272846 | Oct 1999 | JP |
| 2000-142173 | May 2000 | JP |
| 2000-347645 | Dec 2000 | JP |
| 2001-100689 | Apr 2001 | JP |
| 2000-99237 | Oct 2001 | JP |
| 2001324608 | Nov 2001 | JP |
| 2002504764 | Feb 2002 | JP |
| 2001-215332 | Apr 2002 | JP |
| 2002-131775 | May 2002 | JP |
| 2001-56675 | Sep 2002 | JP |
| 2002-350772 | Dec 2002 | JP |
| 2002544544 | Dec 2002 | JP |
| 2003507774 | Feb 2003 | JP |
| 2002-099223 | Oct 2003 | JP |
| 2003-316335 | Nov 2003 | JP |
| 20005178 | Apr 2001 | NO |
| 343229 | Apr 2001 | PL |
| 8805389 | Jul 1988 | WO |
| 9112554 | Aug 1991 | WO |
| 9847106 | Oct 1998 | WO |
| 9942889 | Aug 1999 | WO |
| 9944095 | Sep 1999 | WO |
| 0036578 | Jun 2000 | WO |
| 0048167 | Aug 2000 | WO |
| 0068887 | Nov 2000 | WO |
| 0101290 | Jan 2001 | WO |
| 0115127 | Mar 2001 | WO |
| 0115128 | Mar 2001 | WO |
| 0157799 | Aug 2001 | WO |
| 0195019 | Dec 2001 | WO |
| 0235277 | May 2002 | WO |
| 02084637 | Oct 2002 | WO |
| 02091033 | Nov 2002 | WO |
| 03003109 | Jan 2003 | WO |
| 03032058 | Apr 2003 | WO |
| 2004001488 | Dec 2003 | WO |
| 2004102520 | Nov 2004 | WO |
| 9703025 | Nov 1997 | ZA |
| Entry |
|---|
| “Clearboard 1991-1994,” http://web.media.mit.edu/˜ishii/CB.html. |
| “Teamworkstation 1989-1994,” http://web.media.mit.edu/˜ishii/TWS.html. |
| “Textarc: An Alternate Way to View a Text,” http://textarc.org. |
| “Textarc: NYSCA Grant and Public Installation,” http//textarc.org. |
| “Textarc: The Print and the Artist,” http://textarc.org. |
| Courter et al., Microsoft Office 2000 Professional Edition, 1999, Sybex Inc., pp. xxxi, 543, 685. |
| Harrison et al., “Transparent Layered User Interfaces: An Evaluation of a Display Design to Enhance Focused and Divided Attention” ACM, 13 pages, 1995. |
| Ishii et al., “Iterative Design of Seamless Collaboration Media”, Communications of the ACM, Aug. 1994, vol. 37, pp. 83-97. |
| Office Action U.S. Appl. No. 10/489,101 Mar. 29, 2006. |
| Office Action U.S. Appl. No. 10/489,101 Jul. 16, 2007. |
| Office Action U.S. Appl. No. 10/489,101 Jul. 28, 2005. |
| Office Action U.S. Appl. No. 10/489,101 Nov. 22, 2005. |
| Office Action U.S. Appl. No. 10/841,133 Jan. 8, 2007. |
| Office Action U.S. Appl. No. 10/841,133 Sep. 6, 2007. |
| Office Action U.S. Appl. No. 10/841,133 Nov. 28, 2007. |
| Final OA Dated Feb. 24, 2009; U.S. Appl. No. 10/528,334. |
| Office Action U.S. Appl. No. 10/528,334; Mail Date Feb. 24, 2009. |
| Office Action U.S. Appl. No. 10/528,334; Mail Date Aug. 5, 2008. |
| Office Action U.S. Appl. No. 10/841,133; Mail Date Aug. 7, 2008. |
| Non-Final Office Action Dated Aug. 12, 2009; U.S. Appl. No. 12/107,589. |
| Non-Final Office Action Dated Sep. 9, 2009; U.S. Appl. No. 10/557,157. |
| Non-Final Office Action Dated Sep. 1, 2009; U.S. Appl. No. 10/528,334. |
| “Display”, http://web.archive.org/web/20010717132509/http://whatis.techtarget.com/definition/0,,sid9—gci211965,00.html, Jul. 27, 2000. |
| Non-Final Office Action Dated Feb. 16, 2010; U.S. Appl. No. 12/107,589. |
| Non-Final Office Action Dated Jan. 11, 2010; U.S. Appl. No. 10/519,285. |
| Final Office Action Dated Apr. 15, 2010; U.S. Appl. No. 10/557,157. |
| Non-Final Office Action Dated May 14, 2010; U.S. Appl. No. 11/804,650. |
| Final Office Action Dated Jun. 25, 2010; U.S. Appl. No. 12/107,589. |
| Final Office Action Mailed Oct. 27, 2010; U.S. Appl. No. 11/804,650. |
| Office Action Dated Sep. 4, 2012, U.S. Appl. No. 12/778,039. |
| Office Action Dated Mar. 26, 2012, U.S. Appl. No. 12/089,390. |
| Office Action Dated Mar. 27, 2012, U.S. Appl. No. 12/778,039. |
| Office Action Dated Aug. 17, 2012, U.S. Appl. No. 12/813,173. |
| Office Action Dated Aug. 24, 2012, U.S. Appl. No. 11/804,650. |
| Notice of Allowance Dated Sep. 14, 2012, U.S. Appl. No. 12/089,390. |
| Notice of Allowance Dated Nov. 23, 2012, U.S. Appl. No. 10/528,334. |
| Notice of Allowance Dated Dec. 9, 2012, U.S. Appl. No. 10/557,157. |
| Final Office Action; U.S. Appl. No. 12/831,173; Dated Dec. 27, 2012. |
| Number | Date | Country | |
|---|---|---|---|
| 20060125745 A1 | Jun 2006 | US |
