Patent Grant
9330614
The present invention relates to a display device, such as an active matrix liquid crystal display device, which comprises colour sub-pixels of at least four different colours, and is switchable between a public and private display mode.
Multiprimary displays, consisting of at least four different colour sub-pixels, have been developed and produced in several different types, with several different performance aims.
Displays using more than the standard three (usually red, green and blue (RGB)) primaries for expansion of the range of displayable colours have been produced (Proceedings of the IDW'09, 2009, pp 1199-1202), as well as RGBW displays with an added white sub-pixel to improve display brightness and therefore efficiency (SID'08 Digest, pp 1112-1115). Multiprimary displays have also been produced with the aim of simultaneously increasing brightness, as well as increasing the ability to render fine image features on a sub-pixel level (IMID '05 Digest, pp 867-872). Displays with an additional yellow sub-pixel (RGBY) have also been developed possessing enhanced brightness, increased colour gamut, and increased sub-pixel rendering ability (SID'10 Digest, pp 281-282). As multiprimary displays have more than three types of colour sub-pixel, for many colour and luminance values, there may be multiple configurations of individual data values supplied to the colour sub-pixels which produce the target colour. The multiple configurations producing the same overall luminance and chromaticity are known as metamers. Selection of which of a set of possible metamers to use for a particular pixel in an image, based on sub-pixel rendering considerations, is described in US2010 0277498.
Several types of display which switchable between a public and private display mode, with varying degrees of additional cost over a standard display, ease of use and strength of privacy performance are also well known.
Devices incorporating such displays include mobile phones, Personal Digital Assistants (PDAs), laptop computers, desktop monitors, Automatic Teller Machines (ATMs) and Electronic Point of Sale (EPOS) equipment. Such devices can also be beneficial in situations where it is distracting and therefore unsafe for certain viewers (for example drivers or those operating heavy machinery) to be able to see certain images at certain times, for example an in car television screen while the car is in motion.
Several methods exist for adding a light controlling apparatus to a naturally wide-viewing range display, such as a microlouvre film (USRE27617 (F. O. Olsen; 3M 1973), U.S. Pat. No. 4,766,023 (S.-L. Lu, 3M 1988), and U.S. Pat. No. 4,764,410 (R. F. Grzywinski; 3M 1988)). However, this and other methods involving detachable optical arrangements are not conveniently switchable, requiring as they do manual placement and removal of the film or other apparatus to change the display from the public to the private mode.
Methods of providing an electronically switchable privacy function are disclosed in GB2413394 (Sharp), WO06132384A1 (Sharp, 2005) and GB2439961 (Sharp). In these inventions, a switchable privacy device is constructed by adding one or more extra liquid crystal layers and polarisers to a display panel. The intrinsic viewing angle dependence of these extra elements can be changed by switching the liquid crystal electrically in the well-known way. Devices utilising this technology include the Sharp Sh851i and Sh902i mobile phones. These methods share the disadvantages that the additional optical components add thickness and cost to the display.
Methods to control the viewing angle properties of an LCD by switching the single liquid crystal layer of the display between two different configurations, both of which are capable of displaying a high quality image to the on-axis viewer are described in US20070040780A1 and GB 0721255.8. These devices provide the switchable privacy function without the need for added display thickness, but require complex pixel electrode designs and other manufacturing modifications to a standard display.
One example of a display device with privacy mode capability with no added display hardware complexity is the Sharp Sh702iS mobile phone. This uses a manipulation of the image data displayed on the phone's LCD, in conjunction with the angular dataluminance properties inherent to the liquid crystal mode used in the display, to produce a private mode in which the displayed information is unintelligible to viewers observing the display from an off-centre position. A key advantage of this type of method is that in the public mode, the display consists of, and operates as, a standard display, with no image quality degradation causes by the private mode capability. However, when in the private mode, the quality of the image displayed to the legitimate, on-axis viewer is severely degraded.
Improved schemes which, when in the private mode, manipulate the image data in a manner dependent on a second, masking, image, and therefore causes that masking image to be perceived by the off-axis viewer when the modified image is displayed, are given in GB2428152A1, WO2009110128A1, WO201134209 and WO201134208. These methods provide an electronically switchable public/private display with no additional optical elements required, minimal additional cost, and satisfactory privacy performance. However, as the methods all utilise the limited resolution of the human visual system by representing the main and side images using the average luminance produced by groups of adjacent pixels. Therefore, a resolution loss in the image display to the On-axis viewer is incurred.
It is therefore desirable to provide a high quality LCD display which has public and private mode capability, in which no modification to the LC layer or pixel electrode geometry is required from a standard display, has a substantially unaltered display performance (brightness, contrast resolution etc) in the public mode, and in the private mode has a strong privacy effect with minimal degradation to the on-axis image quality, particularly with regard to resolution loss incurred in the private mode.
PTL 1: USRE27617
PTL 2: U.S. Pat. No. 4,766,023
PTL 3: U.S. Pat. No. 4,764,410
PTL 4: GB2413394
PTL 5: WO06132384A1
PTL 6: GB2439961
PTL 7: US20070040780A1
PTL 8: GB 0721255.8
PTL 9: GB2428152A1
PTL 10: WO2009110128A1
PTL 11: WO201134209
PTL 12: WO201134208
A first aspect of the invention provides a method of processing image data for display on a display device, the display device comprising a multi-primary image display panel, the method comprising: receiving image data constituting an image for display on the image display panel; and in a first mode, determining signal voltages to be applied to sub-pixels of the image display panel from the received pixel data and from a secondary data value for the pixel thereby to generate luminance variations perceivable at a first viewing position but substantially not perceivable at a second viewing position.
This mode of operation of the display device provides a private (narrow-view) display mode for the multi-primary image display panel (which is a display panel having pixels or sub-pixels of more than the standard three primary colours such as, for example, an RGBW or RGBY image panel). The luminance variations generated as a result of the secondary data values serve to obscure the image that would be generated if the received image data were the sole input, so that a viewer at the first viewing position (for example position 5 in
To the accomplishment of the foregoing and related ends, the invention, then, comprises the features hereinafter fully described and particularly pointed out in the claims. The following description and the annexed drawings set forth in detail certain illustrative embodiments of the invention. These embodiments are indicative, however, of but a few of the various ways in which the principles of the invention may be employed. Other objects, advantages and novel features of the invention will become apparent from the following detailed description of the invention when considered in conjunction with the drawings.
In the annexed drawings, like references indicate like parts or features:
In a first embodiment, the display consists of a standard (single wide-viewing (public) mode only), multiprimary (comprising four or more types of colour sub-pixel) LCD display, with modified control electronics. An LCD display generally consists of several component parts including:
1. A backlighting unit to supply even, wide angle illumination to the panel.
2. Control electronics to receive digital image data and output analogue signal voltages for each pixel, as well as timing pulses and a common voltage for the counter electrode of all pixels. A schematic of the standard layout of an LCD control electronics is shown in
3. A liquid crystal (LC) panel, for displaying an image by spatial light modulation, consisting of two opposing glass substrates, onto one of which is disposed an array of pixel electrodes and active matrix array to direct the electronic signals, received from the control electronics, to the pixel electrodes. Onto the other substrate is usually disposed a uniform common electrode and colour filter array film. Between the glass substrates is contained a liquid crystal layer of given thickness, usually 2-6 micro meter, which may be aligned by the presence of an alignment layer on the inner surfaces of the glass substrates. The glass substrates will generally be placed between crossed polarising films and other optical compensation films to cause the electrically induced alignment changes within each pixel region of the LC layer to produce the desired optical modulation of light from the backlight unit and ambient surroundings, and thereby generate the image.
An embodiment of the present invention is represented schematically in
The multi-primary LC panel, 2, will generally be configured with multiple LC domains per sub-pixel and/or passive optical compensation films so as to preserve the display gamma curve as closely as possible to the on-axis response for all viewing angles, thereby providing substantially the same high quality image to a wide viewing region, 4. However, it is an inherent property of liquid crystal displays that their electro-optic response is angularly dependent and the off-axis gamma curve will inevitably differ from the on-axis one. As long as this does not result in contrast inversion or large colour-shift or contrast reduction, this does not generally result in an obvious perceived fault in the observed image for the off-axis viewer, 5.
When the device of this embodiment is operating in the public mode, a set of main image data, 6, constituting a single image, is input to the control electronics, 1, in each frame period. The control electronics then outputs a set of signal data voltages to the LC panel, 2. Each of these signal voltages is directed by the active matrix array of the LC panel to the corresponding pixel electrode and the resulting collective electro-optical response of the pixels in the LC layer generates the image.
The control electronics has a single mapping of input pixel data value to output pixel data voltage (Look-up table 2, which it applies to the process for all pixels. In some cases a different look-up table may be used for the red, green and blue sub-pixels of the display, but there is no variation in the mapping of input data to output voltage based on the spatial position of the pixel data within the image, or the pixel electrode within the display. Substantially the same image is then perceived by the on-axis viewer, 3, and off-axis viewers, 5, and the display can be said to be operating in a wide viewing mode.
When the device is operating in the private mode, two image datasets are input to the control electronics, 1, in every frame period: main image data, 7, constituting a main image, and side image data, 8, constituting a side image.
The control electronics then outputs a set of signal data voltages, one data voltage for each pixel in the LC panel as previously. However, the control electronics (display controller) now utilises an expanded look-up table (LUT) and the output signal data voltage for each pixel in the LC panel, constituting a combined image, is dependent on the data values for the corresponding pixel (in terms of spatial position in the image) in both the main, 7, and side, 8, images. The output data voltage for each pixel may also be dependent on a third parameter determined by the spatial position of the pixel within the display.
In this way, the standard LCD control electronics are modified to receive, and store in a buffer, two, rather than one, images per frame period, and also to map the data values of two input images to a single output voltage per pixel, possibly also taking into account a third, spatially dependent, parameter into this mapping. In this case the mapping of input image data to output pixel voltage is no longer identical for all pixels, or even all sub-pixels of the same colour component, in the display.
The third, spatially dependent, parameter may be a “flag” value indicating which of two or more groups the pixel is deemed to be in based on its spatial position. For example, pixels in odd numbered columns in the image array may be said to form one group and pixels in even columns another. The groups could also constitute odd and even pixel rows, or perhaps the two parts of a chequerboard arrangement of the pixel array, etc.
The output voltage from the control electronics, 1, then causes the multi-primary LC panel, 2, to display a combined image which is the main image when observed by the main viewer, 3, with minimal degradation of the main image quality. However, due to the different gamma curve characteristic of the LC panel for the off-axis viewers, 5, these off-axis observers perceive the side image most prominently, which obscures and/or degrades the main image, securing the main image information to viewers within a restricted cone of angles centred on the display normal, 6. The modifications to the control electronics achieve this by altering the brightness of groups of two or more neighbouring sub-pixels of the same colour type from that specified by the main image data, so that while the group maintains a luminance the same or proportional to the overall or average luminance as specified by the main image data as observed by the on-axis viewer, 3, the distribution of luminance within the group is changed to a greater or lesser extent. For example, two sub-pixels of 50% luminance may have their luminance altered in equal and opposite directions, so they maintain the same average to the on-axis viewer, but their average luminance to the off-axis viewer, 5, changes as the degree of alteration is increased.
The invention so far described amounts thus makes it possible to apply the methods for producing a switchable privacy mode disclosed in GB2428152A1, WO2009110128A1, WO201134209 and WO201134208, applied to a multi-primary LCD panel, and the above noted applications are incorporated herein by reference. The remainder of this disclosure will concentrate on the optimal preferred means of applying the methods of the above applications to multi-primary displays in order to maximise main image quality in the private mode, as well as variations and developments on these methods designed to improve the performance of such privacy technology on multiprimary displays.
In a further embodiment, the display consists of a multiprimary display incorporating the modified control electronics described above, and in the aforementioned references, for providing a switchable privacy mode. In order to incorporate such a privacy mode, the modified control electronics would have to be expanded from those of the prior art to provide for processing of the extra colour sub-pixel data, over the standard RGB data. Such an expanded modified control electronic may take the form of those illustrated in
Note in this figure, the main image data, 7, input to the modified control electronics, 1, already consists of separate R, G, B and W channels. In most multiprimary displays, the display control electronics accept RGB data only, and the data for additional sub-pixels is generated using a gamut mapping algorithm or some other calculation. For the purposes of this disclosure, it will be assumed that this is the case (ie, that the display control electronics accept RGB data only), and the image data processing applied to produce the privacy effect is applied to each of the final number of colour channels separately. It may be the case though that the display is configured to accept data in an increased number of colour channels, or that the privacy processing is performed on the RGB data channels, and then the additional colour channel data generation process is modified to carry the privacy data processing through to the additional channels.
For simplicity, the embodiments described herein will be as pertaining to RGBW or RGBY multiprimary displays. It should be noted however, that the same embodiments, with minor modifications obvious to the reader skilled in the art, will be applicable to other four primary displays, such as an RGBG type layout, or displays with 5, 6 or more types of primary colour sub-pixel, such as large gamut RGBCMY displays.
As noted above, GB2428152A1, WO2009110128A1, WO201134209 and WO201134208 provide an electronically switchable public/private display by making use of the limited resolution of the human visual system by representing the main and side images using the average luminance produced by groups of adjacent pixels. Therefore, a resolution loss in the image display to the On-axis viewer is incurred. To prevent this, in the present embodiment, for an RGBW display, the spatial “flag” parameter may be configured so that for adjacent pixels, one pixel will have the brightness of the R, G and B sub-pixels increased, and the brightness of the W pixel decreased, while the other pixel will have the sub-pixel brightnesses modified in the opposite direction. In this way if the input luminances of the R, G, B and W pixels are equal, i.e. a greyscale image, and the W pixel provides luminance equal to the sum of the R, G and B pixel luminances at the same data values, then the change in luminance and chromaticity applied to the R, G and B sub pixels in total is equal and opposite to that applied to the W pixel, so no loss of resolution occurs. This effect is illustrated in
Even if the R, G, B and W values are not equal, the overall change in luminance incurred within a single pixel will be greatly reduced for most colours than the equivalent processing applied to an RGB only display, when altering the distribution of the same overall luminance between two or more sub-pixels of the same type. This reduced change in overall pixel luminance caused, for coloured main image input data, is shown in
In a further embodiment, for an RGBY display the spatial “flag” parameter may be configured so that for adjacent groups of sub-pixels, one group will have the brightness of the R and G sub-pixels increased, and the brightness of the B and Y sub-pixels decreased, while the other group will have the sub-pixel brightnesses modified in the opposite direction.
Although this does not result in privacy processing for greyscale images with no resolution loss, as is possible for an RGBW display, it does result in significantly reduced resolution loss in comparison to an RGB display As shown in
In a still further embodiment therefore, the pattern of modifications applied to each pair of pixels may be varied on a pair by pair basis, in order to select the pattern which most closely maintains the individual pixel luminances as prescribed by the main image data for each pair.
It can be seen however, that for some input colours, no pattern of modifications exists which allows the distribution of luminance within each pair of like sub pixels to be concentrated maximally in one sub-pixel of the pair, while maintaining the overall luminance of each whole pixel of the pair. In a still further embodiment, the sub-pixel data modifications are performed as described above to the R, G and B sub-pixels, so as to maximally concentrate the combined luminance of each pair of like sub-pixels in one of the pair. The luminance modification applied to the additional W or Y sub-pixel is then calculated so as to compensate for the change in overall pixel luminance incurred by the change to the R, G and B sub-pixels (or alternatively, for the case of an RGBY display, to compensate for the change in overall pixel luminance incurred by the change to the R and G sub-pixels only).
While for input data combinations for which it is not possible to maximally redistribute luminance between like sub-pixel pairs while maintaining overall individual pixel luminance, this will result in a change to the W or Y pixel values which does not maximally redistribute their combined luminance (and therefore does not maximise the privacy strength effect of the processing), it will ensure no resolution loss in the luminance domain is incurred. This is illustrated in
It may be the case that of the possible modification pattern applicable to the R, G and B sub-pixels, one will result in a modification to the W or Y sub-pixel according to the present method which results in a stronger privacy effect (i.e. more complete concentration of the combined W or Y pixel luminance within one pixel of the pair) In a further embodiment, the process identifies which pattern of modifications produces the optimum result according to this measure, and selects the be applied to each pair if pixels, on a pair-by-pair basis.
It may be noted that this method has the advantage that if the input data is such that the like sub-pixel luminances can be maximally redistributed for all types of sub-pixel, while maintaining the overall individual pixel luminances, this method will achieve that, i.e. if the input data is as shown in
It may also be the case that, for some input data colours, after maximal redistribution of the luminance of the R, G, and B pixels, the change in luminance required of the W or Y pixel may be beyond the achievable range (i.e. less than 0 or greater than 1, in the luminance notation used so far). It may be desirable, for simplification of the processing, to simply truncate these “overflow” values, and accept the resulting error in overall pixel luminance. In a further embodiment however, either the amount of luminance overflow is registered and returned to the R, G and B sub-pixels (by further varying the data values for the R, G and B sub-pixels to alter the overall luminance of the R, G and B sub-pixels to take up the “luminance overflow” that the W or Y pixel cannot provide) or the amount of modification applied to the R, G and B sub-pixels is limited to allow full compensation by the W or Y pixel.
In a still further embodiment, if an overflow is registered, a different pattern of modifications to the R, G and B pixels is selected which produces a different overall luminance change, which can be compensated for by changes to the W or Y pixel within the achievable range. It may be the case that, for each pair of pixels being processed, the method identifies the optimum pattern of modifications to the R, G, B and W or Y pixels for both the strength of the privacy effect, as described above, and for minimisation of overall luminance change, or the ability of the W or Y sub-pixels to be altered to compensate for the change in overall luminance applied to the R, G and B sub-pixels. It may however be the case that the sub-pixels are modified according to a standard pattern, and it is only in the case that that an “overflow” value is incurred in the calculation of modified values for the W or Y sub-pixel that other modification patterns are tested.
In a still further embodiment, the W or Y sub-pixel value is truncated, and the “overflow” value required of to maintain the original pixel luminance passed on the next pixel pair, or a another neighbouring pixel pair, to be taken account of in the calculation for that pair, in an error diffusion type process.
The process flow of these embodiments is illustrated in
It may be the case that, for the processes described in the above embodiments, if the input values of the pixels being modified are different for the two pixels in the pair, either the individual overall pixel luminance will not be maintained, or the overall chromaticity values of the pair will not be maintained. In still further embodiments, if the input values of the pixels of a pair differ by an amount exceeding a given threshold, then one of the luminance maintaining processes of the type illustrated in
It should be noted that, while the description of the above embodiments has concentrated on modification to the sub-pixel values which maximally concentrate the luminance of a pair of like sub-pixels in neighbouring pixels in one or the other of the sub-pixels, in order to maximise the strength of the privacy effect, it may also be the case that, depending on the side image data, a less than maximal redistribution may provide a more accurate match to the desired side image luminance at the corresponding position in the image. Indeed, WO2009110128A1 details a method using four pre-calculated degrees of modification for each input value to process images allowing four different off-axis brightnesses for each colour channel. All of the embodiments described herein could equally apply to methods in which varying degrees of modification are used to control off-axis image appearance.
In a still further embodiment, the intended position in a particular colour space, e.g. the CIEXYZ or CIELAB spaces for each pixel according to both the main image and side images is determined according to the main and side image input data. The combination of R, G B and W or Y sub-pixels which best satisfies the required positions in both images is selected. This method may be implemented in several different ways.
For each pixel in the display, a calculation may be performed in order to select the best combination of sub-pixel data values to satisfy both the main and side image requirements as the main and side image data is input to the display. In order to operate at video rate, this calculation would have to be fast however, and the number of sub-pixel data value combination to be considered may be prohibitive. It may be more practical to pre-calculate the On-axis and Off-axis colour space positions for each combination of R, G, B and W or Y Sub-pixel data values and store these results in a LUT for retrieval according to the main and side image data as this data is input to the display. However, again due to the number of sub-pixel data value combinations, the memory required for storage of such an LUT may be prohibitive. Process flows of these possible implementations are shown in
ΔE=√{square root over ((L1−L2)2+(a1−a2)2+(b1−b2))}{square root over ((L1−L2)2+(a1−a2)2+(b1−b2))}{square root over ((L1−L2)2+(a1−a2)2+(b1−b2))}. [Math.1]
Again, in the case that of the available metamers for selection, there are none which produce the target Off-Axis colour according to the side image data to within a satisfactory error, the best available metamer may be selected and the corresponding R′, G′ B′ and W′ or Y′ data values output to the panel, while the difference between the target and output metamer colour values may be stored, for inclusion in the calculation for the next, neighbouring pixel, in an error diffusion type process.
It should be noted that, in the above examples and associated figures, the pixel layout for the multiprimary display has been assumed to be of an RGBX stripe configuration, i.e. each pixel of the display consists of one each of an R, G, bad n W or Y type sub-pixel, in a side-by side arrangement, and that all pixels of the display have the same arrangement of sub-pixels. The methods described above are equally applicable to multiprimary displays in which the sub-pixel arrangement in each pixel is different from this, e.g. pixels with a 2×2 arrangement of sub-pixels are possible, as opposed to 4×1 stripe arrangements. Both 2×2 and 4×1 arrangements are also possible, in which the ordering of the R, G, B and W or Y pixels differs in some pixels compared to others, e.g. an (R, G, B, W), (R, W, B, G) pattern may be utilised. It may be that some of these patterns may be more advantageous than others for the application of the methods described herein, in terms of the macroscopic appearance of the modified pixel data, but application of the methods described to all possible sub-pixel arrangement patterns should be considered within the scope if this invention.
The methods of this invention are also applicable to multiprimary displays in which not all pixels of the display comprise one of each type of sub-pixel, or in which data is rendered onto the display with sub-pixel resolution. Examples of such displays, in which some types of colour sub-pixel are alternated spatially in the display pixels, or are shared between neighbouring pixels, and therefore the chromaticity resolution of the panel is different to the luminance resolution, are described in IMID'05 Digest pp 867-872 and the SID'08 Digest, pp 1112-1115, and are commonly known as “Pentile” type displays. Pentile type displays with a number of different configurations have been proposed and utilised on display devices, such an RGBW type Pentile patterns and RGBG type Pentile patterns.
In the case of the present methods being utilised on such a display, pairs of neighbouring sub-pixel of the same type may be identified for transfer of luminance between the two sub-pixels in the pair, even though the two may not be in what the display considers to be neighbouring whole pixel regions. The pattern of achieving this which is most straightforward (luminance transferred between pairs of nearest like sub-pixel types) and which results in a bright-dark sub-pixel pattern of the highest spatial frequency, and therefore smoothest macroscopic appearance, is shown in
However, if the pixel data modifications are made in this manner, and the main image consists of data rendered at a sub-pixel level, then colour artefacts can occur. This is illustrated in
In a further embodiment which avoids this problem, for Pentile type displays, a grouping of colour sub-pixels containing one of each type is defined for the purposes of the privacy processing, even if such a grouping does not constitute one conventional white pixel in the display. Such a grouping is illustrated in
In the case of the input main image comprising maximum spatial frequency vertical lines, this method results in a much improved retention of the initial high-spatial frequency pattern, while still allowing near-maximal alteration of the individual sub-pixels values except the blue type. This is shown in
In a further embodiment, a “virtual” grouping of each of the sub-pixel types is defined for the purposes of the privacy processing. Such a virtual grouping may comprise portions of two or more sub-pixels of one or more types, to collectively represent one whole sub-pixel. Such groupings are illustrated in
In a still further embodiment, the privacy processing is implemented on a Pentile type display and the pattern of modifications applied is the shown in
The advantages of this pattern are shown in
In a still further embodiment, the pattern of image data modifications may be reversed or otherwise altered temporally, as well as spatially in the image. For example the pattern may be reversed every frame or second frame at the video display rate. In this way, any visibility of the resulting modification patterns, particularly on low pixel resolution displays may be reduced. In these cases, the magnitude of the data modifications may also be calculated to take into account the switching response of the LC display, to ensure the desired overall luminance and chromaticity is produced by each image region of the display despite the rapidly switching pixel data values.
Although the invention has been shown and described with respect to a certain embodiment or embodiments, equivalent alterations and modifications may occur to others skilled in the art upon the reading and understanding of this specification and the annexed drawings. In particular regard to the various functions performed by the above described elements (components, assemblies, devices, compositions, etc.), the terms (including a reference to a “means”) used to describe such elements are intended to correspond, unless otherwise indicated, to any element which performs the specified function of the described element (i.e., that is functionally equivalent), even though not structurally equivalent to the disclosed structure which performs the function in the herein exemplary embodiment or embodiments of the invention. In addition, while a particular feature of the invention may have been described above with respect to only one or more of several embodiments, such feature may be combined with one or more other features of the other embodiments, as may be desired and advantageous for any given or particular application.
A first aspect of the invention provides a method of processing image data for display on a display device, the display device comprising a multi-primary image display panel, the method comprising: receiving image data constituting an image for display on the image display panel; and in a first mode, determining signal voltages to be applied to sub-pixels of the image display panel from the received pixel data and from a secondary data value for the pixel thereby to generate luminance variations perceivable at a first viewing position but substantially not perceivable at a second viewing position.
This mode of operation of the display device provides a private (narrow-view) display mode for the multi-primary image display panel (which is a display panel having pixels or sub-pixels of more than the standard three primary colours such as, for example, an RGBW or RGBY image panel). The luminance variations generated as a result of the secondary data values serve to obscure the image that would be generated if the received image data were the sole input, so that a viewer at the first viewing position (for example position 5 in
The method may comprise, in a second mode, determining signal voltages to be applied to sub-pixels of the image display panel from the received pixel data thereby to generate an image perceivable at the first viewing position and at the second viewing position. This mode provides a wide-view (public) display mode. Switching between the first (private) mode and the second (public) mode may be effected by, for example, use of a “Privacy mode On/Off” signal as shown in
The method may comprise, in the first mode, determining signal voltages to be applied to sub-pixels of the image display panel so as to minimise a change in overall luminance of a pixel to a viewer at the second viewing position. This minimises degradation of the image seen at the second viewing position. By a “change in luminance to a viewer at the second viewing position” is meant the difference in luminance seen by the viewer in the first mode for different values of the secondary data value being applied, i.e. the dependence of the luminance of a pixel to a viewer at the second position on the secondary data value).
The method may comprise, in the first mode, determining signal voltages to be applied to sub-pixels of the image display panel such that the signal voltage for a first sub-pixel of a first pixel of the image display panel is changed in an opposite direction to the signal voltage for a second sub-pixel of the first pixel. Referring to a signal voltage for a sub-pixel being “changed” means that the signal voltage generated for a sub-pixel in the first mode for one value of the secondary data values not the same as the signal voltage that would have been generated for that sub-pixel in the first mode for a second value of the secondary data value, and a “change” in the signal voltage for a sub-pixel refers to the difference between the signal voltage generated for a sub-pixel in the first mode subject to one secondary data value and the signal voltage that would be generated for that sub-pixel in the first mode for a second value of the secondary data value (for the same main image data).
The image display panel may be an RGBW image display panel and the method may comprise, in the first mode, determining signal voltages such that the signal voltage for a white sub-pixel of the first pixel is changed in an opposite direction to the signal voltages for red, green and blue sub-pixels of the first pixel.
The image display panel may bean RGBY image display panel and the method may comprise, in the first mode, determining signal voltages such that the signal voltage for a yellow sub-pixel of the first pixel is changed in an opposite direction to the signal voltages for at least red and green sub-pixels of the first pixel.
The method may comprise, in the first mode, determining signal voltages to be applied to sub-pixels of the image display panel such that the signal voltage for a first sub-pixel of a second pixel of the image display panel is changed in an opposite direction to the signal voltage for a first sub-pixel of the first pixel, the first pixel being adjacent to the second pixel.
The method may comprise determining signal voltages to be applied to sub-pixels of the image display panel separately for each pixel pair.
The method may comprise, in the first mode, determining the signal voltage to be applied to a sub-pixel having the greatest luminance contribution so as to compensate for differences in luminance of other sub-pixels between the first mode and the second modes.
The method may comprise, in the first mode, determining the signal voltage to be applied to a white sub-pixel so as to compensate for differences in luminance of red, green and blue sub-pixels between the first mode and the second modes.
The method may comprise, in the first mode, determining the signal voltage to be applied to a yellow sub-pixel so as to compensate for differences in luminance of red, green and blue sub-pixels between the first mode and the second modes, or to compensate for differences in luminance of red and green sub-pixels between the first mode and the second modes.
The method may comprise, in the first mode, determining signal voltages to be applied to sub-pixels of the image display panel thereby to substantially maximise luminance variations perceivable at the first viewing position.
The method may comprise, in the first mode: determining signal voltages to be applied to sub-pixels not having the greatest luminance contribution; determining the signal voltage to be applied to a sub-pixel having the greatest luminance contribution so as to compensate for differences in luminance of other sub-pixels between the first mode and the second modes; checking whether the determined signal voltage to be applied to a sub-pixel having the greatest luminance contribution exceeds a threshold voltage; and, if the determined signal voltage exceeds the threshold, setting the signal voltage to be applied to the sub-pixel having the greatest luminance contribution to be equal to the threshold voltage.
The method may comprise, if the determined signal voltage to be applied to a sub-pixel having the greatest luminance contribution exceeds the threshold, taking this into account when determining signal voltages to be applied to sub-pixels of a subsequent pixel.
The method may comprise, in the first mode: determining signal voltages to be applied to sub-pixels not having the greatest luminance contribution; determining the signal voltage to be applied to a sub-pixel having the greatest luminance contribution so as to compensate for differences in luminance of other sub-pixels between the first mode and the second modes; checking whether the determined signal voltage exceeds a threshold voltage; and, if the determined signal voltage exceeds the threshold, re-determining the signal voltages to be applied to sub-pixels not having the greatest luminance contribution.
The method may comprise, in the first mode, determining whether the difference in pixel data between two pixels exceeds a threshold; if so, determining whether the signal voltages determined for the sub-pixels of the pixels lead to a change in overall chrominance of the two pixels have been modified; and if so, re-determining the signal voltages determined for the sub-pixels of the pixels to reduce the change in overall chrominance of the two pixels, while leaving the overall luminance in each pixel unchanged. Again, the term “change in overall chrominance” refers to the difference between the chrominance that would be generated by applying the signal voltages determined in the first mode with one possible value of the secondary data value and the chrominance that would be generated by applying the signal voltages that would be determined in the first mode with a different possible value of the secondary data value (for same image data).
The method may further comprise, if the determined signal voltages to be applied to the sub-pixels result in a change in chrominance, taking this into account when determining signal voltages to be applied to sub-pixels of a subsequent pixel.
The method may comprise, in the first mode, determining whether the difference in pixel data between two pixels exceeds a threshold; and applying a method as defined above to the two pixels only if the difference in pixel data between the two pixels exceeds the threshold. The “pixel data” for a pixel are the set of input values for the sub-pixels of that pixel, so determining whether pixel data for two pixels differ by more than a threshold value may for example involve determining whether any of the input values for each colour differ by more than a threshold, or whether e.g. at least two or more of the inputs for like sub-pixels differ by more than a threshold. Alternatively, it may involve the determining whether some calculated value of an overall difference between two pixels, for example based on weighted differences between the inputs for like sub-pixels of the two pixels, exceeds a threshold.
The method may comprise, in the first mode: determining colour space values for a pixel for the pixel data for that pixel; determining colour space values for the pixel for the secondary data value for that pixel; and determining signal voltages to be applied to sub-pixels of the pixel on the basis of the colour space values.
The method may comprise: for a group of pixels in the image, calculating metamers for the pixels which have, to within an error threshold, the same average luminance and chrominance and which have the same individual luminance for each pixel in the group as the input data; and selecting one of the metamers based on the calculated luminance variations perceivable in the first part of the first viewing angle range for the metamers.
The previous method (that is, involving the determination of colour space values) determines output voltages for each pixel based on inputs for that pixel only. In contrast, this method considers inputs from more than one pixel and this allows greater scope for luminance redistribution by requiring only that the luminance of individual pixels is accurate (that is, each individual pixel has the luminance that would be given by the input mage data in the absence of the secondary data). The chrominance of individual pixels may be chosen freely, as long as the average chrominance of the pixels is accurate. Thus, as an example it is possible to calculate metamers for a pair of pixels, or for a block of 4 pixels—the individual pixels are restricted to having the correct luminance, but the chrominance is restricted only in that the average chrominance for the pair of pixels, or for the block of 4 pixels, is correct.
The method may comprise taking account of any error in the selected metamer for a pair of pixels when selecting a metamer for a next pair of pixels. By “error” is meant a difference between the luminance and/or chrominance that would be generated by the signal voltages corresponding to the selected metamer and the luminance and/or chrominance that would be generated by the signal voltages that would have been obtained just from the input data for the pixels.
The method may comprise, in the first mode, defining virtual pixels, at least one sub-pixel being shared between two neighbouring virtual pixels.
The different between a voltage applied to a sub-pixel in the first mode and the voltage applied to the sub-pixel in the second mode changes polarity every N frames. For example, N may be 1, or N may be 2, corresponding to a reversal after every frame or after every 2 frames respectively.
In the first mode, signal voltages to be applied to sub-pixels of a pixel of the image display panel may be determined from the received pixel data, from a secondary data value for the pixel, and from a parameter indicating the location of the pixel.
A second aspect of the invention provides a control circuit for a multi-primary display panel, the control circuit being adapted to perform a method of the first aspect. The processing of the image data to obtain the signal voltages may be carried out by a control circuit that is separate from the display panel, such as the LCD control electronics of
A third aspect of the invention provides display comprising a control circuit of the second aspect and a multi-primary display panel, the control circuit being adapted to, in use, output the modified sub-pixel colour component data values to the multi-primary display panel.
A fourth aspect of the invention provides a multi-primary display panel adapted to perform a method of the first aspect. In this aspect processing of the image data to obtain the signal voltages is carried out within the display panel, so that the display panel receives the image data and generates the required signal voltages.
A fifth aspect of the invention provides a computer-readable medium containing instructions which, when executed by a processor, cause the processor to perform a method of the first second aspect.
The embodiments of this invention are applicable to many display devices where four or more sub-pixel colour types are present in the display, and a user may benefit from the option of a privacy function on their normally wide-view display for use in certain public situations where privacy is desirable. Examples of such devices include mobile phones, Personal Digital Assistants (PDAs), laptop computers, desktop monitors, Automatic Teller Machines (ATMs) and Electronic Point of Sale (EPOS) equipment. Such devices can also be beneficial in situations where it is distracting and therefore unsafe for certain viewers (for example drivers or those operating heavy machinery) to be able to see certain images at certain times, for example an in car television screen while the car is in motion.
| Number | Date | Country | Kind |
|---|---|---|---|
| 1118683.0 | Oct 2011 | GB | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/JP2012/006862 | 10/25/2012 | WO | 00 |
| Publishing Document | Publishing Date | Country | Kind |
|---|---|---|---|
| WO2013/061598 | 5/2/2013 | WO | A |
| Number | Name | Date | Kind |
|---|---|---|---|
| RE27617 | Olsen | Apr 1973 | E |
| 4764410 | Grzywinski | Aug 1988 | A |
| 4766023 | Lu | Aug 1988 | A |
| 20030146893 | Sawabe | Aug 2003 | A1 |
| 20050264580 | Higgins | Dec 2005 | A1 |
| 20070040780 | Gass et al. | Feb 2007 | A1 |
| 20070146608 | Jin et al. | Jun 2007 | A1 |
| 20070296874 | Yoshimoto | Dec 2007 | A1 |
| 20070296900 | Hong | Dec 2007 | A1 |
| 20090058873 | Brown Elliott et al. | Mar 2009 | A1 |
| 20090289968 | Yoshida | Nov 2009 | A1 |
| 20100214324 | Broughton et al. | Aug 2010 | A1 |
| 20100277498 | Elliott et al. | Nov 2010 | A1 |
| 20120299982 | Inada | Nov 2012 | A1 |
| Number | Date | Country |
|---|---|---|
| 2 413 394 | Oct 2005 | GB |
| 2 428 152 | Jan 2007 | GB |
| 2 439 961 | Jan 2008 | GB |
| 2 455 061 | Jun 2009 | GB |
| 2003-0065393 | Aug 2003 | KR |
| 2008-0000497 | Jan 2008 | KR |
| 2008-0011659 | Feb 2008 | KR |
| WO 2006132384 | Dec 2006 | WO |
| WO 2009110128 | Sep 2009 | WO |
| WO 2011034157 | Mar 2011 | WO |
| WO 2011034208 | Mar 2011 | WO |
| WO 2011034209 | Mar 2011 | WO |
| WO 2011102321 | Aug 2011 | WO |
| Entry |
|---|
| International Search Report for corresponding International Application No. PCT/JP2012/006862 mailed Jan. 22, 2013. |
| Form PCT/ISA/237 for corresponding International Application No. PCT/JP2012/006862 dated Jan. 22, 2013. |
| Stokes et al “A standard default color space for the internet—sRGB” v.1.10, Nov. 5, 1996 available at http://www.w3.org/Graphics/Color/SRGB.html on Feb. 11, 2014. |
| “Specification fos sRGB”, (Specified in IEC 61966-2-1:1999). |
| Ernst Lueder, Liquid Crystal Displays, Wiley and sons Ltd, 2001, p. 239. |
| K. Yoshiyama et al., “19.5L: Late-News Paper: A New Advantage of Multi-Primary-Color Displays”, SID'10 Digest, pp. 281-282. |
| Thomas L. Credelle et al., “High-Pixel-Density PenTile Matrix RGBW Displays for Mobile Applications”, IMID '05 Digest, pp. 867-872. |
| C.H. Brown et al, “72.1: Invited Paper: PenTile RGBW Colow Processing”, SID'08, Digest, pp. 1112-1115. |
| K. Tomizawa et al., “Invited Paper: Extending the Applications of Multi-Primary Color LCDs”, Proceedings of the IDW'09, 2009, pp. 1199-1202. |
| Number | Date | Country | |
|---|---|---|---|
| 20140210878 A1 | Jul 2014 | US |
