The present invention is related generally to the art of confidential viewing of display images. More particularly, the present invention is directed to a confidential viewing apparatus and method which utilizes techniques of spatial multiplexing image modification to mask or neutralize a fundamental display image and render it indecipherable to the naked eye, whereby image decoding is available only to the intended viewer.
With the increasing use of video displays for a variety of systems, such as those used in desktop computers, laptop computers, televisions, and personal video entertainment systems, there exists an increasing need and desire to provide confidential viewing of these displays by only those who the displayed content is intended for, thus eliminating the possibility of unauthorized viewing.
Various devices have been introduced over the years to prevent unauthorized viewing of video displays. The simplest devices generally include a form of “anti-glare” privacy screen and/or hoods and shields. These devices are commonly found on desktop computer displays which are intended to restrict viewing to only those who are more or less directly in front of the display. While these are somewhat effective, they cannot prevent viewing by someone peering over ones shoulder, and thus are far from secure.
Other devices have been developed which seek to obscure the view of a fundamental image from an unintended viewer by introducing a “masking image.” One such device is discussed in U.S. Pat. No. 5,614,920, which utilizes a flashing screen of light placed between the video display and the viewer to obscure the fundamental image. Confidential viewing is provided by utilizing time synchronized shutter glasses to block the pulses of light and permit viewing of the fundamental image.
Other similar devices are disclosed in U.S. Pat. Nos. 5,537,476, and 5,619,219. These devices provide secure viewing of a display by introducing a secondary masking light or set of “primary” colors, that are wavelength-shifted from that used to generate the fundamental image. Secure viewing is provided by viewing the composite image through specially formulated narrow-band filtered glasses, which block the wavelength-shifted image, allowing the fundamental image to pass.
Still other devices utilize principles of “time multiplexing” to intermix a masking image with the fundamental image, thereby obscuring its view from the public. Such systems usually alternate display frames of masking and fundamental images, and utilize time synchronized shutter eyewear to decode the fundamental image. These systems, however, suffer inherently from display flicker problems, and often incorporate video “flash” frames which tend to be irritating to the eye. For this reason, such time multiplexing systems are better suited for a cathode ray tube (CRT) display, which can operate at significantly faster refresh rates than a typical liquid crystal display (LCD). Examples of this type of system can be found in U.S. Pat. Nos. 5,629,984; 5,963,371; as well as Japanese Patent No. 05119754 JP.
More sophisticated Confidential viewing systems are disclosed in my two co-pending U.S. patent application Ser. Nos. 10/205,864 and 10/205,866, the contents of which are incorporated herein by reference thereto. Like those previously described, these systems involve applications of image multiplexation over time. However, in this case, principles of color inversion are employed, whereby the fundamental image is encoded by time multiplexing itself with an appropriately determined inverted image in such manner as to produce a neutral, substantially featureless compound image that may be decoded only with properly synchronized eyewear.
In these systems, to provide more enhanced security, the respective color components of the fundamental image may be encoded sequentially, thereby requiring more complicated synchronized variable color-filter decoding eyewear. Such systems are highly secure and do function to reduce irritating display flicker and eye strain, since at least one color component of the fundamental image is always displayed. However, such systems still utilize concepts of time multiplexing and, although they can be used with LCD's, are probably better suited for high speed conventional CRT displays at this time.
The LCD, however, due to its flat screen, thin profile, high resolution, and low power consumption, has become the display of choice for use with most portable laptop computers, where incidentally, the need for confidential viewing is likely to be the greatest. In this regard, some devices more specific to the LCD have been introduced which seek to provide confidential viewing by removing the top polarizing layer of the LCD screen. This renders the display “invisible” except to those wearing polarized glasses. U.S. Pat. No. 5,488,496, issued Jan. 30, 1996, discusses one such device. Although somewhat effective, this system of confidential viewing is vulnerable in that anyone wearing properly polarized glasses, even ordinary Polaroid glasses, can view the hidden image. Additionally, the screen is not easily converted between confidential and normal viewing modes. Other devices of this general type are believed to be disclosed in Japanese Patent Nos. 07084253 JP; 04107524 JP; 02116826 JP; and 05173127 JP.
With the limitations of the prior art, particularly with respect to the popular LCD, it is apparent that a better means is necessary for providing simple, low cost confidential viewing which can be used in all applications of full color/full motion graphics and images. Moreover, in order to better accommodate confidential viewing of today's LCD, it is desirous to accomplish this objective while avoiding the use of high speed time multiplexing techniques, or cumbersome, cost-intensive supplemental and/or wavelength-shifted masking light sources.
It is believed that my improved image altering apparatus and method as described hereafter accomplishes this end while minimizing the cost of implementation and greatly enhancing the viewing security of video displays today.
In accordance with the present invention, an apparatus and method are described herein for providing confidential viewing of a display image by utilizing techniques of spatial multiplexing image modification.
In general, the concept of spatially multiplexing images involves the process of geometrically combining a fundamental image with another image on an image display device. If combined with the appropriate image, spatial multiplexing image modification can be used for purposes of masking the fundamental image. A periodic (or random) array of squares, rows, columns, etc., may be removed from the fundamental image and substituted with corresponding sections of a masking image, thereby generating a combined image which obscures the fundamental image from view with the naked eye.
While it is contemplated that the masking image can be of any composition capable of rendering the fundamental image indecipherable, in one embodiment of my invention, the fundamental image is geometrically combined on an image display device with its true color-inverted image to produce a combined neutral image that appears substantially featureless to the naked eye. This is accomplished by spatially multiplexing fundamental and inverse image components on an image display device so as to associate with separate but closely adjacent display regions thereof. As used herein and throughout the appended claims, the term “adjacent,” when used in reference to the display regions of an image display device, is intended to mean nearby, but not necessarily having a common border.
These display regions to which the fundamental and inverse image components correspond are generally associated with, or may comprise, one or more pixels, or sub-pixels, of a static or dynamic image display device. As such, they are generally microscopic in size and are of sufficiently small compass that the human eye has difficulty distinguishing therebetween. The fundamental and inverse image components are therefore mixed, neutralizing the fundamental image and rendering it virtually invisible to the naked eye.
Creating such a-spatially multiplexed neutral image requires modification of the original fundamental image to incorporate the corresponding inverse image components. Generally, for each fundamental image component utilized, there is required a corresponding derived inverse image component; thus, each inverse image component requires displacement of an original fundamental image component from the fundamental image. The resulting combined image, then, is essentially comprised of a conglomeration of close, geometrically-intermixed corresponding fundamental and inverse image components that, when viewed as a whole with the naked eye, appears neutral and substantially featureless.
The multiplexed fundamental image components, albeit hidden from public view, are representative of the original fundamental display image. In order to provide confidential viewing of the fundamental image components, and thus the fundamental display image, the system is designed such that the display regions of the image display device with which the fundamental image components are associated are always cross-polarized (i.e., one polarization state blocks light admitted by the other) relative to the adjacent display regions with which the masking image components are associated. Thus, appropriately polarized eyewear matching the polarization state of the display regions with which the fundamental image components are associated will effectively block all masking image components and allow passage only of the fundamental image components for confidential viewing. While the combined multiplexed image renders the fundamental image indecipherable to the naked eye of the unintended viewer, an authorized viewer wearing the appropriately polarized eyewear will have full access to the fundamental image for confidential viewing.
Configuring the image display device with adjacent display regions of differing polarization states may be accomplished utilizing one of several techniques. In one embodiment, it is contemplated that a micropolarizing overlay or inlay having closely adjacent areas of differing polarization states be incorporated into the image display device. This may be accomplished using spatially alternating polarized filters, or by using alternating light retarders to rotate the polarization state of adjacent display regions. The micropolarizer is constructed and arranged such that the adjacent areas of different polarization align with various designated display regions/pixels of the image display device to alter the polarization state of such display regions to that of their correspondingly aligned areas of the micropolarizer.
In another embodiment, an electrically controllable polarizer can be incorporated in the image display device to alter the polarization state of the adjacent display regions. Such an electrically controllable polarizer may be used in static or dynamic display systems, and may take the form of a liquid crystal rotator added to the display configuration in such manner as to effectively rotate the polarization angle of transmitted light based on applied voltage thereto. For each display region of the image display device, the polarization angle can be set to rotate transmitted light either 0 or 90 degrees, depending on whether such display region is associated with fundamental or masking image components.
Utilizing an electrically controllable polarizer to alter the state of polarization of adjacent display regions offers certain advantages in enhanced security. With the ability to now change states of polarization of individual display regions of the image display device, it becomes possible to periodically or randomly alter the state of polarization of the display regions associated with the fundamental image components. Provided the polarized eyewear worn by the authorized viewer is synchronized to change states of polarization in unison with the display regions associated with the fundamental image components, the polarization of the eyewear will continue to match that of the fundamental image components, thereby enabling decoding of the fundamental image. In this embodiment, mere passive polarized eyewear may no longer be utilized to decode the fundamental image.
Notably, a similar effect may also be accomplished in an electronic display by periodically or randomly altering the display position of the fundamental image components to align with fixed areas of polarization different from that with which they were aligned in the previous display frame(s). In this embodiment, fundamental image components that are initially suppressed at pixel locations occupied by the masking image components are revived, and those fundamental image components previously displayed at other pixel locations become displaced by new masking image components. In this mariner, the physical display positions of the respective fundamental and masking image components are alternated or switched in synch with the display's refresh rate and in accordance with a predetermined or random sequence pattern.
Alternating the display positions of the fundamental and masking image components in this manner also has the distinct advantage of increasing image resolution by allowing recapture of the initially displaced fundamental image components. Rather than permanently displacing certain fundamental image components, adjacent fundamental image components may now be alternately displayed in any desired sequence, thereby allowing full resolution of the fundamental image to be restored.
Provided the polarized eyewear worn by the authorized viewer is synchronized to change states of polarization in unison with the change of position of the fundamental image components, the eyewear will still be polarized to match the display regions of the fundamental image components, thereby enabling same to be decoded. Again, mere passive polarized eyewear may no longer be utilized to decode the fundamental image.
Although less secure, it is also contemplated that the use of a variable polarizer could be combined to operate in synch with the alternating display positions of the fundamental image components, thereby providing a system that may be decoded using passive polarized eyewear with full resolution of the decoded fundamental image.
In the preferred embodiment where inverse image components are used to mask the fundamental image, more enhanced security may be obtained by adding to or incorporating as a part of the inverse image components overlay image components that are representative of a separate overlay image. By so doing, the fundamental image components are still neutralized by the corresponding inverse image components, but the general viewing public will now see a separate overlay image which may be either static or dynamic, such as in the case of a movie. The overlay image thus appears “on top” of the combined substantially featureless image, thereby deceiving unintended viewers into believing that a different image is being viewed by the system operator. However, since the overlay image components are incorporated as part of the inverse image components, they too will be blocked from the view of the authorized viewer wearing the appropriately polarized eyewear matching the polarization state of the display regions associated with the fundamental image components.
Although the above illustrations are exemplary of various means by which an image display device may be configured with closely adjacent display regions of differing polarization states, it is contemplated that any means of addressing different polarization states to adjacent display regions of the image display device may be utilized for purposes of implementing this invention.
As can be seen by the foregoing, through modification of the fundamental image, corresponding fundamental and masking image components may be spatially multiplexed for display in association with adjacent but cross-polarized display regions of an image display device. From this, with little or no display flicker, a highly secure combined image may be generated that will render the fundamental image indecipherable to the naked eye.
With appropriately polarized eyewear, this combined image may be demultiplexed for confidential viewing of the fundamental image. This is accomplished without the need for high speed multiplexing of image signals, or cumbersome, cost-intensive supplemental and/or wavelength-shifted masking light sources.
These and other objects and advantages of the invention will more fully appear from the following description, made in connection with the accompanying drawings, wherein like reference characters refer to the same or similar parts throughout the several views, and in which:
The present invention, as described and claimed herein, utilizes principles of spatial multiplexing image modification to provide for secure confidential viewing of a display image. While the concepts set forth herein are generally applicable to either electronic or printed images, the following discussion shall focus primarily on electronic images, such as those found on video displays. It shall be understood, however, that print media may be modified upon printing, using these same spatial multiplexing techniques, to mask a fundamental image from unauthorized viewing and provide for confidential viewing only by an intended viewer.
In order to better describe my invention, it is helpful to first explain briefly the concept of “primary color addition” as it pertains to light produced by video displays, and the response of the human eye with respect to the same. Virtually all common video displays, from color television and CRT displays, to LCD screens, plasma displays, etc., generate an image through the additive mixture of three primary colors of light: red; blue; and green. A video display typically has thousands of tiny areas, called pixels, that produce light of a specific color representative of an image at that specific location. Each pixel, in turn, is generally composed of a triad of smaller areas, or sub-pixels, consisting of tiny phosphors, color filters, or the like, which individually produce the primary colors red, blue, and green.
As one views a color image produced on a video display, the human eye does not detect each red, green, or blue sub-pixel separately. Rather, depending on the intensity of each primary color component, the color sensitive cones within the human eye react to the primary colors, such that one viewing the video display will see a range of many colors combined to produce the desired complete image. Thus, depending upon the varying intensities of light produced by each sub-pixel, the corresponding pixel will produce a composite light that appears as a different color to the human eye. If the intensities of all red, blue, and green components of a given pixel are the same, the human eye will perceive that the pixel produces a neutral white light. Nearly all electronically reproducible images are constructed in this manner.
For purposes of further discussion herein, as shown in
With reference to the instant invention, providing confidential viewing of a fundamental image through spatial multiplexing image modification involves the process of geometrically combining the fundamental image with another image for purposes of masking the fundamental image. A periodic (or random) array of squares, rows, columns, etc., may be removed from the fundamental image and substituted with corresponding sections of the masking image, thereby generating a combined image which obscures the fundamental image from view with the naked eye. When the images are constructed of pixels, this combining of images can be on either a pixel by pixel basis, or by groups of pixels.
While it is certainly contemplated that the masking image can be of any composition, it is preferred that it be derived from the original fundamental image, as in the case of an inverse image. An inverse image is one that, when combined with its fundamental image, yields a neutral and featureless image When spatially multiplexing a fundamental image with its inverse image, pixels of the fundamental image are spatially multiplexed with pixels of the inverted image.
This is perhaps shown best in
Creating such a spatially multiplexed image requires modification of the original fundamental image to incorporate the corresponding masking image components. With reference to the preferred embodiment utilizing inverse image components, for each fundamental image component (F) utilized, there is required a corresponding derived inverse image component (I); thus, each inverse image component requires displacement of an original fundamental image component from the fundamental image.
This modification of the fundamental image can be seen in
In
In much the same manner, in
In the above examples, the particular selection and arrangement of fundamental and inverse image components within the image display device 1 is not critical, provided the corresponding components are sufficiently close that the combined image adequately masks the fundamental image. Thus, it is conceivable that the display regions 3F associated with fundamental image components may be periodically or randomly distributed, or comprise either odd or even rows or columns of pixels, provided the display regions 3I with appropriate derived inverses thereto are adjacently located so as to be perceived by the naked eye as a combined substantially featureless image.
If utilizing inverse image components to mask the fundamental image, the intensity for each inverted sub-pixel corresponding to each sub-pixel in the fundamental image is calculated from;
I
MAX
−I
FUND
=I
INV,
where IMAX represents the maximum intensity of the particular sub-pixel in question, either red, green, or blue; IFUND represents the intensity of the particular fundamental sub-pixel in question; and IINV is the required intensity for the inverted sub-pixel in question. It will be appreciated that such calculation and modification of the fundamental image can be accomplished internally within an electronic display device using techniques well known in the art.
The combined, or multiplexed, image will now have the overall intensity of;
I
FUND
+I
INV=50% Gray,
and appear uniformly neutral and featureless.
In the foregoing illustrations, the multiplexed fundamental image components, albeit hidden from public view, are representative of the original fundamental display image. In order to provide confidential viewing of the fundamental image components, and thus the fundamental display image, polarization encoding is utilized to block the masking image components from the sight of the authorized viewer, thereby effectively extracting the fundamental image. Since it is deemed preferable to use fundamental inverse image components as the masking image components, the following discussion will focus on this embodiment. It will be understood, however, that the principles of polarization encoding discussed herein are not limited to this embodiment, or dependant in any way on the composition of the masking image components.
As shown in
Of course, it will be appreciated that it makes no difference how the respective display regions 3F and 3I are polarized, provided that they are cross-polarized relative to each other. Thus, if the display region 3F associated with each fundamental image component is polarized in one orientation, and the display region 3I associated with each inverted image component is polarized in an orthogonal orientation, the fundamental image may be easily extracted, or decoded, by viewing the combined image through appropriately polarized eyewear 27 constructed to match the state of polarization of the fundamental image components. In this way, the fundamental image can only be discerned by those wearing the appropriate eyewear 27.
Configuring the image display device with adjacent display regions of differing polarization states may be accomplished by either incorporating appropriate polarizers directly within the display pixels of an image display device 1, or by applying polarizing overlays thereto. In one embodiment, as shown in
The ½λ retarder plate 35 can be laminated to the standard front polarizer 37 of the LCD panel 1 and properly aligned to effectively rotate the polarization state of alternating pixel rows or display regions 3F and 3I associated with the fundamental and inverse image components on the LCD panel. In the embodiment shown in
Of course, it will be appreciated that the micropolarizers 29, 35 described in the above embodiments could equally well be constructed for column by column cross-polarizing alignment, pixel by pixel cross-polarizing alignment, or randomly, as previously suggested. So long as the areas of the micropolarizer that are aligned with the fundamental image pixels are polarized in a common state of polarization that is orthogonal or otherwise cross-polarized relative to the areas of the micropolarizer aligned with the inverse image pixels, appropriate eyewear 27 passively polarized to match the polarization state of those areas of the micropolarizer that are aligned with the fundamental image pixels may be used to decode the fundamental image.
It is noted that the use of a micropolarizer 29 having alternating polarized filters as in
In another embodiment, as shown in
In this embodiment, a second liquid crystal (LC) layer 42 is laminated to the front panel 37 of the LCD. This second LC layer 42 may be fabricated using known methods in the art, similar to the LCD, and is constructed having two electrically addressable zones 43 and 45. As shown in
Preferably, as shown in
Suspended between the inner and outer substrates 47 and 49 is the crystalline liquid 51, and depending on the voltage applied to the respective zones, the light passing through the crystalline liquid 51 at such location may be rotated so as to effect a change in polarization thereof. In
Notably, in
Although the aforementioned embodiments do provide for secure viewing of the fundamental image, they are secure only to the point of having the appropriate passive eyewear 27. More specifically, anyone wearing eyewear passively polarized to the same state of polarization as the display regions 3F associated with the fundamental image components would be able to decipher the underlying fundamental image. There are circumstances, however, where it is desirable to provide a higher level of security and a more confidential viewing environment.
One means of providing for enhanced security is to vary the polarization states of adjacent display regions 3F and 3I using the electrically controllable polarizer 40 described in
Provided the polarized eyewear worn by the authorized viewer is synchronized to change states of polarization in unison with the display regions 3F associated with the fundamental image components, the polarization of the eyewear will continue to match that of the display regions 3F associated with the fundamental image components, thereby enabling decoding of the fundamental image. In this embodiment, mere passive polarized eyewear may no longer be utilized to decode the fundamental image, and thus security is enhanced.
A higher level of security may also be obtained using active polarized eyewear in combination with the passive micropolarizer overlays 29, 35 previously described. To accomplish this, pixel position on an electronic display device can actually be made to alternate between display frames. In other words, the display position of the fundamental image components may be periodically or randomly altered to align with fixed areas of polarization different from that with which they were aligned in the previous display frame(s).
For example, shown in
Notably, in this embodiment, fundamental image components that are initially suppressed at pixel locations occupied by inverse image components are revived, and those fundamental image components previously displayed at other pixel locations become displaced by new inverse image components derived from the revived fundamental image components. This can be seen in
In order to decode the fundamental image in this case, active polarized eyewear 57 is required. These incorporate electrically variable polarizers synchronized with the display device 1. When the fundamental image components are horizontally polarized, so are the glasses, and when the fundamental image components switch to vertical polarization, so do the glasses. In this way, the intended viewer sees only the fundamental image, while all others see nothing. The active eyewear 57 can be made wireless as well, and also made to incorporate unique identification codes so that other active eyewear is unable to synchronize.
Another advantage of this active eyewear approach is recovered resolution. In previous embodiments, one half of the fundamental image data or pixels were suppressed to allow room for the inverse image components. For most applications, the typical resolution of an LCD screen is more than sufficient to accommodate this loss. But, for high resolution applications, it may be desirable to have full resolution, as well as a secure viewing environment. In the embodiment of
In still another more secure and preferable embodiment of my invention, principles of both spatial and time multiplexation can be combined to create an image encoding scheme that provides a highly secure and confidential viewing environment. As shown in
In the second display frame 61, all image components of the first display frame 59 are inverted. Thus, all odd rows of pixels now comprise the corresponding inverse image components of the original fundamental image components associated with that specific row (i.e., I11-I1N; I31-I3N, etc.). Likewise, all even rows of pixels now comprise fundamental image components associated with that specific row (i.e., F21-F2N; F41-F4N, etc.). As this inversion process continues over time, every fundamental image component at each pixel location is not only spatially multiplexed with an adjacent approximate inverse image component, but is also time multiplexed with its corresponding derived inverse image component. As in previous embodiments, it is contemplated that those pixels or groups of pixels associated with corresponding fundamental and inverse image components may be arranged by pixel rows (as shown), pixel columns, or even randomly distributed, as previously described.
Implementation of the encoding scheme in
The second display frame (Frame 2) of the fundamental image 65 is shown further broken down into a display 73 of “even row” fundamental image components (i.e., F21-F2N; F41-F4N, etc.) and a display 75 of “odd row” inverse image components (i.e., I11-I1N; I31-I3N, etc.) which, when combined, creates another relatively obscure spatially combined image 77 of fundamental and inverse image components that is the true inverse of the spatially combined image 71 of the first display frame.
Since the spatially combined images 71 and 77 are the true inverses of one another, alternating such images over time generates a resulting combined image 79 that appears substantially featureless and neutral to the naked eye, thereby masking the fundamental image from the sight of all unauthorized viewers. As described previously in connection with
Also, as in the embodiment of
Although less secure, it is also contemplated that the use of an electrically controllable polarizer 40 as described in
To provide an even more secure environment, overlay or misleading images may be incorporated. In systems utilizing masking inverse image components, such overlay components may be simply added to the derived inverse image components. Thus, casual observers will see something other than neutral gray, and something entirely different than the fundamental image. Since the overlay image components are incorporated as part of the displayed inverse image components, the dynamic range of the inverse image components must be compressed to allow for the addition of the overlay image. Consequently, in order to maintain neutrality of the background to the overlay image, the dynamic range of all corresponding fundamental image components must also be compressed proportionately to account for the addition of the overlay image. In other words, the dynamic range of the fundamental image must be reduced by the dynamic range of the overlay image to maintain complete masking of the fundamental image. With the overlay image components being added to the inverse image components, they too will be blocked from the view of an authorized viewer wearing the appropriately polarized eyewear matching the polarization state of the display regions associated with the fundamental image components.
When applied to print media, confidential images may be embedded within other misleading images. In much the same way as described above, the fundamental image pixels and the inverted image pixels are printed and then laminated with a micropolarized overlay. Now, viewing the fundamental image is only possible while wearing the appropriate eyewear.
As can be seen by the foregoing, through modification of the fundamental image, fundamental and masking image components may be spatially multiplexed for display in association with adjacent but cross-polarized display regions of an image display device. By utilizing masking “inverse” image components, a highly secure combined image may be generated that will appear neutral and substantially featureless to the naked eye, and if desired, misleading overlay images may be incorporated. With appropriately polarized eyewear, this combined image may be demultiplexed for confidential viewing of the fundamental image. As shown, this may be accomplished without the need for high speed multiplexing of image signals, or cumbersome, cost-intensive supplemental and/or wavelength-shifted masking light sources.
It will, of course, be understood that various changes may be made in the form, details, arrangement and proportions of the parts without departing from the scope of the invention which comprises the matter shown and described herein and set forth in the appended claims.
This application is an application for a patent which is also disclosed in Provisional Application Ser. No. 60/557,901, filed on Mar. 30, 2004 by the same inventor, namely David A. Struyk, and entitled “CONFIDENTIAL VIEWING SYSTEM UTILIZING SPATIAL MULTIPLEXING,” the benefit of the filing date of which is hereby claimed.
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/US2005/010807 | 3/30/2005 | WO | 00 | 4/13/2006 |
Number | Date | Country | |
---|---|---|---|
60557901 | Mar 2004 | US |