The entire disclosure of Japanese Patent Application No. 2010-257572, filed Nov. 18, 2010 is expressly incorporated by reference herein.
1. Technical Field
The present invention relates to a display device that displays images, a method of controlling the display device, and a program.
2. Related Art
In recent years, a so-called OSD display function has been known, in which a display device displaying an input image displays a menu screen or the like to be superimposed on the image being displayed. JP-A-2008-216460 discloses a device capable of displaying an OSD image of various colors by combining the colors of the OSD image in units of pixels.
Moreover, in recent years, display devices that display 3D (stereo) images have been known. Display devices of this kind display stereoscopic images by showing different images to the right and left eyes of a viewer by using a configuration (for example, see JP-A-7-284128) which uses polarized glasses or a configuration (for example, see JP-A-5-304685) in which lenticular lenses are disposed on a display surface.
However, when applying a 3D image display method to the display of OSD images, how the display was to be realized was a problem which was not solved. In the related art, when displaying OSD images, it is a common practice to superimpose an OSD image stored in advance on an input image similarly to the display device described above. However, unlike a planar (2D) image, a 3D image is composed of pairs of right and left-eye images, and a technique on how to superimpose the OSD image on each of the right and left-eye images is not known. In addition, a technique which uses a 3D image as the OSD image itself is not known.
An advantage of some aspects of the invention is to solve at least part of the problems described above and the invention can be implemented as the following forms or aspects.
An aspect of the invention is directed to a display device including: an image acquisition unit that acquires a left-eye image and a right-eye image based on an input image; a storage unit that stores an OSD image; an OSD image acquisition unit that acquires at least one of a left-eye OSD image and a right-eye OSD image based on the OSD image stored in the storage unit; an image combination unit that superimposes the OSD images acquired by the OSD image acquisition unit on the left and right-eye images acquired by the image acquisition unit to thereby generate an image; and a display unit that displays the image generated by the image combination unit.
According to the above aspect of the invention, it is possible to display the OSD image so as to be superimposed on an image including the left and right-eye images. In this case, when the same image is used as the left and right-eye OSD images, only the OSD image can be displayed as a 2D image. When a pair of images with parallax is used as the left and right-eye OSD images, the OSD image can be displayed in 3D. In this way, it is possible to display the OSD image effectively by combining the 3D image and the OSD image.
According to the above aspect of the invention, it is possible to display the left and right-eye OSD images so as to be superimposed on the input 3D image appropriately so as to correspond to the image format of the input 3D image.
According to the above aspect of the invention, it is possible to reliably discriminate the left and right-eye images input alternately and to display the left and right-eye OSD images so as to be superimposed on the input 3D image appropriately.
According to the above aspect of the invention, when the input image is a 2D image, it is possible to generate the left and right-eye images based on the 2D image and to display the left and right-eye OSD images so as to be superimposed on the respective images. Thus, even when the input image is a 2D image, it is possible to display the OSD image in 3D and to effectively display the OSD image.
According to the above aspect of the invention, since the left and right-eye OSD images which are stored in advance are read and superimposed, it is possible to quickly execute the process of superimposing the OSD image.
According to the above aspect of the invention, it is possible to display a 2D OSD image by using the left and right-eye OSD images which are stored in advance in order to display the OSD image in 3D.
According to the above aspect of the invention, it is possible to display the OSD image in 3D with a small storage capacity.
By executing the control method according to another aspect of the invention, it is possible to display the OSD image so as to be superimposed on an image including the left and right-eye images. In this case, when the same image is used as the left and right-eye OSD images, only the OSD image can be displayed as a 2D image. When a pair of images with parallax is used as the left and right-eye OSD images, the OSD image can be displayed in 3D. In this way, it is possible to display the OSD image effectively by combining the 3D image and the OSD image.
By allowing a computer to execute the program according to still another aspect of the invention, it is possible to display the OSD image so as to be superimposed on an image including the left and right-eye images. In this case, when the same image is used as the left and right-eye OSD images, only the OSD image can be displayed as a 2D image. When a pair of images with parallax is used as the left and right-eye OSD images, the OSD image can be displayed in 3D. In this way, it is possible to display the OSD image effectively by combining the 3D image and the OSD image.
According to the above aspects of the invention, it is possible to superimpose the OSD image on an image including the left and right-eye images to display the OSD image as a 2D image or a 3D image. Moreover, it is possible to effectively display an OSD image by combining a 3D image and an OSD image.
The invention will be described with reference to the accompanying drawings, wherein like numbers reference like elements.
Hereinafter, embodiments of the invention will be described with reference to the drawings.
The projector 1 is capable of displaying both still images and moving images (video images). In the following description, a case of displaying and outputting moving images input from the image supply device will be described as an example. That is, in the following description, the process of displaying an input image can be equally applied to a case of displaying still images.
In the present embodiment, the screen SC is approximately vertical, and the screen surface has a rectangular shape. The images input to the projector 1 may be both moving images (video images) and still images, and the projector 1 is capable of projecting a video onto the screen SC and continuously projecting still images onto the screen SC.
The projector 1 mainly includes a display unit 40 (display unit) that forms an optical image and an image processing system that electrically processes the video signal input to the display unit 40. The display unit 40 includes an illumination optical system 41, a liquid crystal panel 42, and a projection optical system 43. The illumination optical system 41 includes a light source which is formed of a xenon lamp, an ultrahigh-pressure mercury lamp, an LED, or the like. Moreover, the illumination optical system 41 may include a reflecting mirror and an auxiliary reflecting mirror that guide light emitted from the light source to a liquid crystal panel 42. Furthermore, the illumination optical system 41 may include a lens array (not shown) and a polarizing plate for enhancing the optical properties of projection light or may include a dimmer that attenuates the intensity of light emitted from the light source on an optical path along which the light arrives at the liquid crystal panel 42.
The liquid crystal panel 42 receives signals from the image processing system described later and forms images on the panel surface. The liquid crystal panel 42 is composed of three liquid crystal panels corresponding to the three primary colors of RGB in order to realize color projection. Thus, the light from the illumination optical system 41 is separated into color light components of the three colors RGB, and the respective color light components enter the respective liquid crystal panels. The color light components modulated after passing through the respective liquid crystal panels are combined by a combination optical system such as a cross dichroic prism and output to the projection optical system 43.
The projection optical system 43 includes a zoom lens that adjusts the zooming and focusing of an image to be projected, a motor for adjusting the degree of zooming, and a motor for adjusting the focusing. The projection optical system 43 projects and images an incident light modulated by the liquid crystal panel 42 onto the screen SC using the zoom lens.
The display unit 40 is connected to a projection optical system driver 18 that drives the respective motors of the projection optical system 43 in accordance with the control of the controller 11 and a light source driver 19 that drives the light source of the illumination optical system 41 in accordance with the control of the controller 11.
The image processing system is mainly composed of the controller 11 that controls the overall operation of the projector 1 in an integrated manner, and includes a storage unit 12 that stores data processed by the controller 11 and programs executed by the controller 11, an input processor 13 that detects operations input through an operation panel 51 and a remote light receiver 52, a display controller 15 that processes an input video image, and a liquid crystal panel driver 17 that drives the liquid crystal panel 42 based on the video signal output from the display controller 15 to thereby perform drawing.
The controller 11 controls the respective constituent elements of the projector 1 by reading and executing a control program stored in the storage unit 12. The controller 11 detects the content of an operation performed by a user based on an operation signal input from the input processor 13 and controls the display controller 15, the liquid crystal panel driver 17, the projection optical system driver 18, and the light source driver 19 to thereby project a video image onto the screen SC.
Moreover, the storage unit 12 includes an OSD image memory 3 (storage unit) for storing image data of an OSD image in addition to a storage area for storing the control program and data described above.
The operation panel 51 includes various switches for allowing the user to perform operations and an indicator lamp is arranged on the main body of the projector 1. The operation panel 51 is connected to the input processor 13, and the input processor 13 causes the indicator lamp of the operation panel 51 to be appropriately switched on and off based on the operation state or setting state of the projector 1 in accordance with the control of the controller 11. When a switch of the operation panel 51 is operated, an operation signal corresponding to the operated switch is output from the input processor 13 to the controller 11.
Moreover, the projector 1 includes a remote control 5 used by the user. The remote control 5 includes various buttons and transmits an infrared light signal in correspondence to the operations of these buttons. The remote light receiver 52 for receiving the infrared light signal emitted by the remote control 5 is arranged on the main body of the projector 1. The remote light receiver 52 decodes the infrared light signal received from the remote control 5, generates an operation signal indicating the content of the operation in the remote control 5, and outputs the operation signal to the controller 11.
The display controller 15 is connected to the external image supply device (not shown). The display controller 15 generates a display signal based on the input video image signal input from the image supply device in accordance with the control of the controller 11 and outputs the display signal to the liquid crystal panel driver 17.
Moreover, the display controller 15 includes a display mode selector 21 that selects a display mode of the OSD image in accordance with the control of the controller 11, an image determiner 22 (determining unit) that performs determination on the input video image, an image reader 23 (OSD image acquisition unit) that reads the OSD image from the OSD image memory 3 in accordance with the result of the determination by the image determiner 22, and an image combiner 24 (an image acquisition unit and an image combination unit) that combines the OSD image and the input video image by superimposition to thereby generate a display video image.
The display mode selector 21 selects whether the OSD image will be displayed as a 2D image or a 3D image in accordance with the control of the controller 11. Whether the OSD image will be displayed in 2D or 3D is determined based on the operation of the input processor 13, the preconfiguration or the like.
The image determiner 22 determines whether the input video image is a 3D video image or a 2D video image, and determines the video format of the input video image when the input video image is a 3D video image. Examples of the format of the 3D video image include a line alternative format, a frame sequential format, a side-by-side format, and the like. When the input video image is a 3D video image, the image determiner 22 determines whether the respective frames or lines of the 3D video image are right-eye images or left-eye images.
When the display mode selector 21 has selected 3D display as the display mode of the OSD image, the image reader 23 reads the left-eye OSD image 31 and the right-eye OSD image 32 from the OSD image memory 3 and outputs the images to the image combiner 24. Moreover, when the display mode selector 21 has selected 2D display as the display mode of the OSD image, the image reader 23 reads only the left-eye OSD image 31 from the OSD image memory 3 and outputs the image to the image combiner 24.
The image combiner 24 performs a process of superimposing the OSD image input from the image reader 23 on the input video image. Here, when the image determiner 22 has determined that the input video image is a 3D video image, the image combiner 24 superimposes the OSD image on the input video image so as to match the video format of the 3D video image determined by the image determiner 22.
A 3D video image of the line alternative format is an image in which a right-eye image and a left-eye image are alternately arranged in units of horizontal lines. In order to correspond to this image, the image reader 23 reads and outputs one line of left-eye OSD images 31 from the memory A of the OSD image memory 3 to the image combiner 24, and subsequently, reads and outputs one line of right-eye OSD images 32 from the memory B of the OSD image memory 3 to the image combiner 24. By repeatedly performing this operation, the image reader 23 alternately outputs the left-eye OSD image 31 and the right-eye OSD image 32. The image combiner 24 combines the left and right-eye OSD images 31 and 32 alternately input in units of lines from the image reader 23 to generate an OSD image 33 shown in
Moreover, the vertical resolution of the input video image of the line alternative format is compressed to half so that a pair of left and right-eye frames is combined so as to have a size corresponding to one frame. Thus, the image combiner 24 performs a process of inserting horizontal lines to increase the vertical resolution in order to break down the input video image into left-eye frames and right-eye frames. The image combiner 24 may superimpose the OSD image 33 after performing the process of interpolating horizontal lines of the input video image and may perform the process of interpolating the horizontal lines of the display image 101 in which the OSD image 33 is superimposed. It is desirable to superimpose the OSD image 33 after performing the process of interpolating the horizontal lines of the input video image because it is not necessary to convert the resolution of the left and right-eye OSD images 31 and 32, and the amount of computation can be suppressed.
The image combiner 24 draws and expands the right and left-eye frames in an internal frame memory (not shown) based on the display image 101 and outputs the right and left-eye frames alternately to the liquid crystal panel driver 17. In this way, the right and left-eye frames are alternately projected onto the screen SC in a switching manner. Thus, a person wearing polarized glasses, for example, can see an OSD image superimposed on the input video image.
A 3D video image of the frame sequential format is an image in which a right-eye frame and a left-eye frame are alternately input in units of frames. Thus, the image reader 23 reads left-eye OSD images 31 from the memory A of the OSD image memory 3, reads right-eye OSD images 32 from the memory B, and outputs these left and right-eye OSD images 31 and 32 alternately to the image combiner 24.
As shown in
The image combiner 24 draws and expands the left and right-eye display images 111 and 112 in an internal frame memory (not shown) and outputs the right and left-eye display images alternately to the liquid crystal panel driver 17. In this way, the right and left-eye frames are alternately projected onto the screen SC in a switching manner. Thus, a person wearing polarized glasses, for example, can see an OSD image superimposed on the input video image.
A 3D video image of the side-by-side format is an image in which right and left-eye frames are arranged in the lateral direction and compressed so as to have a size corresponding to one frame. Thus, the image reader 23 reads left-eye OSD images 31 from the memory A of the OSD image memory 3, reads right-eye OSD images 32 from the memory B, generates an OSD image 34 in which these left and right-eye OSD images 31 and 32 are arranged in the horizontal direction, and outputs the OSD image 34 to the image combiner 24.
Moreover, the horizontal resolution of the input video image of the side-by-side half format is compressed to half so that a pair of left and right-eye frames is combined so as to have a size corresponding to one frame. Thus, the image combiner 24 performs a process of inserting pixels of the respective lines to increase the horizontal resolution in order to break down the input video image into left-eye frames and right-eye frames. The image combiner 24 may superimpose the OSD image 34 to generate the display image 121 after performing the process of interpolating pixels and may perform the process of interpolating pixels of the display image 121 in which the OSD image 34 is superimposed. It is desirable to superimpose the OSD image 34 to generate the display image 121 after performing the process of interpolating pixels because it is not necessary to convert the resolution of the left and right-eye OSD images 31 and 32, and the amount of computation can be suppressed.
As shown in
The image combiner 24 draws and expands the right and left-eye frames in which the OSD image is superimposed in an internal frame memory (not shown) based on the display image 121 and outputs the right and left-eye frames alternately to the liquid crystal panel driver 17. In this way, the right and left-eye frames are alternately projected onto the screen SC in a switching manner. Thus, a person wearing polarized glasses, for example, can see an OSD image superimposed on the input video image.
As such, when the input video image is a 3D video image, the projector 1 superimposes the left and right-eye OSD images 31 and 32 on the left and right-eye frames of the 3D video image, respectively, and projects the left and right-eye frames onto the screen SC. In this way, it is possible to display the OSD image on the 3D video image.
Here, the left and right-eye OSD images 31 and 32 and the OSD images 33 and 34 generated based on these images have an opaque background. Although it is also possible to display the OSD image semi-transparently so that the image on the background of the OSD image can be seen through, if the background of the OSD image is seen through, the images on the background of the OSD image may appear to be shifted in the left and right frames due to the difference in the parallaxes of the background image and the OSD image. As a result, there is a possibility of causing an unnatural effect on the visibility of the 3D video image. Thus, in the present embodiment, an opaque OSD image is projected onto the screen SC in a superimposed manner so that both the background 3D image and the OSD image can be visible satisfactorily.
The left-eye OSD image 31 illustrated in
Moreover, the projector 1 of the present embodiment displays only the left-eye OSD image 31 so as to be superimposed on the input video image when the user instructs to display a 2D OSD image by operating the remote control 5 or the operation panel 51. A display pattern of this case will be described with reference to
In the example of
In the example of
The use of such a display pattern enables a viewer to easily see the characters in the OSD image without wearing polarized glasses. Thus, this display pattern is particularly useful when operating the remote control 5 without wearing polarized glasses. Naturally, a person wearing polarized glasses can also see the OSD image satisfactorily. The display pattern shown in
In the screen shown in
In the example of
The display controller 15 of the projector 1 causes the image determiner 22 to determine whether an input image is a 3D video image or a 2D video image (step S11). When the input image is a 3D video image, the image determiner 22 also checks the image format (such as a line alternative format, a frame sequential format, or a side-by-side format), and determines whether the data being input is a data of left-eye frame or a data of right-eye frame. The determination result is output from the image determiner 22 to the image reader 23 and the image combiner 24.
Subsequently, the content of operations by the user relating to the display of the OSD image, input through the remote control 5 or the operation panel 51 is acquired and analyzed by the controller 11 (step S12). The controller 11 determines whether the OSD image will be displayed in 3D or 2D based on the content of the operations (step S13). When displaying the OSD image in 3D (step S13: Yes), the image reader 23 acquires both the left and right-eye OSD images 31 and 32 from the OSD image memory 3 (step S14).
Subsequently, the image combiner 24 determines whether the input video image is a 3D video image or not based on the result of the determination by the image determiner 22 (step S15). When the input video image is a 3D video image, the left and right-eye OSD images 31 and 32 are superimposed on the left and right-eye frames of the input video image, respectively (step S16). On the other hand, when the input video image is not a 3D video image (step S15: No), the image combiner 24 duplicates the frames of the input video image and uses one of the frames as the left-eye frame and the other frame as the right-eye frame (step S17) and performs the process of step S16. After that, the image combined by the image combiner 24 is input to the liquid crystal panel driver 17, and the liquid crystal panel driver 17 draws the image on the liquid crystal panel 42, and the image is projected onto the screen SC (step S18).
Moreover, when the OSD image is not displayed in 3D (step S13: No), the image reader 23 acquires only the left-eye OSD image 31 from the OSD image memory 3 (step S19). Subsequently, the image combiner 24 determines whether the input video image is a 3D video image or not based on the result of the determination by the image determiner 22 (step S20). When the input video image is a 3D video image, the left-eye OSD image 31 is superimposed on the left and right-eye frames of the input video image, respectively (step S21). On the other hand, when the input video image is not a 3D video image (step S20: No), the image combiner 24 superimposes the left-eye OSD image 31 on the input video image (step S22). After that, in step S18, the image combined by the image combiner 24 is input to the liquid crystal panel driver 17, and the liquid crystal panel driver 17 draws the image on the liquid crystal panel 42, and the image is projected onto the screen SC.
As described above, the projector 1 according to the embodiment to which the invention is applied includes the OSD image memory 3 that stores an OSD image to be superimposed on an input video image, the image reader 23 that acquires the left and right-eye OSD images 31 and 32 based on the OSD image stored in the OSD image memory 3, the image combiner 24 that acquires the left and right-eye frames from the input video image and superimposes the left and right-eye OSD images 31 and 32 acquired by the image reader 23 on the left and right-eye frames of the input video image to thereby generate a 3D display image, and the display unit 40 that displays the 3D display image generated by the image combiner 24. The projector 1 is capable of displaying the OSD image so as to be superimposed on an image including the left and right-eye frames. In this case, when the same image is used as the left and right-eye OSD images 31 and 32, only the OSD image can be displayed as a 2D image. When a pair of images with parallax is used as the left and right-eye OSD images 31 and 32, the OSD image can be displayed in 3D. In this way, it is possible to display the OSD image effectively by combining the 3D image and the OSD image.
The display controller 15 of the projector 1 further includes the image determiner 22 that determines the image format (such as a line alternative format, a frame sequential format, or a side-by-side format) of the input 3D image when a 3D image including a pair of left and right-eye frames is input as the input video image. In this case, the image combiner 24 superimposes the left and right-eye OSD images 31 and 32 acquired by the image reader 23 on the left and right-eye frames of the input video image in correspondence to the image format determined by the image determiner 22 to thereby generate the 3D display image. Thus, it is possible to display the left and right-eye OSD images 31 and 32 so as to be superimposed on the input 3D image appropriately in correspondence to the image format of the input 3D image.
Moreover, when a pair of left and right-eye frames is alternately input as the input video image, the image determiner 22 determines whether the frame of the image input alternately is a left-eye frame or a right-eye frame. The image combiner 24 superimposes the left-eye OSD image 31 on the left-eye frame determined by the image determiner 22 and superimposes the right-eye OSD image 32 on the right-eye frame determined by the image determiner 22 to thereby generate the 3D display image. Thus, it is possible to reliably discriminate the left and right-eye frames input alternately and to display the left and right-eye OSD images 31 and 32 so as to be superimposed on the input 3D image appropriately.
Moreover, when the input video image is a 2D image, the image combiner 24 duplicates the 2D image to generate two images of the same content to acquire one of the frames as the left-eye frame and the other frame as the right-eye frame. Thus, even when the input video image is a 2D image, it is possible to display the OSD image in 3D and to effectively display the OSD image.
Furthermore, the OSD image memory 3 stores the left and right-eye OSD images 31 and 32 in advance, and the image reader 23 reads and superimposes the left and right-eye OSD images 31 and 32 stored in advance. Thus, it is possible to quickly execute the process of superimposing the OSD image.
Moreover, the image combiner 24 determines whether the input video image is a 3D video image based on the result of the determination by the image determiner 22. When the input image is a 2D image, the left-eye OSD image 31 stored in the OSD image memory 3 is read and displayed so as to be superimposed on the input image. Thus, it is possible to display a 2D OSD image by using the left-eye OSD image 31 which is stored in advance in order to display the OSD image in 3D.
In the above embodiment, a configuration in which the left and right-eye OSD images 31 and 32 are stored in the OSD image memory 3, the left and right-eye OSD images 31 and 32 are used when displaying the OSD image in 3D, and only the left-eye OSD image 31 is displayed when displaying the OSD image in 2D has been described as an example. However, the invention is not limited to this, and a 2D OSD image may be stored in the OSD image memory 3 in addition to the left and right-eye OSD images 31 and 32. Moreover, a reference OSD image may be stored in the OSD image memory 3 in a format such that the positions of the background and the characters can be individually adjusted, the left and right-eye OSD images may be generated based on the reference OSD image and used when displaying the OSD image in 3D, and a 2D OSD image may be generated from the reference OSD image and displayed when displaying the OSD image in 2D. In this case, it is possible to display the OSD image in 3D with a small storage capacity.
Moreover, in the above embodiment, a configuration in which when the input video image is a 2D video image, and the OSD image is displayed in 2D, the left-eye OSD image 31 stored in the OSD image memory 3 is read (step S19 in
The embodiment described above is just an example of a specific mode, to which the invention is applied, and does not restrict the invention, but the invention can be applied in other modes different from the embodiment. Moreover, in the above embodiment, a configuration in which the display unit 40 uses three transmissive or reflective liquid crystal panels 42 corresponding to the respective colors of RGB as a modulator that modulates light emitted from the light source has been described. However, the invention is not limited to this, and for example, the modulator may be a system which uses a liquid crystal panel and a color wheel, a system which uses three digital mirror devices (DMD), or a DMD system which uses a digital mirror device and a color wheel are combined. Here, when only one liquid crystal panel or a DMD is used as the modulator, a constituent member corresponding to a combination optical system such as a cross dichroic prism is not necessary. Moreover, besides the liquid crystal panel and the DMD, any configuration which is capable of modulating light emitted from the light source can be used. Moreover, in the above embodiment, a configuration in which the image combiner 24 performs the superimposition process depending on whether the format of the input video image determined by the image determiner 22 is the line alternative format, the frame sequential format, or the side-by-side format has been described as an example. However, the format of the input video image is not limited to the above example, and the image determiner 22 may determine the frame rate or the resolution of the input video image, and the image combiner 24 may perform other processes depending on the determination result.
Furthermore, in the above embodiment, a configuration in which the display controller 15 processes the input video image input from the external image supply device and superimposes and projects the OSD image on the input video image has been described. However, the invention is not limited to this, and an image supply device such as an external personal computer connected to the projector 1 may execute the process of superimposing the OSD. In this case, the image supply device may include the functions of the controller 11, the storage unit 12, and the display controller 15 of the projector 1. Moreover, the invention may be implemented as a program executed by such a device. In such a configuration, the projector 1 may project images input from the image supply device onto the screen SC.
Furthermore, the display device of the invention is not limited to the projector that projects video images onto the screen SC. The display device of the invention includes various display devices such as a liquid crystal monitor or a liquid crystal TV that displays images or videos on a liquid crystal display panel, a monitor device or a television receiver that displays images or videos on a plasma display panel (PDP), or a self-emission display device of a monitor device or a TV receiver that displays images or videos on an organic EL display panel commonly called an organic light-emitting diode (OLED), an organic electro-luminescence (OEL), or the like. In this case, the liquid crystal display panel, the plasma display panel, and the organic EL display panel correspond to the display unit.
Moreover, the respective functional units of the projector 1 shown in
Number | Date | Country | Kind |
---|---|---|---|
2010-257572 | Nov 2010 | JP | national |