The present disclosure relates to an image display system including a plurality of image display devices having different device characteristics and an image display method.
PTL (Patent Literature) 1 discloses an interactive indoor show and a game system which are configured to provide an attractive and immersive multimedia show or presentation in a room. The system disclosed in PTL 1 includes a controller for selectively operating a display device, an image projector, an audio system (such as speakers), and other show components (a light source, fan, mechanical device, and the like).
PTL 1 is U.S. Pat. No. 10,004,984.
The system in PTL 1 includes a display and a projector. However, these devices have different device characteristics from each other. In this case, the “device characteristics” refer to the display characteristics of a device including the relationship between the illuminance of external light and the contrast (dynamic range) of an image by the image display device and the influence of chromaticity of external light on the chromaticity of an image by the image display device. Accordingly, depending on conditions such as external light, the continuity of contrast or chromaticity is not maintained between the two display images displayed by a display and a projector, and the sense of immersion in the show or game may be impaired.
The present disclosure provides an image display system and an image display method that improve the continuity between images displayed by image display devices in an image display system including a plurality of image display devices having different device characteristics.
An image display system according to the first aspect of the present disclosure causes a plurality of image display devices having different device characteristics to respectively display images. The image display system includes an external light detection device that detects external light and an image adjustment device that performs adjustment to make at least one of contrast, chromaticity, and luminance between the images displayed on the plurality of image display devices, the adjustment being performed based on device characteristics and detected external light.
An image display system according to the second aspect of the present disclosure causes a plurality of image display devices to respectively display images. The image display system includes an image adjustment device that, in a case in which a predetermined original image is divided into a plurality of images and the plurality of divided images are respectively displayed on the plurality of image display devices, displays the plurality of divided images to form one continuous original image when viewed from a viewpoint position of a user.
Therefore, according to the image display system of the present disclosure, it is possible to improve the continuity between display images by a plurality of image display devices having different device characteristics.
Hereinafter, exemplary embodiments will be described in detail with appropriate reference to the drawings. However, an unnecessarily detailed description such as a detailed description of already well-known matters and an overlapping description of substantially the same configuration will be sometimes omitted. This is to avoid an unnecessarily redundant description below and to facilitate understanding of a person skilled in the art.
Note that the attached drawings and the following description are provided for those skilled in the art to help sufficient understanding of the present disclosure, and are not intended to limit the subject matter as described in the appended claims.
(First Exemplary Embodiment)
A first exemplary embodiment will be described below with reference to
[1-1. Configuration]
With reference to
Media server 10 outputs the first image signal including the first image content to be displayed by projector 51 and the second image signal including the second image content to be displayed by display 52 to image adjustment device 20. Device characteristic database memory 30 includes a database that stores the characteristic data of projector 51 and display 52. In the present exemplary embodiment, device characteristic database memory 30 outputs external light contrast characteristics (to be described later), which are device characteristic data of projector 51 and display 52, to image adjustment device 20. Illuminance sensor 40 detects the current illuminance of external light on screen 60 and outputs illuminance data indicating the illuminance to image adjustment device 20.
Based on device characteristic data from device characteristic database memory 30 and illuminance data from illuminance sensor 40, image adjustment device 20 obtains contrast set values respectively corresponding to projector 51 and display 52 and outputs the contrast set values as first contrast information and second contrast information to projector 51 and display 52, respectively. These contrast set values are obtained such that the difference in contrast generated between the display images by projector 51 and display 52 is reduced. Furthermore, image adjustment device 20 outputs the first and second image signals from media server 10 to projector 51 and display 52, respectively. Projector 51 and display 52 change their own contrast set values based on the first contrast information and the second contrast information from image adjustment device 20. Further, projector 51 displays a first display image according to the first image signal from image adjustment device 20. Display 52 displays a second display image according to the second image signal from image adjustment device 20.
Note that first and second image contents are stored in an internal memory of media server 10 or acquired by media server 10 via a network (not illustrated). Further, device characteristic database memory 30 may be included in image adjustment device 20. Moreover, in order to acquire device characteristic data from device characteristic database memory 30, image adjustment device 20 may acquire identification codes or the like indicating devices from projector 51 and display 52 and request the device characteristic data of the corresponding devices.
With reference to
Correction value calculator 240 obtains the contrast set values of projector 51 and display 52 on the basis of the input device characteristic data and illuminance data so as to reduce the difference in contrast between the images displayed by projector 51 and display 52, outputs the first contrast information indicating the contrast set value of projector 51 to projector 51, and outputs the second contrast information indicating the contrast set value of display 52 to display 52.
[1-2. Operation]
An operation of image display system 1 having the above configuration will be described below.
Therefore, image adjustment device 20 corrects the contrast difference as follows based on the external light contrast characteristic from device characteristic database memory 30 and the illuminance data from illuminance sensor 40.
Specifically, correction value calculator 240 of image adjustment device 20 outputs the first contrast information indicating a contrast set value lower than a predetermined value to projector 51 that displays first display image 71 having a higher contrast than second display image 72 by display 52 at the current illuminance. Since projector 51 decreases the contrast set value in accordance with the input first contrast information, the contrast of first display image 71 by projector 51 decreases and approaches the contrast of second display image 72 on display 52. In this case, the contrast set value of the first contrast information to be output to projector 51 is set to such a value that the contrasts of the display images by projector 51 and display 52 substantially coincide with each other. As a result, as illustrated in
Note that correction value calculator 240 may set a predetermined lower limit value to the contrast set value in order to prevent the display image itself from being unclear due to an excessive decrease in the contrast set value of the image display device.
[1-3. Effects and Others]
As described above, in the present exemplary embodiment, based on the illuminance of the external light detected by the external light detection device, image display system 1 changes the contrast set value of each image display device such that a difference in contrast between two display images is reduced between two image display devices having different external light contrast characteristics. This reduces a difference in contrast generated between the two display images and improves continuity in contrast between the two display images.
(Second Exemplary Embodiment)
(1) As an external light detection device, a camera sensor 40A is provided instead of illuminance sensor 40.
(2) Device characteristic database memory 30A outputs an external light chromaticity characteristic instead of the external light contrast characteristic to correction value calculator 240A of image adjustment device 20A as device characteristic data.
(3) Correction value calculator 240A is provided instead of correction value calculator 240. With reference to
As illustrated in
A chromaticity correction operation of image display system 1A will be described with reference to
With reference to
Accordingly, as illustrated in
Specifically, correction value calculator 240A calculates the first and second correction values for shifting the color as described above on the basis of device characteristic data (including the external light chromaticity characteristic) from device characteristic database memory 30A and external light information from camera sensor 40A and outputs the first and second correction values to first and second image converters 251 and 252, respectively. In response to this, first and second image converters 251 and 252 shift the chromaticities of the image signals input from first and second input buffers 211 and 212 by the first and second correction values and then output the corrected first and second image signals to projector 51 and display 52 via first and second output buffers 231 and 232, respectively. As a result, projector 51 and display 52 display two display images with improved continuity regarding chromaticity. Note that first and second image converters 251 and 252 of image display system 1A according to the present exemplary embodiment may further correct and convert the contrasts of first and second display images 71 and 72. Consequently, similarly to the first exemplary embodiment, the difference in contrast generated between two first and second display images 71 and 72 can be reduced, and the continuity concerning contrast can also be improved.
(Third Exemplary Embodiment)
(1) Image adjustment device 20B is provided instead of image adjustment device 20, and image adjustment device 20B further includes image divider 260.
(2) Media server 10 outputs an integrated image signal including one piece of integrated image content to image divider 260 of image adjustment device 20B.
(3) Image divider 260 divides the integrated image content included in the input integrated image signal into two image contents and outputs the image contents as image signals to first and second input buffers 211 and 212.
(4) Image adjustment device 20 B further includes first and second image converters 251B and 252B and includes correction value calculator 240B instead of correction value calculator 240.
However, in a case in which display 52 and screen 60 overlap as illustrated in
In
Based on the positional relationship among projector 51, screen 60, display 52, and the predetermined viewpoint position of the user 80, image adjustment device 20B divides and outputs an integrated image content such that display 52 and mask region 92 just overlap with each other when viewed from user 80. Specifically, first, image divider 260 divides the integrated image content included in an integrated image signal from media server 10 into a region to be displayed on display 52 and a region to be displayed on projection region 91 of screen 60 via projector 51.
On the basis of the positional relationship among projector 51, screen 60, display 52, and a predetermined viewpoint position of user 80, correction value calculator 240B obtains a first correction value, which is a parameter for deforming the first image content for allowing mask region 92 to just overlap display 52 as viewed from user 80, and outputs the first correction value to first image converter 251B. The deformation includes translation and scaling in a planar direction of screen 60 and geometric transformation such as trapezoidal deformation. First image converter 251B deforms the first image content to be displayed by projector 51 in accordance with the first correction value from correction value calculator 240B and outputs the first image content to projector 51 via first output buffer 231.
Correction value calculator 240B obtains the second correction value that is the shift amount in the vertical direction and the horizontal direction of the second image content and outputs the second correction value to second image converter 252B. Second image converter 252B shifts the second image content to be displayed on display 52 in accordance with the second correction value from correction value calculator 240B. In the present exemplary embodiment, since the second image content to be displayed on display 52 is not shifted, the second correction value is 0, and second image converter 252B outputs the second image signal from second input buffer 212 without any change.
Further, image adjustment device 20B performs contrast correction on the divided first and second image contents similarly to the first exemplary embodiment and outputs the first and second image signals to projector 51 and display 52. Note that the division boundary may be a predetermined boundary line obtained in advance on the basis of the positional relationship among projector 51, screen 60, display 52, and a predetermined viewpoint position.
(Fourth Exemplary Embodiment)
(1) Viewpoint sensor 90 is further provided.
(2) Image adjustment device 20C including image divider 260A is provided instead of image adjustment device 20B including image divider 260.
Viewpoint sensor 90 detects the position of the viewpoint of user 80 and transmits the viewpoint position data to image divider 260A of image adjustment device 20C. Image divider 260 A divides an image on the basis of viewpoint position data. A specific dividing operation will be described below.
Accordingly, image divider 260A of image adjustment device 20C divides the integrated image content included in the integrated image signal from media server 10 on the basis of the viewpoint position of user 80. This content is divided into a region to be displayed on display 52 and a region to be displayed on current projection region 91 of screen 60 on the basis of the positional relationship among projector 51, screen 60, display 52, and the viewpoint of user 80. Two specific examples of this division will be described with reference to
7 (second exemplary embodiment) to image adjustment device 20C and deforming the first image content to be displayed by projector 51 so as to shift to the right in accordance with the correction value obtained by correction value calculator 240 based on the detected viewpoint position of user 80. When the image contents divided and corrected in this way are displayed through projector 51 and display 52, user 80 can observe the continuous image of first display image 71 and second display image 72 as illustrated in part (c) of
In this manner, viewpoint sensor 90 detects the viewpoint position of user 80, and image adjustment device 20C converts the image content or divides the integrated image content on the basis of the detected viewpoint position, thereby reducing the deviation between first and second display images 71 and 72 by projector 51 and display 52 and improving the continuity of the display image. Although the present exemplary embodiment has exemplified only the case in which the viewpoint moves to the left, similar correction can be performed for the movement of the viewpoint position including upward and downward movement, leftward and rightward movement, forward and backward movement, and combinations of them.
Fifth Exemplary Embodiment
(1) Screen 60 T has transparency and is closer to user 80 than display 52 is.
First display image 71 from projector 51 is projected on projection region 91 of transparent screen 60T. Second display image 72 displayed on display 52 is transmitted through transparent screen 60T and is observed by user 80.
In image display system 1D in
(Other Exemplary Embodiments)
The first to fifth exemplary embodiments each have been described above as an example of the technique disclosed in the present disclosure. However, the technique of the present disclosure is not limited to these exemplary embodiments, and also applicable to other exemplary embodiments that undergo modifications, replacements, additions, and omissions, for example, as appropriate. A new exemplary embodiment can also be made by combining the respective components described in the exemplary embodiments above. Accordingly, other exemplary embodiments will be exemplarily described below.
The first to fifth exemplary embodiments have exemplified two devices that are projector 51 and display 52 as the plurality of image display devices having different characteristics. However, the present disclosure is not limited to this, and a number of image display devices may be any number of two or more, or at least some of the image display devices may have the same device characteristics. For example, the image display system may include one display, one projector, and two spotlight projectors.
The image display system according to the present disclosure may include one display and two projectors. For example, in the image display system illustrated in
In addition, in each of the first to fifth exemplary embodiments, the image display system may include another display placed at the position of screen 60 instead of projector 51 and screen 60. In this case, first display image 71 may be displayed in mask region 92.
In each of the first to fifth exemplary embodiments, when first display image 71 and second display image 72 are superimposed and displayed in the mask region, first display image 71 may be displayed in the mask region.
Furthermore, each of the first to fifth exemplary embodiments has exemplified the case in which illuminance sensor 40 or camera sensor 40A is disposed at the upper portion on screen 60. However, the position of illuminance sensor 40 or camera sensor 40A is not limited to the position on screen 60, and illuminance sensor 40 or camera sensor 40A may be built in display 52, for example.
Further, the first and second exemplary embodiments each have exemplified the method for improving the continuity of the contrast and the chromaticity between a plurality of image display devices having different characteristics. However, instead of or in addition to contrast and chromaticity, luminance continuity may be improved. In this case, the device characteristic data in the device characteristic database includes an external light luminance characteristic indicating the influence of the luminance of external light on the luminance of a display image.
As described above, the exemplary embodiments have been described as examples of the technique of the present disclosure. In addition, for this purpose, the accompanying drawings and the detailed description have been provided.
Therefore, in order to illustrate the above techniques, the components described in the accompanying drawings and the detailed description can include not only components necessary to solve the problem but also components not necessary to solve the problem. Therefore, it should not be immediately construed that these components that are not essential are essential just because these components that are not essential are described in the accompanying drawings and the detailed description.
Since the above-described exemplary embodiments are intended to exemplify the technique according to the present disclosure, various modifications, replacements, additions, and omissions can be made within the scope of the appended claims or of their equivalents.
The present disclosure can be applied to an image display system including a plurality of image display devices having different device characteristics.
Number | Date | Country | Kind |
---|---|---|---|
2019-038338 | Mar 2019 | JP | national |
Number | Name | Date | Kind |
---|---|---|---|
10004984 | Voris et al. | Jun 2018 | B2 |
20020167531 | Baudisch | Nov 2002 | A1 |
20050134525 | Tanghe | Jun 2005 | A1 |
20130147365 | Takahashi | Jun 2013 | A1 |
20160180812 | Choi et al. | Jun 2016 | A1 |
20160202758 | Peana | Jul 2016 | A1 |
20180117465 | Voris et al. | May 2018 | A1 |
Number | Date | Country |
---|---|---|
2008-216427 | Sep 2008 | JP |
2010-231931 | Oct 2010 | JP |
2013-140780 | Jul 2013 | JP |
2013-238793 | Nov 2013 | JP |
2016-126229 | Jul 2016 | JP |
2017-181592 | Oct 2017 | JP |
Entry |
---|
International Search Report dated Jun. 2, 2020 in corresponding International Application No. PCT/JP2020/007296. |
Number | Date | Country | |
---|---|---|---|
20210397400 A1 | Dec 2021 | US |
Number | Date | Country | |
---|---|---|---|
Parent | PCT/JP2020/007296 | Feb 2020 | US |
Child | 17466572 | US |