This application claims the benefit of Japanese Priority Patent Application JP 2018-221719 filed Nov. 27, 2018, the entire contents of which are incorporated herein by reference.
The present disclosure relates to a display control apparatus, a display control method, and a display control program. Specifically, the present disclosure relates to control of image display using a projector.
In general, a display such as a liquid crystal monitor is used for image display. Alternatively, instead of the display, a projector that projects an image on a screen or a wall can also be used for image display. Some projectors are ultra-short focus projectors that enable projection from a distance of a few centimeters, for example. Such projectors are capable of performing projection at various places, and thus, it is relatively easy to operate them.
For example, as a technology related to image display, there is known a technology of locally changing the characteristics of a projected image.
PTL 1: WO 2016/098600
In accordance with an existing technology, it is possible to increase the expressive power of the projected image and improve visibility by change characteristics such as luminance and resolution in the target area.
However, in the existing technology, it is difficult to suppress the presence of a display medium such as a screen. In the case of using a projector, there is a need to prepare a wall or screen for projecting an image. Therefore, the presence of the wall or screen increases as an image is displayed on a larger screen although it is not as large as a display case. Note that there are products such as a transparent screen that is usually transparent and displays an image only when light is applied thereto from a projector. Such products have a problem that it becomes difficult to see an image depending on the strength of the ambient light due to being transparent.
Therefore, the present disclosure proposes a display control apparatus, a display control method, and a display control program capable of realizing image display that does not cause a user to feel a sense of oppression while ensuring visibility of an image under external light.
According to an aspect of the present disclosure, there is provided an apparatus including circuitry configured to control a transmissivity of a transparent screen and a brightness an image projected on the transparent screen, based on characteristics of an environment proximate to the transparent screen.
According to another aspect of the present disclosure, there is provided a method including controlling a transmissivity of a transparent screen and a brightness of an image projected on the transparent screen, based on characteristics of an environment proximate to the transparent screen.
According to another aspect of the present disclosure, there is provided a non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer causes the computer to execute a method, the method including controlling a transmissivity of a transparent screen and a brightness of an image projected on the transparent screen, based on characteristics of an environment proximate to the transparent screen.
Hereinafter, embodiments of the present disclosure will be described in detail on the basis of drawings. Note that in each of the following embodiments, the same part will be denoted by the same reference numeral, thereby omitting redundant description.
The present disclosure will be described in the order of items shown below.
1. First Embodiment
1-1 One example of display control processing according to first embodiment
1-2 Configuration example of display control apparatus according to first embodiment
1-3 Procedure of display control processing according to first embodiment
1-4 Modification according to first embodiment
2. Second Embodiment
2-1 One example of display control processing according to second embodiment
2-2 Configuration example of display control apparatus according to second embodiment
2-3 Procedure of display control processing according to second embodiment
2-4 Modification according to second embodiment
3. Other embodiments
3-1 One example of display control system according to present disclosure
3-2 Other
4. Effect of display control apparatus according to present disclosure
5. Hardware configuration
In the present disclosure, a description will be given of a display control apparatus 100 that enables image display that does not cause a user to feel a sense of oppression while ensuring visibility of an image under external light.
In general, there is a need for a larger screen for an apparatus (display medium) for displaying an image. A display employing a system such as a liquid crystal display (LCD) and an organic light emitting diode (OLED) is used for image display. However, when trying to realize a larger screen with a display employing a system such as an LCD and OLED, the entire case becomes large and heavy. This can be a factor that causes the user to feel a sense of oppression.
A transparent display is mentioned as a proposal for enabling image display that does not cause a user to feel a sense of oppression. The transparent display can be realized by a known system such as the LCD and the OLED. However, in the LCD or OLED system, structurally, it is difficult to avoid light being blocked by a semiconductor circuit around a light emitting section, and it is difficult to increase transparency (transmittance). In addition, since the display of the LCD or OLED system has fixed pixels, there is a problem that a size and resolution of a screen are fixed. Furthermore, the display of the LCD or OLED system has limitations in increasing the screen size in terms of productions facilities and the like.
In view of the above point, there is a proposal to display an image by combining a projector and a screen instead of the transparent display. For example, by using a simple configuration in which an ultra-short focus projector is installed directly under the screen, it is possible to display a larger image as compared with the display of the LCD or OLED system. In addition, the projector has an advantage of being able to flexibly set a size and resolution of an image to be projected. However, even when such a configuration is adopted, since a configuration such as the screen and white-based wall for projection may be necessary, a sense of presence of a display medium such as the screen and wall is given in a state in which the user does not view the image.
Incidentally, there is a transparent screen is as an example of a screen on which the projector performs projection. For example, the transparent screen is configured to enclose a substance that diffuses light with a substance having a high transmittance. The transparent screen is normally transparent. However, the transparent screen is capable of displaying, when an image, etc. is projected, the projected image thereon, by reflecting light at a specific angle. In accordance with the transparent screen, since it is difficult to cause the user to feel a sense of presence when the image is not projected, it is possible to prevent the user from feeling a sense of oppression by installation of the screen.
However, the transparent screen having high transmittance is susceptible to ambient light such as external light. For this reason, in the above configuration, even if it is possible to display an image in a dark room, etc., there is concern that visibility of the image may extremely deteriorate under external light. Meanwhile, when black coating, etc. is performed on a screen surface in an attempt to suppress an influence of ambient light, the transmittance of the screen decreases.
As described above, in image display, various problems are present to enable image display that does not cause the user to feel a sense of oppression while ensuring visibility of the image under external light. The display control apparatus 100 according to an embodiment of the present disclosure solves the above-mentioned problems by a configuration and display control processing described below. Hereinafter, an example of the configuration of the display control apparatus 100 according to an embodiment of the present disclosure and display control processing will be described using
In the first embodiment, the display control apparatus 100 includes, as components, a projector 10 having a function of projecting an image, and a display section 150 that displays the image projected from the projector 10. The display control apparatus 100 is an information processing apparatus that controls projection of an image of the projector 10 and a display mode of the display section 150.
Although not illustrated in
Note that the display control apparatus 100 may have any mode as long as the display control apparatus 100 can control the projector 10 and the display section 150 by wire or wirelessly. For example, the display control apparatus 100 may correspond to a smartphone, a tablet terminal, etc. In this case, display control processing according to an embodiment the present disclosure may be realized as one function of an application installed in a smartphone, a tablet terminal, etc.
The projector 10 is a device that projects image data, etc. In the first embodiment, the projector 10 is referred to as a so-called ultra-short focus projector, and can project an image on a medium several centimeters to several tens of centimeters ahead.
Note that in the example of
The display section 150 includes a light control film 20 and a transparent screen 30. For example, the display section 150 is configured by bonding the light control film 20 and the transparent screen 30.
The light control film 20 is a film whose transmittance is variable by voltage or current control. For example, the light control film 20 is a film configured by interposing an electrochromic element between transparent electrodes, and has a light control function of an electrochromic system. In the electrochromic system, the transmittance of the film is controlled by occurrence of an oxidation reaction or a reduction reaction in the electrochromic element in accordance with a voltage applied to the transparent electrode. Note that a suspended particle device (SPD) method, a gas chromic method, etc. may be employed for the light control film 20.
That is, the light control film 20 can freely change the transmittance by electronic control. For example, in the first embodiment, the light control film 20 is transparent (a shading rate is the lowest) when the transmittance is maximized, and black (the shading rate is the maximum) when the transmittance is minimized.
The transparent screen 30 is a screen formed of a transparent material and a material that diffuses light. For example, in a case where the transparent screen 30 receives light projected from the projector 10 installed at a lower side or an upper side, a transparent material portion transmits the light, and a material portion that diffuses light diffuses (reflects) light. Specifically, in a case of receiving light projected from the projector 10, the transparent screen 30 reflects light on a viewing surface, i.e., a front face of the transparent screen 30. In this way, the transparent screen 30 can display the image projected from the projector 10 while maintaining permeability.
As described above, the display control apparatus 100 can perform image display that does not cause a user to feel a sense of oppression, by using the display section 150 formed of a transparent member as a display surface of the image. In addition, the display control apparatus 100 can improve visibility of the image by controlling the transmittance of the light control film 20 and setting of an image signal projected by the projector 10.
For example, the display control apparatus 100 detects ambient light around the display section 150 using an illuminance sensor embedded in the display section 150. Specifically, the display control apparatus 100 detects a numerical value of an illuminance around the display section 150 (hereinafter collectively referred to as ┌environment information┘).
Further, in a case where an extremely strong illuminance of external light, etc. is observed in the vicinity of the display section 150, the display control apparatus 100 performs a control operation such that the light control film 20 is in a light shielding state. In the example of
Meanwhile, in a case where an extremely strong illuminance of external light, etc. is not observed in the vicinity of the display section 150, the display control apparatus 100 performs a control operation such that the light control film 20 is in a transmissive state. In the example of
Next, a description will be given of an installation example of the display control apparatus 100 using
As illustrated in
The display section 150 related to the display control apparatus 100 is transparent in a state in which an image is not displayed, and thus does not block the field of view from the inside to the outside of the room. That is, the user can handle the display control apparatus 100 in the same mode as a normal window glass.
After that, in the case of receiving an operation of image display from the user, the display control apparatus 100 starts processing of displaying an image (Step S1). At this time, the display control apparatus 100 acquires environment information around the display section 150 by using an illuminance sensor or the like. Then, the display control apparatus 100 controls the light shielding state of the display section 150 in accordance with the environment information. Specifically, in the case where the display section 150 is exposed to extremely strong light such as external light, the display control apparatus 100 performs a control operation such that the display section 150 is in a light shielding state. For example, the display control apparatus 100 changes the state of the display section 150 to the light shielding state by controlling voltage or the like to be applied to the light control film 20.
Further, the display control apparatus 100 may also control the image signal projected from the projector 10 in accordance with the environment information. For example, in the case where the display section 150 is exposed to external light, the display control apparatus 100 switches the mode of the image signal projected by the projector 10 to an image mode (e.g., image mode referred to as so-called ┌vivid (high luminance, high contract, and high color temperature)┘, etc.) in which the outline of the image is sharper.
As a result, the display control apparatus 100 can provide the user with a clear image with high contrast even under the influence of external light.
Note that in the case where the environment illuminance value is relatively low, the display control apparatus 100 may maintain the display section 150 in a transmissive state. In this case, the display control apparatus 100 may also switch the mode of the image signal projected by the projector 10 to an image mode (e.g., image mode referred to as so-called ┌Standard (standard setting)┘ or ┌film (low luminance and low color temperature as in a cinema)┘ that makes it possible to naturally view the image. For example, the display control apparatus 100 stores such setting of the light shielding state and image signal in a database in advance, and refers to the database to control the light shielding state and the image signal. Further, regarding the setting of the light shielding state and image signal, the display control apparatus 100 may receive setting of the numerical value and state desired by the user in advance.
That is, the display control apparatus 100 can display an image while maintaining the permeability of the display section 150 depending on the environment. As a result, the display control apparatus 100 can provide the user with a fresh image experience as if the outside scenery and the image are mixed.
As described above, the display control apparatus 100 controls, on the basis of the environment information, pixel information of an image of projected on the transparent screen 30 related to the display section 150 and transmittance of the light control film 20 related to the display section 150. Specifically, the display control apparatus 100 adjusts the transmittance of the display section 150 in accordance with the illuminance around the display control apparatus 100, and switches the setting of the image signal. As a result, the display control apparatus 100 can balance the image to be displayed while maintaining the functionality as a window glass. For example, in accordance with the display control apparatus 100, the user can enjoy a clear image on a large screen without installing a case of a large display or the like in a room. Further, since the user can use, for image display, a window glass or the like that may be necessary for housing equipment without newly installing a screen or the like, space can be effectively used. As described above, the display control apparatus 100 can realize image display that does not cause a user to feel a sense of oppression while ensuring visibility of an image under external light.
In addition, the display control apparatus 100 projects an image by the projector 10, and thus can flexibly change a size of the image and a place where the image is projected. Even though
In addition, the display control apparatus 100 may identify a position presumed to be an obstacle to viewing an image, such as a direct spot of the sun and a position corresponding to strong reflection on the basis of the illuminance sensor, and project the image while avoiding the identified position. Alternatively, the display control apparatus 100 may identify a position of a high luminance point where strong light is observed, and perform a control operation to project an image on a place where the user does not need to visually recognize the position.
Hereinafter, a description will be given of a configuration of the display control apparatus 100, etc. according to the first embodiment using
The configuration of the display control apparatus 100 will be described using
Note that the configuration illustrated in
The communication section 110 is realized by, for example, a network interface card (NIC). The communication section 110 may correspond to a universal serial bus (USB) interface including a USB host controller, a USB port, etc. Alternatively, the communication section 110 may correspond to a high-definition multimedia interface (HDMI) (registered trademark) interface, etc. for receiving an input of an image file projected by the projector 10. Alternatively, the communication section 110 may correspond to a wired interface or a wireless interface. For example, the communication section 110 may correspond to a wireless communication interface of a wireless local area network (LAN) method or a cellular communication method. The communication section 110 functions as communication means or transmission means of the display control apparatus 100. For example, the communication section 110 is connected to a network N (such as the Internet) by wire or wirelessly, and transmits and receives information to and from another information processing terminal, etc. via the network N. For example, the communication section 110 may receive an operation from the user or an input of various types of information via the network N.
The storage section 120 is realized by, for example, a semiconductor memory device such as a random access memory (RAM) and a flash memory, or a storage device such as a hard disk and an optical disc. The storage section 120 stores various data.
For example, the storage section 120 stores a data table DB01 in which information about a scheme of controlling the transmittance or the image in accordance with the environment information is set.
┌Setting ID┘ indicates identification information for identifying setting information. ┌Environmental illuminance value┘ indicates an illuminance value in the environment information detected by the display control apparatus 100. Note that even though relative information such as ┌high┘, ┌medium┘, and ┌low┘ is stored in an item of the environmental illuminance value in the example of
┌Light control film┘ indicates the transmissive state of the light control film 20. Even though
┌Image signal adjustment┘ indicates setting information of an image signal projected from the projector 10. Even though
That is, in the example illustrated in
Returning to
As illustrated in
The detector 131 detects various types of information by controlling the sensor 140. For example, the detector 131 detects environment information indicating an environment around the display control apparatus 100 or the display section 150.
The sensor 140 is a device that detects various types of information regarding the display control apparatus 100. For example, the sensor 140 includes an illuminance sensor 141 and a depth sensor 142.
The illuminance sensor 141 is referred to as an ambient light sensor, etc., and is a device that detects an ambient illuminance using a phototransistor, a photodiode, etc.
The depth sensor 142 is a device that detects a distance to a target object to estimate a shape of the target object or detect motion of the target object on the basis of the distance. The depth sensor 142 may correspond to any one of a time of flight (ToF) method, a stereo camera method, a structured-light (SL) method, an infrared method, etc. For example, the depth sensor 142 detects information such as a distance to the user viewing an image and motion of the user.
Note that the sensor 140 illustrated in
The acquisition section 132 acquires various types of information. For example, the acquisition section 132 acquires the environment information detected by the detector 131. Specifically, the acquisition section 132 acquires environment information around the display section 150 that includes the transparent screen 30 for reflecting the image projected from the projector 10 and the light control film 20 having a variable transmittance.
For example, the acquisition section 132 acquires an illuminance around the display section 150, which is detected by the illuminance sensor 141 provided in the vicinity of the display section 150.
Further, the acquisition section 132 acquires information regarding action of a user around the display section 150, which is detected by the depth sensor 142. Note that the user around the display section 150 indicates, for example, a user whose distance to the display section 150 or the like can be measured by the depth sensor 142.
The acquisition section 132 appropriately stores the acquired information in the storage section 120. In addition, the acquisition section 132 may appropriately acquire information for processing from the storage section 120. In addition, the acquisition section 132 may acquire information from various external devices via the network N.
The display controller 133 controls the pixel information of the image to be projected on the transparent screen 30 and the transmittance of the light control film 20 on the basis of the environment information.
For example, the display controller 133 refers to the data table DB01 to control the pixel information of the image and the transmittance of the light control film on the basis of setting information in which the illuminance as an example of the environment information, the pixel information of the image, and the transmittance of the light control film are associated with each other in advance.
As an example, the display controller 133 performs a control operation such that as the illuminance is higher, the transmittance of the light control film is lower, and a luminance value of the pixel of the image is higher. In this way, the display controller 133 can display a clear image even under a condition of a high illuminance such as external light. As illustrated in
The light control section 134 controls the transmittance of the light control film. For example, the light control section 134 controls the transmittance of the light control film in accordance with the illuminance around the display section 150. Specifically, the light control section 134 controls a voltage or current value applied to the light control film 20 so that the transmittance of the light control film 20 becomes a set value corresponding to the illuminance with reference to the data table DB01.
The signal control section 135 is a so-called video processor, and controls the pixel information of the image to be projected on the transparent screen 30. For example, the signal control section 135 controls the pixel information of the image to be projected on the transparent screen 30 in accordance with the illuminance around the display section 150. Specifically, the signal control section 135 controls the output value of the image signal to obtain pixel information corresponding to the illuminance with reference to the data table DB01. For example, the signal control section 135 controls the output value of the image signal so that the luminance, the contrast, the color temperature, etc. in the image signal become set values according to the illuminance.
The display section 150 is a display medium for displaying the image projected from the projector 10. As illustrated in
The output section 160 is a device for outputting various types of information. As illustrated in
Next, a description will be given of a procedure of image processing according to the first embodiment using
As illustrated in
When the environment information has been acquired (step S101; Yes), the display control apparatus 100 determines the transmittance of the light control film 20 on the basis of the environment information (Step S102).
In addition, the display control apparatus 100 determines setting of the image signal output from the projector 10 on the basis of the environment information (step S103).
Subsequently, the display control apparatus 100 sets the transmittance determined in step S102 for the light control film 20 (step S104). Specifically, the display control apparatus 100 causes transition of the transmittance of the light control film 20 by controlling the light control film 20 on the basis of a parameter (a voltage value, etc.) for changing the light control film 20 to the transmittance determined in step S102.
In addition, the display control apparatus 100 projects the image on the display section 150 on the basis of image setting by controlling the projector 10 using image setting determined in step S103 (step S105).
Thereafter, the display control apparatus 100 determines whether an operation to end projection of the image has been received from a user (step S106). When the operation to end projection of the image has not been received from the user (step S106; No), the display control apparatus 100 repeats a process of acquiring the environment information, and continues adjusting the transmittance and image setting to obtain appropriate image display in accordance with the environment information. Meanwhile, when the operation to end projection of the image has been received from the user (step S106; Yes), the display control apparatus 100 ends projection of the image.
The display control apparatus 100 according to the first embodiment may include a projector having a general focal length as well as the ultra-short focus projector as the projector 10. In addition, the display control apparatus 100 may receive light control and image setting operation from a terminal device such as a smartphone used by the user using, for example, a Wi-Fi (registered trademark) or a Bluetooth (registered trademark) function.
A display control apparatus 200 according to a second embodiment includes a display section 250. The display section 250 further includes a light control mirror 40 in addition to the light control film 20 and the transparent screen 30. Hereinafter, a description will be given of display control processing performed by the display control apparatus 200 according to the second embodiment. Note that a description overlapping with the first embodiment will be omitted.
As illustrated in
The light control mirror 40 is configured, for example, by interposing an electrochromic element between transparent electrodes. The light control mirror 40 can switch between a mirror state and a transparent state by electronic control.
The display control apparatus 200 according to the second embodiment can perform various types of image display by controlling the transmittance of the light control mirror 40 in addition to the light control film 20 and the transparent screen 30.
For example, the display control apparatus 200 can obtain a state in which operation as a screen is allowed while displaying a mirror in addition to the black screen state and the transparent screen state described in the first embodiment by controlling the transmittance of the display section 250. Such a state is indicated as a ┌mirror+screen state┘ in the example of
In addition, the display control apparatus 200 can put the display section 250 in the mirror state by allowing the light control film 20 to be penetrated and controlling the light control mirror 40 in the mirror state. In this way, the display control apparatus 200 can provide the user with the display section 250 as a mirror when an image is not projected.
Next, an installation example of the display control apparatus 200 will be described using
As shown in
The display section 250 related to the display control apparatus 200 is in a mirror state when an image is not displayed. That is, the user can handle the display control apparatus 200 in the same mode as that of the vanity mirror.
Thereafter, in a case of receiving an image display operation from the user, the display control apparatus 200 starts a process of displaying an image (step S2). In this instance, for example, the display control apparatus 200 allows the light control mirror 40 to be transmissive to release the mirror state. In this way, the display section 250 functions as not a mirror but a screen for displaying an image. That is, the user can view an image using a mirror installed on a dressing table. Specifically, the user can cause the display control apparatus 200 to display image content corresponding to an example of makeup of the user. In this instance, as in the first embodiment, the display control apparatus 200 may adjust the transmittance of the light control film 20 and the image signal in accordance with the environment information to improve the visibility of the image.
In addition, the display control apparatus 200 may perform a process to switch between the mirror state and the transmissive state in accordance with an operation of the user or motion of the user.
For example, in the example illustrate in
In addition, the display control apparatus 200 may automatically change a display state of the screen without receiving an operation from the user. For example, the display control apparatus 200 acquires motion information of the user using the depth sensor 142 installed at the edge, etc. of the display section 250. Specifically, the display control apparatus 200 acquires motion of the user or position information such as whether the user is directly facing the display section 250 or obliquely viewing the display section 250. Alternatively, the display control apparatus 200 may observe movement, etc. of the head of the user on the basis of tracking information obtained by the depth sensor 142.
Further, for example, when the user is positioned directly in front of the display section 250, the display control apparatus 200 temporarily suspends projection from the projector 10 so that the user can use the mirror. In addition, for example, when the user obliquely looks into the display section 250, the display control apparatus 200 makes the display section 250 semi-transparent, starts projection from the projector 10, and displays an image.
In this way, the user can use the mirror when the user performs makeup and occasionally check the image content of the sample by performing an operation of slightly moving the head sideways, etc. In addition, for example, when the user moves the head upward or downward with respect to the display section 250, the display control apparatus 200 may completely shield the light control film 20 from light and start projection from the projector 10. In this way, the display control apparatus 200 can display a clearer image in accordance with specific motion of the user. That is, the display control apparatus 200 can appropriately change setting of the display section 250 or the projector 10 in accordance with various types of motion of the user.
As described above, the display control apparatus 200 can display an image while maintaining permeability of the display section 250 in a manner that depends on the environment. In this way, the display control apparatus 200 can provide the user with a fresh image experience as if the outside scenery and the image are mixed.
As described above, the display control apparatus 200 controls pixel information of an image to be projected on the transparent screen 30 related to the display section 250, the transmittance of the light control film 20 related to the display section 250, and the transmittance of the light control mirror 40 on the basis of the environment information. In addition, the display control apparatus 200 may adjust the transmittance of the display section 250 in accordance with the motion of the user as well as the ambient illumination, etc. In this way, the display control apparatus 200 can perform highly convenient image display such as displaying an image by superimposing the image on a mirror while maintaining functionality as the mirror.
Hereinafter, a description will be given of a configuration of the display control apparatus 200, etc. according to the second embodiment using
A description will be given of the configuration of the display control apparatus 200 using
In addition to the information held by the storage section 120 according to the first embodiment, the storage section 220 stores a data table DB02 in which information about a scheme of controlling the transmittance and image in accordance with motion of the user is set.
┌Setting ID┘ indicates identification information for identifying setting information. ┌Head tracking┘ indicates tracking information of the head of the user in the motion information of the user. For example, ┌Full-shift┘ of head tracking indicates the state of having moved (shifted) in the vertical direction or horizontal direction beyond the threshold value from the reference position (e.g., the installation position of the depth sensor 142 or direct front of the display section 250) for acquiring the position of the head. Further, ┌middle position┘ of head tracking indicates the state in which the head of the user is located in the middle area between the position directly in front of the reference position for acquiring the position of the head and the position determined to be ┌full-shift┘.
┌Light control film┘ indicates the transmissive state of the light control film 20. ┌Image signal adjustment┘ indicates setting information of the image signal projected from the projector 10. For example, ┌full-illuminance┘ of image signal adjustment indicates the state in which an image is projected from the projector 10 at the maximum luminance. Further, ┌semi-luminance┘ of image signal adjustment indicates the state in which an image is projected from the projector 10 with approximately half the luminance. Further, ┌off┘ of image signal adjustment indicates the state in which projection from the projector 10 is temporarily stopped.
That is, in the example illustrated in
In other words, when the user greatly shifts the head from the front of the display section 250, the display section 250 transits to the light shielding state (black screen state illustrated in
Returning to
Further, the acquisition section 132 acquires tracking information of the head of the user as information regarding motion of the user.
Specifically, the acquisition section 132 acquires, as tracking information of the head of the user, a relative positional relationship between the user facing the display section 250 and the display section 250. For example, the acquisition section 132 determines, in the case where the user is located within an angle (e.g., plus or minus 10 degrees) determined to be facing the display section 250 of the angle of view in which the depth sensor 142 can detect an object, that the user is facing the display section 250. Alternatively, the acquisition section 132 determines, in the case where the user is located within an angle (e.g., close to limitation of the angle of view in which the depth sensor 142 can detect an object) determined to be largely deviated of the angle of view in which the depth sensor 142 can detect an object, that the user is not facing the display section 250 and is located at a deviated position. In addition, the acquisition section 132 determines that the user is located at a position between a position facing the display section 250 and a position determined to be largely deviated.
Further, the display controller 133 according to the second embodiment controls at least of the pixel information of the image to be projected on the transparent screen 30, the transmittance of the light control film 20, or the transmittance of the light control mirror 40 on the basis of the environment information. For example, as in the example illustrated in
Further, the display controller 133 may control, on the basis of the information regarding motion of the user, the pixel information of the image to be projected on the transparent screen 30 and the transmittance of the light control film 20.
For example, the display controller 133 controls, on the basis of tracking information of the head of the user, the pixel information of the image to be projected on the transparent screen 30 and the transmittance of the light control film 20. Further, the display controller 133 may control the transmittance of the light control mirror 40 on the basis of the tracking information of the head of the user.
Specifically, the display controller 133 controls, on the basis of the relative positional relationship between the user and the display section 250, the pixel information of the image to be projected on the transparent screen 30 and the transmittance of the light control film 20.
As an example, the display controller 133 may perform a control operation such that the transmittance of the light control film 20 is lowered as the user approaches the position facing the display section 250 in the relative positional relationship between the user and the display section 250. Alternatively, the display controller 133 may perform a control operation such that the transmittance of the light control film 20 is increased as the user moves away from the position facing the display section 250 in the relative positional relationship between the user and the display section 250.
Next, procedure of information processing according to the second embodiment will be described using
As illustrated in
In the case where environment information and information regarding motion of a user have been acquired (step S201; Yes), the display control apparatus 200 determines the transmittances of the light control film 20 and the light control mirror 40 on the basis of the environment information and the information regarding the motion of the user (step S202).
Further, the display control apparatus 200 determines, on the basis of the environment information and the information regarding the motion of the user, setting of the image signal output from the projector 10 (step S203).
Subsequently, the display control apparatus 200 sets the transmittances determined in step S102 for the light control film 20 and the light control mirror 40 (Step S204). Specifically, the display control apparatus 200 causes transition of the transmittance of the light control film 20 by controlling the light control film 20 on the basis of a parameter (voltage value or the like) for changing the transmittance of the light control film 20 to the transmittance determined in step S202. Further, the display control apparatus 200 causes transition of the transmittance of the light control mirror 40 by controlling the light control mirror 40 on the basis of a parameter (voltage value or the like) for changing the transmittance of the light control mirror 40 to the transmittance determined in step S202.
Further, the display control apparatus 200 projects an image on the display section 250 on the basis of the image setting by controlling the projector 10 with the image setting determined in step S203 (step S205). Alternatively, the display control apparatus 200 temporarily stops the projection of the image from the projector 10 on the basis of the image setting.
After that, the display control apparatus 200 determines whether or not an operation to end projection of the image has been received from the user (Step S206). In the case where the operation to end projection of the image has not been received from the user (Step S206; No), the display control apparatus 200 repeats a process of acquiring environment information and information regarding motion of a user, and continues adjusting the transmittance and image setting to obtain appropriate image display in accordance with the acquired information. Meanwhile, in the case where the operation to end projection of the image has been received from the user (step S206; Yes), the display control apparatus 200 ends projection of the image. For example, the display control apparatus 200 controls the light control film 20 so that the light control film 20 is transmissive and is made function as a normal mirror.
The display control apparatus 200 according to the second embodiment may include a normal mirror instead of the light control mirror 40. Even when such a configuration is adopted, the display control apparatus 200 can arbitrarily change the state of the display section 250 to a state other than the transparent screen state illustrated in
The processes according to the respective embodiments described above may be implemented in various different forms other than the respective embodiments.
For example, the display control apparatus according to an embodiment of the present disclosure may correspond to an apparatus separated from the projector 10 or the display section 150 to control the separated projector 10 and display section 150. That is, the display control apparatus according to an embodiment of the present disclosure may correspond to an apparatus configured by combining the projector 10 and the display section 150, and control a display device that operates in a stand-alone manner. In addition, the display control apparatus according to an embodiment of the present disclosure may control a plurality of display devices.
In this case, the display control processing according to an embodiment of the present disclosure may be executed by a display control system 1 illustrated in
In the display control system 1, the display control apparatus 300 collectively controls the transmittance of each display apparatus and an image signal on the basis of the illuminance sensor and the depth sensor provided in the vicinity of each of the first display apparatus 300A and the second display apparatus 300B.
In accordance with the display control system 1, since a plurality of display apparatuses can be controlled, for example, when the display apparatuses correspond to a plurality of digital signage, etc. simultaneously displaying the same content, it is possible to perform optimum display in accordance with each environment.
For example, among the respective processes described in the respective embodiments, all or some of processes described as being automatically performed may be manually performed, or all or some of processes described as being manually performed may be automatically performed by a known method. In addition, a processing procedure, a specific name, and information including various data and parameters shown in the above-mentioned document and drawings can be arbitrarily changed unless otherwise specified. For example, various types of information shown in each figure are not limited to the illustrated information.
In addition, each component of each device illustrated in the figure is functionally conceptual, and does not necessarily need to be physically configured as illustrated in the figure. That is, a specific form of dispersion and integration of each device is not limited to the illustrated one, and all or some thereof may be functionally or physically dispersed/integrated in an arbitrary unit in accordance with various loads, usage conditions, etc.
In addition, the respective embodiments and modifications described above may be appropriately combined in a range not contradicting process content.
In addition, effects described in the present specification are merely examples and are not limited, and other effects may be present.
As described above, the display control apparatus (the display control apparatus 100, etc. in the embodiments) according to an embodiment of the present disclosure includes the acquisition section (the acquisition section 132 in the embodiment) and the display controller (the display controller 133 in the embodiment). The acquisition section acquires the environment information around the display section (the display section 150, etc. in the embodiment) including the transparent screen which reflects the image projected from the projector and the light control film having a variable transmittance. The display controller controls the pixel information of the image to be projected on the transparent screen and the transmittance of the light control film on the basis of the environment information.
As described above, the display control apparatus according to an embodiment of the present disclosure can display an appropriate image under various environments by controlling the pixel information of the image and the transmittance of the light control film on the basis of the environment information. Further, the display control apparatus can prevent a user from feeling a sense of oppression, by using the transparent screen as the display section. As a result, the display control apparatus can realize image display that does not cause a user to feel a sense of oppression while ensuring visibility of an image under external light.
Further, the acquisition section acquires the illuminance around the display section. The display controller controls, on the basis of the illuminance, the pixel information of the image to be projected on the transparent screen and the transmittance of the light control film. As a result, the display control apparatus can perform appropriate display in accordance with the illuminance at a timing to display an image.
Further, the display controller controls the pixel information of the image and the transmittance of the light control film on the basis of the setting information in which the illuminance, the pixel information of the image, and the transmittance of the light control film are associated with each other in advance. As a result, the display control apparatus can control the display of the image on the basis of preset optimum setting, setting desired by the user, etc.
Further, the display controller performs a control operation such that the transmittance of the light control film is lowered and the luminance value of the pixel of the image is increased as the illuminance is higher. As a result, the display control apparatus can appropriate display in accordance with the current illuminance even if there is no information such as a preset illuminance and transmittance (the data table DB01 or the like).
Further, the acquisition section acquires environment information around the display section further including the light control mirror having a variable transmittance. The display controller controls, on the basis of the environment information, at least any of the pixel information of the image to be projected on the transparent screen, the transmittance of the light control film, and the transmittance of the light control mirror. As a result, the display control apparatus can provide the user with a fresh image experience by, for example, display a superimposed image on the mirror.
Further, the acquisition section acquires the information regarding the motion of the user around the display section. The display controller controls, on the basis of the information regarding the motion of the user, the pixel information of the image to be projected on the transparent screen and the transmittance of the light control film. As a result, the display control apparatus can selectively use the display section in accordance with the motion of the user, e.g., use the display section as a normal mirror or use the display section as an image screen.
Further, the acquisition section acquires, as the information regarding the motion of the user, tracking information of the head of the user. The display controller controls, on the basis of the tracking information of the head of the user, the pixel information of the image to be projected on the transparent screen and the transmittance of the light control film. As a result, the display control apparatus can switch the image or the mirror in accordance with the motion of the user without causing the user to perform a troublesome operation.
Further, the acquisition section acquires the relative positional relationship between the user facing the display section and the display section. The display controller controls, on the basis of the relative positional relationship between the user and the display section, the pixel information of the image to be projected on the transparent screen and the transmittance of the light control film. As a result, the display control apparatus can perform AR-like image display, e.g., display an image when the user is deviated from the display section or display an image and a semi-transmissive mirror.
Further, the display controller performs a control operation such that the transmittance of the light control film is lowered as the user approaches the position facing the display section in the relative positional relationship between the user and the display section. As a result, since the display control apparatus can cause the user to use the display section as a mirror when the user is facing the display section, it is possible to improve the convenience of the user.
For example, information-processing equipment such as the display control apparatus 100 according to each embodiment described above is realized by a computer 1000 configured as illustrated in
The CPU 1100 operates on the basis of a program stored in the ROM 1300 or the HDD 1400 to control each section. For example, the CPU 1100 loads a program stored in the ROM 1300 or the HDD 1400 into the RAM 1200 and executes processing corresponding to various programs.
The ROM 1300 stores a boot program such as a basic input output system (BIOS) executed by the CPU 1100 when the computer 1000 starts up, and a program that depends on hardware of the computer 1000.
The HDD 1400 is a computer readable recording medium for non-temporarily recording a program executed by the CPU 1100, data used by the program, etc. Specifically, the HDD 1400 is a recording medium for recording a display control program according to an embodiment of the present disclosure, which is an example of the program data 1450.
The communication interface 1500 is an interface for connecting the computer 1000 to an external network 1550 (for example, the Internet). For example, the CPU 1100 receives data from another device via the communication interface 1500, and transmits data generated by the CPU 1100 to another device.
The input/output interface 1600 is an interface for connecting the input/output device 1650 and the computer 1000 to each other. For example, the CPU 1100 receives data from an input device such as a keyboard and a mouse via the input/output interface 1600. In addition, the CPU 1100 transmits data to an output device such as a display and a speaker via the input/output interface 1600. In addition, the input/output interface 1600 may function as a media interface for reading a program, etc. recorded on a predetermined recording medium (media). Examples of the media include an optical recording medium such as a digital versatile disc (DVD) and a phase change rewritable disk (PD), a magneto-optical recording medium such as a magneto-optical disk (MO), a tape medium, a magnetic recording medium, and a semiconductor memory.
For example, when the computer 1000 functions as the display control apparatus 100 according to an embodiment of the present disclosure, the CPU 1100 of the computer 1000 implements a function of the control section 130, etc. by executing the display control program loaded on the RAM 1200. In addition, the HDD 1400 stores the display control program according to an embodiment of the present disclosure and data in the storage section 120. Note that even though the CPU 1100 reads the program data 1450 from the HDD 1400 and executes the program data 1450, these programs may be acquired from another device via the external network 1550 as another example.
Note that the present technology can be configured as follows.
(1)
A display control apparatus, including:
(2)
The display control apparatus according to (1) above, in which
(3)
The display control apparatus according to any one of (1) or (2) above, in which
(4)
The display control apparatus according to any one of (1) to (3) above, in which
(5)
The display control apparatus according to any one of (1) to (4) above, in which
(6)
The display control apparatus according to any one of (1) to (5) above, in which
(7)
The display control apparatus according to any one of (1) to (6) above, in which
(8)
The display control apparatus according to any one of (1) to (7) above, in which
(9)
The display control apparatus according to any one of (1) to (8) above, in which
(10) A display control method, including: by a computer,
(11)
A display control program that causes a computer to function as:
(12)
An apparatus including:
(13)
The apparatus according to (12), wherein the circuitry is further configured to:
(14)
The apparatus according to any one of (12) or (13), wherein the circuitry is further configured to:
(15)
The apparatus according to any one of (12) to (14), wherein the environment information includes a numerical value of an illuminance of the environment proximate to the apparatus.
(16)
The apparatus according to any one of (12) to (15), wherein the circuitry is further configured to:
(17)
The apparatus according to any one of (12) to (16), wherein the circuitry is further configured to:
(18)
The apparatus according to any one of (12) to (17), wherein the circuitry is further configured to:
(19)
The apparatus according to any one of (12) to (18), wherein the circuitry is further configured to:
(20)
The apparatus according to any one of (12) to (19), wherein the circuitry is further configured to:
(21)
The apparatus according to any one of (12) to (20), wherein the light control mirror can switch between a mirror state and a transparent state.
(22)
The apparatus according to any one of (12) to (21), wherein the circuitry is further configured to:
(23)
The apparatus according to any one of (12) to (22), wherein the circuitry is further configured to:
(24)
The apparatus according to any one of (12) to (23), wherein the circuitry is further configured to:
(25)
The apparatus according to any one of (12) to (24), wherein the circuitry is further configured to:
(26)
The apparatus according to any one of (12) to (25), wherein the circuitry is further configured to:
(27)
The apparatus according to any one of (12) to (26), wherein the circuitry is further configured to:
(28)
The apparatus according to any one of (12) to (27), wherein the circuitry is further configured to:
(29)
The apparatus according to any one of (12) to (28), wherein the circuitry is further configured to:
(30)
A method including:
(31)
A non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer causes the computer to execute a method, the method including:
It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and alterations may occur depending on design requirements and other factors insofar as they are within the scope of the appended claims or the equivalents thereof.
Number | Date | Country | Kind |
---|---|---|---|
2018-221719 | Nov 2018 | JP | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2019/045516 | 11/20/2019 | WO | 00 |