Patent Application
20210358181
The present technology relates to a display device and a display control method, and more particularly to a display device and a display control method that enable improvement of user experience.
In recent years, display devices such as television receivers can provide various functions as their performance increases (see, for example, Patent Document 1).
Patent Document 1: U.S. Pat. No. 9,198,496
By the way, in display devices such as television receivers, improvement of user experience has been demanded when providing various functions.
The present technology has been made in view of such circumstances and enables improvement of the user experience.
The display device according to an aspect of the present technology is a display device including: a control unit that, when displaying a video corresponding to an image frame obtained by capturing a user on a display unit, controls luminance of a lighting region including a first region including the user in the image frame and at least a part of a second region of the second region excluding the first region to cause the lighting region to function as a light that emits light to the user.
The display control method according to an aspect of the present technology is a display control method in which a display device, when displaying a video corresponding to an image frame obtained by capturing a user on a display unit, controls luminance of a lighting region including a first region including the user in the image frame and at least a part of a second region of the second region excluding the first region to cause the lighting region to function as a light that emits light to the user.
With the display device and the display control method according to an aspect of the present technology, when a video corresponding to an image frame obtained by capturing a user is displayed on a display unit, luminance of a lighting region including a first region including the user in the image frame and at least a part of a second region of the second region excluding the first region is controlled to cause the lighting region function as a light that emits light to the user.
The display device of one aspect of the present technology may be an independent device, or may be an internal block constituting a single device.
Embodiments of the present technology are described below with reference to the drawings. Note that the description is given in the order below.
1. Embodiments of the present technology
2. Variation
3. Configuration of computer
<1. Embodiments of the Present Technology>
(Configuration of System)
A display device 10 includes, for example, a television receiver or the like. By receiving and processing a broadcast signal, the display device 10 displays the video of the broadcast content and outputs its sound. Therefore, a user 1 can watch and listen to broadcast contents such as TV programs.
Furthermore, the display device 10 has a capture function, and by capturing (imaging) the user 1 located in front by a camera unit and displaying its video, the display device 10 functions as a mirror that reflects the user 1. Moreover, when the user 1 uses the display device 10 as a mirror, the display device 10 controls the backlight provided for a liquid crystal display unit to function as lighting for makeup and eye catching.
The display device 10 also has a communication function such as a wireless local area network (LAN). For example, by communicating with a router 20 installed in a room, the display device 10 can access servers 30-1 to 30-N (N is an integer greater than or equal to 1) via a network 40 such as the Internet. The servers 30-1 to 30-N are servers that provide various services.
For example, the server 30-1 is a server that provides a website such as an electronic commerce (EC) site or an electronic shopping street (cyber mall), and the display device 10 can present information (web page) for purchasing products such as cosmetics. Furthermore, for example, the server 30-2 is a server that provides a social networking service (SNS). Moreover, for example, the server 30-3 is a server that distributes communication content such as moving images, and the server 30-4 is a server that distributes an application that can be executed by the display device 10. Note that although not described further, various services are provided also by the servers 30-4 to 30-N.
As described above, the display device 10 has a function as a so-called smart mirror in addition to the function as a general television receiver.
(Configuration of the Display Device)
In
The control unit 100 includes, for example, a central processing unit (CPU), a microcomputer, and the like. The control unit 100 controls the operation of each unit of the display device 10.
A broadcast signal transmitted from a transmitting station and received via a receiving antenna is input to the tuner unit 101. The tuner unit 101 performs necessary processing (for example, demodulation processing or the like) on the received signal according to the control from the control unit 100, and supplies the resulting stream to the decoder unit 102.
A video stream and a sound stream are supplied to the decoder unit 102 as streams supplied from the tuner unit 101.
The decoder unit 102 decodes the sound stream according to the control from the control unit 100, and supplies the resulting sound signal to the speaker unit 103. Furthermore, the decoder unit 102 decodes the video stream according to the control from the control unit 100, and supplies the resulting video signal to the display unit 104.
The speaker unit 103 performs necessary processing on the sound signal supplied from the decoder unit 102 according to the control from the control unit 100, and outputs a sound corresponding to the sound signal. The display unit 104 performs necessary processing on the video signal supplied from the decoder unit 102 according to the control from the control unit 100, and displays a video corresponding to the video signal. Note that a detailed configuration of the display unit 104 will be described later with reference to
The communication unit 105 includes a communication module that supports wireless communication such as wireless LAN, cellular communication (for example, LTE-Advanced, 5G, or the like), and the like. The communication unit 105 exchanges various data with the server 30 via the network 40 according to the control from the control unit 100.
The recording unit 106 includes a storage device such as a semiconductor memory, a hard disk drive (HDD), or a buffer device for temporarily storing data. The recording unit 106 records various data according to the control from the control unit 100.
The camera unit 107 includes, for example, an image sensor such as a complementary metal oxide semiconductor (CMOS) image sensor or a charge coupled device (CCD) image sensor, and a signal processing unit such as a camera image signal processor (ISP).
The camera unit 107 performs various signal processing by the signal processing unit on a capture signal obtained by capturing a subject by the image sensor according to the control from the control unit 100. The camera unit 107 supplies the video signal of the image frame obtained as a result of the signal processing to the control unit 100.
Note that the camera unit 107 may be built into the display device 10 or externally attached via a predetermined interface. Furthermore, the number of camera units 107 is not limited to one, but a plurality of camera units 107 may be provided at predetermined positions on the display device 10.
The sensor unit 108 includes various sensors. The sensor unit 108 performs sensing for obtaining various information about the periphery of the display device 10 according to the control from the control unit 100. The sensor unit 108 supplies the sensor data according to the sensing result to the control unit 100.
The sensor unit 108 can include various sensors such as a color sensor that detects the ambient color temperature, a distance measuring sensor that measures the distance to a target object, and an ambient light sensor that detects the ambient brightness.
The microphone unit 109 converts an external sound (voice) into an electric signal, and supplies the resulting sound signal to the control unit 100.
The power supply unit 110 supplies a power supply power obtained from an external power source or a storage battery to each unit of the display device 10 including the control unit 100 according to the control from the control unit 100.
(Configuration of the Display Unit)
In
The signal processing unit 121 performs predetermined video signal processing on the basis of the video signal input thereto. In this video signal processing, a video signal for controlling the drive of the liquid crystal display unit 123 is generated and supplied to the display drive unit 122. Furthermore, in this video signal processing, a drive control signal (BL drive control signal) for controlling the drive of the backlight 125 is generated and supplied to the backlight drive unit 124.
The display drive unit 122 drives the liquid crystal display unit 123 on the basis of the video signal supplied from the signal processing unit 121. The liquid crystal display unit 123 is a display panel in which pixels including a liquid crystal element and a thin film transistor (TFT) element are arranged in a two-dimensional manner, and modulates the light emitted from the backlight 125 according to the drive from the display drive unit 122 to perform display.
The liquid crystal display unit 123 includes, for example, a liquid crystal material enclosed between two transparent substrates including glass or the like. A transparent electrode including, for example, indium tin oxide (ITO) is formed on a portion of these transparent substrates facing the liquid crystal material, and constitutes a pixel together with the liquid crystal material. Note that in the liquid crystal display unit 123, each pixel includes, for example, three sub-pixels, red (R), green (G), and blue (B).
The backlight drive unit 124 drives the backlight 125 on the basis of a drive control signal (BL drive control signal) supplied from the signal processing unit 121. The backlight 125 emits light emitted by a plurality of light emitting elements to the liquid crystal display unit 123 according to the drive from the backlight drive unit 124. Note that as the light emitting element, for example, a light emitting diode (LED) can be used.
Here, the backlight 125 may be divided into a plurality of partial light emitting regions, and one or a plurality of light emitting elements such as LEDs is arranged in each partial light emitting region. At this time, the backlight drive unit 124 may perform lighting control, so-called partial drive, in which the BL drive control signal is changed for each partial light emitting region. Furthermore, here, the dynamic range of the luminance can be improved by utilizing the partial drive of the backlight 125. This technique for improving the dynamic range of luminance is also called “luminance enhancement” and is realized by, for example, the following principle.
That is, in a case where the display unit 104 uniformly displays a 100% white video as the luminance level of the video signal on the entire screen, all of the plurality of partial light emitting regions of the backlight 125 are turned on. It is assumed that the output luminance of the display unit 104 in this state is 100%, the power consumption of the backlight 125 is 200 W per half of the entire light emitting region, and the power consumption of the entire backlight 125 is 400 W. Furthermore, it is assumed that the backlight 125 has a power limit of 400 W as a whole.
On the other hand, a case is assumed in which, in the display unit 104, black is displayed on the half of the screen with the minimum luminance level of the video signal and white is displayed on the other half of the screen with the luminance level of the video signal being 100%. In this case, the black display portion can turn off the backlight 125 and reduce the power consumption of the backlight 125 to 0 W. On the other hand, the backlight 125 in the white display portion may consume 200 W, but in that case, by turning off the black display portion, a power margin of 200 W is created. Then, it is possible to increase the power of the backlight 125 in the white display portion to 200 W+200 W=400 W. Therefore, a maximum output luminance value LMAX in the display unit 104 can be increased to 200% as compared with the above example. By such principle, “luminance enhancement” is realized.
Note that the configuration of the display device 10 shown in
Furthermore, for example, the display device 10 may reproduce not only broadcast content such as TV programs, but also content such as communication content such as moving images distributed from the server 30-3, or recorded content input via an interface that supports a predetermined scheme such as high-definition multimedia interface (HDMI) (registered trademark) or universal serial bus (USB). Moreover, the display device 10 can download and execute an application (for example, a smart mirror application) distributed from the server 30-4. The application may be, for example, a native application executed by the control unit 100, or a web application that executes a browser and displays a screen.
(Smart Mirror Function)
Next, the smart mirror function of the display device 10 will be described with reference to
In
In the central region of this display screen, the video of the user 1 located in front thereof is displayed. Furthermore, in the left and right regions (lighting regions) of the display screen, a plurality of, four, lights 151 as eye-catching lighting is displayed in the vertical direction, and in the lower region of the display screen, product information 161 related to a product such as cosmetics is displayed.
Here, by displaying the plurality of lights 151 in the left and right regions as the eye-catching lighting, for example, in a dressing room where an actress makes up or in a cosmetics section in a department store, it is possible to illuminate (the face of) the user 1 evenly from various angles (to eliminate the shadow of the face) so that makeup can be performed correctly. When displaying a plurality of lights 151, the control unit 100 controls the luminance of the backlight 125 of the display unit 104 according to the brightness of the lighting region. Here, for example, the above-mentioned technology “luminance enhancement” is applied to increase the power of the backlight 125 in the white display part (lighting region), and it is possible to realize the eye-catching lighting.
In this way, the display device 10 displays the plurality of lights 151 as the eye-catching lighting so that the optimum lighting for makeup is reproduced at the home of the user 1 (A of
Note that the eye-catching lighting is not limited to the plurality of lights 151 vertically displayed in the left and right regions, but, for example, lights having a predetermined shape may be provided. A of
Furthermore, as the eye-catching lighting, a plurality of lights may be displayed in the lateral direction in the upper and lower regions. That is, the display device 10 can display a plurality of lights as the lighting region in at least some of the upper, lower, left, and right regions of the display screen on the display unit 104. Here, the lighting region is a region including a first region including (the image of) the user 1 in the image frame and at least a part of a second region within the second region (region including the background) excluding the first region.
In
Here, for example, the video of the face of the user 1 on the display screen is made up by AR technology (A of
Note that the user 1 may register the information regarding costumes or the like by operating the display device 10 or by activating a dedicated application on a mobile terminal such as a smartphone or a tablet terminal. Furthermore, the recommended combination of costumes or the like may be determined by (the control unit 100 of) the display device 10 using a predetermined algorithm, or a dedicated server 30 such as a recommendation server using machine learning, for example, may be contacted via the network 40. Further, the user 1 may select the combination of costumes and accessories by himself/herself instead of the device side such as the display device 10 or the like presenting a recommended combination.
Thereafter, for example, the user 1 can purchase cosmetics for makeup as displayed by the AR technology and put on makeup, change into recommended costumes, and wear accessories to check the state after the makeup in the video displayed on the display device 10 (
By the way, in the display device 10, the background video of the user 1 is blurred, but by blurring the background, for example, the cluttered state in the room is not recognized.
Here, as shown in
Then, in the display device 10, the control unit 100 can blur the region (background region) excluding the extracted region of the face or body of the user 1 to blur the cluttered state in the room (A of
In
Note that the information regarding the destination of the user 1 is registered in advance, but as this registration method, of course, the display device 10 is operated, and for example, a dedicated application is activated on a mobile terminal such as a smartphone to perform registration, or information regarding the destination may be acquired in cooperation with a schedule application used by user 1. Furthermore, instead of using the sensor unit 108 such as a color sensor, the color temperature in the room in which the display device 10 is installed may be detected by analyzing the image frame captured by the camera unit 107.
In
For example, a case is assumed in which the user 1 facing the display screen side of the display device 10 at present (time t1) faced the opposite side, i.e., faced away from the display screen of the display device 10 X seconds before (time t0). In this case, since the video data of the user 1 facing backward is recorded in the recording unit 106, the display device 10 can display the videos of the user 1 at the present (time t1) and X seconds before (time t0) at the same time. Therefore, the user 1 can check not only the current front view of himself/herself but also the back view of himself/herself in the past (for example, a few seconds ago) displayed with a time difference (time shift).
Furthermore, in this example, the case where the user 1 faces away from the display screen of the display device 10 has been described, but the orientation of the user 1 is not limited to the backward, but, for example, when the video data of the user 1 in sideways orientation is recorded, the user 1 when checking the makeup or costumes can also check his/her front view and back view as well as his/her profile. Note that the video displayed on the display screen of the display device 10 can be switched not only to a mirror image but also to a normal image. For example, by switching the display from a mirror image to a normal image, the user 1 can check his/her view as seen by others.
In
Here, a scene is assumed in which in a case where the user 1 wants to see a certain scene of the tutorial moving image 171 again and makes an utterance “play it again” (B of
Semantic analysis processing is performed on a sound recognition result obtained in this way. In this semantic analysis processing, the sound recognition result (text data), which is a natural language, is converted into an expression that can be understood by a machine (display device 10) by appropriately referring to a database for understanding a spoken language, for example. Here, for example, as a semantic analysis result, an intention (intent) that the user 1 wants to execute and an entity information (entity) that is a parameter thereof are obtained.
The display device 10 rewinds the tutorial moving image 171 on the basis of the semantic analysis result so that the target scene is reproduced again. Since the display device 10 supports such sound operation, the user 1 can operate the moving image reproduction by a sound even if both hands are full during makeup.
Note that in the example of
Furthermore, in the example of
In
(Example of Switching to the Smart Mirror Function)
Note that the timing of switching between a normal television function and the smart mirror function in the display device 10 can be triggered by, for example, whether the position of the user 1 with respect to the display device 10 is within a predetermined range. That is, in the display device 10, for example, the position (current position) of the user 1 is detected by the sensor unit 108 such as a distance measuring sensor, and in a case where a value corresponding to the detected position is equal to or greater than a predetermined threshold value, the position of the user is outside of the predetermined range so that the normal television function is executed (A of
On the other hand, in the display device 10, in a case where the value corresponding to the detected position is less than the predetermined threshold value, the position of the user is within the predetermined range so that the smart mirror function is executed (B of
Furthermore, here, processing such as face recognition processing using the image frame captured by the camera unit 107 may be performed. For example, in the display device 10 as a television receiver, by registering the face information of the user who uses the smart mirror function in advance and executing the face recognition processing, for example, in a case where a family of four is assumed, when the father or the son approaches the display device 10, the normal television function is maintained, and when the mother or the daughter approaches the display device 10, the smart mirror function is executed.
(Flow of Processing)
Next, the flow of processing executed by the display device 10 will be described with reference to the flowcharts of
The display device 10 turns on the power in a case where a predetermined operation is performed by the user 1 (S11). Therefore, in the display device 10, the power from the power supply unit 110 is supplied to each unit, and for example, the video of a selected television program is displayed on the display unit 104.
Then, the display device 10 activates the smart mirror application (S12). Here, for example, the control unit 100 activates the smart mirror application recorded in the recording unit 106 in a case where the position of the user 1 with respect to the display device 10 is within the predetermined range on the basis of the detection result from the sensor unit 108.
Then, in the display device 10, when the smart mirror application is activated, a camera input video and the eye-catching lighting are displayed (S13, S14). Here, the control unit 100 performs control so that the video of the image frame captured by the camera unit 107 and the plurality of lights 151 as the eye-catching lighting are displayed on the display unit 104. Note that, here, as described above, for example, by applying the technology “luminance enhancement” to increase the power of the backlight 125 in the white display portion (lighting region), the eye-catching lighting can be realized.
Therefore, in (the display unit 104 of) the display device 10, for example, the display screen shown in
First, the operation of the AR mode by the display device 10 will be described with reference to
The display device 10 accepts the selection of cosmetics that the user 1 wants to try (S32). Here, for example, on the display screen of the display unit 104, desired cosmetics according to the predetermined operation by the user 1 are selected from the product information 161 displayed in the lower region.
The display device 10 displays a video in which makeup is superimposed on the user 1 by the AR technology (S33). Here, the control unit 100 performs control such that, as the video of the user 1 included in the image frame captured by the camera unit 107, a video in which makeup according to the cosmetics selected by the user 1 in the processing of step S32 is displayed on the display unit 104. Therefore, (the display unit 104 of) the display device 10 displays, for example, the display screen shown in A of
Next, the display device 10 accepts the selection of a situation by the user 1 (S34). Here, the control unit 100 selects a situation (for example, outdoors, a party, or the like) according to the destination of the user 1, which is input according to a predetermined operation by the user 1.
The display device 10 changes the illumination to a color that matches the situation (S35). Here, the control unit 100 causes the backlight 125 in the lighting region to reproduce the color temperature according to the situation (for example, outdoors or a party) selected in the processing of step S34 to change the color of the plurality of lights 151 displayed on the display unit 104 (for example, change from white to reddish color). Therefore, in (the display unit 104 of) the display device 10, for example, the display screen shown in B of
Next, the display device 10 accepts the selection of accessories and costumes that the user 1 wants to try (S36). Here, for example, from the wardrobe registered in advance, desired accessories and costumes according to a predetermined operation by the user are selected.
The display device 10 displays a video in which accessories and costumes are superimposed on the user 1 by the AR technology (S37). Here, the control unit 100 performs control such that, as the video of the user 1 included in the image frame captured by the camera unit 107, a video in which makeup is performed and accessories and costumes selected in the processing of step S36 are superimposed is displayed on the display unit 104. Therefore, (the display unit 104 of) the display device 10 displays, for example, the display screen shown in B of
Thereafter, it is determined whether the user 1 performs an operation of purchasing the product (selected cosmetics) (S38). In a case where it is determined that the user 1 performs an operation of purchasing the product (“YES” in S38), the display device 10 accesses the server 30-1 that provides an EC site of the desired cosmetics via the network 40 (S39). Therefore, the user 1 can purchase the desired cosmetics using the EC site. Note that, here, not only cosmetics, but, for example, accessories and costumes that the user 1 does not possess can be purchased by using the EC site in a case where the user 1 likes those accessories and costumes by displaying the accessories and the cosmetics in a superimposing manner.
By operating the display device 10 in the AR mode in this way, the user 1 can try makeup, accessories, and costumes.
Next, the operation of the model mode by the display device 10 will be described with reference to
The display device 10 accepts the selection of a situation by the user 1 (S52). Here, the control unit 100 selects a situation (for example, outdoors, a party, or the like) according to the destination of the user 1.
The display device 10 changes the illumination to a color that matches the situation (S53). Here, the control unit 100 causes the backlight 125 in the lighting region to reproduce the color temperature according to the situation (for example, outdoors or a party) selected in the processing of step S52 to change the color of the plurality of lights 151 displayed on the display unit 104. Therefore, the display device 10 emulates the ambient light according to the situation.
The display device 10 accepts the selection of cosmetics that the user 1 is about to use for makeup (S54). Here, for example, on the display screen of the display unit 104, cosmetics (cosmetics used for makeup) according to the predetermined operation by the user 1 are selected from cosmetics displayed in predetermined region.
The display device 10 displays a video (video of the user 1 who wears makeup) according to the image frame captured by the camera unit 107, and reproduces a tutorial moving image for makeup (S55, S56). Here, the communication unit 105 accesses the server 30-3 via the network 40 according to the control from the control unit 100, and streaming data of the tutorial moving image corresponding to the cosmetics (for example, lipstick) selected in the processing of step S54 is received. Then, in the display device 10, a reproduction player is activated by the control unit 100, and the streaming data is processed to reproduce the tutorial moving image.
Therefore, (the display unit 104 of) the display device 10 displays, for example, the display screen shown in A of
Thereafter, it is determined whether to change the reproduction position of the tutorial moving image (S57). In a case where it is determined that the reproduction position of the tutorial moving image is to be changed (“YES” in S57), the display device 10 changes the reproduction position of the tutorial moving image according to the sound operation by the user 1 (S58).
Here, for example, in a case where the user 1 makes an utterance “playing it again”, the sound is collected by the microphone unit 109. Therefore, the control unit 100 performs processing such as the sound recognition processing or the semantic analysis processing on the sound signal to control the reproduction position of the tutorial moving image 171 to be reproduced by the reproduction player (B of
When the processing of step S58 ends, the processing returns to step S56, and the processing of step S56 and subsequent steps is repeated. Further, in a case where it is determined that the reproduction position of the tutorial moving image is not to be changed (“NO” in S57), the processing proceeds to step S59. In this determination processing, it is determined whether or not the makeup by the user 1 is completed (S59). Then, in a case where it is determined that the makeup by the user 1 is completed (“YES” in S59), the display device 10 ends the operation of the model mode, and for example, the operation of a capture mode shown in
The display device 10 accepts the selection of a background by the user 1 (S71). Furthermore, the display device 10 accepts a capture instruction according to the sound operation by the user 1 (S72).
Then, in a case where the display device 10 accepts the capture instruction from the user 1 in the processing of step S72, the display device 10 starts the operation of the capture mode (S73). At this time, the display device 10 starts the countdown until the actual capture is performed, and when the countdown ends (“YES” in S74), the camera unit 107 captures the user 1 (S75).
Then, the display device 10 synthesizes and displays the captured image of the user 1 and the selected background image (S76). Here, for example, the control unit 100 performs mask processing on the region of the face or body of the user 1 extracted from the image frame obtained in the processing of step S75, and performs synthesis processing of synthesizing the background image selected in the processing of step S71 (e.g., an image of a building at a party venue), so that the resulting synthesis image is displayed.
At this time, it is determined whether or not the user 1 posts the synthesis image to an SNS (S77). In a case where it is determined that posting to the SNS is performed (“YES” in S77), the display device 10 accepts the selection of the posting destination of the synthesis image by the user 1 (S78). Here, for example, a list of SNSs in which the user 1 is registered as a member is displayed, and the SNS to which the synthesis image is posted can be selected from the list.
Then, the display device 10 transmits the synthesis image data to the server 30-2 of the selected SNS (S79). Here, by the communication unit 105, the synthesis image data obtained in the processing of step S76 is transmitted via the network 40 to the server 30-2 of the SNS selected in the processing of step S78. Therefore, the synthesis image is posted on the SNS, and the synthesis image can be viewed by, for example, a friend or family member of the user 1 using a mobile terminal or the like.
Note that in a case where it is determined not to post the synthesis image to SNS (“NO” in S77), the processing in steps S78 and S79 is skipped, and the processing of
The flow of processing executed by the display device 10 has been described above. The summary of the above flow of processing can be as shown in
That is, the display device 10 as a television receiver has a function as a smart mirror, and by using the high-luminance backlight 125 as the eye-catching lighting, the user 1 also can perfect the eye catching (A of
Moreover, in the display device 10, when the AR technology is used to add information such as makeup, costumes, and accessories to the user 1 in the real space to expand the real world, the ambient light is emulated, or the background is blurred, it is possible to check how the product looks, including the situation (C of
Furthermore, since the display device 10 as a television receiver can reproduce the tutorial moving image as a model when the user 1 makes up, the user 1 can make up while watching the tutorial moving image (A of
Moreover, in the display device 10, in a case where an image (synthesis image) captured by the user 1 is posted to the SNS, for example, the self-portrait (selfie) image (video) can be checked in advance (C of
<2. Variation>
In the above description, the display device 10 has been described as being a television receiver, but is not limited to this, but may be electronic devices such as display devices, personal computers, tablet terminals, smartphones, mobile phones, head mounted displays, and game machines.
Furthermore, in the above description, the case where the display unit 104 of the display device 10 includes the liquid crystal display unit 123 and the backlight 125 has been described, but the configuration of the display unit 104 is not limited to this, and, for example, the display unit 104 may include a self-emitting display unit and its luminance may be controlled.
(Another Configuration of the Display Unit)
In
The signal processing unit 141 performs predetermined video signal processing on the basis of a video signal input thereto. In this video signal processing, a video signal for controlling the drive of the self-emitting display unit 143 is generated and supplied to the display drive unit 142.
The display drive unit 142 drives the self-emitting display unit 143 on the basis of the video signal supplied from the signal processing unit 141. The self-emitting display unit 143 is a display panel in which pixels including self-emitting elements are arranged in a two-dimensional manner, and performs display according to the drive from the display drive unit 142.
Here, the self-emitting display unit 143 is, for example, a self-emitting display panel such as an organic EL display unit (OLED display unit) using organic electroluminescence (organic EL). That is, in a case where the organic EL display unit (OLED display unit) is adopted as the self-emitting display unit 143, the display device 10 is an organic EL display device (OLED display device).
An organic light emitting diode (OLED) is a light emitting element having a structure in which an organic light emitting material is sandwiched between a cathode and an anode, and constitutes a pixel arranged two-dimensionally on the organic EL display unit (OLED display unit). The OLED included in this pixel is driven according to a drive control signal (OLED drive control signal) generated by the video signal processing. Note that, in the self-emitting display unit 143, each pixel includes, for example, four sub-pixels, red (R), green (G), blue (B), and white (W).
Note that, in the above description, a plurality of display examples is shown as the display screen displayed on the display device 10, but the display examples of each display screen may of course be displayed independently, and a display screen including a combination of a plurality of display examples may be displayed. Furthermore, in the description above, the system means a cluster of a plurality of constituent elements (an apparatus, a module (component), or the like), and it does not matter whether or not all the constituent elements are present in the same enclosure.
<3. Configuration of Computer>
The series of processing described above (e.g., processing shown in the flowcharts of
In the computer 1000, a central processing unit (CPU) 1001, a read only memory (ROM) 1002, a random access memory (RAM) 1003, are interconnected by a bus 1004. An input/output interface 1005 is further connected to the bus 1004. An input unit 1006, an output unit 1007, a recording unit 1008, a communication unit 1009, and a drive 1010 are connected to the input/output interface 1005.
The input unit 1006 includes a microphone, a keyboard, a mouse, and the like. The output unit 1007 includes a speaker, a display, and the like. The recording unit 1008 includes a hard disk, a non-volatile memory, and the like. The communication unit 1009 includes a network interface and the like. The drive 1010 drives a removable recording medium 1011 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.
In the computer 1000 configured in the manner described above, the series of processing described above is performed, for example, such that the CPU 1001 loads a program recorded in the ROM 1002 or the recording unit 1008 into the RAM 1003 via the input/output interface 1005 and the bus 1004 and executes the program.
The program to be executed by the computer 1000 (CPU 1001) can be provided by being recorded on the removable recording medium 1011, for example, as a package medium or the like. Furthermore, the program can be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting.
In the computer 1000, the program can be installed on the recording unit 1008 via the input/output interface 1005 when the removable recording medium 1011 is mounted on the drive 1010. Furthermore, the program can be received by the communication unit 1009 via a wired or wireless transmission medium and installed on the recording unit 1008. In addition, the program can be pre-installed on the ROM 1002 or the recording unit 1008.
Here, in the present specification, the processing performed by the computer according to the program is not necessarily needed to be performed in chronological order along the procedure described as the flowchart. In other words, the processing performed by the computer according to the program also includes processing that is executed in parallel or individually (e.g., parallel processing or processing by an object). Furthermore, the program may be processed by a single computer (processor) or may be processed in a distributed manner by a plurality of computers.
Note that the embodiment of the present technology is not limited to the aforementioned embodiments, but various changes may be made within the scope not departing from the gist of the present technology.
For example, each step of the processing shown in the flowcharts of
Note that, the present technology may adopt the configuration described below.
(1)
A display device including:
a control unit that, when displaying a video corresponding to an image frame obtained by capturing a user on a display unit, controls luminance of a lighting region including a first region including the user in the image frame and at least a part of a second region of the second region excluding the first region to cause the lighting region to function as a light that emits light to the user.
(2)
The display device according to (1), in which
the display unit functions as a mirror reflecting the user by displaying a video of a mirror image or normal image of the user, and
the light functions as a light used when the user puts on makeup.
(3)
The display device according to (2), in which
the control unit superimposes various information on the video of the user included in the first region by AR technology.
(4)
The display device according to (3), in which
the control unit displays a video in which makeup is applied to a video of a face of the user.
(5)
The display device according to (4), in which
the control unit displays information regarding cosmetics and applies makeup according to the cosmetics selected by the user.
(6)
The display device according to any of (3) to (5), in which
the control unit displays a video in which a video of at least one of an accessory or a costume is superimposed on the video of the user.
(7)
The display device according to any of (2) to (6), in which
the control unit displays a video in which predetermined video processing is performed on a background video included in the second region.
(8)
The display device according to (7), in which
the control unit performs blurring processing on the background video or synthesis processing for synthesizing the video of the user and another background video.
(9)
The display device according to any of (2) to (8), in which
the control unit controls a color temperature of the lighting region and emulates ambient light according to a situation.
(10)
The display device according to any of (2) to (9), in which
the control unit displays a video of a tutorial moving image according to makeup of the user.
(11)
The display device according to (10), in which
the control unit controls reproduction of the tutorial moving image according to a sound operation of the user.
(12)
The display device according to (10) or (11), in which
the control unit displays a video of a site of the user to be a target of makeup in a partially enlarged manner, which is a part of a video of a face of the user included in the first region.
(13)
The display device according to (5), further including: a communication unit that communicates with a server via a network,
in which
the communication unit accesses a server that provides a site for selling a product including the cosmetics and exchanges information regarding the product according to an operation of the user.
(14)
The display device according to any of (2) to (12), further including:
a communication unit that communicates with a server via a network,
in which
the communication unit accesses a server that provides an SNS and transmits an image after completion of makeup of the user according to an operation of the user.
(15)
The display device according to any of (2) to (12), further including:
a recording unit that records data of a video of the user included in the first region,
in which
the control unit displays the video of the user in a time-shifted manner on the basis of the data recorded in the recording unit.
(16)
The display device according to any of (2) to (12), in which
the lighting region includes a region including a region of at least a part of upper, lower, left, and right regions of a display screen in the display unit, or includes a donut-shaped region, and
the control unit controls luminance of the lighting region according to brightness of the lighting region.
(17)
The display device according to any of (2) to (12), in which
the display unit displays a video of content in a case where a position of the user is out of a predetermined range and functions as a mirror reflecting the user in a case where the position of the user is within the predetermined range.
(18)
The display device according to any of (1) to (17), in which
the display unit includes a liquid crystal display unit, and
the control unit controls luminance of a backlight provided with respect to the liquid crystal display unit.
(19)
The display device according to any of (1) to (18) being configured as a television receiver.
(20)
A display control method in which
a display device, when displaying a video corresponding to an image frame obtained by capturing a user on a display unit, controls luminance of a lighting region including a first region including the user in the image frame and at least a part of a second region of the second region excluding the first region to cause the lighting region to function as a light that emits light to the user.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2018-202810 | Oct 2018 | JP | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/JP2019/040574 | 10/16/2019 | WO | 00 |
