The present disclosure relates to an information processing device, an information processing method, and a program.
In the related art, technologies of displaying a picture with binocular disparity between a left eye and a right eye of a user are proposed. According to such a technology, users are capable of seeing the picture stereoscopically, and feeling a sense of depth.
In addition, Patent Literature 1 listed below describes a technology of tilting each of a right eye optical system and a left eye optical system outside to widen an angle of view of observation, the right eye optical system and the left eye optical system being arranged in front of the eyes of a user.
Patent Literature 1: JP 2013-25101A
However, the technology described in Patent Literature 1 tilts each of the right eye optical system and the left eye optical system outside regardless of content to be displayed. Therefore, for example, a positional relation between video displayed by the right eye optical system and video displayed by the left eye optical system may become inappropriate depending on content.
Accordingly, the present disclosure proposes a novel and improved information processing device, information processing method, and program that are capable of changing video to be displayed on a left eye display unit and video to be displayed on a right eye display unit in accordance with display target content.
According to the present disclosure, there is provided an information processing device including an output control unit configured to change a first region and a second region on a basis of information related to content to be displayed, the first region being a region within the content to be displayed on a left eye display unit, the second region being a region within the content to be displayed on a right eye display unit.
In addition, according to the present disclosure, there is provided an information processing method including changing, by a processor, a first region and a second region on a basis of information related to content to be displayed, the first region being a region within the content to be displayed on a left eye display unit, the second region being a region within the content to be displayed on a right eye display unit.
In addition, according to the present disclosure, there is provided a program causing a computer to function as an output control unit configured to change a first region and a second region on a basis of information related to content to be displayed, the first region being a region within the content to be displayed on a left eye display unit, the second region being a region within the content to be displayed on a right eye display unit.
As described above, according to the present disclosure, it is possible to change video to be displayed on a left eye display unit and video to be displayed on a right eye display unit in accordance with display target content. Note that the effects described here are not necessarily limited, and any effect that is desired to be described in the present disclosure may be exhibited.
Hereinafter, (a) preferred embodiment(s) of the present disclosure will be described in detail with reference to the appended drawings. Note that, in this specification and the appended drawings, structural elements that have substantially the same function and structure are denoted with the same reference numerals, and repeated explanation of these structural elements is omitted.
Note that, according to an order of items listed below, the “Mode(s) for Carrying Out the Invention” will be described.
Note that, in this specification and the drawings, sometimes the HMD 10-1 according to the first embodiment and the HMD 10-2 according to the second embodiment may be referred to as HMDs 10.
First, with reference to
The HMD 10 is an example of a display device or the information processing device according to the present disclosure. The HMD 10 is a device configured to control display of content and applications. Note that, next, a situation in which the HMD 10 controls display of content will mainly be described. In addition, it is also possible to control display of the applications in a similar way.
For example, the HMD 10 generates a left eye picture to be displayed on a left eye display unit 126L (to be described later) and a right eye picture to be display on a right eye display unit 126R (to be descried later) on the basis of content received from the server 20 via the communication network 22. Here, for example, the content may be video data recorded in various kinds of recording media, may be video data provided from the server 20 via the communication network 22 or the like, or may be the other media files. In addition, the content may be 2D content or may be 3D content (stereoscopic video).
In addition, basically, the HMD 10 is a see-through head-mounted display as illustrated in
The server 20 may be a device configured to store a plurality of pieces of content and applications. In addition, in the case where a content acquisition request is received from another device such as the HMD 10 or the like, the server 20 is capable of transmitting content to the other device in response to the received acquisition request.
Note that, in the case where the requested content is not stored in the server 20, the server 20 is capable of transmitting the content acquisition request to another device connected with the communication network 22, and acquiring the content from the other device.
The communication network 22 is a wired or wireless transmission path through which information is transmitted from devices connected with the communication network 22. For example, the communication network 22 may include a public network, various kinds of local area networks (LANs), a wide area network (WAN), and the like. The public network includes the Internet, a satellite communication network, a telephone network, and the like, and the LANs include Ethernet (registered trademark). In addition, the communication network 22 may include a dedicated line network such as an Internet Protocol Virtual Private Network (IP-VPN).
The configuration of the information processing system that is common to the respective embodiments has been described above. Next, a first embodiment will be described. First, a background where the HMD 10-1 according to the first embodiment has been developed will be described.
For example, it is desirable for the HMD 10-1 to cause a user to perceive that virtual display such as a graphical user interface (GUI) is arranged at an appropriate position. Therefore, the virtual display with appropriate sizes and positions should be displayed for a left eye and a right eye in accordance with binocular disparity between the left and right eyes.
However, in publicly-known head-mounted displays, a picture displayed by the right eye optical system and a picture displayed by the left eye optical system do not overlap each other in a region in which the binocular disparity is more effective than the other cognition (in other words, region close to a user), or the publicly-known head-mounted displays have small overlap regions. Accordingly, the binocular vision region (in other words, region in which a right eye picture and a left eye picture overlap each other) is hardly formed near the user.
Therefore, the HMD 10-1 according to the first embodiment has been developed in view of the above described circumstance. Next, with reference to
For example, the right eye optical system may be integrated with a right eye display unit 126R including a light-emitting element, and the left eye optical system may be integrated with a left eye display unit 126L including a light-emitting element. In addition, as illustrated in
Next, details of the configuration of the HMD 10-1 according to the first embodiment will be described.
The control unit 100-1 controls entire operation of the HMD 10-1 by using hardware such as a central processing unit (CPU) 150 and random access memory (RAM) 154 (to be described later) that are embedded in the HMD 10-1. In addition, as illustrated in
The content acquisition unit 102 acquires display target content. For example, the content acquisition unit 102 receives the display target content from the server 20. Alternatively, in the case where the content is stored in the storage unit 124, the content acquisition unit 102 is also capable of acquiring the display target content from the storage unit 124.
In addition, the content acquisition unit 102 is capable of acquiring content information of the content in addition to a video signal of the content. Here, for example, the content information may be meta-information indicating a type, a genre, a title or the like of the content.
The detection result acquisition unit 104 acquires a result of sensing performed by the sensor unit 122. For example, the detection result acquisition unit 104 acquires detection results such as a speed, acceleration, inclination, positional information, and the like of the HMD 10-1, or a detection result such as brightness of an environment. In addition, the detection result acquisition unit 104 acquires a picture captured by the sensor unit 122.
The output control unit 106 generates a right eye picture and a left eye picture on the basis of a video signal of content acquired by the content acquisition unit 102. For example, in the case where the content is 2D content, the output control unit 106 generates a right eye picture and a left eye picture on the basis of a (single) video signal of the content. Alternatively, in the case where the content is 3D content, the output control unit 106 generates a right eye picture on the basis of a right eye video signal included in the content, and generates a left eye picture on the basis of a left eye video signal included in the content.
More specifically, the output control unit 106 generates the right eye picture by cutting out a region corresponding to the right eye picture (that is a generation target) from a video signal of the content, and generates the left eye picture by cutting out a region corresponding to the left eye picture (that is a generation target) from a video signal of the content.
Next, with reference to
Note that, with reference to
Note that, a plurality of streams may be prepared in advance for one piece of content. For example, four types of streams prepared for one piece of content include a left eye video signal and a right eye video signal of content that the display device such as a publicly-known see-through head-mounted display can display (hereinafter, also referred to as content for a reverse-V-shape display) and a left eye video signal and a right eye video signal of content that the HMD 10-1 can display (hereinafter, also referred to as content for the HMD 10-1). In this case, for example, the output control unit 106 generates a left eye picture on the basis of the left eye video signal of the content for the HMD 10-1, and generates a right eye picture on the basis of the right eye video signal of the content, among the four types of streams acquired by the content acquisition unit 102.
Note that, for example, it is also assumed that the left eye video signal or the right eye video signal of the content for the HMD 10-1 is not acquired because the left eye video signal or the right eye video signal of the content for the HMD 10-1 is not prepared in advance. In this case, for example, it is also possible for the output control unit 106 to generate alternative video of the content for the HMD 10-1 on the basis of an existing picture processing technology and a left eye video signal and a right eye video signal of content for a reverse-V-shape display acquired by the content acquisition unit 102. Subsequently, the output control unit 106 is capable of generating a left eye picture and a right eye picture on the basis of the generated alternative video.
Alternatively, it is also possible for the output control unit 106 to generate a right eye picture and a left eye picture on the basis of content information acquired by the content acquisition unit 102 (in addition to content). For example, it is possible for the output control unit 106 to generate a right eye picture and a left eye picture by cutting out a region corresponding to the right eye picture (that is a generation target) and a region corresponding to the left eye picture (that is a generation target) from the video signal of the content at a cutout position indicated by the content information. Alternatively, it is also possible for the output control unit 106 to generate a right eye picture and a left eye picture by enlarging or reducing a specific region or an entire video signal of content on the basis of the content information.
Alternatively, the output control unit 106 is also capable of generating a right eye picture and a left eye picture on the basis of analysis of video of acquired content. For example, it is possible for the output control unit 106 to generate a right eye picture and a left eye picture by determining a cutout position in accordance with a video analysis result of the content and cutting out a region corresponding to the right eye picture and a region corresponding to the left eye picture from the video signal of the content at the determined cutout position.
Alternatively, the output control unit 106 is capable of clipping a video signal of content or enlarging/reducing the video signal of the content in accordance with an aspect ratio of video that the left eye display unit 126L or the right eye display unit 126R can display. For example, in the case where acquired content is a video signal of “16:9 (=1920×1080)” and the left eye display unit 126L and the right eye display unit 126R are capable of displaying video of “4:3 (=640×480)”, the output control unit 106 may reduce the acquired content to a video signal of “4:3” and generate a right eye picture and a left eye picture on the basis of the video with the reduced aspect ratio.
Alternatively, the output control unit 106 is also capable of correcting a display position of content on the basis of the acquired content or content information. For example, the output control unit 106 determines whether to arrange (information included in) the content in a binocular vision region or in a monocular vision region (in other words, a region in which the right eye picture and the left eye picture do not overlap each other) on the basis of the acquired content or content information. For example, in the case where the acquired content is 3D content, the output control unit 106 arranges the content in the binocular vision region. Alternatively, in the case where the acquired content is 2D content, it is possible for the output control unit 106 to arrange the content in the monocular vision region.
Alternatively, the output control unit 106 determines an arrangement position of an object on the basis of a distance between a user and an initial position of the object included in content. For example, in the case where the distance between the user and the initial position of the object is smaller than a predetermined threshold, the output control unit 106 arranges the object in the binocular vision region. Alternatively, in the case where the distance between the user and the initial position of the object is larger than the predetermined threshold, the output control unit 106 arranges the object in the monocular vision region. Alternatively, in the case where the distance between the user and the initial position of the object is moderate and all or a part of the object is displayed in the monocular vision region, the output control unit 106 may display the object in the monocular vision region in a translucent manner, may display a defocused object, or may display a wire frame of the object. This enables causing the user to perceive the distance to the object ambiguously.
Alternatively, the output control unit 106 determines an arrangement position of an object included in content in accordance with a detected moving speed of a user. For example, in the case where the moving speed of the user is faster than a predetermined threshold, the output control unit 106 arranges the object in the monocular vision region (which is far away from the user). Alternatively, in the case where the moving speed of the user is slower than the predetermined threshold, the output control unit 106 arranges the object in the binocular vision region.
In addition, in the case of video (expression) changing from 3D to 2D, the output control unit 106 may display the video in a simple manner. For example, the output control unit 106 may display such video by crossfading 3D video (generated in real time by a graphics processing unit (GPU), for example) and 2D video that has been generated in advance. In addition, (while crossfading the video), the output control unit 106 may display a wire frame of video to be displayed in a peripheral vision region in the video, may gradually reduce resolution, or may obscure the video through blurring or shading, for example.
In general, a human cognitive ability is very lower in the peripheral vision region than in a central vision region. According to the above-described control methods, boundary portions are displayed smoothly, for example. Therefore, the user does not perceive the video unnaturally. In addition, this also enables to reduce processing load of the GPU or the like, for example.
Note that, in the case where the right eye picture and the left eye picture are generated by simply cutting out video signals of the content (especially, 3D content), the boundary potion may be perceived unnaturally between the monocular vision region and the binocular vision region. For example, border lines may be perceived. Therefore, the output control unit 106 preferably performs a correction process of suppressing change in luminance in the boundary portions between the monocular vision regions and in the binocular vision region, with regard to a cutout region of the right eye picture and a cutout region of the left eye picture.
For example, the output control unit 106 is capable of changing luminance of pixels by an amount of change corresponding to luminance of pixels in the cutout region of the right eye picture or the cutout region of the left eye picture in the content. For example, the output control unit 106 changes the luminance of the pixels on the basis of a predetermined gamma curve and the luminance of the pixels in the cutout region of the right eye picture or the cutout region of the left eye picture.
Next, with reference to
For example, the output control unit 106 corrects luminance in an overlap region 422R in the section “O2” in the cutout region 42R (in other words, an overlap region including a right end of the cutout region 42R), by using a gamma curve having a shape illustrated in the section “O2” in
According to the above-described correction examples, it is possible to appropriately blend the cutout region of the right eye picture and the cutout region of the left eye picture at the boundary portion between the monocular vision region and the binocular vision region. This enables to moderate the change in luminance. Accordingly, it is possible for the user to naturally perceive the boundary portion.
In addition, the output control unit 106 is also capable of eliminating distortion of the right eye picture and the left eye picture that have been cut out.
In addition, the output control unit 106 causes the right eye display unit 126R to display the generated right eye picture, and causes the left eye display unit 126L to display the generated left eye picture.
The communication unit 120 exchanges information with another device capable of communicating with the HMD 10-1. For example, the communication unit 120 transmits a predetermined content acquisition request to the server 20 under the control of the content acquisition unit 102. In addition, the communication unit 120 receives the content from the server 20.
For example, the sensor unit 122 includes a triaxial acceleration sensor, a gyro scope, a magnetic sensor, an illuminance sensor, an image sensor, an infrared sensor, or the like. For example, the sensor unit 122 measures a speed, acceleration, inclination, a cardinal direction, or the like of the HMD 10-1. In addition, the sensor unit 122 measures brightness in an environment. In addition, the sensor unit 122 is also capable of detecting external video and recording it as a digital picture by using the image sensor or the infrared sensor.
In addition, the sensor unit 122 may include a positioning device configured to measure a current position by receiving a positioning signal from a positioning satellite such as the Global Positioning System (GPS), for example.
The storage unit 124 stores various kinds of data and various kinds of software.
The left eye display unit 126L and the right eye display unit 126R display video by emitting light. For example, the left eye display unit 126L and the right eye display unit 126R include picture projection devices. In addition, the left eye display unit 126L and the right eye display unit 126R causes the picture projection devices to project video on at least respective partial regions of the left eye lens (left eye optical system) and the right eye lens (right eye optical system) that are serving as projection surfaces. Note that, the left-eye lens and the right-eye lens may include transparent material such as resin or glass, for example.
Note that, in a modification, each of the left eye display unit 126L and the right eye display unit 126R may include a liquid crystal panel, and may be capable of controlling transmittance of the liquid crystal panel. Accordingly, the left eye display unit 126L and the right eye display unit 126R may be controlled to be the transparent or translucent state.
In addition, as another modification, the left eye display unit 126L and the right eye display unit 126R may be configured as a non-see-through display device, and may successively display video of a gaze direction of a user captured by the sensor unit 122. For example, the left eye display unit 126L and the right eye display unit 126R may include a liquid crystal display (LCD), an organic light emitting diode (OLED), or the like.
The configurations according to the first embodiment have been described above. Next, with reference to
As illustrated in
Next, the output control unit 106 determines whether the acquired content is dedicated content (in other words, content dedicated to the HMD 10-1) or not (S103).
In the case where the acquired content is the dedicated content (Yes in S103), the output control unit 106 generates a left eye picture on the basis of a left eye video signal of the acquired content, and generates a right eye picture on the basis of a right eye video signal of the content (S105).
Next, the left eye display unit 126L displays the generated left eye picture under the control of the output control unit 106. In addition, the right eye display unit 126R displays the generated right eye picture under the control of the output control unit 106 (S107).
Alternatively, in the case where the acquired content is not the dedicated content in S103 (No in S103) and content information of the content is acquired in S101 (Yes in S109), the output control unit 106 generates a right eye picture and a left eye picture on the basis of the acquired content and content information (S111). Next, the HMD 10-1 performs a process in S107.
Alternatively, in the case where the acquired content is not the dedicated content in S103 (No in S103) and content information of the content is not acquired in S101 (No in S109), the output control unit 106 first analyzes the video signal of the content (S113). Next, the output control unit 106 generates a right eye picture and a left eye picture on the basis of the content and a video analysis result (S115). Next, the HMD 10-1 performs a process in S107.
As described above, in the HMD 10-1 according to the first embodiment, the right eye display unit 126R and the left eye display unit 126L are tilted in a manner that the plane passing through the right eye 2R and the center line intersects with the plane passing through the left eye 2L and the other center line, the center line being perpendicular to the right eye virtual image 30R, the other center line being perpendicular to the left eye virtual image 30L. This enables to secure both a wide field of view and a wide binocular vision region at the same time.
For example, in comparison with the publicly-known see-through head-mounted display, the device according to the present disclosure is capable of securing a binocular vision region staring from a position closer to a user. Therefore, in comparison with the publicly-known technology, the device according to the present disclosure is capable of appropriately displaying video using binocular disparity view in a wider range in a region in which binocular disparity is more effective than the other cognition (in other words, a region close to a user). In addition, it is possible to cause a user to visually recognize video with a wide field of view in a region in which motion parallax and relative sizes of objects are effective in object recognition (in other words, a region far from a user).
Note that, the first embodiment is not limited to the above described examples. The example in which the content acquisition unit 102 and the output control unit 106 are included in the HMD 10-1 has been described above, for example. However, the present disclosure is not limited thereto. For example, instead of the HMD 10-1, the server 20 may include (at least a part of the respective functions of) the content acquisition unit 102 and the output control unit 106.
In addition, according to the modification, the server 20 is capable of generating a right eye picture and a left eye picture on the basis of display target content and device information received from another device such as the HMD 10-1 or the like, and transmitting the generated right eye picture and left eye picture to the other device, for example. For example, the server 20 first determines whether a display of the other device is a reverse-V-shape display or a display for HMD 10-1 (in other words, a V-shape display) on the basis of the device information received from the other device. Next, the server 20 acquires two types of streams for the determined display (in other words, a left eye video signal and a right eye video signal for the determined display) among four types of streams of the display target content, and generates a right eye picture and a left eye picture on the basis of the acquired streams. Next, the server 20 transmits the generated right eye picture and left eye picture to the other device.
The first embodiment has been described above. In the first embodiment, the example in which the positional relation (such as an angle) between the left eye display unit 126L and the right eye display unit 126R is fixed has been described.
Meanwhile, a desirable positional relation between the left eye display unit 126L and the right eye display unit 126R may change in accordance with usage situations. For example, in the case of prioritizing a wide binocular vision region, it is desirable to determine a positional relation between the left eye display unit 126L and the right eye display unit 126R such that a wide overlap region between a picture displayed on the left eye display unit 126L and a picture displayed on the right eye display unit 126R is obtained. In this case, for example, as illustrated in
In addition, in the case of prioritizing a wide field of view, it is desirable to determine a positional relation between the left eye display unit 126L and the right eye display unit 126R such that a small overlap region between a picture displayed on the left eye display unit 126L and a picture displayed on the right eye display unit 126R is obtained. In this case, for example, as illustrated in
Next, the second embodiment will be described. As described below, it is possible for the HMD 10-2 according to the second embodiment to change a positional relation between the left eye display unit 126L and the right eye display unit 126R in accordance with usage situations.
Here, the positional relation between the left eye display unit 126L and the right eye display unit 126R may be changed manually or automatically. For example, it is possible to manually change the positional relation between the left eye display unit 126L and the right eye display unit 126R in response to operation performed on an operation unit (not illustrated) such as a dial attached to the HMD 10-2. Note that, the positional relation between the left eye display unit 126L and the right eye display unit 126R may include a plurality of stages in advance.
First, a configuration of the HMD 10-1 according to the second embodiment will be described. Note that, hereinbelow, description similar to the first embodiment will be omitted.
The output control unit 106 according to the second embodiment changes a region in content to be displayed on the left eye display unit 126L (hereinafter, referred to as a left eye display region) and a region in content to be displayed on the right eye display unit 126R (hereinafter, referred to as a right eye display region), on the basis of information related to display target content. For example, the output control unit 106 changes a degree of overlap between the left eye display region and the right eye display region in accordance with information related to display target content.
For example, in the case where the content is a video signal of “16:9”, the output control unit 106 shrinks an overlap region between the left eye display region and the right eye display region such that it becomes possible to display the video of “16:9”. In addition, in the case where the content includes setting data regarding the overlap between the regions, the output control unit 106 determines the left eye display region and the right eye display region in accordance with the setting data. In addition, in the case where the content is 2D content, the output control unit 106 may determine the left eye display region and the right eye display region such that the overlap region between the left eye display region and the right eye display region becomes smaller than a predetermined threshold (in other words, such that a total region including the left eye display region and the right eye display region becomes larger). Alternatively, in the case where the content is 3D content, the output control unit 106 may determine the left eye display region and the right eye display region such that the overlap region between the left eye display region and the right eye display region becomes larger than the predetermined threshold. In addition, in the case where the content is still picture content, the output control unit 106 may determine the left eye display region and the right eye display region such that the overlap region between the left eye display region and the right eye display region becomes larger than a predetermined threshold.
In addition, the output control unit 106 is capable of determining the left eye display region and the right eye display region on the basis of a genre of the content. Here, the genre of the content includes supportive applications such as navigation, shopping, game, education, and a manual for assembling a plastic model, for example. For example, in the case where the genre indicates the navigation, the output control unit 106 may determine the left eye display region and the right eye display region such that the overlap region between the left eye display region and the right eye display region becomes larger than a predetermined threshold.
In addition, the output control unit 106 is also capable of determining the left eye display region and the right eye display region on the basis of information regarding chapters or scenes included in the content, for each chapter or scene.
Alternatively, in the case where a display target (not content) is an application, the output control unit 106 may determine the left eye display region and the right eye display region such that the overlap region between the left eye display region and the right eye display region in the application becomes larger than a predetermined threshold, on the basis of information notified by the application.
Note that, in the case where the overlap between regions is not particularly prescribed in the application, or in the case where the overlap between regions is prescribed such that the overlap is variable in accordance with behavior of a user, the output control unit 106 is capable of determining the left eye display region and the right eye display region on the basis of a situation of a user or an environment.
In addition, the output control unit 106 is capable of determining the left eye display region and the right eye display region on the basis of information regarding a user or an environment. Here, the information regarding a user or an environment may include age of the user, user setting information, a moving speed of the user, a result of recognizing behavior of the user, positional information of the user, and the like, for example.
For example, in the case where a user is not old enough to see 3D content (this is defined by a public agency, for example), the output control unit 106 may determine the left eye display region and the right eye display region such that the overlap region between the left eye display region and the right eye display region becomes smaller than a predetermined threshold, or such that there is no overlap region between the left eye display region and the right eye display region. Alternatively, in the case where a user is old enough to see 3D content, the output control unit 106 may determine the left eye display region and the right eye display region such that the overlap region between the left eye display region and the right eye display region becomes larger than the predetermined threshold.
In addition, the output control unit 106 may determine the left eye display region and the right eye display region in accordance with whether or not wide-angle display is set by a user. For example, in the case where the wide-angle display is set, the output control unit 106 may determine the left eye display region and the right eye display region such that the overlap region between the left eye display region and the right eye display region becomes smaller than a predetermined threshold. Alternatively, in the case where the wide-angle display is not set, the output control unit 106 may determine the left eye display region and the right eye display region such that the overlap region between the left eye display region and the right eye display region becomes larger than the predetermined threshold.
In addition, the output control unit 106 is capable of determining the left eye display region and the right eye display region on the basis of a detected moving speed of a user. For example, in the case where the detected moving speed is faster than a predetermined threshold, the output control unit 106 may determine the left eye display region and the right eye display region such that the overlap region between the left eye display region and the right eye display region becomes larger than a predetermined threshold. Alternatively, in the case where the detected moving speed is slower than the predetermined threshold, the output control unit 106 may determine the left eye display region and the right eye display region such that the overlap region between the left eye display region and the right eye display region becomes smaller than the predetermined threshold.
In addition, the output control unit 106 is capable of determining the left eye display region and the right eye display region on the basis of a result of recognizing behavior of a user through the detection result acquisition unit 104. Here, the behavior of the user includes walking, running, riding a bicycle, being on a train, riding a vehicle, walking up or down stairs, being on an elevator, being on an escalator, and the like, for example.
For example, in the case where it is recognized that the user is walking, the output control unit 106 may determine the left eye display region and the right eye display region such that the overlap region between the left eye display region and the right eye display region becomes larger than a predetermined threshold. Alternatively, in the case where it is recognized that the user is running or riding a bicycle, the output control unit 106 may determine the left eye display region and the right eye display region such that the overlap region between the left eye display region and the right eye display region becomes smaller than the predetermined threshold.
In addition, in the case where it is recognized that the user is being on a train or riding a vehicle, the output control unit 106 may determine the left eye display region and the right eye display region in accordance with a detected moving speed of the train or the vehicle. For example, in the case where the detected moving speed of the train or the vehicle is faster than a predetermined speed, the output control unit 106 may determine the left eye display region and the right eye display region such that the overlap region between the left eye display region and the right eye display region becomes smaller than a predetermined threshold. Alternatively, in the case where the detected moving speed of the train or the vehicle is slower than the predetermined speed, the output control unit 106 may determine the left eye display region and the right eye display region such that the overlap region between the left eye display region and the right eye display region becomes larger than the predetermined threshold.
In addition, in the case where it is recognized that the user is walking up or down stairs, the output control unit 106 may determine the left eye display region and the right eye display region such that the overlap region between the left eye display region and the right eye display region becomes smaller than a predetermined threshold.
In addition, the output control unit 106 is also capable of determining the left eye display region and the right eye display region on the basis of information regarding a detected position of a user. For example, the output control unit 106 may acquire information including designation of overlap between regions from a server 20 for example, and determine the left eye display region and the right eye display region on the basis of the acquired information. The information including designation of overlap between regions is associated with detected positional information of the user.
In addition, the output control unit 106 is also capable of determining the left eye display region and the right eye display region in accordance with a place where the user is present. The place is detected by the detection result acquisition unit 104. For example, in the case where it is detected that the user is in an amusement park, the output control unit 106 may acquire information including designation of overlap between regions, and determine the left eye display region and the right eye display region on the basis of the acquired information. The information including designation of an overlap region is issued from an organizer of the amusement park. Alternatively, in the case where it is detected that the user is in a store such as a department store, the output control unit 106 may acquire information including designation of overlap between regions, and determine the left eye display region and the right eye display region on the basis of the acquired information. The information including designation of an overlap region is issued from an organizer of the department store.
In addition, the output control unit 106 may determine the left eye display region and the right eye display region on the basis of a result of detecting whether a user is in a room or not.
In addition, the output control unit 106 is also capable of determining the left eye display region and the right eye display region on the basis of whether or not a setting for referring to past user statuses is configured. For example, in the case where a setting for referring to past user statuses is configured, the output control unit 106 may determine the left eye display region and the right eye display region in accordance with a behavior history of the user. For example, the output control unit 106 determines the left eye display region and the right eye display region on the basis of a history of a setting regarding a degree of overlap between the left eye display region and the right eye display region at the time of displaying content that is similar to or the same as display target content in the past. For example, the output control unit 106 determines an overlap region between the left eye display region and the right eye display region such that the over region becomes the same as a degree of overlap that has been set most frequently in the past.
Here, the behavior history may be a behavior history of a target user himself/herself, or may be a behavior history of another user related to the target user. For example, the other user may be all or a part of users registered in a predetermined service that the target user uses.
In addition, in the case where a setting for referring to past user statuses is not configured, the output control unit 106 may determine the left eye display region and the right eye display region in accordance with current setting information regarding overlap between regions.
In addition, the output control unit 106 generates a left eye picture on the basis of the determined left eye display region, and generates a right eye picture on the basis of the determined right eye display region.
Note that, the output control unit 106 is also capable of determining whether to arrange an object in the binocular vision region or the monocular vision region in accordance with a current positional relation between the left eye display unit 126L and the right eye display unit 126R, and then generating a left eye picture and a right eye picture on the basis of the determined arrangement of the object. The object is included in the determined left eye display region or right eye display region.
In addition, in the case where it is possible to manually change a positional relation between the left eye display unit 126L and the right eye display unit 126R, the output control unit 106 controls output of guide information for instructing a user to change the positional relation in accordance with the determined left eye display region and right eye display region. Here, the guide information may include not only content of the change in positional relation (for example, turning the dial to the number “3”), but also an instruction regarding a timing to change the positional relation.
For example, the output control unit 106 may cause the left eye display unit 126L or the right eye display unit 126R to display a UI that instructs a user to change the positional relation in accordance with the determined left eye display region and right eye display region, or may blink an LED in accordance with a blinking pattern corresponding to the guide information. The LED is installed in the HMD 10-2. Alternatively, the output control unit 106 may output sound of the guide information, or may vibrate the HMD 10-2 or another device carried by the user.
Alternatively, in the case where it is possible to automatically change the positional relation between the left eye display unit 126L and the right eye display unit 126R (under the control of the drive control unit 108 to be described later), the output control unit 106 causes the left eye display unit 126L or the right eye display unit 126R to show a display indicating that the positional relation between the left eye display unit 126L and the right eye display unit 126R is changing. For example, the output control unit 106 may cause the left eye display unit 126L or the right eye display unit 126R to display text or a picture indicating that the positional relation is changing. Alternatively, it is also possible for the output control unit 106 to temporarily darken video that is currently being displayed on the left eye display unit 126L or the right eye display unit 126R, to mist all or a part of the displayed video, or to hide all or a part of the displayed video.
According to the above-described control examples, visibility is reduced when the positional relation between the left eye display unit 126L and the right eye display unit 126R is changed. Accordingly, it is possible to reduce a feeling of strangeness regarding viewing, or to reduce visually induced motion sickness.
The drive control unit 108 performs control such that a positional relation between the left eye display unit 126L and the right eye display unit 126R automatically changes, on the basis of the left eye display region and right eye display region that have been determined by the output control unit 106. For example, the drive control unit 108 drives the actuator 128L or the actuator 128R such that the positional relation between the left eye display unit 126L and the right eye display unit 126R becomes a positional relation corresponding to the determined left eye display region and right eye display region.
Meanwhile, when wearing the HMD 10-2, positions of eyes of a user with respect to the left eye display unit 126L or the right eye display unit 126R may vary depending on each user. For example, as illustrated in
Therefore, it is preferable for the drive control unit 108 to perform control such that the positional relation between the left eye display unit 126L and the right eye display unit 126R changes on the basis of a result of detecting a position of the left eye with respect to the left eye display unit 126L or a position of the right eye with respect to the right eye display unit 126R, and a way to see a target that is determined in advance for each piece of content, for example.
The actuator 128L and the actuator 128R changes angles or positions of the left eye display unit 126L or the right eye display unit 126R under the control of the drive control unit 108.
Alternatively, for example, in the case where movement of a right eye 2R is detected as illustrated in
Note that, although
For example, each of the dimmer filter 130L and the dimmer filter 130R include a transmitting light amount variable device such as electrochromic. The dimmer filter 130L and the dimmer filter 130R reduce transmitting light amounts under the control of the control unit 100-2.
Note that, the configuration of the HMD 10-2 according to the second embodiment is not limited to the above. For example, the positional relation between the left eye display unit 126L and the right eye display unit 126R may be changed manually only. In addition, in this case, the HMD 10-2 does not have to include the drive control unit 108, the actuator 128L, or the actuator 128R.
In addition, the HMD 10-2 does not have to include the dimmer filter 130L or the dimmer filter 130R.
The configurations according to the second embodiment have been described above. Next, an operation example according to the second embodiment will be described.
After S201, the content acquisition unit 102 of the HMD 10-2 acquires information related to content acquired in S201 from the server 20, for example (S203).
Next, the detection result acquisition unit 104 acquires information regarding a user or an environment (S205). The information regarding the user or the environment is detected by the sensor unit 122.
Next, the output control unit 106 determines a degree of overlap between the left eye display region and the right eye display region on the basis of the information related to the content acquired in S203, and the information regarding the user or the environment acquired in S205. Subsequently, the output control unit 106 generates a right eye picture on the basis of the determined right eye display region, and generates a left eye picture on the basis of the determined left eye display region (S207).
Next, in the case where it is impossible to automatically change the positional relation between the left eye display unit 126L and the right eye display unit 126R, in other words, in the case where it is possible to change the positional relation manually only (No in S209), the output control unit 106 causes the right eye display unit 126R or the left eye display unit 126L to display a UI that instructs the user to change the positional relation between the right eye display unit 126R and the left eye display unit 126L in accordance with a degree of overlap determined in S207. Subsequently, the user operates an operation unit of the HMD 10-2 in accordance with the displayed UI to change the positional relation between the right eye display unit 126R and the left eye display unit 126L, for example (S211). Next, the HMD 10-2 performs a process in S215 (to be described later).
On the other hand, in the case where it is possible to automatically change the positional relation between the left eye display unit 126L and the right eye display unit 126R (Yes in S209), the drive control unit 108 drives the actuator 128L or the actuator 128R such that the positional relation between the left eye display unit 126L and the right eye display unit 126R changes in accordance with a degree of overlap determined in S207 (S213).
Note that, S215 illustrated in
As described above, it is possible for the HMD 10-2 according to the second embodiment to change the degree of overlap between the left eye display region and the right eye display region in accordance with usage situations.
For example, in the case of prioritizing a wide binocular vision region, the HMD 10-2 determines the left eye display region and the right eye display region such that a wide overlap region between the left eye display region and the right eye display region is obtained. Alternatively, in the case of prioritizing a wide field of view, the HMD 10-2 determines the left eye display region and the right eye display region such that a small overlap region between the left eye display region and the right eye display region is obtained. As described above, the HMD 10-2 is capable of dynamically adjusting the size of the field of view and the size of the binocular vision region. Therefore, it is possible for the HMD 10-2 to display optimum video that varies for each of the usage situations.
Note that, the second embodiment is not limited to the above. For example, in the case where a part of the HMD 10-2 is malfunctioning, the output control unit 106 is capable of outputting display, sound, or vibration that indicates an error. For example, in such a case, the drive control unit 108 may drive the actuator 128L or the actuator 128R such that the angle of the left eye display unit 126L and the angle of the right eye display unit 126R become parallel to each other.
Alternatively, in the case where it becomes impossible to detect necessary information such as a moving speed during driving a vehicle, the output control unit 106 may shrink an overlap region between the left eye display region and the right eye display region, for example. According to such a modification, it is possible to improve safety during using the HMD 10-2.
Next, with reference to
The CPU 150 functions as an arithmetic device and a control device to control all of the operating processes in the HMD 10 in accordance with various kinds of programs. In addition, the CPU 150 realizes the function of the control unit 100-1 or the control unit 100-2. Note that, the CPU 150 is implemented by a processor such as a microprocessor.
The ROM 152 stores programs used by the CPU 150, control data such as operation parameters, and the like.
The RAM 154 temporarily stores programs and the like executed by the CPU 150, for example.
The internal bus 156 is implemented by a CPU bus or the like. The internal bus 156 mutually connects the CPU 150, the ROM 152, with the RAM 154.
The interface 158 connects the input device 160, the output device 162, the storage device 164, and the communication device 166 with the internal bus 156.
The storage device 164 is a data storage device that functions as the storage unit 124. For example, the storage device 164 may include a storage medium, a recording device configured to record data in the storage medium, a reader device configured to read data from the storage medium, a deletion device configured to delete data recorded in the storage medium, and the like.
The communication device 166 is a communication interface including a communication device or the like configured to connect with the communication network 22. In addition, the communication device 166 may be a wireless LAN compatible communication device, a long term evolution (LTE) compatible communication device, or may be a wired communication device that performs wired communication. The communication device 166 functions as the communication unit 120.
The preferred embodiment(s) of the present disclosure has/have been described above with reference to the accompanying drawings, whilst the present disclosure is not limited to the above examples. A person skilled in the art may find various alterations and modifications within the scope of the appended claims, and it should be understood that they will naturally come under the technical scope of the present disclosure.
For example, in the case where the left eye display and the right eye display are distorted, visibility is reduced unfortunately. Next, with reference to
Accordingly, it is desirable for the HMD 10 to change a positional relation between the left eye display and the right eye display (such as an angle between the displays) in accordance with distortions of the left eye display and the right eye display. This enables to smooth the joints in the overlap region between the left eye display region 44L and the right eye display region 44R as illustrated in
In addition, in the above described embodiments, the example in which the display device and the information processing device according to the present disclosure serve as HMDs 10 has been described. However, the present disclosure is not limited thereto. For example, the display device or the information processing device may be a projector device configured to draw a picture on retina by using laser light, for example.
In addition, all the structural elements included in the control unit 100-1 (or the control unit 100-2) may be installed in the server 20 instead of the HMD 10-1 (or the HMD 10-2). In addition, in this case, the display device or the information processing device according to the present disclosure may serve as the server 20 instead of the HMD 10-1 (or the HMD 10-2).
Alternatively, the display device or the information processing device may be another type of device capable of connecting with the communication network 22, such as a personal computer (PC), a smartphone, a tablet terminal, or a game console.
In addition, according to the above described embodiment, it is also possible to provide a computer program for causing hardware such as the CPU 150, ROM 152, and RAM 154, to execute functions equivalent to the structural elements of the HMD 10-1 or the HMD 10-2 according to the above described embodiments. Moreover, it is also possible to provide a recording medium having the computer program stored therein.
Further, the effects described in this specification are merely illustrative or exemplified effects, and are not limitative. That is, with or in the place of the above effects, the technology according to the present disclosure may achieve other effects that are clear to those skilled in the art from the description of this specification.
Additionally, the present technology may also be configured as below.
An information processing device including a
n output control unit configured to change a first region and a second region on a basis of information related to content to be displayed, the first region being a region within the content to be displayed on a left eye display unit, the second region being a region within the content to be displayed on a right eye display unit.
The information processing device according to (1),
in which the output control unit determines the first region and the second region on a basis of the information related to the content, such that a size of a region in which the first region and the second region overlap each other changes.
The information processing device according to (1) or (2), further including
a drive control unit configured to perform control such that a positional relation between the left eye display unit and the right eye display unit changes, on a basis of the first region and the second region that are determined by the output control unit.
The information processing device according to (3),
in which the drive control unit performs control such that the positional relation between the left eye display unit and the right eye display unit changes, further on a basis of detection of a position of a left eye or a right eye.
The information processing device according to (3) or (4),
in which the output control unit causes a display to be shown while performing the control such that the positional relation between the left eye display unit and the right eye display unit changes, the display indicating that the positional relation between the left eye display unit and the right eye display unit is changing.
The information processing device according to (1) or (2),
in which the output control unit further controls output of guide information for changing a positional relation between the left eye display unit and the right eye display unit, on a basis of the information related to the content.
The information processing device according to (6),
in which the guide information includes information indicating a timing of changing the positional relation between the left eye display unit and the right eye display unit.
The information processing device according to any one of (1) to (7),
in which the information related to the content includes information indicating whether or not three-dimensional video is included in the content.
The information processing device according to any one of (1) to (8),
in which the information related to the content includes information indicating whether or not the content is a still picture.
The information processing device according to any one of (1) to (9),
in which the information related to the content includes information indicating a genre of the content.
The information processing device according to any one of (1) to (10),
in which the information related to the content includes setting information regarding overlap between the first region and the second region.
The information processing device according to any one of (1) to (11),
in which the output control unit changes the first region and the second region further on a basis of information regarding a user or an environment.
The information processing device according to (12),
in which the information regarding the user or the environment includes age of the user.
The information processing device according to (12) or (13),
in which the information regarding the user or the environment includes user setting information regarding overlap between the first region and the second region.
The information processing device according to any one of (12) to (14),
in which the information regarding the user or the environment includes a moving speed of the user.
The information processing device according to any one of (12) to (15),
in which the information regarding the user or the environment includes a result of behavior recognition of the user.
The information processing device according to any one of (12) to (16),
in which the information regarding the user or the environment includes information of a place where the user is present.
The information processing device according to any one of (12) to (17),
in which the information regarding the user or the environment includes a behavior history of the user.
An information processing method including
changing, by a processor, a first region and a second region on a basis of information related to content to be displayed, the first region being a region within the content to be displayed on a left eye display unit, the second region being a region within the content to be displayed on a right eye display unit.
A program causing a computer to function as
an output control unit configured to change a first region and a second region on a basis of information related to content to be displayed, the first region being a region within the content to be displayed on a left eye display unit, the second region being a region within the content to be displayed on a right eye display unit.
Number | Date | Country | Kind |
---|---|---|---|
2015-255884 | Dec 2015 | JP | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2016/077349 | 9/15/2016 | WO | 00 |