Patent Grant
10009602
1. Technical Field
The present invention relates to a head-mounted display device, which is a display device mounted on the head, and a control method for the head-mounted display device.
2. Related Art
There is known a head-mounted display device (a head mounted display, HMD), which is a display device mounted on the head. For example, the head-mounted display device generates image light representing an image using a liquid crystal display and a light source and guides the generated image light to the eyes of a user using a projection optical system and a light guide plate to thereby cause the user to recognize a virtual image. In general, in the head mounted display, a configuration capable of being battery-driven is adopted in order to improve portability. The battery-driven head mounted display is requested to reduce power consumption of the head mounted display in order to increase an available time. In this regard, in the past, there is known a technique for realizing a reduction in power consumption of the head mounted display by reducing the resolution or the frame rate of an image formed on a display device (see, for example, JP-A-2009-118159). However, when the resolution or the frame rate of the image formed on the display device is reduced, the image quality of a virtual image recognized by the user is markedly deteriorated.
An advantage of some aspects of the invention is to provide a technique for realizing low power consumption without deteriorating the image quality of a virtual image recognized by a user.
This application example of the invention is directed to a head-mounted display device that causes a user to recognize a virtual image in a state in which the head-mounted display device is mounted on the head of the user. The head-mounted display device includes: an image-light generating unit for right eye that generates image light from image data for right eye corresponding to the right eye of the user and emits the image light; an image-light generating unit for left eye that generates image light from image data for left eye corresponding to the left eye of the user and emits the image light; a pair of light guide units that guide the image lights, which are emitted from the image-light generating unit for right eye and the image-light generating unit for left eye, to the left and right eyes of the user; and a display control unit that transmits control signals for controlling the emission of the image lights respectively to the image-light generating unit for right eye and the image-light generating unit for left eye. The display control unit transitions, according to a condition set in advance, the head-mounted display device to a power saving state for causing one of the image-light generating unit for right eye and the image-light generating unit for left eye to stop the emission of the image light and causing the other to execute the emission of the image light.
With such a configuration, the display control unit transitions, according to the condition set in advance, the head-mounted display device to the power saving state for causing one of the image-light generating unit for right eye and the image-light generating unit for left eye to stop the emission of the image light and causing the other to execute the emission of the image light. Therefore, in the head-mounted display device, it is possible to realize a reduction in power consumption without deteriorating the image quality of a virtual image recognized by the user.
This application example of the invention is directed to the head-mounted display device of Application Example 1, wherein the condition set in advance is a condition that a target image used for display of the virtual image is a still image. With such a configuration, in the head-mounted display device, it is possible to realize a reduction in power consumption when the target image is a still image.
This application example of the invention is directed to the head-mounted display device of Application Example 1 or 2, which further includes a battery that supplies electric power to the head-mounted display device. The condition set in advance is a condition that the remaining power of the battery is equal to or smaller than predetermined remaining power. With such a configuration, in the head-mounted display device, it is possible to realize a reduction in power consumption when the remaining power of the battery is equal to or smaller than the predetermined remaining power.
This application example of the invention is directed to the head-mounted display device of any of Application Examples 1 to 3, which further includes an illuminance acquiring unit that acquires illuminance indicating ambient brightness. The condition set in advance is a condition that the acquired illuminance is equal to or lower than predetermined illuminance.
With such a configuration, in the head-mounted display device, it is possible to realize a reduction in power consumption when illuminance is equal to or lower than the predetermined illuminance.
This application example of the invention is directed to the head-mounted display device of any of Application Examples 1 to 4, which further includes: a temperature detecting unit for right eye that detects the temperature of the image-light generating unit for right eye; and a temperature detecting unit for left eye that detects the temperature of the image-light generating unit for left eye. The condition set in advance is a condition that at least one of the temperature detected by the temperature detecting unit for right eye and the temperature detected by the temperature detecting unit for left eye is equal to or higher than predetermined temperature. With such a configuration, in the head-mounted display device, it is possible to realize a reduction in power consumption when at least one of the temperature of the image-light generating unit for right eye and the temperature of the image-light generating unit for left eye is equal to or higher than the predetermined temperature.
This application example of the invention is directed to the head-mounted display device of any of Application Examples 1 to 5, wherein the condition set in advance is any one of a condition that the head-mounted display device detects startup of an application designated in advance in an operating system installed in the head-mounted display device, a condition that the head-mounted display device acquires a request from the outside, and a condition that the head-mounted display device detects that a state in which operation for the head-mounted display device is not detected continues for a predetermined time.
With such a configuration, in the head-mounted display device, it is possible to realize a reduction in power consumption when the head-mounted display device detects the startup of the application designated in advance in the operating system installed in the head-mounted display device, when the head-mounted display device acquires a request from the outside, or when the head-mounted display device detects that the state in which operation for the head-mounted display device is not detected continues for the predetermined time.
This application example of the invention is directed to the head-mounted display device of any of Application Examples 1 to 6, which further includes a selection receiving unit that receives, from the user, selection of one of the image-light generating unit for right eye and the image-light generating unit for left eye, the emission of the image light from which is stopped by the display control unit.
With such a configuration, the head-mounted display device includes the selection receiving unit that receives, from the user, selection of one of the image-light generating unit for right eye and the image-light generating unit for left eye, the generation and the emission of the image light from which are stopped by the display control unit. Therefore, it is possible to improve convenience.
This application example of the invention is directed to the head-mounted display device of any of Application Examples 1 to 7, wherein the display control unit alternately switches, in the power saving state, a first state for causing one of the image-light generating unit for right eye and the image-light generating unit for left eye to stop the emission of the image light and causing the other to execute the emission of the image light and a second state for causing one of the image-light generating unit for right eye and the image-light generating unit for left eye to execute the emission of the image light and causing the other to stop the emission of the image light.
With such a configuration, the display control unit alternately switches, in the power saving state, the first state for causing one of the image-light generating unit for right eye and the image-light generating unit for left eye to stop the emission of the image light and causing the other to execute the emission of the image light and the second state for causing one of the image-light generating unit for right eye and the image-light generating unit for left eye to execute the emission of the image light and causing the other to stop the emission of the image light. Therefore, in the head-mounted display device, it is possible to realize a reduction in power consumption without deteriorating the image quality of a virtual image recognized by the user.
This application example of the invention is directed to the head-mounted display device of Application Example 8, wherein, in switching the first state and the second state, the display control unit switches the first state and the second state through a third state for causing both the image-light generating unit for right eye and the image-light generating unit for left eye to execute the emission of the image lights. With such a configuration, when the display control unit switches the first state and the second state, the display control unit switches the states through the third state for causing both the image-light generating unit for right eye and the image-light generating unit for left eye to execute the emission of the image lights. Therefore, it is possible to more naturally switch the first state and the second state.
This application example of the invention is directed to the head-mounted display device of Application Example of 8 or 9, wherein the display control unit switches the first state and the second state further includes: a temperature detecting unit for right eye that detects the temperature of the image-light generating unit for right eye; and a temperature detecting unit for left eye that detects the temperature of the image-light generating unit for left eye. The display control unit switches the first state and the second state when a difference between the temperature detected by the temperature detecting unit for right eye and the temperature detected by the temperature detecting unit for left eye is equal to or larger than a predetermined temperature difference.
With such a configuration, the display control unit switches the first state and the second state when a difference between the temperature of the image-light generating unit for right eye and the temperature of the image-light generating unit for left eye is equal to or larger than a predetermined temperature difference. Therefore, it is possible to suppress a rise in the temperature of one of the image-light generating units.
This application example of the invention is directed to the head-mounted display device of any of Application Examples of 1 to 10, which further includes an image processing unit that acquires a target image used for display of the virtual image and generates the image data for right eye and the image data for left eye using the target image.
The invention can be implemented in various forms. For example, the invention can be implemented in forms such as a head-mounted display device and a control method for the head-mounted display device, a head-mounted display system, a computer program for realizing functions of the method, device, or the system, and a recording medium having recorded therein the computer program.
The invention will be described with reference to the accompanying drawings, wherein like numbers reference like elements.
Embodiments of the invention are explained below.
The head mounted display HM includes an image display unit 20 that causes the user to visually recognize a virtual image in a state in which the image display unit 20 is mounted on the head of the user and a controller 10 that controls the image display unit 20.
The image display unit 20 is a mounted member mounted on the head of the user. In this embodiment, the image display unit 20 has an eyeglass shape. The image display unit 20 includes ear hooking sections 21, a right display driving unit 22, a left display driving unit 24, an illuminance sensor 25, a right optical panel 26, and a left optical panel 28. The ear hooking sections 21 are members provided to transverse on the ears of the user from the ends of the right display driving unit 22 and the left display driving unit 24 and function as temples. The right optical panel 26 and the left optical panel 28 are arranged to be respectively located before the right and left eyes of the user in a state in which the user wears the image display unit 20. The right display driving unit 22 is arranged in a connecting place of the ear hooking section 21 for the right ear and the right optical panel 26. The left display driving unit 24 is arranged in a connecting place of the ear hooking section 21 for the left ear and the left optical panel 28. In the following explanation, the right display driving unit 22 and the left display driving unit 24 are collectively referred to simply as “display driving unit”. The right optical panel 26 and the left optical panel 28 are collectively referred to simply as “optical panel”. The illuminance sensor 25 functioning as the illuminance acquiring unit is a sensor for acquiring ambient brightness (illuminance).
The display driving unit includes an LCD (Liquid Crystal Display), a projection optical system, and the like, which are not shown in the figure. Details are explained later. The optical panel includes a light guide plate and a light modulating plate, which are not shown in the figure. The light guide plate is formed of a light transmissive resin material or the like and emits image light, which is captured from the display driving unit, to the eyes of the user. The light modulating plate is an optical device of a thin plate shape and is arranged to cover the front side (a side opposite to the side of the eyes of the user) of the light guide plate. The light modulating plate protects the light guide plate, suppresses, for example, damage and adhesion of stains to the light guide plate, and adjusts the light transmittance of the light modulating plate. Consequently, the light modulating plate can adjust an amount of external light entering the eyes of the user and adjust easiness of visual recognition of a virtual image. The light modulating plate can be omitted. The image display unit 20 further includes a right earphone 32 for the right ear and a left earphone 34 for the left ear. The right earphone 32 and the left earphone 34 are respectively worn on the right ear and the left ear when the user wears the image display unit 20.
The image display unit 20 further includes a connecting unit 40 for connecting the image display unit 20 to a controller 10. The connecting unit 40 includes a main body cord 48 connected to the controller 10, a right cord 42 and a left cord 44, which are two cords branching from the main body cord 48, and a coupling member 46 provided at a branch point. The right cord 42 is connected to the right display driving unit 22. The left cord 44 is connected to the left display driving unit 24. The image display unit 20 and the controller 10 perform transmission of various signals via the connecting unit 40. Connectors (not shown) that fit with each other are respectively provided at an end on the opposite side of the coupling member 46 in the main body cord 48 and the controller 10. The controller 10 and the image display unit 20 are connected and disconnected by fitting the connector of the main body cord 48 and the connector of the controller 10 and releasing the fitting. As the right cord 42, the left cord 44, and the main body cord 48, for example, a metal cable and an optical fiber can be adopted.
The controller 10 is a device for operating the head mounted display HM. The controller 10 includes a lighting unit 12, a touch pad 14, a cross key 16, and a power switch 18. The lighting unit 12 notifies an operation state of the head mounted display HM (e.g., an ON or OFF state of the power supply) with a light emission state of the lighting unit 12. As the lighting unit 12, for example, an LED (Light Emitting Diode) can be used. The touch pad 14 detects finger operation by the user on an operation surface of the touch pad 14 and outputs a signal corresponding to detection content. The cross key 16 detects pressing operation of keys corresponding to up, down, left, and right directions and outputs a signal corresponding to detection content. The power switch 18 detects slide operation of the switch to switch a power-on state of the head mounted display HM.
The CPU 140 executes a computer program installed in advance to thereby provide a function of an operating system (OS) 150. The CPU 140 expands firmware or a computer program stored in the ROM or the hard disk on the RAM and executes the firmware or the computer program to thereby function as an image processing unit 160 (details are explained later), a sound processing unit 170 (details are explained later), and a display control unit 190 (details are explained later).
The interface 180 is an interface for connecting various external apparatuses OA (e.g., a personal computer PC, a cellular phone terminal, and a game terminal), which are supply sources of contents, to the controller 10. As the interface 180, the controller 10 can include, for example, a USB interface, a micro USB interface, an interface for memory card, or a wireless LAN interface. Contents mean information contents including an image (a still image or a moving image) and sound. The image processing unit 160 generates a vertical synchronization signal VSync, a horizontal synchronization signal HSync, and image data Data on the basis of contents input via the interface 180 and supplies these signals to the image display unit 20 via the connecting unit 40. Specifically, the image processing unit 160 acquires an image signal included in the contents. For example, in the case of a moving image, the acquired image signal is, in general, an analog signal including thirty frame images per second. The image processing unit 160 separates synchronization signals such as the vertical synchronization signal VSync and the horizontal synchronization signal HSync from the acquired image signal. The image processing unit 160 converts the analog image signal, from which the synchronization signals are separated, into a digital image signal using a not-shown A/D conversion circuit or the like. Thereafter, the image processing unit 160 stores, frame by frame, the digital image signal after the conversion in the DRAM in the storing unit 120 as image data Data (RGB data) of a target image. The image processing unit 160 outputs the image data Data of the target image as image data for right eye and image data for left eye. The image processing unit 160 may execute, on the image data, image processing such as resolution conversion processing, various kinds of color tone correction processing such as adjustment of luminance and chroma, and keystone correction processing according to necessity.
The display control unit 190 generates control signals for controlling the right display driving unit 22 and the left display driving unit 24 and supplies the control signals to the image display unit 20 via the connecting unit 40 to thereby control an image display state in the image display unit 20. Specifically, the display control unit 190 separately controls, according to the control signals, effectiveness/ineffectiveness of driving of a right LCD 241 by a right LCD-control unit 211, effectiveness/ineffectiveness of driving of a right backlight 221 by a right-backlight control unit 201, effectiveness/ineffectiveness of driving of a left LCD 242 by a left-LCD control unit 212, and effectiveness/ineffectiveness of driving of a left backlight 222 by a left-backlight control unit 202 to thereby control presence or absence of generation and emission of image lights by each of the right display driving unit 22 and the left display driving unit 24. Details are explained later.
The sound processing unit 170 acquires a sound signal included in the contents, amplifies the acquired sound signal, and supplies the sound signal to the right earphone 32 and the left earphone 34 of the image display unit 20 via the connecting unit 40.
The image display unit 20 includes the right display driving unit 22, the left display driving unit 24, a right light guide plate 261 functioning as the right optical panel 26, a left light guide plate 262 functioning as the left optical panel 28, the illuminance sensor 25, the right earphone 32, and the left earphone 34. The right display driving unit 22 includes the right-backlight (BL) control unit 201 and the right-backlight (BL) 221 functioning as a light source, the right LCD-control unit 211 and the right LCD 241 functioning as a display device, a right temperature detecting unit 231 functioning as the temperature detecting unit for right eye, and a right projection optical system 251. The left display driving unit 24 includes the left-backlight (BL) control unit 202 and the left-backlight (BL) 222 functioning as a light source, the left-LCD control unit 212 and the left LCD 242 functioning as a display device, a left temperature detecting unit 232 functioning as the temperature detecting unit for left eye, and a left projection optical system 252. The right display driving unit 22 and the left display driving unit 24 form a pair. The units of the left display driving unit 24 have configurations and perform operations same as those of the units of the right display driving unit 22 explained below. Therefore, detailed explanation of the units of the left display driving unit 24 is omitted.
The right-backlight control unit 201 includes a function of driving the right backlight 221 on the basis of a control signal input via the connecting unit 40. The right backlight 221 is, for example, a light emitting member such as an LED. The right LCD-control unit 211 has a function of driving the right LCD 241 on the basis of the vertical synchronization signal VSync, the horizontal synchronization signal HSync, and the image data for right eye input via the connecting unit 40. The right LCD 241 is a transmissive liquid crystal panel in which plural pixels are arranged in a matrix shape. The right LCD 241 has a function of driving liquid crystals corresponding to the positions of the pixels arranged in the matrix shape to thereby change the transmittance of light transmitted through the right LCD 241 to modulate illumination light irradiated from the right backlight 221 into effective image light representing an image. The right-backlight control unit 201, the right LCD-control unit 211, the right backlight 221, and the right LCD 241 are generally referred to as “image-light generating unit for right eye”. Similarly, the left-backlight control unit 202, the left-LCD control unit 212, the left backlight 222, and the left LCD 242 are generally referred to as “image-light generating unit for left eye”. In this embodiment, the backlight system is adopted. However, image light may be emitted using a front light system or a reflection system.
The right projection optical system 251 includes a collimate lens that converts image light emitted from the right LCD 241 into light beams in a parallel state. The right light guide plate 261 functioning as the right optical panel 26 guides the image light output from the right projection optical system 251 to the right eye of the user while reflecting the image light along a predetermined optical path. The right projection optical system 251 and the right light guide plate 261 are generally referred to as “light guide unit”.
The right temperature detecting unit 231 is attached to an end of the right LCD 241 and includes a function of detecting the temperature of the right LCD 241. The right temperature detecting unit 231 includes, for example, a thermistor, a temperature sensor IC, and a fuse. The right temperature detecting unit 231 may be configured as a non-contact temperature sensor besides a contact temperature sensor.
When the head mounted display HM is in the normal state SN, the display control unit 190 monitors whether a power saving start condition is satisfied. After the power saving start condition is satisfied, the display control unit 190 transitions the head mounted display HM to the power saving state SE. When the head mounted display HM is in the power saving state SE, the display control unit 190 monitors whether a power saving stop condition is satisfied. After the power saving stop condition is satisfied, the display control unit 190 transitions the head mounted display HM to the normal state SN. A state that the head mounted display HM takes first when started (an initial state) may be either the normal state SN or the power saving state SE.
The power saving start condition can be arbitrarily set. For example, one or plural conditions can be selected out of conditions (a1) to (a7) listed below.
(a1) Content is a still image. The still image means an image having a main purpose of displaying information such as an initial screen of an OS, a screen of document creation software or mail software started on the OS, or a play list display screen for music. The display control unit 190 can determine, according to the type of an application started on the OS, whether the content is a still image. If the condition (a1) is selected as the power saving start condition, the head mounted display HM can take the power saving state SE according to the type of a target image. Therefore, it is possible to realize low power consumption according to the type of the target image. When the content is a still image, even in the power saving state SE for displaying a virtual image before one eye of the user, the user can easily recognize the virtual image displayed in a visual field area.
(a2) The remaining power of the power supply 130 (the secondary battery) is equal to or smaller than predetermined remaining power. The predetermined remaining power can be arbitrarily set and is stored in the setting information CI in the storing unit 120. If the condition (a2) is selected as the power saving start condition, the head mounted display HM can take the power saving state SE when the remaining power of the secondary battery runs short. Therefore, it is possible to realize low power consumption when the remaining power of the secondary battery runs short. As a result, when the remaining power of the battery runs short in the head mounted display HM that can be battery-driven, it is possible to increase an operating time of the battery.
(a3) Illuminance acquired by the illuminance sensor 25 is equal to or lower than predetermined illuminance. The predetermined illuminance can be arbitrarily set and is stored in the setting information CI in the storing unit 120. If the condition (a3) is selected as the power saving start condition, the head mounted display HM can take the power saving state SE when the ambient brightness is equal to or lower than the predetermined illuminance, i.e., when the environment is dark. Therefore, it is possible to realize low power consumption when the environment is dark. When the environment is dark, even in the power saving state SE for displaying a virtual image before one eye of the user, the user can easily recognize the virtual image displayed in the visual field area.
(a4) One of the temperature of the right LCD 241 detected by the right temperature detecting unit 231 and the temperature of the left LCD 242 detected by the left temperature detecting unit 232 is equal to or higher than predetermined temperature. The predetermined temperature can be arbitrarily set and is stored in the setting information CI in the storing unit 120. If the condition (a4) is selected as the power saving start condition, the head mounted display HM can take the power saving state SE when the temperature of the image-light generating unit for right eye or the image-light generating unit for left eye is equal to or higher than predetermined temperature, i.e., when the temperature of the left or right image-light generating units rises. Therefore, it is possible to realize low power consumption when the temperature of the left or right image-light generating units is high. It is desirable to suppress the rise in the temperature of the image-light generating unit because the rise in the temperature leads to a failure of the LCD. Consequently, since the low power consumption is realized when the temperature of the left or right image-light generating unit is high, it is possible to suppress a further rise in the temperature of the image-light generating unit.
(a5) Startup of an application designated in advance in the OS is detected. As the designation of the application, for example, designation by the user is possible. Content of the designation is stored in the setting information CI in the storing unit 120. If the condition (a5) is selected as the power saving start condition, the head mounted display HM can take the power saving state SE according to the startup of the application designated in advance.
(a6) A power saving request is acquired from the outside. Specifically, the display control unit 190 acquires a request for selection of power saving via the touch pad 14 or the cross key 16 provided in the controller 10. If the condition (a6) is selected as the power saving start condition, the head mounted display HM can take the power saving state SE according to operation from the touch pad 14 or the cross key 16.
(a7) A state in which operation for the head mounted display HM (e.g., operation for the touch pad 14 and the cross key 16) is not detected continues for a predetermined time. The predetermined time can be arbitrarily set and is stored in the setting information CI in the storing unit 120. If the condition (a7) is selected as the power saving start condition, the head mounted display HM can take the power saving state SE when operation for the head mounted display HM is not performed for a long time.
The power saving stop condition can be arbitrarily set. For example, one or plural conditions can be selected out of conditions listed below. In the following explanation, when a number affixed to the end of a reference number of the power saving stop condition is the same as a number affixed to a reference number of the power saving start condition, the power saving stop condition corresponds to the power saving start condition. The power saving stop condition is desirably a condition corresponding to the power saving start condition. Specifically, when the power saving start condition is the condition (a1), the power saving stop condition is desirably a condition (b1).
(b1) Content is a moving image. The moving image means an image having a main purpose of displaying a video such as a screen for displaying a video and a game screen. It is possible to determine, according to the type of an application started on the OS, whether the content is a moving image. When a displayed image is a moving image that constantly changes, the head mounted display HM takes the normal state SN, whereby a virtual image is displayed before the left and right eyes of the user. If the power saving stop condition (b1) and the power saving start condition (a1) are used as a set, it is possible to secure visibility of the user while realizing low power consumption in the head mounted display HM.
(b2) The remaining power of the power supply 130 (the secondary battery) exceeds the predetermined remaining power. If the power saving stop condition (b2) and the power saving start condition (a2) are used as a set, the head mounted display HM transitions to the normal state SN when the battery remaining power of the head mounted display HM exceeds the predetermined remaining power (i.e., charging is performed). A virtual image is displayed before the left and right eyes of the user. As a result, it is possible to improve visibility of the user while realizing low power consumption.
(b3) Illuminance acquired by the illuminance sensor 25 exceeds the predetermined illuminance. If the power saving stop condition (b3) and the power saving start condition (a3) are used as a set, the head mounted display HM transitions to the normal state SN when the environment is bright and the user can less easily recognize a virtual image. A virtual image is displayed before the left and right eyes of the user. As a result, it is possible to secure visibility of the user while realizing low power consumption.
(b4) Both the temperature of the right LCD 241 detected by the right temperature detecting unit 231 and the temperature of the left LCD 242 detected by the left temperature detecting unit 232 are lower than the predetermined temperature. If the power saving stop condition (b4) and the power saving start condition (a4) are used as a set, the head mounted display HM transitions to the normal state SN when the temperatures of the left and right image-light generating units fall. A virtual image is displayed before the left and right eyes of the user. As a result, it is possible to secure visibility of the user while realizing low power consumption.
(b5) The end of an application set in advance in the OS is detected. If the power saving stop condition (b5) and the power saving start condition (a5) are used as a set, the head mounted display HM can switch the normal state SN and the power saving state SE according to the startup and the end of a specific application designated in advance by the user or the like.
(b6) A power saving release request is received from the outside. Specifically, the display control unit 190 acquires a request for release of the power saving state via the touch pad 14 or the cross key 16 provided in the controller 10. If the power saving stop condition (b6) and the power saving start condition (a6) are used as a set, the head mounted display HM can switch the normal state SN and the power saving state SE according to a request from the outside.
(b7) Operation for the head mounted display HM (e.g., operation for the touch pad 14 and the cross key 16) is detected. If the power saving stop condition (b7) and the power saving start condition (a7) are used as a set, it is possible to realize lower power consumption in the head mounted display HM.
Subsequently, in step S204 in
As a result, the generation and the emission of image light by the image-light generating unit for right eye of the head mounted display HM are stopped. Only the image-light generating unit for left eye performs the generation and the emission of image light. Therefore, in the power saving state SE, a virtual image is displayed before the left eye of the user. In the power saving state SE, the stop of the image light (step S204) is performed after the stop of the irradiation of the illumination light (step S202). Therefore, it is possible to suppress flickering during the stop of the virtual image display and smoothly extinguish the virtual image.
In this embodiment, in the power saving state SE, a virtual image is displayed before the left eye of the user, i.e., the generation and the emission of image light by the image-light generating unit for right eye are stopped. However, the display of a virtual image and the stop of the generation and the emission of image light may be reversed. In other words, the generation and the emission of image light by the image-light generating unit for left eye may be stopped. In the power saving state SE, the user can designate which of the image-light generating unit for right eye and the image-light generating unit for left eye is stopped. Specifically, the user selects one of the image-light generating unit for right eye and the image-light generating unit for left eye, the generation and the emission of image light by which are stopped, by operating the touch pad 14 or the cross key 16 provided in the controller 10 functioning as the selection receiving unit.
As explained above, in the first embodiment, the display control unit 190 can control, with a control signal, the generation and the emission of image light by each of the image-light generating unit for right eye and the image-light generating unit for left eye. Therefore, the display control unit 190 can realize the normal state SN in which the generation and the emission of image light are performed by both the image-light generating unit for right eye and the image-light generating unit for left eye and the power saving state SE in which the generation and the emission of image light are performed by one of the image-light generating unit for right eye and the image-light generating unit for left eye. In the power saving state SE, a virtual image is displayed before one eye (the left or right eye) of the user. Even the virtual image displayed before one eye can be recognized as one virtual image VI displayed in the visual field of the user as in
In a second embodiment of the invention, in the power saving state SE, a configuration for causing the image-light generating unit for right eye and the image-light generating unit for left eye to alternately display a virtual image is explained. In the following explanation, only components that have configurations and perform operations different from those in the first embodiment are explained. In the figures, components same as those in the first embodiment are denoted by reference numerals and signs same as those in the first embodiment explained above and detailed explanation of the components is omitted.
The configuration of the head mounted display HM in the second embodiment is the same as the configuration in the first embodiment explained with reference to
When the head mounted display HM is in the power saving state SE, the display control unit 190 monitors whether a switching condition is satisfied. After the switching condition is satisfied, when the head mounted display HM is in the first state SE1, the display control unit 190 transitions the head mounted display HM to the second state SE2. When the head mounted display HM is in the second state SE2, the display control unit 190 transitions the head mounted display HM to the first state SE1. A state that the head mounted display HM takes first when transitioning to the power saving state SE may be either the first state SE1 or the second state SE2.
The switching condition can be arbitrarily set. For example, one or plural conditions may be selected out of conditions listed below.
(c1) After state transition, a fixed time elapses. The fixed time can be arbitrarily set. For example, the fixed time may be several minutes or may be, for example, a time until thirty frames are displayed. If the condition (c1) is selected as the switching condition, it is possible to equally switch the image-light generating unit for right eye and the image-light generating unit for left eye.
(c2) A difference between the temperature of the right LCD 241 detected by the right temperature detecting unit 231 and the temperature of the left LCD 242 detected by the left temperature detecting unit 232 is equal to or larger than a predetermined temperature difference. The predetermined temperature difference can be arbitrarily set and is stored in the setting information CI in the storing unit 120. If the condition (c2) is selected as the switching condition, it is possible to switch the image-light generating unit for right eye and the image-light generating unit for left eye to perform the generation and the emission of image light using the image-light generating unit on a side where the generation and the emission of image light are stopped (i.e., a side where the temperature of the LCD is low). As a result, the first state SE1 and the second state SE2 can be switched according to the temperatures of the LCDs. Therefore, it is possible to suppress the temperature of only one image-light generating unit from rising.
A procedure of processing performed when the head mounted display HM transitions to the first state SE1 is the same as the procedure shown in
Subsequently, the display control unit 190 stops the reproduction of the left image (step S304). Specifically, the display control unit 190 transmits a control signal indicating “effective” to the right-LCD control unit 211 and transmits a control signal indicating “ineffective” to the left-LCD control unit 212. The right-LCD control unit 211 that receives the control signal indicating “effective” continues driving of the right LCD 241. On the other hand, the left-LCD control unit 212 that receives the control signal indicating “ineffective” stops driving of the left LCD 242. Consequently the generation of the image by the left LCD 242 is stopped. As a result, the generation and the emission of image light by the image-light generating unit for left eye of the head mounted display HM are stopped. Only the image-light generating unit for right eye performs the generation and the emission of image light. Therefore, in the second state SE2, a virtual image is displayed before the right eye of the user. Step S204 of the processing performed when the head mounted display HM transitions to the first state SE1 (
As explained above, in the second embodiment, the display control unit 190 alternately switches, triggered by the satisfaction of the switching condition, the first state SE1 for causing one (the image-light generating unit for right eye) of the image-light generating unit for right eye and the image-light generating unit for left eye to stop the generation and the emission of image light and causing the other (the image-light generating unit for left eye) to execute the generation and the emission of image light and the second state SE2 for causing one (the image-light generating unit for right eye) to execute the generation and the emission of image light and causing the other (the image-light generating unit for left eye) to stop the generation and the emission of image light. Therefore, as in the first embodiment, in the head mounted display HM, it is possible to realize low power consumption without deteriorating the image quality of a virtual image recognized by the user. In the second embodiment, the display control unit 190 causes the image-light generating unit for right eye and the image-light generating unit for left eye to alternately display a virtual image. In this way, compared with continuous use of only one image-light generating unit, it is possible to suppress a rise in temperature, deterioration, and the like involved in continuous use of the LCD.
In a third embodiment of the invention, a configuration for switching, in switching the first state SE1 and the second state SE2, the first state SE1 and the second state SE2 through a third state for causing both the image-light generating unit for right eye and the image-light generating unit for left eye to display a virtual image is explained. In the figures, components same as those in the second embodiment are denoted by reference numerals and signs same as those in the second embodiment explained above and detailed explanation of the components is omitted.
The configuration of the head mounted display HM in the third embodiment is the same as the configuration in the first embodiment explained with reference to
A procedure of processing performed when the head mounted display HM transitions to the third state SE3 is the same as the procedure shown in
As explained above, in the third embodiment, in switching the first state SE1 and the second state SE2, the display control unit 190 switches the first state SE1 and the second state SE2 through the third state SE3 for causing both the image-light generating unit for right eye and the image-light generating unit for left eye to perform the generation and the emission of image light. As a result, it is possible to reduce a sense of discomfort that the user feels during the switching of the first state SE1 and the second state SE2 and more naturally perform the switching.
The invention is not limited to the embodiments and can be carried out in various forms without departing from the spirit of the invention. For example, the functions realized by software may be realized by hardware. Besides, modifications explained below are possible.
In the embodiments, the configuration of the head mounted display is exemplified. However, the configuration of the head mounted display can be arbitrarily set without departing from the spirit of the invention. For example, addition, deletion, conversion, and the like of the components can be performed.
For example, the configurations of the controller and the image display unit shown in
For example, the controller shown in
For example, the head mounted display is the transmissive head mounted display of a binocular type. However, the head mounted display may be configured as a non-transmissive head mounted display that blocks an external scene when the user wears the head mounted display. The head mounted display may be a head mounted display of a monocular type.
For example, the image-light generating unit for right eye is configured using the right-backlight control unit, the right-LCD control unit, the right backlight, and the right LCD. However, an organic EL (organic Electro-Luminescence) and an organic EL control unit may be used instead of the right-backlight control unit, the right-LCD control unit, the right backlight, and the right LCD. In the case of the organic EL, since deterioration involved in a temperature rise is severer than the deterioration of the LCD, the invention is particularly effective. The same applies to the image-light generating unit for left eye.
For example, the functional units such as the image processing unit, the display control unit, and the sound processing unit are described as being realized by the CPU expanding the computer program stored in the ROM or the hard disk on the RAM and executing the computer program. However, these functional units may be configured using an ASIC (Application Specific Integrated Circuit) designed to realize the functions.
For example, in the embodiments, the image display unit is the head mounted display worn like eyeglasses. However, the image display unit may be a normal flat display device (a liquid crystal display device, a plasma display device, an organic EL display device, etc.) In this case, as in the head mounted display, the controller and the image display unit may be connected via the wired signal transmission line or may be connected via the wireless signal transmission line. In this way, the controller can be used as a remote controller of the normal flat display device.
As the image display unit, an image display unit having another shape such as an image display unit worn like a cap may be adopted instead of the image display unit worn line eyeglasses. As the earphone, an ear hooking type or a headband type may be adopted. The earphone may be omitted.
For example, in the embodiments, the secondary battery is used as the power supply. However, the power supply is not limited to the secondary battery. Various batteries can be used as the power supply. For example, a primary battery, a fuel cell, a solar battery, a thermal battery, and the like may be used.
In the embodiments, the image processing unit outputs the same image data as the image data for right eye and the image data for left eye. However, the image processing unit may be configured to be capable of causing the user to visually recognize a 3D virtual image by outputting different image data as the image data for right eye and the image data for left eye.
In the first embodiment, the examples of the power saving start condition and the power saving stop condition are explained. However, the transition conditions explained in the first embodiment are only examples. Various conditions can be adopted.
For example, when the head mounted display can cause the user to visually recognize a 3D virtual image, the power saving start condition may be a condition that the head mounted display is in a mode for displaying a 3D virtual image. The power saving stop condition may be a condition that the head mounted display is in a mode for displaying a 2D virtual image.
In the second embodiment, the example of the switching condition is explained. However, the switching condition explained in the second embodiment is only an example. Various conditions can be adopted.
In the third embodiment, in the third state through which the first state and the second state are switched, a virtual image is displayed by both the image-light generating unit for right eye and the image-light generating unit for left eye. However, the third state may be a state for stopping the display of a virtual image in both the image-light generating unit for right eye and the image-light generating unit for left eye.
The entire disclosure of Japanese Patent Application Nos. 0.2011-026810, filed Feb. 10, 2011 and 2011-026809, filed Feb. 10, 2011 are expressly incorporated by reference herein.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2011-026809 | Feb 2011 | JP | national |
| 2011-026810 | Feb 2011 | JP | national |
This is a continuation application of application Ser. No. 13/351,492 filed Jan. 17, 2012 which claims priority to JP2011-026810 filed Feb. 10, 2011 and JP2011-026809 filed Feb. 10, 2011. The disclosures of the prior application are hereby incorporated by reference herein in their entirety.
| Number | Name | Date | Kind |
|---|---|---|---|
| 5959365 | Mantini | Sep 1999 | A |
| 6445363 | Urisaka | Sep 2002 | B1 |
| 6512497 | Kondo et al. | Jan 2003 | B1 |
| 20010005185 | Endo et al. | Jun 2001 | A1 |
| 20050088365 | Yamazaki et al. | Apr 2005 | A1 |
| 20050191028 | Matsuda et al. | Sep 2005 | A1 |
| 20080088554 | Lee | Apr 2008 | A1 |
| 20090109246 | Oh | Apr 2009 | A1 |
| 20100045190 | Cramer | Feb 2010 | A1 |
| 20100053133 | Furuta | Mar 2010 | A1 |
| 20100060551 | Sugiyama et al. | Mar 2010 | A1 |
| 20100103078 | Mukawa et al. | Apr 2010 | A1 |
| 20100148702 | Shen | Jun 2010 | A1 |
| 20100214275 | Chiou | Aug 2010 | A1 |
| 20100259603 | Mihara | Oct 2010 | A1 |
| 20100302219 | Kitashou | Dec 2010 | A1 |
| 20100328331 | Iwaki et al. | Dec 2010 | A1 |
| 20110006690 | Hoffman et al. | Jan 2011 | A1 |
| 20110128209 | Ono | Jun 2011 | A1 |
| 20110138208 | Lee et al. | Jun 2011 | A1 |
| 20110298826 | Namba | Dec 2011 | A1 |
| 20120200478 | Kobayashi | Aug 2012 | A1 |
| 20120242560 | Nakada et al. | Sep 2012 | A1 |
| 20120242570 | Kobayashi | Sep 2012 | A1 |
| 20120242677 | Kobayashi | Sep 2012 | A1 |
| Number | Date | Country |
|---|---|---|
| H09-130704 | May 1997 | JP |
| 2009-118159 | May 2009 | JP |
| Entry |
|---|
| Dec. 30, 2013 Office Action issued in U.S. Appl. No. 13/351,492. |
| May 21, 2014 Office Action issued in U.S. Appl. No. 13/351,492. |
| Oct. 2, 2014 Office Action issued in U.S. Appl. No. 13/351,492. |
| May 1, 2015 Notice of Allowance issued in U.S. Appl. No. 13/351,492. |
| Number | Date | Country | |
|---|---|---|---|
| 20150341624 A1 | Nov 2015 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 13351492 | Jan 2012 | US |
| Child | 14819111 | US |
