In general, binocular rivalry occurs when one image is presented to one eye and a different image is presented to the other eye. For example, binocular rivalry occurs in monocular head mounted displays (MHMDs) when an image is projected in front of the display eye of a user, while the non-display eye of the user sees the world that lies behind the image projected by the display. Some existing systems introduce an element into the field of view of the non-display eye that completely blocks the entire field of view of the non-display eye, thus reducing the user to a single eye view. Some other existing systems regard the image projected via the display as the “attention area” and expect the user to ignore the “non-attention area.” In some other existing systems, optokinetic nystagmus is used to reduce the binocular rivalry by producing a stimulus synchronized with the occurrence of the binocular rivalry. Some other existing methods resort to reduction of the brightness of the scene visible to the non-display eye by limiting the light incident on the non-display eye. However, none of these existing systems eliminates binocular rivalry without impeding normal vision. As such, binocular rivalry continues to be one of the biggest barriers to the comfortable use of monocular head mounted displays.
Examples of the disclosure eliminate binocular rivalry in monocular head mounted displays (MHMDs). A monocular display device of an MHMD is adjustably positioned in front of a display eye of a user. The monocular display device displays information in a first field of view of the display eye. An occluding device is adjustably positioned in front of a non-display eye of the user. The occluding device blocks a second field of view of the non-display eye, with the blocking being regulated to block at least a part of the second field of view that corresponds to the first field of view. Suitably positioning and/or adjusting the properties of the occluding device allows the user to view the information projected by the monocular display device with the display eye while preventing the non-display eye from seeing the world that lies behind the projected image of the display in the first field of view of the display eye.
This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.
Corresponding reference characters indicate corresponding parts throughout the drawings.
Referring to the figures, examples of the disclosure eliminate binocular rivalry in monocular head mounted displays (MHMDs) 418. Some examples prevent a non-display eye of a user from seeing the world that lies behind an image projected onto a display eye of the user. The image occupies a first field of view of the display eye (e.g., a right eye field of view 104). Aspects of the disclosure are operable with any form of image. For example, the image projected, using an image projector, may include a static image, a dynamic image such as video, a synthetic image produced via animation, any document, file, text, and/or any other information that may be perceived by a human eye. In some examples, an occluder 502 is adjustably positioned in front of the non-display eye of the user to limit a second field of view of the non-display eye, where the second field of view corresponds to the first field of view The correspondence between the second and first fields of view indicates that the second field of view completely overlaps, covers, and/or includes the first field of view to prevent the non-display eye from seeing anything in the first field of view (e.g., a space that would otherwise be visible to the display eye of the user if the user were not using the MHMD 418).
In some examples, adjustable mechanical means are used to limit the field of view of the non-display eye. In some other examples, electrical and/or electronic means are used to adjust the position and/or the transmittance of an occluding element (e.g., occluder 502) to limit the field of view of the non-display eye. In still other examples, properties of the materials used for the occluding element are used to produce a partial or complete occluding of the field of view (e.g., the second field of view) of the non-display eye (e.g., using photochromic glass) that corresponds to the field of view (e.g., the first field of view) containing the projected image.
Aspects of the disclosure limit, to the non-display eye, a real world background view 606 that lies behind an image projector 412, positioned in front of the display eye, of the MHMD 418 while providing a broad view of the environment to the user to enable the user to recognize the environment and navigate around it. Thus, aspects of the disclosure provide a facility that is different from completely hiding the entire field of view of the non-display eye. Aspects of the disclosure provide active immersion and action around the real world while specific information such as text, graphics, and real time parameters (e.g., flight data and parameters) are available to the user via the MHMD 418. For example, a pilot, while maneuvering an airplane, may be provided with information in the projected image such as engine parameters, cross-wind data, air speed, altitude, attitude information, etc. Aspects of the disclosure further operate to avoid motion sickness which might otherwise be felt while using the MHMD in moving vehicles such as aircraft or ships (e.g., where the background view 606 is changing).
Aspects of the disclosure further enable selective blocking of the real world using means for limiting the field of view of the non-display eye and for enabling control over the extent of limiting of the field of view of the non-display eye (e.g., a left eye 406 of a user 402) based on situational demands. Further, aspects of the disclosure enable blocking a user-chosen area in the field of view of the non-display eye to accommodate specific preferences of the user. Aspects of the disclosure maintain a clear view of the world while at the same time improve the clarity of the display as perceived by the user 402.
At least because of the capability of regulating the extent of blocking the field of view of the non-display eye as described herein, various functionalities of the disclosure may be adapted to suit individual preferences and situational aptness for different users. For example, aspects of the disclosure provide a reduced view of the world while also providing a clear view of the display to suit individual tastes, likes, and dislikes. Aspects of the disclosure improve efficiency of the user 402 by preventing conflicting information reaching the eyes that may pose problems to the user 402 in processing the received information and/or acting on it.
By providing the MHMD 418 that eliminates binocular rivalry, aspects of the disclosure provide a device that uses less space, extend user interface (e.g., user interface 1526) functionality, and improve interaction between the user and the MHMD 418. Aspects of the disclosure reduce a user error rate in a given environment while using computing devices that employ an MHMD.
As shown in
As next described, to suppress binocular rivalry, aspects of the disclosure block a portion of the field of view of one eye, as shown in front of the left eye at 108 in
Referring to
Referring next to
Referring now to
Referring next to
In
In
In some examples, occluding devices may be independent of the MHMD 418.
In some examples, an occluding device, that is independent of the MHMD 418, may be suitably positioned in front of the non-display eye of the user 402 to adjustably block a field of view of the non-display eye (e.g., a second field of view) that corresponds to a field of view of the display eye onto which an image and/or other information is being projected by the image projector 412 (e.g., the first field of view). For example, the occluding device may be a hand-held device that is suitably positioned near a mid-sagittal plane of the face of the user 402 to block the second field of view. In another example, the independent occluding device may comprise a physical component, made of suitable material (such as plastic or multi-layer structures) and worn on the body of the user, whose position is adjustable with respect to the nose 420 of the user 402, and that may be suitably positioned to block the second field of view.
In some examples, the image projected onto the display eye of the user may be adjusted to be displayed outside the field of view of the non-display eye of the user 402. In these examples, there is no need for the occluder 502. For example, when the projected image (e.g., projected image 1004) lies within a field of view of the non-display eye, the image may be re-directed so as to fall outside the field of view of the non-display eye and hence outside the binocular vision 202. For example, the projected image may be positioned such that it is hidden behind the nose 420 of the user 402. In some example, the image projector 412 and/or the MHMD 418 may be re-positioned so that the projected image lies outside the field of vision of the non-display eye of the user 402. In one example, the re-direction of the displayed image may be done automatically upon detecting that the image is occupying a field of view that is common, or overlaps, with the field of view of the non-display eye. In another example, the re-direction of the displayed image may be done manually, for example by adjusting a position and/or orientation of the image projector 412 and/or the MHMD 418. In some examples of re-directing the location of the projected image (e.g., projected image 1004), the re-directed image falls within the monocular vision of the user's eye (e.g., within a cone of the cones illustrated at 204 and 206 of
Referring now to
In one example, the MHMD 418 has a computing device built in to MHMD 418 or has at least one computing device associated with it (e.g., a computing device 1502) as schematically illustrated in
In some examples, the computing device has at least one processor 1504, a memory area 1510, and at least one user interface 1526. The processor 1504 includes any quantity of processing units, and is programmed to execute computer-executable instructions for implementing aspects of the disclosure. The instructions may be performed by the processor 1504 or by multiple processors within the computing device 1502, or performed by a processor external to the computing device 1502. In some examples, the processor is programmed to execute instructions such as those illustrated in the figures (e.g.,
In some examples, the processor 1504 represents an implementation of analog techniques to perform the operations described herein. For example, the operations may be performed by an analog computing device and/or a digital computing device.
The computing device 1502 further has one or more computer readable media such as the memory area 1510. The memory area 1510 includes any quantity of media associated with or accessible by the computing device 1502. The memory area 1510 may be internal to the computing device 1502 (as shown in
The memory area stores, among other data, one or more applications 1512. The applications 1512, when executed by the processor 1504, operate to perform functionality on the computing device 1502 and the MHMD 418. Exemplary applications include mail application programs, web browsers, calendar application programs, address book application programs, messaging programs, media applications, location-based services, search programs, and the like. The applications 1512 may communicate with counterpart applications or services such as web services accessible via a network such as network 1528. For example, the applications may represent downloaded client-side applications that correspond to server-side services such as cloud services 1530 executing in a cloud.
The memory area 1510 further stores image projection data 1514 and occluder data 1516 that may be used during the operation of the MHMD 418 and may be dynamically updated. The dynamic updating of image projection data 1514 and occluder data 1516 may include periodic updates or updates during the operation of the MHMD 418 or both. The image projection data 1514 includes the data that is provided to the image projector 412 for display onto the display eye of the user. In some examples, the image projection data 1514 may be supplied by the cloud services 1530. The occluder data 1516 includes, for example, parameter values describing an amount of transparency of the occluder 502, parameter values describing the field of view to occlude, etc.
In some examples, the image projection data 1514 and/or the occluder data 1516 may be stored by the cloud services 1530 and supplied on demand. In another example, the image projection data 1514 and/or the occluder data 1516 may be pushed by the cloud services 1530 to the computing device 1502 and periodically updated. In yet another example, the updates may be supplied by the cloud services 1530 on demand on or without payment. In some other example, the user 402 may download the image projection data 1514 and/or the occluder data 1516 from other web services against payment or otherwise.
The image projection data 1514 and the occluder data 1516 may include data associated with the properties and control parameters of the image projector 412 and the occluder 502, the electrical occluder 1102, and the variable transmittance occluder 1202.
The memory area further stores one or more computer-executable components. Exemplary components include a communications interface component 1518, a user interface component 1520, an image projector control component 1522, and an occluder control component 1524.
In some examples, the communications interface component 1518 includes a network interface card and/or computer-executable instructions (e.g., a driver) for operating a network interface card. Communication between the computing device 1502 and other devices or services such as cloud services 1530 may occur using any protocol or mechanism over any wired or wireless connection such as the network 1528. In some examples, the communications interface is operable with short-range communication technologies such as by using near-field communication (NFC) tags.
The communications interface component 1518, when executed by the processor 1504 of the computing device 1502 causes the processor 1504 to communicate with web services (e.g., the cloud services 1530) via the network 1528.
The user interface component 1520, when executed by the processor 1504 of the computing device 1502, enables communication with the user via the user interface 1526. In some examples, the user interface component 1520 includes a graphics card for displaying data to the user and receiving data from the user. The data displayed and received via the user interface 1526 is an alternative to and/or in addition to the display projected via the image projector 412. The user interface component 1520 may also include computer-executable instructions (e.g., a driver) for operating a graphics card. Further, the user interface component 1520 may include a display (e.g., a touch screen display or natural user interface such as user interface 1526) and/or computer-executable instructions (e.g., a driver) for operating the display, in addition to the display provided by the image projector 412. The user interface component 1520 may also include one or more of the following to provide data to the user or receive data from the user: speakers, a sound card, a camera, a microphone, a vibration motor, one or more accelerometers, one or more gyroscopes, a BLUETOOTH brand communication module, global positioning system (GPS) hardware, and a photoreceptive light sensor. For example, the user may input commands or manipulate data by moving the computing device in a particular way.
The image projector control component 1522, when executed by the processor 1504 of the computing device 1502, causes the processor 1504 to provide images and/or other data to the image projector 412 of the MHMD 418 for display onto the display eye of the user 402. Further, the image projector control component 1522 also provides control signals to the image projector 412 to control the location and properties of the image projector 412. The occluder control component 1524, when executed by the processor 1504 of the computing device 1502, causes the processor 1504 to control the location and properties of the occluder 502 (e.g., transmittance, filter characteristics, color characteristics, opacity, altering a plane of polarization of incoming light, and the like).
In some examples, the level of brightness of the image displayed by the image projector 412 may be suitably adjusted based on the ambient light intensity. In other examples, when the image projector 412 is projecting images, the vision of the non-display eye may be selectively blurred to eliminate or at least minimize binocular rivalry. Other regions of the real world background view 606, which are not to be blurred/blocked in some examples, may be visible but the extent of brightness as perceived by the user's eyes may be controlled in response to the ambient light intensity. The amount of light incident on the eyes may be controlled by using the properties of photochromism, electrochromism, and LC structure either individually or by any combination of photochromism, electrochromism, LC structure and control signals.
In some examples, multiple layers of different material may be used for the image projector 412, the occluder 502 and/or the variable transmittance occluder 1202. For example, a photochromic material may be used to control the amount of light received by each eye through the image projector 412 and the occluder 502 and/or the variable transmittance occluder 1202. Additional blocking/blurring layer may be used for the occluder 502 and/or the variable transmittance occluder 1202 to eliminate binocular rivalry. In this example Polymer-Dispersed-Liquid-Crystal (PDLC) material or other material exhibiting similar properties may be used for providing the occluding via dispersion and/or blurring. The PDLC material may be used to control the transparency of the image projector 412 and/or the occluder 502 and/or the variable transmittance occluder 1202 over a very large range beginning from a very low value to reach approximately 90% transparency.
In some examples, polarizing material includes multi-layer material that may be used for all or any of the image projector 412, the occluder 502 and/or the variable transmittance occluder 1202. In such examples, the orientation of the polarizer is adjusted such that the multi-layer material may also provide optimum photochromic properties. Further, other factors such as direction of glare (e.g., to read LC display content clearly) and projection angles into an optical waveguide, that may be used in the image projector 412, are optimized to minimize loss of light and provide effective photochromic dimming of the ambient light.
In another example, an occluding device may be a frame supporting glasses, such that the glass in front of the non-display eye of the user 402 may extend outward and may be positioned in front of the non-display eye of the user 402. The glass may be a photochromic glass whose level of opacity increases when exposed to ambient light (e.g., the real world background view 606) thus limiting the field of view of the non-display eye and impeding the line of sight 602.
In some examples, a combination of materials that exhibit photochromism, electrochromism, and LC structure may be used. In this example, changes in the level of transmissiveness may be used for both the image projector 412 and the variable transmittance occluder 1202. As described herein, in some examples, the image projector 412 is made see-through when the image projector 412 is not projecting any image. In some examples, the level of transmittance of different regions of the image projector 412 and the variable transmittance occluder 1202 may be regulated differently by application of suitable control signals based on the location of the image projector 412, the extent of blocking to be provided to the non-display eye, and all the other regions that are to be made see-through. In some examples, different material and control methods (e.g., electrical, optical or chemical methods or a combination of all the three methods) of regulating the transmissive and/or reflective properties of different regions may be used. In some examples, transmissive and/or reflective properties of different regions that comprise the image projector 412 and the variable transmittance occluder 1202 may be independently regulated using suitable control signals. In some examples, a display zone, that is a part on the image projector 412, may have its brightness determined by the amount of ambient light (e.g., it may function as a photochromic material). In one example, a blocking zone that is a part of the variable transmittance occluder 1202 or the occluder 502 may also use photochromic material but transitions to a blocked/blurred state when the image projector 412 display is active.
Alternatively or in addition to the other examples described herein, examples include any combination of the following:
a monocular display device adjustably positioned in front of a display eye of a user, the monocular display device displaying information in a first field of view of the display eye, and
an occluder adjustably positioned in front of a non-display eye of the user, the occluder blocking a second field of view of the non-display eye, the second field of view corresponding to the first field of view.
the occluder comprising a component attached to a part of the monocular display device, the component being located near a mid-sagittal plane of a face of the user and blocking the second field of view of the non-display eye.
blocking the second field of view comprising limiting the second field of view of the non-display eye.
the occluder component being selected from a group consisting of a fin, a flap, a blade, a flipper, a vane, a sheet, and a tab.
the occluder comprises a nose bridge that extends outward from a nose of the user.
the occluder comprises an attachable frame that is removably attached to the monocular display device.
the occluder comprises an electrical occluder.
a transmittance of the electrical occluder varies in response to application of a control signal.
the electrical occluder comprises liquid crystal material.
the electrical occluder comprises electrochromic material.
the electrical occluder includes a set of slats fitted within a frame, the frame being located near a mid-sagittal plane of a face of the user, the slats being rotatable so as to block or unblock the second field of view of the non-display eye.
the slats automatically rotate to block the second field of view of the non-display eye.
the slats rotate in response to a command given by the user to block the second field of view of the non-display eye.
an apparatus for eliminating binocular rivalry occurring from use of a monocular display device displaying information in a first field of view of a display eye of a user, said apparatus comprising:
an occluder adjustably positioned in front of a non-display eye of the user the occluder blocking a second field of view of the non-display eye, the second field of view corresponding to the first field of view of the display eye.
the occluder comprises a photochromic structure that automatically darkens in high ambient light to limit the second field of view of the non-display eye.
the occluder comprises a hand held device that, when positioned near a mid-sagittal plane of a face of the user, blocks the second field of view of the non-display eye.
the occluder comprises an adjustable component worn on the body of the user that, when positioned near a mid-sagittal plane of a face of the user, blocks the second field of view of the non-display eye.
displaying information to a user with a monocular display device adjustably positioned in front of a display eye of the user,
determining that the image is occupying a second field of view of a non-display eye of the user, and
in response to the determining , adjusting the monocular display device to display the information to a first field of view of the display eye, the first field of view being outside any field of view of the non-display eye.
adjusting the monocular display device comprises automatically re-positioning display of the image to the first field of view.
adjusting the monocular display device comprises manually re-positioning the monocular display device relative to a face of the user.
At least a portion of the functionality of the various elements in
In some examples, the operations illustrated in
While the aspects of the disclosure have been described in terms of various examples with their associated operations, a person skilled in the art would appreciate that a combination of operations from any number of different examples is also within scope of the aspects of the disclosure.
The term “BLUETOOTH” as used herein refers, in some examples, to a wireless technology standard for exchanging data over short distances using short wavelength radio transmission. The term “cellular” as used herein refers, in some examples, to a wireless communication system using short-range radio stations that, when joined together, enable the transmission of data over a wide geographic area. The term “NFC” as used herein refers, in some examples, to a short-range high frequency wireless communication technology for the exchange of data over short distances.
Exemplary computer readable media include flash memory drives, digital versatile discs (DVDs), compact discs (CDs), floppy disks, and tape cassettes. By way of example and not limitation, computer readable media comprise computer storage media and communication media. Computer storage media include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media are tangible and mutually exclusive to communication media. Computer storage media are implemented in hardware and exclude carrier waves and propagated signals. Computer storage media for purposes of this disclosure are not signals per se. Exemplary computer storage media include hard disks, flash drives, and other solid-state memory. In contrast, communication media typically embody computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism and include any information delivery media.
Although described in connection with an exemplary computing system environment, examples of the disclosure are capable of implementation with numerous other general purpose or special purpose computing system environments, configurations, or devices.
Examples of well-known computing systems, environments, and/or configurations that may be suitable for use with aspects of the disclosure include, but are not limited to, mobile computing devices, personal computers, server computers, hand-held or laptop devices, multiprocessor systems, gaming consoles, microprocessor-based systems, set top boxes, programmable consumer electronics, mobile telephones, mobile computing and/or communication devices in wearable or accessory form factors (e.g., watches, glasses, headsets, or earphones), network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like. Such systems or devices may accept input from the user in any way, including from input devices such as a keyboard or pointing device, via gesture input, proximity input (such as by hovering), and/or via voice input.
Examples of the disclosure may be described in the general context of computer-executable instructions, such as program modules, executed by one or more computers or other devices in software, firmware, hardware, or a combination thereof. The computer-executable instructions may be organized into one or more computer-executable components or modules. Generally, program modules include, but are not limited to, routines, programs, objects, components, and data structures that perform particular tasks or implement particular abstract data types. Aspects of the disclosure may be implemented with any number and organization of such components or modules. For example, aspects of the disclosure are not limited to the specific computer-executable instructions or the specific components or modules illustrated in the figures and described herein. Other examples of the disclosure may include different computer-executable instructions or components having more or less functionality than illustrated and described herein.
Aspects of the disclosure transform a general-purpose computer into a special-purpose computing device when configured to execute the instructions described herein.
The examples illustrated and described herein as well as examples not specifically described herein but within the scope of aspects of the disclosure constitute exemplary means for a monocular display device that may be adjustably positioned in front of a display eye of a user to display an image in a first field of view of the display eye, and means for an occluder that may be adjustably positioned in front of a non-display eye of the user to block a second field of view of the non-display eye, where the second field of view corresponds to the first field of view. For example, the elements illustrated in
Alternatively, or in addition, the functionalities described herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, illustrative types of hardware logic components that may be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), system-on-a-chip (SOCs) systems, programmable logic devices (PLDs), etc.
The order of execution or performance of the operations in examples of the disclosure illustrated and described herein is not essential, unless otherwise specified. That is, the operations may be performed in any order, unless otherwise specified, and examples of the disclosure may include additional or fewer operations than those disclosed herein. For example, it is contemplated that executing or performing a particular operation before, contemporaneously with, or after another operation is within the scope of aspects of the disclosure.
When introducing elements of aspects of the disclosure or the examples thereof, the articles “a,” “an,” “the,” and “said” are intended to mean that there are one or more of the elements. The terms “comprising,” “including,” and “having” are intended to be inclusive and mean that there may be additional elements other than the listed elements. The term “exemplary” is intended to mean “an example of” The phrase “one or more of the following: A, B, and C” means “at least one of A and/or at least one of B and/or at least one of C.”
Having described aspects of the disclosure in detail, it will be apparent that modifications and variations are possible without departing from the scope of aspects of the disclosure as defined in the appended claims. As various changes could be made in the above constructions, products, and methods without departing from the scope of aspects of the disclosure, it is intended that all matter contained in the above description and shown in the accompanying drawings shall be interpreted as illustrative and not in a limiting sense.
Although the subject matter has been described in language specific to structural features and/or acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as examples of implementing the claims and other equivalent features and acts are intended to be within the scope of the claims.