Patent Application
20190212565
The present invention relates generally to wearable displays that generate stereoscopic images and more particularly relates to a wearable display that directs modulated light toward the eye of the viewer from a lower portion of the peripheral field of vision.
There have been a number of solutions proposed for providing image content from wearable devices. Various types of goggles, glasses, and other apparatus have been described for displaying image content to a viewer who is wearing the apparatus. These devices may be completely immersive, so that the viewer sees only images generated by the apparatus and has no ability to see the outside world when wearing the device. Alternately, varying degrees of visibility of the real world are provided with other designs, so that the generated images are superimposed on the real-world image as an augmented display or, in some way, used to complement the real-world visual content that lies in the viewer's field of view.
Wearable display devices offer considerable promise for providing information and displaying complementary imagery that can improve performance and efficiency in a number of fields. In medicine and dentistry, for example, the capability to view image content that had been previously stored and, optionally, post processed, or is currently being acquired from another vantage point can help the practitioner to more accurately obtain detailed data that would aid diagnosis and treatment. Imaging data that is currently available only from high-cost 3-D imaging systems can be provided in a useable format for viewing on less expensive wearable imaging equipment that allows the practitioner to have this information in an active clinical setting. Stereoscopic imaging, with its enhanced spatial understanding and improved presentation of relevant detail, can be particularly useful for those treating patients using medical imaging guidance or medical data, as well as for those skilled in other fields.
With many of the apparatus that have been proposed for wearable displays, the viewer is encumbered by the device in some way, due to device size, bulkiness and discomfort, component and image positioning, poor image quality, eye fatigue, and other difficulties. Although many clever solutions for providing a more natural viewing experience have been outlined, and a number of advances toward improved image quality have been introduced, the form factors for many of these solutions still make it difficult to win broad-based acceptance for these devices, particularly for long-term use. Their bulky size and appearance are still considered to be significant factors in limiting the appeal of wearable imaging devices for many people.
Despite years of design effort and optimization, including integration of miniaturization and improved imaging technologies, designing wearable display apparatus with acceptable ergonomics and high image quality has proved to be a continuing challenge. Workable solutions for wearable display devices that have a natural “feel” and that can be easily worn and used remain elusive. Thus, it can be appreciated that there is a need for a wearable device for stereoscopic display that provides high image quality and is lightweight, inexpensive, easy to use, and ergonomically less invasive and cumbersome than conventional designs.
It is an object of the present invention to advance the art of stereoscopic presentation from a wearable viewing apparatus. Embodiments of the present disclosure provide a wearable viewing apparatus that provides a high quality stereoscopic display with little or no impediment to viewer visibility over the field of view. Embodiments of the present disclosure can provide an improved viewing apparatus that reduces a number of optical, physiological, and ergonomic constraints of conventional stereoscopic imaging devices. Embodiments of the present disclosure can provide a wearable viewing apparatus having increased field of view with versatile arrangements of scanning, beam width adjustment, and related optical components in a near-eye imaging arrangement.
These objects are given only by way of illustrative example, and such objects may be exemplary of one or more embodiments of the invention. Other desirable objectives and advantages inherently achieved by the disclosed invention may occur or become apparent to those skilled in the art. The invention is defined by the appended claims.
According to one aspect of the present invention, there is provided a wearable display apparatus for displaying an image to an eye of a viewer comprising:
From an alternate aspect, an embodiment of the present disclosure provides a wearable display apparatus for displaying a stereoscopic image pair to the left and right eyes of a viewer comprising:
a) a source of modulated laser light for each eye;
b) a scanning apparatus for each eye that is energizable to scan the modulated light from the source in a raster pattern and into the eye of the viewer for forming an image,
wherein the scanning apparatus for each eye is:
c) a corresponding right eye optical fiber and left eye optical fiber disposed to direct the modulated laser light from each corresponding source to each corresponding scanning apparatus; and
d) a retaining band that grips against the sides of the viewer's head and that seats each scanning apparatus against the viewer's face along or below the cheekbone.
From another alternate aspect, an embodiment of the present disclosure provides a wearable display apparatus for forming a stereoscopic pair of virtual images to the left and right eyes of a viewer, the apparatus comprising, for forming each image of the stereoscopic pair:
a) a source of modulated laser light that is energizable to direct light having a first beam width into an optical fiber;
c) the optical fiber disposed to direct the modulated laser light from the source to a beam expander;
d) the beam expander comprising two or more lens elements that expand the modulated laser light to a second beam width that is larger than the first beam width;
e) a scanning apparatus that is disposed to direct the modulated light of the second beam width to a microelectromechanical systems device that is energizable to scan the modulated light in a raster pattern and toward the eye of the viewer for forming an image, wherein the scanning apparatus for the eye is disposed within a retaining band that grips against the sides of the viewer's head and that seats the scanning apparatus against the viewer's face along or below the cheekbone; and
f) a relay lens element in the path of light from the microelectromechanical systems device and disposed within the object focal length of the eye of the viewer.
The foregoing and other objects, features, and advantages of the invention will be apparent from the following more particular description of the embodiments of the invention, as illustrated in the accompanying drawings. The elements of the drawings are not necessarily to scale relative to each other.
Figures provided herein are given in order to illustrate principles of operation and component relationships along their respective optical paths according to the present invention and are not drawn with intent to show actual size or scale. Some exaggeration may be necessary in order to emphasize basic structural relationships or principles of operation. Some conventional components that would be needed for implementation of the described embodiments, such as support components used for providing power, for packaging, and for mounting, for example, are not shown in the drawings in order to simplify description of the invention. In the drawings and text that follow, like components are designated with like reference numerals, and similar descriptions concerning components and arrangement or interaction of components already described may be omitted.
Where they are used, the terms “first”, “second”, and so on, do not necessarily denote any ordinal or priority relation, but may be used for more clearly distinguishing one element or time interval from another. The term “plurality” means at least two.
In the context of the present disclosure, the term “energizable” describes a component or device that is enabled to perform a function upon receiving power and, optionally, upon also receiving an enabling signal.
In the context of the present disclosure, positional terms such as “top” and “bottom”, “upward” and “downward”, and similar expressions are used descriptively, to differentiate different surfaces or views of an assembly or structure and do not describe any necessary orientation of the assembly in an optical apparatus.
In the context of the present disclosure, the term “coupled” is intended to indicate a mechanical association, connection, relation, or linking, between two or more components, such that the disposition of one component affects the spatial disposition of a component to which it is coupled. For mechanical coupling, two components need not be in direct contact, but can be linked through one or more intermediary components.
In the context of the present disclosure, the term “left eye image” describes a virtual image that is formed in the left eye of the viewer and a “right eye image” describes a corresponding virtual image that is formed in the right eye of the viewer. The phrases “left eye” and “right eye” may be used as adjectives to distinguish imaging components for forming each of the two images of a stereoscopic image pair, as the concept is widely understood by those skilled in the stereoscopic imaging arts.
The term “oblique”, where used in the present disclosure, describes an angular relationship that is not parallel or normal, that is, other than an integer multiple of 90 degrees. In practice, two optical surfaces are considered to be oblique with respect to each other if they are offset from parallel or normal by at least about +/−2 degrees or more. Similarly, a line and a plane are considered to be oblique to each other if they are offset from parallel or normal by at least about +/−2 degrees or more. Substantially parallel planes are parallel to within +/−2 degrees. Likewise, substantially parallel beams are parallel to within about +/−2 degrees.
In the context of the present disclosure and claims, the term “about”, when used with reference to a measurement, means within expected tolerances for measurement error and inaccuracy that are accepted in practice. Some reasonable tolerance must be allowed, for example, for measurement differences in determining the extent of a particular viewer's visual field, as it would vary from the measurement of one practitioner to another.
Microelectromechanical systems (MEMS) devices include a number of mechanical components that provide systems of miniaturized mechanical and electro-mechanical elements (that is, devices and structures) that are made using microfabrication techniques analogous to those used for forming semiconductor devices. MEMS devices can vary from relatively simple structures having no moving elements, to extremely complex electromechanical systems with multiple moving elements under the control of integrated microelectronics. In a MEMS device, at least some of the elements have a mechanical function, whether or not the elements are themselves movable. MEMS devices can alternately be termed “micro-machined devices” or devices formed and operating using microsystems technologies. Physical dimensions of individual MEMS mechanical elements can range from well below one micron to several millimeters. In the context of the present disclosure, MEMS devices provide mechanically movable elements, such as reflectors, that are energizable to temporally and spatially modulate light in order to provide a virtual image using a raster scan pattern.
It is useful to distinguish real images from virtual images, as generated by an optical system. A real image can be formed on a display surface, for example. In contrast to methods for forming a real image, a virtual image is not formed on a display surface. That is, if a display surface were positioned at the perceived location of a virtual image, no image would actually be formed on that surface. A virtual image is formed by an optical system that directs light to the eye at angles that emulate viewing parameters for real objects, such as far point, apparent angular width, and other characteristics related to visual perception. Virtual image display has a number of inherent advantages for stereoscopic viewing. For example, the size of a virtual image is not limited by the size or location of an actual object or display surface. Additionally, the source object for a virtual image may be small; a magnifying glass, as a simple example, provides a virtual image of its real object. It is known that, in comparison with systems that project a real image, a more realistic viewing experience can be provided by forming a virtual image that is disposed to appear some distance away, beyond the physical limits of the optical system. Providing a virtual image using only modulated light also obviates any need to compensate for screen distortion or other display artifacts, as may be necessary when projecting a real image.
In conventional use, the term “field of view” (FOV) broadly relates to the overall visual field that is available to a viewer with relatively normal eyesight under daylight viewing conditions. Field of view is typically measured in orthogonal horizontal and vertical directions.
The vertical field of view, as this measurement is referred to herein, is shown schematically in
Different portions of the field of view can be distinguished from each other. Foveal vision, having the highest visual acuity due to the greatest retinal cone density, encompasses the central portion of the human visual field. This region uses approximately 50% of our optical pathway. Parafoveal vision, providing high quality acuity and color vision as well, due to a high retinal cone concentration, is thus generally considered to be at an angle a that is within no more than about +/−5 degrees of the line of sight. The approximately ten-degree parafoveal visual field is generally circular about the line of sight with about a four-inch diameter at a distance of 22 inches. As an approximation for an adult viewer, this region would be slightly smaller than the surface of a standard compact disc (CD) or digital video disc (DVD) held out at arm's length. Outside of this region, the visual field is considered to be peripheral and provides increasingly less visual information. Due to the retinal rod distribution of the human eye, the bulk of peripheral visual information lies within about the first 20 degrees beyond the parafoveal field of view.
For the embodiments described herein, a normal usable vertical FOV F1 is larger than the parafoveal FOV and is defined as being within the range from about +25 to −30 degrees of the line of sight. FOV F1 is considered generally to be within the limits of color discrimination, which degrades substantially for vision angles increasingly outside this region.
Line of sight S1 generally tracks head position. For a seated viewer, for example, the reference line of sight S1 tends to shift downwards to about 15 degrees from horizontal. All of the other vertical coordinates and angles that define parafoveal and peripheral fields shift accordingly, as is shown schematically in
As shown in the cross-sectional side view of FIG. ID, the optics system of the human eye E, considered as an optical component primarily with lens 24 and cornea 28, has focal lengths that are determined by the geometry of the lens 24, cornea 28, and the surrounding medium. For an adult with normal, uncorrected vision, the eye E has an object focal length F0 of about 16.7 mm. The normal, uncorrected adult human eye E has an image focal length Fi of about 22.3 mm. The object focal length F0 is in air; the image focal length F1 is within the refractive liquid medium of the eye E, which effectively shortens the actual distance dimensions as shown in
Block Diagram
Embodiments of the present disclosure provide a wearable imaging apparatus that is advantaged over earlier designs from a number of aspects. The wearable imaging apparatus provides stereoscopic imaging by scanning collimated, coherent light from solid-state lasers directly into each eye of the viewer, to form a virtual image onto the viewer's retina. Unlike other proposed solutions for wearable imaging devices, embodiments of the present disclosure can have an extremely low profile, without requiring lenses or display surfaces in the normal usable visual field. Significantly, the configuration of system optics allows all imaging components to be disposed outside of the normal field of view, so that the viewer has the capability to view the virtual image as needed, without having obstruction of the real world view.
The schematic block diagram of
To provide stereoscopic imaging, an optical fiber 40 and scanner apparatus 50 are provided for each eye E. (Only the system for a single eye E is shown in
Light module 30 can be a commercially available modular component for generating modulated light according to input image data, such as a pico-projector device from Microvision, Inc., Redmond, Wash. for example. By way of example only, this device forms an image using light from three primary color laser diodes, at 638 nm (Red), 517 nm (Green), and 450 nm (Blue). Other wavelengths can be used for primary colors. The lasers are low-power Class 1 devices, whose light can be directed into the eye of a viewer without concern for energy levels that are considered to be harmful. Light from each of the primary color lasers can be provided separately, so that red, green, and blue beams are provided in rapid sequence. Alternately beams of the different primary wavelengths are combined for forming the color image. Techniques for beam combination include the use of dichroic combiners, for example. Spot sizes for the light beams can be varied from each other, such as for improved efficiency. The light beams can be collimated to provide the smallest optimal size or enlarged to overfill a small or large MEMS scanning mirror, as described in more detail subsequently. Beams can be converted from a generally Gaussian profile to a flat-top profile for improved beam homogeneity.
An exemplary optical fiber 40 can be a single-mode optical fiber. This type of light guide can be easily fitted into the band that is used for fitting the scanner apparatus 50 against the viewer's face, as described subsequently. The optical fiber can have an angled or otherwise shaped termination, such as to prevent back reflection. A single fiber can be used for guiding light from all of the laser diodes 32r, 32g, 32b. Alternately, three fibers can be used, spliced together to form a single fiber at the light output at scanner apparatus 50.
The optical components of scanner apparatus 50 used in a particular wearable imaging apparatus 10 can vary and may include, in addition to a MEMS scanner device, alternate types of reflective and refractive relay optics, folding optics that may or may not provide optical power, and other components that are used to scan image content into eye E. Alternate components that may be part of scanner apparatus 50 are described with reference to subsequent embodiments of the present disclosure.
Configuration of the Optical Components about and Against the Face
According to an alternate embodiment of the present disclosure, one or more of light module 30, battery 22, and control logic processor 20 can be mounted outside of retaining band 60, such as along the viewer's neck or chest, for example, or in a pocket or other convenient holder.
The light from light module 30 is directed to scanner apparatus 50 through optical fiber 40, so that scanner apparatus 50 can be configured with only a small number of components seated against the viewer's face that provide the raster scan and form the image from the source light. Facial retaining band 60 fastens about or against the head of the viewer and is configured to position scanner apparatus 50 in front of and below the viewer's eyes in the peripheral field of vision for image display. In terms of the FOV regions defined previously with respect to
The skull diagram of
When supported using retaining band 60, scanning apparatus 50 has the following placement relative to each eye:
“Substantially none” as used hereinabove means less than about 20 percent of the retaining band 60 is visible to the viewer within the normal usable vertical field F1 of the viewer, preferably less than about 10 percent or even with none of band 60 viewable within the normal usable vertical field F1 of the viewer.
The optical element that lies nearest to the eye within the object focal length F0 as specified in (i) above may be the MEMS scanner device itself or may be an optical relay element such as a relay lens or other component, as described in more detail subsequently.
Band 60 grips against the sides of the viewer's head at pinna 68 as shown in
The arrangement with band 60 resting against portions of the face below the eyes, seated against the face along and even below each eye, at the anterior maxilla adjacent to the nose and nasal alar, allows the extremely low-profile design of wearable imaging apparatus 10 to form a virtual image without blocking the standard field of view for the viewer when the viewer is standing or seated and looking forward. When the viewer is observing real-world scene content that lies ahead, the view is thus substantially unobstructed. Then, when the viewer's interest is in the virtual image, the viewer looks slightly downward toward the MEMs scanner device and related components of scanner apparatus 50 in band 60.
According to an alternate embodiment of the present disclosure, as shown in FIG. 3D, a sensor 62, such as an infrared light sensor, is used to detect the gaze direction of the viewer and to provide a signal that, when sensed at control logic processor 20 (
Advantages of the band 60, and consequently of scanner apparatus 50 placement, for medical uses are similar to advantages for a viewer who wears reading glasses oriented below the normal vertical field of vision. This viewer can use unaided vision or magnified vision as is typical in the operating room for observing scene content without obstruction, but can raise the chin or lower the head for viewing medical images or medical informatics for one example.
The section views in
The top view sections of
MEMS scanner device 52 may be any of a number of types of scanner apparatus known in the imaging arts for forming an image using a scan pattern such as a raster scan. Other scan sequences can alternately be used, including vector scanning, for example. MEMS scanner device 52 can have a single mirror 54, such as a gimbaled mirror for 2-D or two-axis scanning, or may have two tandem mirrors 54, one for directing the beam in each of two orthogonal directions. One exemplary type of scanning mirror is the two-axis scanning mirror that is provided with the Microvision picoprojector system. Another exemplary type of scanning mirror combines two tandem single-axis scanning mirrors, such as the device that is provided with the Maradin Laser Scanning Mirror Module, Maradin, Ltd., Israel, which supports large laser beam diameters. MEMS scanning mirror 54 serves as the last optical element in the path of image-bearing light to the eye and is within the object focal length F0 as described with reference to
The schematic diagram of
MEMS mirror 54 dimensions can be optimized to expand the field for the virtual image. Optimization methods known to those skilled in the scanning arts can include providing a measure of curvature to the mirror 54 surface. These methods also provide for increasing scanning mirror dimensions and dimensioning the beam width to more completely fill the pupil.
In conventional MEMS scanning devices, due to the requirement for high resonant scanning frequencies for raster scanning, mirrors are typically fabricated to be as small as feasible and are configured to rotate over large scan angles. In contrast to this conventional approach, embodiments of the present disclosure can use larger scanning mirrors, such as scanning mirrors larger than 2 mm diameter in the plane of the scanned beam. In one embodiment, a 3 mm diameter mirror with an average pupil size in bright light of 2.5 mm can provide a 17 degree FOV, equivalent to or greater than the FOV available with conventional commercial devices, offering much larger eye relief, increased size and obstructive lenses in front of the eye. Some amount of vignetting at the pupil is acceptable in order to provide light at angles for the largest possible field, given the geometrical constraints of the scanner apparatus 50. The changes in light intensity on the pupil can be compensated electronically by modulating the intensity of the laser light to provide uniform brightness at each point in the scan interval.
Beam-shaping can alternately be provided for improved resolution and efficiency. Overfilling the MEMS scanning mirror may help to compensate for Gaussian beam characteristics by providing a more homogeneous ‘flat top’ laser beam profile.
According to an alternate embodiment, as shown in the side view of
2*TAN−1(S/16)=28 degrees.
In the
For the
According to an alternate embodiment, a catoptric relay apparatus, such as that described in U.S. Pat. No. 5,309,276 to Rodgers entitled “Catoptric Optical System Including Concave and Convex Reflectors”, incorporated herein by reference, can alternately be used as an angle reducing relay for optical relay element 100.
Band 60 is designed to suitably dispose components of scanning apparatus 50 so that mirror 54 is properly positioned and oriented for directing image-bearing light into the eyes E of the viewer when the viewer lowers the eyes toward the mirror 54 for viewing the virtual image that is formed by wearable imaging apparatus 10.
Modulation of the laser light beam can be performed by direct modulation of the lasers within light module 30 (
Due to anatomical differences between individual viewers, such as differences in facial structure, inter-pupil distance (IPD), and other factors, wearable imaging apparatus 10 is adaptable and adjustable for band 60 positioning and, where needed, for alignment of scan geometry. Padding or other cushioning members, not shown, can be added to compensate for individual differences in cheekbone anatomy, for example. Band 60 can be formed from or onto a stiff material, such as a bendable wire supporting frame that can be shaped to conform to the viewer's face and even individually shaped to direct the scanned beam vertically and horizontally to each individual viewer as needed.
Optionally, wearable imaging apparatus 10 can be fitted to the individual viewer, such as by being aligned in vertical and horizontal directions using screws or other adjustment mechanism.
The term “exemplary” is used herein to mean “serving as an example, instance, or illustration.” Any aspect described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other aspects.
The invention has been described in detail with particular reference to a presently preferred embodiment, but it will be understood that variations and modifications can be effected within the spirit and scope of the invention. For example, although the above description concentrates on forming an image for one eye, it can be readily understood that corresponding elements and logic are used for forming the stereoscopic images needed to form and coordinate image content for both right- and left-eye images, using methods familiar to those skilled in the stereoscopic imaging arts. The images that are formed can be stereoscopic or biocular, that is, with the same image content provided to both eyes for monoscopic display.
The presently disclosed embodiments are therefore considered in all respects to be illustrative and not restrictive. The scope of the invention is indicated by the appended claims, and all changes that come within the meaning and range of equivalents thereof are intended to be embraced therein.
This application claims the benefit of U.S. Provisional application No. 62/002,796 provisionally filed on May 24, 2014, entitled “Laser Based MEMS Display for Medical Applications”, in the names of Adam Davis et al., incorporated herein in its entirety.
| Number | Date | Country | |
|---|---|---|---|
| 62002796 | May 2014 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 14720163 | May 2015 | US |
| Child | 16356739 | US |
