Embodiments of the invention relate to the field of personal display devices. More specifically, embodiments of the invention relate to a retinal display apparatus and method.
Personal display devices make it possible to provide image content to a viewer in applications where the use of conventional display screens would be an encumbrance. Head-mounted display (HMD) devices (also referred to as near-eye display (NED) or near-to-eye (NTE) devices), such as display goggles, are being considered as a useful type of wearable personal display device usable in a variety of fields, with applications ranging from military, medical, dental, industrial, and game presentation, among others.
It is known that Maxwellian HMDs (also referred to as retinal display devices) offer an accommodation-free display which allows a user to steadily observe both real and virtual objects, a key feature which cannot be provided by conventional HMDs. However, conventionally a Maxwellian view is limited by its extremely narrow field of view that requires the beam to strictly converge at the center of the crystalline lens. This narrow field of view is insufficient to provide a convenient user viewing experience and thus limiting the deployment of such technology.
Lin, J. et al., “Retinal projection head-mounted display,” in Journal of Frontiers of Optoelectronics, 10(1): 1-8, 2017 discloses a so-called modified Maxwellian view for expanding the field of view to a certain extent. However, the suggested approach neglects the crystalline accommodation, narrows the pupil aperture, and reduces the view angle field.
Thus, there is still a need for an improved retinal display apparatus and method providing a larger field of view for a user.
Embodiments of the invention are defined by the features of the independent claims, and further advantageous implementations of the embodiments by the features of the dependent claims.
According to a first aspect the invention relates to a retinal display apparatus for generating an image on the retina of an eye of a user, wherein the retinal display apparatus is configured to: generate an output beam conveying the image, i.e., an image beam, which may be composed of pixel beams; provide eye information, which comprises information about a current orientation, i.e., viewing direction of the eye; and steer the output beam based on the eye information to direct the output beam to the pupil of the eye.
Thus, an improved retinal display apparatus is provided. The apparatus allows moving the exit pupil location dynamically based on a tracked eye position and/or orientation. The user can thus move the eyes without losing the image on the retina.
As will be described in more detail below, in an embodiment, the retinal display apparatus comprises a movable dynamic aperture stop and an image displacement module which are synchronized with the exit pupil movement. In another embodiment, the retinal display apparatus comprises a light source emitting a set of collimated rays, i.e., a beam and a controllable reflective screen and/or light source to steer the angle of incidence of the rays. The exit pupil location can be estimated based on a tracked eye movement. In an embodiment, only one exit pupil is active at a time to avoid double image artifacts. In an embodiment, the tracked eye location can trigger the retinal display apparatus to either place the exit pupil in an arbitrary location or in a determined location among a given set of locations which represent an optimally sampled location of a possible eye movement.
More specifically, in a further possible implementation form of the first aspect, the retinal display apparatus comprises: a diffuse screen for displaying the image on a spatial portion of the screen and a beam shaper for generating the output beam from the displayed image. The beam shaper can comprise an aperture stop for defining an aperture, wherein the retinal display apparatus is configured to adjust the spatial portion of the screen and a position of the aperture on the basis of the eye information. Thus, allowing the output beam to be steered.
In a further possible implementation form of the first aspect, the retinal display apparatus is configured to adjust the position of the aperture on the basis of the eye information by displacing the aperture stop. The position of the aperture stop can thus be adjusted in a simple and reliable manner.
In a further possible implementation form of the first aspect, the aperture stop comprises a plurality of openings, wherein the retinal display apparatus is configured to mechanically open a selected one and to close the other ones of the plurality of openings on the basis of the eye information. The position of the aperture stop can thus be adjusted with no need for displacing the whole aperture stop.
In a further possible implementation form of the first aspect, the retinal display apparatus is configured to position the aperture at one of a plurality of discrete positions on the basis of the eye information.
In a further possible implementation form of the first aspect, the retinal display apparatus further comprises: a beam generator configured to generate an optical source beam representing the image; a reflective screen configured to reflect the optical source beam; and a beam shaper for generating the output beam from the reflected source beam, wherein the retinal display apparatus is configured to adjust an orientation of the beam generator on the basis of the eye information. Thus, the angle of incidence of the reflected source beam on the beam shaper, and thus the output beam, can be steered. In an embodiment, the beam shaper can comprise a lens assembly and, thus, does not require an aperture stop.
In a further possible implementation form of the first aspect, the retinal display apparatus comprises: a beam generator configured to generate an optical source beam representing the image; a reflective screen configured to reflect the optical source beam; and a beam shaper for generating the output beam from the reflected source beam, wherein the retinal display apparatus is configured to adjust an orientation of the reflective screen on the basis of the eye information. Thus, the angle of incidence of the reflected source beam on the beam shaper, and thus the output beam, can be steered. In an embodiment, the beam shaper can comprise a lens assembly and, thus, does not require an aperture stop.
In a further possible implementation form of the first aspect, the beam generator is configured to generate a plurality of pixel beams, wherein each of the pixel beams corresponds to a pixel of the image and the plurality of pixel beams compose the source beam. Each pixel beam may be a laser beam. This type of beam generator is described, for example, in Lin, J. et al., “Retinal projection head-mounted display,” in Journal of Frontiers of Optoelectronics, 10(1): 1-8, 2017.
According to a second aspect the invention relates to a near eye display apparatus comprising one or more retinal display apparatuses according to the first aspect of the invention.
According to a third aspect the invention relates to a corresponding retinal display method for generating an image on the retina of an eye of a user. The retinal display method comprises the steps of: generating an output beam conveying the image; providing eye information, which comprises information about an orientation of the eye; and steering the output beam based on the eye information to direct the output beam to the pupil of the eye.
The retinal display method according to the third aspect of the invention can be performed by the retinal display apparatus according to the first aspect of the invention. Further features of the retinal display method according to the third aspect of the invention result directly from the functionality of the retinal display apparatus according to the first aspect of the invention and its different implementation forms described above and below.
According to a fourth aspect the invention relates to a computer program product comprising program code for performing the method according to the third aspect when executed on a computer.
Details of one or more embodiments are set forth in the accompanying drawings and the description below. Other features, objects, and advantages will be apparent from the description, drawings, and claims.
The following embodiments of the invention are described with reference to the following figures, in which:
In the following identical reference signs refer to identical or at least functionally equivalent features.
In the following description, reference is made to the accompanying figures, which form part of the disclosure, and which show, by way of illustration, specific aspects of embodiments of the invention or specific aspects in which embodiments of the invention may be used. It is understood that embodiments of the invention may be used in other aspects and comprise structural or logical changes not depicted in the figures. The following detailed description, therefore, is not to be taken in a limiting sense, and the scope of the invention is defined by the appended claims.
For instance, it is understood that a disclosure in connection with a described method may also hold true for a corresponding device or system configured to perform the method and vice versa. For example, if one or a plurality of specific method steps are described, a corresponding device may include one or a plurality of units, e.g., functional units, to perform the described one or plurality of method steps (e.g., one unit performing the one or plurality of steps, or a plurality of units each performing one or more of the plurality of steps), even if such one or more units are not explicitly described or illustrated in the figures. On the other hand, for example, if a specific apparatus is described based on one or a plurality of units, e.g., functional units, a corresponding method may include one step to perform the functionality of the one or plurality of units (e.g., one step performing the functionality of the one or plurality of units, or a plurality of steps each performing the functionality of one or more of the plurality of units), even if such one or plurality of steps are not explicitly described or illustrated in the figures. Further, it is understood that the features of the various exemplary embodiments and/or aspects described herein may be combined with each other, unless specifically noted otherwise.
As will be described in more detail further below, the retinal display apparatus 100 is configured to: generate an output beam conveying the image, i.e. an image beam, which may be composed of pixel beams; provide eye information, which comprises information about a current orientation, i.e. current viewing direction of the eye 109; and steer the output beam based on the eye information to direct the output beam to the pupil of the eye 109.
To this end, the retinal display apparatus 100 shown in
In an embodiment, the light engine is configured to generate a single image collimated beam (a set of light rays). In an embodiment, the light engine can comprise a laser. In an embodiment, the light engine is configured to generate a plurality of pixel beams, wherein each of the pixel beams corresponds to a pixel of the image and the plurality of pixel beams compose the source beam. Each pixel beam may be a laser beam. This type of beam generator is described, for example, in Lin, J. et al., “Retinal projection head-mounted display”, in Journal of Frontiers of Optoelectronics, 10(1): 1-8, 2017, which is herein fully incorporated by reference.
In the exemplary embodiment shown in
A further embodiment of the retinal display apparatus 100 is shown in
In a further embodiment of the retinal display apparatus 100 shown in
In the “mechanical approach” illustrated in
In the “digital approach” illustrated in
The person skilled in the art will understand that the “blocks” (“units”) of the various figures (method and apparatus) represent or describe functionalities of embodiments of the invention (rather than necessarily individual “units” in hardware or software) and thus describe equally functions or features of apparatus embodiments as well as method embodiments (unit=step).
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus, and method may be implemented in other manners. For example, the described apparatus embodiment is merely exemplary. For example, the unit division is merely logical function division and may be other division in actual implementation. For example, a plurality of units or components may be combined or integrated into another system, or some features may be ignored or not performed. In addition, the displayed or discussed mutual couplings or direct couplings or communication connections may be implemented by using some interfaces. The indirect couplings or communication connections between the apparatuses or units may be implemented in electronic, mechanical, or other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one position, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
In addition, functional units in the embodiments of the invention may be integrated into one processing unit, or each of the units may exist alone physically, or two or more units are integrated into one unit.
This application is a continuation of International Application No. PCT/EP2018/070863, filed on Aug. 1, 2018, the disclosure of which is hereby incorporated by reference in its entirety.
Number | Date | Country | |
---|---|---|---|
Parent | PCT/EP2018/070863 | Aug 2018 | US |
Child | 17154843 | US |