Embodiments of the present invention relate in general to an optical waveguide arrangement and more specifically to an optical waveguide arrangement for reducing interference patterns.
Head-Mounted Displays, HMDs, and Head-Up Displays, HUDs, can be implemented using optical waveguide technology. Optical waveguides, such as diffractive waveguides, may be used with light sources having narrow spectral bandwidth, e.g., lasers and optically filtered Light-Emitting Diodes, LEDs. Such waveguides typically suffer from interference patterns visible in the virtual image though. These interference patterns may be cylindrically symmetric for example, such as Newton rings. The interference patterns are an undesired effect since those weaken the quality of the image produced by the display. There is therefore a need to provide an optical waveguide arrangement for reducing interference patterns.
According to some aspects, there is provided the subject-matter of the independent claims. Some embodiments are defined in the dependent claims.
According to a first aspect of the present invention, there is provided an optical waveguide arrangement comprising a light source arranged to transmit a light signal to at least one optical waveguide of the optical waveguide arrangement, the at least one optical waveguide, wherein the at least one optical waveguide is arranged to receive the light signal from the light source and to convey the light signal to a human eye, to generate a waveguide-based display and at least one processor configured to control the light source, wherein the at least one processor is configured to cause shaping of a spectrum of the light signal during a period of time, said period of time corresponding to a persistence time of vision of the human eye.
According to a second aspect of the present invention, there is provided a head-mounted display or a head-up display comprising the optical waveguide arrangement of the first aspect.
According to a third aspect of the present invention, there is provided a method comprising transmitting by a light source a light signal to at least one optical waveguide of the optical waveguide arrangement, receiving by the at least one optical waveguide the light signal from the light source and conveying the light signal to a human eye, to generate a waveguide-based display and controlling the light source by at least one processor to cause shaping of a spectrum of the light signal during a period of time, said period of time corresponding to a persistence time of vision of the human eye.
According to a fourth aspect of the present invention, there is provided a non-transitory computer readable medium having stored thereon a set of computer readable instructions that, when executed by at least one processor, cause an apparatus to at least perform the method.
According to a fifth aspect of the present invention, there is provided a computer program comprising instructions which, when the program is executed by an apparatus, cause the apparatus to perform the method.
Embodiments of the present invention relate to an optical waveguide arrangement for reducing interference patterns, such as Newton rings. In accordance with at least some embodiments of the present invention, interference patterns may be reduced by sweeping a distinct spectral characteristic, such as a distinct spectral peak, of a light signal during a period of time, wherein said period of time corresponds to the persistence time of vision of the human eye, which may also be referred to as an averaging/integration time of the human eye. The human eye may be considered as a detector and thus, the persistence time of vision of the human eye equals the coherence time of the corresponding detector.
It should be noted that in embodiments of the present invention coherence time, coherence length and other characterizations of coherence do not refer to the coherence characteristics of the light field source alone, as is typical, but to the joint coherence characteristics of source and detector. Specifically, since the time scale of persistence of vision in the human eye is typically tens of milliseconds low frequency changes/modulations (compared to the central frequency of a laser) of the spectral characteristics of the light source influence the visibility of interference fringes (to the human eye), and it is this effect that is utilized herein. That is, the visibility of interference effects to the human eye are dependent on the light source spectral distribution as averaged over the persistence of vision time, and can hence be influenced by modulating said spectrum within this time frame. Shaping of the spectrum may be done for example by sweeping the peak wavelength of a laser source across a wide enough wavelength band, but more complicated light sources and more complicated changes to the spectrum can also be used. Shaping of the spectrum may comprise changing amplitude and/or wavelength.
The peak wavelength may be swept for example within a range of few nanometres, such as within a range of 2 nanometres. That is to say, the peak wavelength may be moved across the range, from one end of the range to the other end of the range, in a continuous motion or as a series of smaller discrete shifts. In general, the spectral characteristic of the light signal may be changed multiple times. i.e., more than once, during a period of time. In some embodiments, said period of time may be 20 milliseconds, which corresponds to the averaging/integration time of a typical human eye. The changes may thus be repeated, for example 50 times in a second. In some example embodiments, said period of time is 5-200 milliseconds.
According to at least some embodiments of the present invention, optical waveguide-based displays may be used for Head-Mounted Displays. HMDs, and Head-Up Displays. HUDs. In general, optical waveguides are capable of conveying optical frequency light. Optical, or visible, frequencies may refer to light signals within about 400 to 700 nanometres in wavelength. Optical waveguides may be suitable for augmented reality or virtual reality type applications for example. In augmented reality, a user sees a view of the real world and superimposed thereon supplementary indications. In virtual reality, the user is deprived of his view into the real world and provided instead a view into a software-defined scene.
Light signal 104 from a light source 140 may be directed to an in-coupling structure 103, such as a partially reflecting mirror, surface relief grating or other diffractive structures. The in-coupling structure 103 may comprise one or more in-coupling gratings and/or prisms for example. The in-coupling structure 103 may be arranged to guide the light ray 104 into the optical waveguide 110. That is to say, the in-coupling structure 103 may diffractively couple an image into the optical waveguide 110. As shown in
In some embodiments, the in-coupling structure 103 may be absent though and in such cases it is possible to get the light signal 104 into the optical waveguide 110 by illuminating a side surface of the optical waveguide 110 directly.
In the waveguide 110, light signal 104 may advance by being reflected repeatedly inside the waveguide, interacting with elements 112a until it interacts with elements 112 which cause it to be deflected from waveguide 110 to air, towards eye 120 as image producing light signals 114. Elements 112a and 112 may be located on either side or both sides of the optical waveguide 110, wherein a side of the optical waveguide 110 refers to the side which is towards the eye 120 or to the “outside world” side. Elements 112a and 112 may comprise partially reflecting mirrors, surface relief gratings or other diffractive structures, for example. Elements 112a may be arranged, for example, to spread light field 100 inside waveguide 110 such that the image of the waveguide display is correctly generated. As light from different angular aspects of light field 110 will interact with elements 112, light signals 114 will produce the image encoded in light field 100 on the retina of eye 120. Light may interact with elements 112 in distinct sequences, wherein all elements 112 are not necessarily used all the time. Not all of the light needs to necessarily hit all elements 112.
Elements 112 then cause the light signal 104 to leave waveguide 110 at an exit location or at multiple exit locations. As a consequence, the user will perceive the image encoded in light field 100 in front of his eyes 120. As waveguide 110 may be, at least in part, transparent, the user may also advantageously see his real-life surroundings through waveguide 110 in case the waveguide-based display is head-mounted, for example. Light is released from waveguide 110 as a consequence of the action of the elements 112, i.e., elements 112 may be referred to as out-coupling elements.
A color image may be generated, for example by assuming the user's color vision perception corresponds to a standard eye. A term “color space” refers to the (two-dimensional) chromaticity diagram corresponding to the perceived colors resulting from the spectral response of an average human eye. The gamut of a device is the region of the color space, which is reproducible by that device. Specifically, here the gamut corresponds to the region in color space, which can be reproduced by the combination of light sources 140 and waveguides in the system for light fields that the observer perceives to originate from a focal plane. The Region of Interest, ROI, in turn, refers to a region of color space that is sufficient to reproduce what is perceived as a full color image, but may also correspond to a smaller or larger region of color space. As a specific point in the color space can be reached by different combinations of wavelengths, a specific ROI can be reached using different combinations of distinct spectral characteristics, such as peaks in visible spectrum.
A color image may be generated, for example by assuming the user's color vision perception corresponds to a standard eye and by reproducing (a part of) the corresponding color space. As is clear from the definition of the color space, the user perceives the same color as the result of several different light signal spectra. This provides degrees of freedom to how a waveguide 110 operates. In addition, different combinations of distinct spectral characteristics, such as wavelengths, may be used to generate the same color. How light is coupled out of the waveguide may be a function of the exit location. That is, a light ray corresponding to a specific position in the input image (specific propagation angle) may leave the waveguide at different angles depending on the exit location. In general, the user may perceive a same color from more than one spectrum of light signals 114. This yields degrees of freedom in manufacturing waveguide 110.
In a waveguide-based display, there may be present plural optical waveguides 110, i.e., a stack of optical waveguides 110 on top of each other. Plural optical waveguides 110 may for example convey light simulating different apparent depths in front of eye 120, as well as, optionally, the user's other eye which is not illustrated in
The light field 100 encoding the image may be generated using an optical system comprising, for example, a mirror 130 and laser light sources 140. Mirror 130 may comprise, for example, a Microelectromechanical System, MEMS, mirror which is configured to reflect light signals from light sources 140 as to generate the image encoding light field 100 in a controlled manner by, for example, scanning the angular space thereby generating the light field encoding the image. Mirror 130 may therefore be actuated to tilt to different angles so as to direct the light from light sources 140 to the appropriate parts of the light field 100 in angular space.
In some embodiments, the optical system may consist of other types of image generating devices, such as projectors, where the light sources may for example be LEDs and a primary display may be present in the form of a Liquid Crystal on Silicon, LCOS, device. The optical system maps the image from the primary display to angular space, thereby generating a light field for input to waveguide 110.
The example system illustrated in
To produce a color image encoded in the light field 100 in angular space, light sources 140 may, for example, be programmatically controlled. In instances where the mirror 130 is present, light sources 140 and the mirror 130 may be synchronized with each other such that light from light sources 140 illuminates specific angular regions of the angular space 100 in a controlled manner so as to produce therein a representation of a color image which reproduces a still or moving input image received from an external source, such as, for example, a virtual reality or augmented reality computer. The still or moving image received from the external source may comprise a digital image or a digital video feed, for example. The image encoded in light field 100 is thus configurable by provision of a suitably selected input image.
To produce a specific color at a given aspect in angular space of light field 100, this given aspect in the angular space may be illuminated by a set of three light sources 140 for example. This specific color is then reproduced by the light signals 114, as light from the given aspect in the angular space of light field 100 proceeds in waveguide 110 to an element 112 where it exists at angle corresponding to the given aspect in the angular space 100.
Consequently, reflected light signal 116 may interfere with light signal 114 and cause visible interference patterns, if the coherence length of the system comprised by the light source and the detector (human eye) is larger than the optical path length difference of the light signals. The interference patterns, may for example occur in the form of Newton rings. So even though interference always occurs, the effects of the interference are usually not visible when the path length difference is larger than the coherence length of the system.
The strength of the interference patterns occurring in the example of
In some embodiments of the present invention, light signal 104 may be a laser signal. Lasers may be used to provide three discrete wavelengths, such as red, green and blue, and to enable easier implementation of working gratings. Lasers also enable higher operating efficiency and smaller form factors, which is particularly important in case of HMDs.
One challenge related to the use of lasers is unwanted interference, such as Newton rings, which should be minimized. According to some embodiments of the present invention, unwanted interference may be minimized by making a laser signal less coherent at a detector. A human eye may be considered as the detector and characteristics of the human eye may be taken into account to make the laser less coherent at the detector. For instance, if the averaging/integration time of the human eye is 20 milliseconds (50 Hz) and the distinct spectral characteristic of light signal 104 is swept over 2 nanometres during a time period of 20 milliseconds, i.e., during a period of time which corresponds to a persistence time of vision of the human eye, light signal 104 may be observed as incoherent by eye 120. This suppresses unwanted interference. Observed in slow motion, each freeze-frame may display interference, but observed at normal rate the human eye averages the distinct interference patterns, whereby the visibility of interference effects is much reduced.
In case of a laser, the spectrum of the light signal may be shaped by adjusting the cavity of the laser. Adjusting the cavity may comprise changing at least one of: cavity length, mirror reflectivity, and optical properties of materials. In an embodiment, light source 140 may be for example an open cavity diode laser. In case of the open cavity diode, a length of the cavity, which defines the wavelength, may be adjusted. A distinct spectral characteristic of the light signal may be thus swept by adjusting the length of the cavity accordingly. Alternatively, or in addition, light source 140 may be electrical and controlled by changing the driving current. So one way to shape the spectrum of a laser, as perceived by the human eye, is to shift the peak wavelength thereof within the persistence time of vision of the human eye. Shifting of the peak wavelength can be realized for example, but not exclusively, by electronically modifying driving current of a diode laser or by electronically modifying the cavity length of an open cavity diode laser by applying piezo-electric transducers.
In general, any laser source 140 that enables shaping of the spectrum of the laser signal 104 may be used. For instance, sweeping of a distinct spectral characteristic of the laser signal 104, i.e., sweeping of the peak wavelength, may be used. The open cavity diode laser provides one such choice. By shifting the peak wavelength embodiments of the present invention therefore enable spectral shaping, which makes it possible to create a desired shape for the spectrum. Spectral shaping/modulation is the general goal, and laser sources, the previously mentioned open cavity diode and changing of the driving current are merely exemplary means for achieving this goal.
Apparatus 300 may comprise memory 320. Memory 320 may comprise random-access memory and/or non-volatile memory. Memory 320 may comprise at least one RAM chip. Memory 320 may comprise solid-state, magnetic, optical and/or holographic memory, for example. Memory 320 may be at least in part accessible to processor 310. Memory 320 may be at least in part comprised in processor 310. Memory 320 may be means for storing information. Memory 320 may comprise computer instructions that processor 310 is configured to execute. When computer instructions configured to cause processor 310 to perform certain actions are stored in memory 320, and apparatus 300 overall is configured to run under the direction of processor 310 using computer instructions from memory 320, processor 310 and/or its at least one processing core may be considered to be configured to perform said certain actions. Memory 320 may be at least in part comprised in processor 310. Memory 320 may be at least in part external to apparatus 300 but accessible to apparatus 300. Memory 320 may store information defining segments of primary display 100, for example.
Apparatus 300 may comprise a transmitter 330. Apparatus 300 may comprise a receiver 340. Transmiter 330 and receiver 340 may be configured to transmit and receive, respectively, information in accordance with at least one cellular or non-cellular standard. Transmiter 330 may comprise more than one transmitter. Receiver 340 may comprise more than one receiver. Receiver 340 may be configured to receive an input image, and transmitter 330 may be configured to output control commands to direct mirror 130, where present, and light sources 140, for example, in accordance with the input image. Transmitter 430 and/or receiver 440 may be configured to operate in accordance with Wireless Local Area Network, WLAN, standards for example.
Apparatus 300 may comprise User Interface, UI. 350. UI 350 may comprise at least one of a display, a keyboard, a touchscreen, a vibrator arranged to signal to a user by causing apparatus 300 to vibrate, a speaker and a microphone. A user may be able to operate apparatus 300 via UI 350, for example to configure display parameters.
Processor 310 may be furnished with a transmitter arranged to output information from processor 310, via electrical leads internal to apparatus 300, to other devices comprised in apparatus 300. Such a transmitter may comprise a serial bus transmitter arranged to, for example, output information via at least one electrical lead to memory 320 for storage therein. Alternatively to a serial bus, the transmitter may comprise a parallel bus transmitter. Likewise processor 310 may comprise a receiver arranged to receive information in processor 310, via electrical leads internal to apparatus 300, from other devices comprised in apparatus 300. Such a receiver may comprise a serial bus receiver arranged to, for example, receive information via at least one electrical lead from receiver 340 for processing in processor 310. Alternatively to a serial bus, the receiver may comprise a parallel bus receiver.
Apparatus 300 may comprise further devices not illustrated in
Processor 310, memory 320, transmitter 330, receiver 340 and/or UI 350 may be interconnected by electrical leads internal to apparatus 300 in a multitude of different ways. For example, each of the aforementioned devices may be separately connected to a master bus internal to apparatus 300, to allow for the devices to exchange information. However, as the skilled person will appreciate, this is only one example and depending on the embodiment various ways of interconnecting at least two of the aforementioned devices may be selected without departing from the scope of the present invention.
The distinct spectral characteristic of the light signal may be swept during a period of time, e.g., by at least one processor 150 of
In some embodiments, the distinct spectral characteristic of the signal may be swept within a range of a few nanometres. For instance, the distinct spectral characteristic of the light signal may be swept by about 2 nanometres during said period of time. i.e., maximum shift of the sweeping wavelength range 420 of the distinct spectral characteristic of the light signal may be about 2 nanometres. For instance, the wavelength of the signal may be swept around a central wavelength by +/−1 nanometre. In some embodiments, the wavelength of the signal may be swept around a central wavelength by +/−5 nanometres. In some embodiments, a wider sweeping wavelength range is used in connection with amplitude modulation such as the amplitude decreasing towards the end points of the sweeping wavelength range.
The distinct spectral characteristic of the light signal may be swept/shifted between first wavelength 430 and second wavelength 440 during said period of time. That is to say, the distinct spectral characteristic of the light signal may be shifted more than once, i.e., multiple times, during said period of time. For instance, the distinct spectral characteristic may be shifted, possibly gradually, from first wavelength 430 to second wavelength 440 during said period of time. Alternatively, the distinct spectral characteristic may be shifted, possibly gradually, from first wavelength 430 to second wavelength 440 and then from second wavelength 440 back to first wavelength 430. In some embodiments, the distinct spectral characteristic may be swept from the central wavelength towards the end points 430 and 440 of the sweeping wavelength range 420 in arbitrary order.
In some embodiments, the distinct spectral characteristic may be swept/shifted uniformly so that a step size of each shift is the same, to enable simple implementation. Alternatively, the distinct spectral characteristic may be swept/shifted non-uniformly so that a step size of each shift is not the same, to cope with certain hardware restrictions.
The distinct spectral characteristic of the light signal may be swept/shifted continuously, i.e., non-stop, during said period of time, to make the light signal less coherent and enable incoherent detection by a human eye. More specifically, in some embodiments, the distinct spectral characteristic of the light signal may be swept/shifted continuously in a discrete manner. That is to say, the distinct spectral characteristic of the light signal may be shifted multiple times during said period of time, but in a continuous manner. A spectral shape of the distinct spectral characteristic may also change during said period of time, i.e., the spectral shape of the distinct spectral characteristic may change in connection with the wavelength change. In some embodiments, the sweeping wavelength range is swept multiple times during said period of time.
In some embodiments, the intensity and/or the spectral shape of the distinct spectral characteristic of the light signal may be changed during sweeping/shifting as well, e.g., by at least one processor 150 of
In some embodiments, the light source may be a laser source and the light signal may be a laser signal. For instance, the laser source may be an open cavity diode laser. Lasers may be used for example to enable easier implementation of working gratings, e.g., for HMDs.
The persistence time of vision of the human eye may depend on the individual person and thus, the persistence time of vision may be different for different persons. In some embodiments, it may be assumed that the persistence time of vision of a human eye is 20 milliseconds and thus, said period of time may be 20 milliseconds as well. Hence, the light signal may be observed as incoherent by the human eye during said period of time. In some example embodiments, said period of time is 5-200 milliseconds.
The distinct spectral characteristic of the light signal may be swept/shifted similarly as in the embodiment of
In general, a spectrum of the light signal may be shaped during a period of time, said period of time corresponding to a persistence time of vision of the human eye. Said shaping of the spectrum may comprise sweeping a distinct spectral characteristic of the light signal during said period of time, changing an amplitude of the light signal as a function of a wavelength such that lower amplitudes are used at end points of the sweeping wavelength range compared to a maximum amplitude at the sweeping wavelength range, changing a spectral shape of the light signal during said period of time to achieve a smooth spectral profile and/or changing an intensity of the light signal during said period of time to achieve a smooth spectral profile. In some embodiments, a wider spectral distribution may be swept instead of a peak of distinct spectral characteristics.
The method may comprise, at step 610, transmitting by a light source a light signal to at least one optical waveguide of the optical waveguide arrangement. Moreover, the method may comprise, at step 620, receiving by the at least one optical waveguide the light signal from the light source and conveying the light signal to a human eye, to generate a waveguide-based display. Finally, the method may comprise, at step 630, controlling the light source by at least one processor to cause shaping of a spectrum of the light signal during a period of time, said period of time corresponding to a persistence time of vision of the human eye.
It is to be understood that the embodiments of the invention disclosed are not limited to the particular structures, process steps, or materials disclosed herein, but are extended to equivalents thereof as would be recognized by those ordinarily skilled in the relevant arts. It should also be understood that terminology employed herein is used for the purpose of describing particular embodiments only and is not intended to be limiting.
Reference throughout this specification to one embodiment or an embodiment means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, appearances of the phrases “in one embodiment” or “in an embodiment” in various places throughout this specification are not necessarily all referring to the same embodiment. Where reference is made to a numerical value using a term such as, for example, about or substantially, the exact numerical value is also disclosed.
As used herein, a plurality of items, structural elements, compositional elements, and/or materials may be presented in a common list for convenience. However, these lists should be construed as though each member of the list is individually identified as a separate and unique member. Thus, no individual member of such list should be construed as a de facto equivalent of any other member of the same list solely based on their presentation in a common group without indications to the contrary. In addition, various embodiments and example of the present invention may be referred to herein along with alternatives for the various components thereof. It is understood that such embodiments, examples, and alternatives are not to be construed as de facto equivalents of one another, but are to be considered as separate and autonomous representations of the present invention.
In an exemplary embodiment, an apparatus, such as, for example, apparatus 300 in
In an exemplary embodiment, a computer program may be configured to cause a method in accordance with the embodiments described above and any combination thereof. In an exemplary embodiment, a computer program product, embodied on a non-transitory computer readable medium, may be configured to control a processor to perform a process comprising the embodiments described above and any combination thereof.
In an exemplary embodiment, an apparatus, such as, for example, apparatus 300 in
Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the preceding description, numerous specific details are provided, such as examples of lengths, widths, shapes, etc., to provide a thorough understanding of embodiments of the invention. One skilled in the relevant art will recognize, however, that the invention can be practiced without one or more of the specific details, or with other methods, components, materials, etc. In other instances, well-known structures, materials, or operations are not shown or described in detail to avoid obscuring aspects of the invention.
While the forgoing examples are illustrative of the principles of the present invention in one or more particular applications, it will be apparent to those of ordinary skill in the art that numerous modifications in form, usage and details of implementation can be made without the exercise of inventive faculty, and without departing from the principles and concepts of the invention. Accordingly, it is not intended that the invention be limited, except as by the claims set forth below.
The verbs “to comprise” and “to include” are used in this document as open limitations that neither exclude nor require the existence of also un-recited features. The features recited in depending claims are mutually freely combinable unless otherwise explicitly stated. Furthermore, it is to be understood that the use of “a” or “an”, that is, a singular form, throughout this document does not exclude a plurality.
At least some embodiments of the present invention find industrial application in HMDs and HUDs.
Number | Date | Country | Kind |
---|---|---|---|
20215616 | May 2021 | FI | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/FI2022/050348 | 5/23/2022 | WO |