The present application relates to a Lissajous dual-axial scan component and a method for controlling the Lissajous dual-axial scan component, and in particular such a component and method for a projection system.
A projector is an optical device that receives an imaging signal and projects corresponding still images or moving images onto a display surface such as a screen or retina.
Many projection devices use a microelectromechanical systems (MEMS) mirror to reflect light onto a display surface (hereinafter referred to as a screen) or directly onto the retina of user's (retinal projection). The MEMS mirror oscillates on one or more oscillation axes to scan light across the screen for projecting an image on the screen or retina. For example, the MEMS mirrors, used in projection interfaces such as augmented reality and virtual reality applications, are arranged to oscillate on two orthogonal or near orthogonal axes to allow projection on the screen or retina.
Some projectors are arranged to scan in a raster scan arrangement, similar to the approach familiar from television systems. Alternatively, the scanning arrangement can produce a Lissajous figure whose shape is determined by the oscillation frequencies applied to the two oscillation axes, and the phase relationship between the two frequencies. The trajectory of the two-dimensional oscillations determines the degree of illumination on the display screen, also called line density or fill factor. If the oscillation frequencies are not properly controlled with respect to the degree of illumination, the Lissajous trajectory will change and may not be suited for any projection process. The Lissajous trajectory determines the degree of the illumination on the screen, and the Lissajous trajectory is determined by the oscillation frequencies on the two axes and their relative phase. Additionally, it may be desirable for total optical scan angles (TOSA) of the MEMS mirror to be maximized in MEMS scanning applications generally, as the TOSA determines the size of a projection surface. To achieve this, MEMS scanners are usually driven at their resonance frequencies on respective axes. However, the resonance frequencies are not constant over time, for example, they may be temperature dependent, so the Lissajous trajectory may change over time as well, leading to instability in illumination. In certain scenarios, the illumination on the screen even falls below 50% with the Lissajous based MEMS scanning projection systems. Such a low illumination percentage makes the projection of display contents at least unpleasant.
Therefore, there arises a need to address the aforementioned technical drawbacks in existing technologies in optimising high illumination on a display surface.
It is an object of the present disclosure to provide a Lissajous dual-axial scan component that enhances illumination and line density on a screen or retina and also provides a smooth visual perception of moving images.
This object is achieved by the features of the independent claims. Further implementation forms are apparent from the dependent claims, the description, and the figures.
The present disclosure provides a Lissajous dual-axial scan component and a method for controlling a Lissajous dual-axial scan component.
According to a first aspect, there is provided a Lissajous dual-axial scan component including:
The Lissajous dual-axial scan component may have both high mechanical stability and low operating voltages. Based on the combinations of the driving frequencies and their phase difference (φ) stored in the memory as topics, the Lissajous dual-axial scan component achieves high definition and high frame-rate (HDHF) scanning and enables a necessary degree of illumination and high line density during projection of images and videos. Each topic corresponding to the particular pair of ranges of first-axis and second-axis resonant frequencies that are stored in the memory provides settings that that ensure desired fill factor for the particular pair of resonant frequencies.
In a first possible implementation form of the Lissajous dual-axial scan component of the first aspect, the ratio of the first-axis resonance frequency to the second-axis resonance frequency is at least 20 to 1.
In a second possible implementation form of the Lissajous dual-axis scan component of the first possible implementation form, the ratio of the first-axis resonance frequency to the second-axis resonance frequency is at least 30 to 1,
In a third possible implementation form of the Lissajous dual-axial scan component of the second possible implementation, the ratio of the first-axis resonance frequency to the second-axis resonance frequency is at least 40 to 1. The above ratios of the first-axis resonance frequency to the second-axis resonance frequency enable the mirror of the Lissajous dual-axial scan component to provide high illumination and high line density on the screen or retina. Hereinafter, for convenience and ease of reading, we will refer simply to “screen”, but any reference to screen should be taken to mean “screen or retina” unless the context clearly requires otherwise.
In a fourth possible implementation form of the first aspect as such or according to any of the preceding implementation forms of the first aspect, the first and second rotational axes are orthogonal to each other.
In a fifth possible implementation form of the first aspect as such or according to any of the preceding implementation forms of the first aspect, the ratio of the first-axis resonance frequency to the second-axis resonance frequency is a rational number.
In a sixth possible implementation form of the first aspect as such or according to any of the first through fourth implementation forms of the first aspect, the ratio of the first-axis resonance frequency to the second-axis resonance frequency is an irrational number.
In a seventh possible implementation form of the first aspect as such or according to any of the preceding implementation forms of the first aspect, the controller is configured to drive the scan component with a frame repetition rate between 25 and 35 Hz (i.e. 25 Hz<fres<35 Hz).
According to a second aspect, there is provided a visual display device including one or more Lissajous dual-axial scan components according to the first aspect as such or according to any of the preceding implementation forms of the first aspect.
In a first implementation form of the visual display device, the visual display device includes a direct digital synthesis device to generate the first-axial bias frequency and the second-axial bias frequency.
According to a third aspect, there is provided a method of fabricating a Lissajous dual-axial scan component according to the first aspect as such or according to any of the preceding implementation forms of the first aspect, the method including writing multiple tuples into a memory of the Lissajous dual-axial scan component, each tuple includes a first-axial bias frequency value, a second-axial bias frequency value, and a phase difference between the first-axial bias frequency and the second-axial bias frequency. Each tuple corresponds to a particular pair of ranges of first-axis and second-axis resonance frequencies. The Lissajous dual-axial scan component fabricated using the method of the third aspect may have both high mechanical stability and low operating voltages. The Lissajous dual-axial scan component achieves high illumination and high line density on a screen using combinations of the driving frequencies and their phase difference (φ) stored in a memory.
According to a fourth aspect, there is provided a method of controlling a Lissajous dual-axial scan component, the method including:
The method of the fourth aspect controls the Lissajous dual-axial scan component to provide high illumination and high line density on a screen using the combinations of the driving frequencies and their phase difference (φ) stored in the memory as tuples. The Lissajous dual-axial scan component may have both high mechanical stability and low operating voltages.
In a first possible implementation form of the method of the fourth aspect, the method further includes
In a second possible implementation form of the method of the fourth aspect as such or according to the first implementation form of the fourth aspect, the ratio of the first-axis resonance frequency to the second-axis resonance frequency is at least 20 to 1.
In a third possible implementation form of the method of the second possible implementation of the fourth aspect, the ratio of the first-axis resonance frequency to the second-axis resonance frequency is at least 30 to 1.
In a fourth possible implementation form of the method of the third possible implementation of the fourth aspect, the ratio of the first-axis resonance frequency to the second-axis resonance frequency is at least 40 to 1. The above ratios of the first-axis resonance frequency to the second-axis resonance frequency enable the mirror of the Lissajous dual-axial scan component to provide high illumination and high line density on the screen.
In a fifth possible implementation of the fourth aspect as such or according to any of the preceding implementations of the fourth aspect, the ratio of the first-axis resonance frequency to the second-axis resonance frequency is a rational number.
In a sixth possible implementation of the fourth aspect as such or according to any of the first to fourth preceding implementations of the fourth aspect, the ratio of the first-axis resonance frequency to the second-axis resonance frequency is an irrational number.
In a seventh possible implementation of the fourth aspect as such or according to any of the preceding implementations of the fourth aspect, the controlling of the first-axial and second-axial bias frequencies is such as to produce a frame repetition rate between 25 and 35 Hz.
A Lissajous dual-axial scan component according to the present disclosure may be used in any augmented reality or virtual reality (AR/VR) device relying on Lissajous based MEMS scanning to achieve a high illumination on a screen, e.g., glasses or goggles for the display of visual information, A Lissajous dual-axial scan component according to the present disclosure may be used in any form of projection of visual content onto a screen relying on Lissajous based MEMS scanning.
A technical problem in the prior art is resolved, where the technical problem is that the trajectory changes over time, for example, due to changes in system temperature leading to instability in illumination.
Therefore, compared with the prior art, according to the Lissajous dual-axial scan component and the method for controlling the Lissajous dual-axial scan component provided in the present disclosure, the Lissajous dual-axial scan component enables high illumination and line density on the screen, and provides the smooth visual perception of moving images by shifting driving frequencies, i.e. a first-axial bias frequency and a second-axial bias frequency and their phase difference (φ) of a mirror if any changes are identified in at least one of (a) a first-axis resonance frequency and (b) a second-axis resonance frequency. The Lissajous dual-axial scan component monitors the first-axis resonance frequency and the second-axis resonance frequency. Based on a change that is identified in at least one of (a) the first-axis resonance frequency and (b) the second-axis resonance frequency, the Lissajous dual-axial scan component switches settings based on pre-stored tuples.
These and other aspects of the present disclosure will be apparent from and the embodiment(s) described below.
Embodiments of the invention will now be described, by way of example only, with reference to the accompanying drawings, in which:
Embodiments of the present disclosure provide a Lissajous dual-axial scan component and a method for controlling the Lissajous dual-axial scan component to optimize illumination and line density on a screen and provide a smooth visual perception of moving images.
To make the solutions of the present disclosure more comprehensible for a person skilled in the art, the following clearly and completely describes the technical solutions in the embodiments of the present disclosure with reference to the accompanying drawings in the embodiments of the present disclosure. The described embodiments are provided merely by way of example. All other embodiments derived by a person of ordinary skill in the art based on the embodiments of the present disclosure without creative efforts shall fall within the protection scope of the present disclosure.
In order to help understand embodiments of the present disclosure, several terms that will be introduced in the description of the embodiments of the present disclosure are defined herein first.
Terms such as “a first”, “a second”, “a third”, and “a fourth” (if any) in the summary, claims, and foregoing accompanying drawings of the present disclosure are used to distinguish between similar objects and are not necessarily used to describe a specific sequence or order. It should he understood that the terms so used are interchangeable under appropriate circumstances, so that the embodiments of the present disclosure described herein are, for example, capable of being implemented in sequences other than the sequences illustrated or described herein. Furthermore, the terms “include” and “have” and any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, a method, a system, a product, or a device that includes a series of steps or units, is not necessarily limited to expressly listed steps or units, but may include other steps or units that are not expressly listed or that are inherent to such process, method, product, or device.
The controller 114 controls application of a first-axial bias frequency, different from the first-axis resonance frequency, to cause rotation about the first rotational axis 105, and of a second-axial bias frequency, different from the second-axis resonance frequency, to cause rotation about the second rotational axis 107. The first-axial bias frequency and the second-axial bias frequency are driving frequencies of the mirror 110 of the Lissajous dual-axial scan component 100.
The Lissajous dual-axial scan component 100 scans according to a ratio of the first-axial bias frequency to the second-axial bias frequency when the Lissajous dual-axial scan component 100 is driven. The memory 116 stores multiple tuples each including a first-axial bias frequency value, a second-axial bias frequency value, and a phase difference (φ) between the first-axial bias frequency and the second-axial bias frequency. Each tuple corresponds to a particular pair of ranges of first-axis and second-axis resonant frequencies.
The controller 114 is coupled to the sensing arrangement 112 to receive signals indicative of the resonant frequencies, i.e. the first-axis resonance frequency and the second-axis resonance frequency. The controller 114 selects one of the tuples from the memory 116 based on the signals received from the sensing arrangement 112. The controller 114 sets the applied bias frequencies, and their phase, according to the selected triple.
The mirror 110 may be a MEMS mirror. The MEMS mirror may form the basis, for example, of a micro-scanner, or any other bi-axial scanners, etc. The sensing arrangement 112 may include one or more sensors. The one or more sensors may he resonant sensors to monitor the first-axis resonance frequency and the second-axis resonance frequency. The controller 114 may include a microcontroller (MCU) or a microprocessor or a digital signal processor (DSP).
In an embodiment, combinations of driving frequencies, i.e. the first-axial bias frequency and the second-axial bias frequency, and their phase difference (φ) that provide the desired degree of illumination are predetermined and stored in the memory 116 as tuples. The memory 116 electronically stores the combinations of the driving frequencies and their phase difference (φ) as tuples. The tuples may he defined as a finite ordered list of elements.
Signals received from the sensing arrangement 112 enable the controller 114 to switch to another setting that is determined by one of the stored triples based on a change that is identified in at least one of the first-axis resonance frequency and the second-axis resonant frequency. The controller 114 of the Lissajous dual-axial scan component 100 may identify another tuple that is stored in the memory 116 based on a new combination of the first-axis resonance frequency and the second-axis resonance frequency, if the sensing arrangement 112 identifies an above threshold change in at least one of the first-axis resonance frequency and the second-axis resonance frequency. The controller 114 adjusts the drive frequencies, i.e. the first-axial bias frequency and the second-axial bias frequency and their phase offset based on the appropriate tuple.
Sensing arrangement 112 is preferably configured provides a reliable sense signal for each axis of rotation, each sense signal containing information about the movement of the mirror on that particular axis. In a best case scenario, this signal consists only of one harmonic which exactly represents the mirror's movement. In this case, this signal could be analyzed electronically so that one ends up with a number representing the actual frequency. In other cases, this signal is filtered, and analyzed by the controller 114.
According to a first embodiment, the ratio of the first-axis resonance frequency to the second-axis resonance frequency is at least 20 to 1. The ratio of the first-axis resonance frequency to the second-axis resonance frequency is optionally at least 30 to 1. The ratio of the first-axis resonance frequency to the second-axis resonance frequency is optionally at least 40 to 1. The first and second rotational axes 105, 107 are optionally orthogonal to each other. The ratio of the first-axis resonance frequency to the second-axis resonance frequency is optionally a rational number. The ratio of the first-axis resonance frequency to the second-axis resonance frequency is optionally an irrational number.
The controller 114 is preferably configured to drive the Lissajous dual-axial scan component 100 with a frame repetition rate between 25 and 35 Hz, although higher repetition rates may be used without loss of apparent smoothness. The frame repetition rate may be, for example, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34 or 35 Hz. The frame repetition rate is a number of frames or images that are repeated per second. The frame repetition rate is considered when deciding which combinations of the driving frequencies and their phase difference (φ) to be stored in the memory 116. The combinations of the driving frequencies and their phase difference (φ) that provide desired degree of illumination may he determined numerically and iteratively or by measuring using a sample device.
In
and the multiplicators nx is 3 and ny is 4. In
and the multiplicators nx is 3 and ny is 4. In
and the multiplicators nx is 3 and ny is 4. In
and the multiplicators nx is 3 and ny is 4. In
and the multiplicators nx is 3 and ny is 4. In
and the multipticators nx is 3 and ny is 4. In
and the multiplicators nx is 3 and ny is 4. In
and the multiplicators nx is 3 and ny is 4.
In an embodiment, the visual display device 402 includes an electronic circuit and a memory that stores tuples, each tuple comprising a combination of two driving frequencies and their phase difference. The electronic circuit receives signals from a sensing arrangement that monitors the first-axis resonance frequency and the second-axis resonance frequency. The electronic circuit identities a tuple that is stored in the memory, based on a new combination of the first-axis resonance frequency and the second-axis resonance frequency if the electronic circuit identities any changes in at least one of the first-axis resonance frequency and the second-axis resonance frequency. A thresholding arrangement is used, with each tuple corresponding to a range of first resonant frequencies and a range of second resonant frequencies, so that changes in either or both resonant frequency that do not require a change in drive frequency or phase to ensure continuance of a desired fill factor do not result in any change in in drive frequencies or phase. The electronic circuit sets the applied bias frequencies, and their phase, according to the tuple appropriate for the instantaneous resonant frequency combination.
The one or more Lissajous dual-axial scan components 100 in the visual display device 402 enhance illumination and line density on a screen and also provide a smooth visual perception of moving images. The one or more Lissajous dual-axial scan components 100 in the visual display device 402 have both high mechanical stability and low operating voltages.
The first-axis resonance frequency and the second-axis resonance frequency may be monitored continuously, but they may also be monitored intermittently at a rate high enough to ensure continued good optical performance. Another tuple of the multiple stored tuples are selected in response to any significant change in signals received from the monitoring. A significant change is here one that necessitates a change in the applied bias frequencies or phase in order to maintain a desired fill factor or other aspect of optical performance. The applied bias frequencies, and their phase, are set according to the selected another tuple.
Oscillations on the first rotational axis 105 and the second rotational axis 107 of the Lissajous dual-axial scan component 100 can be written as
x(t)=sin(2πnxfrest)
y(t)=sin(2πnxfrest+φ)
where nx and ny are multiplicators that determine the shape of the Lissajous curves, and fx and fy are the driving frequencies of the mirror 110, i.e. a first-axial bias frequency and the second-axial bias frequency and fres denotes a repetition frequency of the Lissajous curves, whereas scanning frequencies on the first rotational axis 105 and the second rotational axis 107 are
f
x
=n
x
*f
res and fy=ny*fres
The repetition frequency (fres) should be sufficient for a smooth perception of a projected video (assuming that the video is of a moving image). To achieve a high enough line density or fill factor, it is desirable for the irreducible fraction nx/ny to be large
For example, if the driving frequencies fx=27600 Hz and fy=690 Hz, one or more combinations of nx, ny, fres are possible within a certain range of the driving frequencies (fx and fy), e.g., fres=690 Hz, nx=40, ny=1 or fres=36.316 Hz, nx=13, ny=760 with resulting frequencies of fx=27600.16 Hz and fy=690.004 Hz. The latter combination is a lot better suited far projection applications, as the frame rate is sufficient to allow smooth visual perception While nx and ny are maximised. In projection applications, a frame rate that enables smooth visual perception if the multiplicators nx and ny are maximized.
By making
greater than at least 24 Hertz (Hz) smooth perception of a video is possible (and typically it may be convenient to work with a repetition frequency in the range 24 to 35 fps). The fraction of
allows better line density, and preferably
and more preferably
This requires the mirror 110, (e.g. MEMS mirror) with the resonance frequencies according to that rule, as
With the example given above of a MEMS mirror with rough resonance frequencies of fx=27600 and fy=690 Hz respectively, we estimate a maximum fluctuation in those resonance frequencies on both axes. Let us say on the fast axis it fluctuates between 27590 and 27610 Hz and on the slow axis between 688 and 692 Hz depending on the conditions imaginable. We then know that the minimum multiplicator nx_min for the fast axis would be 788, as 788*35 Hz roughly equals 27590 Hz, while the maximum multiplicator nx_max is 1104, because 1100*25 Hz roughly equals 27610 Hz. Accordingly the range for all possible multiplicators ny can be calculated to be 19 to 27.
Then all imaginable combinations of allowed driving frequencies can be calculated numerically and iteratively. First one has to check all possible pairs of multiplicators nx and ny in the aforementioned ranges whether they are coprime. If they are, they are stored, if they are not, they are discarded. 19 and 788 e.g. are stored, as the greatest common divisor (gcd) of (19,788)=1, whereas 20 and 788 are discarded, as gcd of (20,788)=4. In this way one ends up with a list of coprime numbers that could lead to possible driving frequencies within the allowed range above.
One could implement a Python script where these pairs of coprime multiplicators are stored pairwise in a numpy vector in the memory 116.
If one now multiplies this numpy vector with all frame rates within the allowed range, a large number of allowed driving frequencies is generated. For example, with one pair of multiplicators of 19 and 788 and a frame rate of exactly 25 Hz, the resulting driving frequencies are 475 Hz and 19700 Hz. In this particular example, this pair is discarded though, as it's too far away from the resonance frequencies, thus one does not have to store it in the ROM mentioned. If one takes another coprime pair of multiplicators, e.g. nx=842 and ny=21, one actually is within the assumed range of resonance frequency fluctuation with a resonance frequency of 32.78 Hz for example (842*32.78 Hz=27600.76 Hz, 21*32.78 Hz=688.38 Hz). So we can implement a Python script as mentioned that takes the generated numpy vector of coprime multiplicators and iteratively multiples those with all resonance frequencies in the range mentioned above, starting at 25 Hz, 25.0001 Hz and so on up to 35 Hz. All of the resulting matrices of frequency pairs are then filtered so that they satisfy the condition for the fluctuation of resonance frequencies as described.
It will be appreciates that this is a rather long and demanding mathematical operation, and it is for this reason that it is done beforehand and then stored in memory 116.
Although the present invention and its advantages have been described in detail, it should be understood that various changes, substitutions and alterations can he made herein without departing from the spirit and scope of the invention as defined by the appended claims.
Number | Date | Country | |
---|---|---|---|
Parent | PCT/EP2020/080207 | Nov 2020 | US |
Child | 18196773 | US |