Some display devices employ laser scanning to produce viewable images. In one example, laser light is reflected by a scanning mirror system at different angles to scan the laser across pixels of a projected image. Control of the light color and/or intensity at each pixel allows the image to be projected.
Examples are disclosed that related to scanning image display systems. In one example, a scanning display system comprises a laser light source comprising two or more offset lasers, a scanning mirror system configured to scan light from the laser light source in a first direction at a higher frequency, and in a second direction at a lower frequency to form an image, and a controller configured to control the scanning mirror system to scan the laser light an interlaced pattern to form the image, and to adjust one or more of a scan rate in the second direction and a phase offset between a first frame and a second frame of the interlaced image.
This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter. Furthermore, the claimed subject matter is not limited to implementations that solve any or all disadvantages noted in any part of this disclosure.
As described above, some display devices employ laser scanning to produce viewable images. In one example, laser light is reflected by a mirror system at different angles to project reflected laser light throughout a field-of-view (FOV). To achieve a range of reflection angles, a suitable actuator such as a microelectromechanical system (MEMS) actuator may rotate the mirror system.
A MEMS actuator may rotate a mirror system in horizontal and vertical directions to produce viewable images in a two-dimensional FOV. To this end, the mirror system may include a single mirror driven in both horizontal and vertical directions, or two mirrors separately driven in horizontal and vertical directions. Different scan rates may be employed in the horizontal and vertical directions. In a two mirror system, for example, a horizontally scanned mirror may be driven at a relatively fast rate (e.g., ˜10 kHz), whereas a vertically scanned mirror may be driven at a relatively slower rate (e.g., ˜60 Hz). The horizontal and vertical scan rates may at least partially determine the resolution of images generated at these rates, along with other factors such as mirror aperture (e.g., diameter) and scan angle.
However, current MEMS technology places an upper limit on mirror scan rates, in turn limiting display resolution. As an example, a 27 kHz horizontal scan rate combined with a 60 Hz vertical scan rate may yield a vertical resolution of 720p. Significantly higher vertical resolutions (e.g., 1440p, 2160p) may be desired, particularly for near-eye display implementations, where 720p and similar vertical resolutions may appear blurry and low-resolution. While an increase in the horizontal and/or vertical scan rate would increase display resolution, the former may be technologically infeasible while the latter increases power consumption. Further, high scan rates may at least partially constrain mirror scan angle and aperture, where larger values are also desired. Additionally, supporting higher resolution also may require a larger mirror size due to the diffraction limit associated with smaller “pixel” sizes. The use of such a larger mirror may further increase the difficulties in achieving higher resolutions with scanning displays, as the larger mirror leads to a lower scanning frequency.
Examples are thus disclosed for a laser-based MEMS scanning display device configured for high-resolution output. As described below, an interlaced mode of operating multiple lasers may be combined with variable scan rates and/or phase offsets between interlaced frames to achieve desired spacing between laser output, in turn yielding desired image pixel spacing and resolution. The use of multiple lasers allows multiple lines to be scanned per mirror period, thereby allowing higher resolution to be achieved without increasing mirror scan frequencies, and also permits larger mirrors to be used, which may help to avoid issues with pixel size imposed by diffraction limits. Further, examples are disclosed in which output from an eye-tracking sensor is utilized to dynamically alter laser output spacing as a function of user gaze direction.
To enable the generation of desired images, an actuator 110 separately drives first and second mirrors 104 and 106. In one example, actuator 110 rotates first mirror 104 in the horizontal direction at a first, relatively faster rate (e.g., 27 kHz, 35 kHz), and second mirror 106 in the vertical direction at a second, relatively slower rate (e.g., 60 Hz, 120 Hz). The second rate may be fixed such that second mirror 106 is vertically scanned in a continuous manner, while in other examples the vertical scanning may be carried out stepwise, such that second mirror has a vertical velocity substantially equal to zero prior to completion of a horizontal scan line, and is nonzero upon completion of a horizontal scan line to thereby transition to a subsequent horizontal scan line. Mirrors 104 and 106 may assume any suitable form, such as that of a MEMS actuated mirror (e.g., resonant piezoelectric-actuated).
In some implementations, display device 100 may further comprise an eye tracking sensor 112 operable to detect a gaze direction of a user of the display device. The gaze direction may be mapped to a region in display space to determine a location at output 108 where a user's gaze is directed. As described in further detail below with reference to
Display device 100 further comprises a controller 114 for effecting the approaches described herein. Controller 114 may control operation of lasers 102 (e.g., frequency, intensity, duty cycle) and/or first and/or second mirrors 104 and 106, and may receive output from eye tracking sensor 112 and adjust operation of the lasers, first mirror, and/or second mirror based on the eye tracking sensor output.
Display device 100 may comprise alternative or additional elements not shown in
As indicated at a legend 204, diagram 200 shows a trace of a first laser in a first frame, a trace of a second laser in the first frame, a trace of the first laser in a second frame, and a trace of the second laser in the second frame. In the first frame, the traces of the first and second lasers may be vertically separated in display space by one line. Thus, the traces of the first and second lasers may produce light at vertically adjacent image pixels that are vertically aligned. As an example,
The example shown in
In this formulation, the interlacing of the first and second frames, and other successive, alternate frames, may include applying a phase offset between alternate frames. As an example,
While a single line (e.g., pixel) spacing may be achieved at certain regions within FOV 201, less desirable spacing may result in other regions within the FOV. In the example depicted in
The laser trace diagrams shown in
It will be understood that
Various laser configurations may be used to generate single, and other desired, line spacings. As one example,
This and other vertical separation distances, however, may manifest in line spacings greater than one line in display space. As described in further detail below, specific vertical refresh rates and/or phase offsets may be selected to compensate and achieve single line spacing.
Single line spacing may be achieved with laser die 400 by rotating the laser die relative to the orientation shown in
The phase offset between interlaced frames generated by laser die 400 with vertical separation distance 408 may be adjusted to produce desired line spacings in certain parts of FOV 604, as described above. FIG. 7 shows an example laser trace diagram 700 resulting from a change in a phase offset of pi radians used to produce diagram 600 to a phase offset of pi/2 radians. In contrast to diagram 600, in which undesired line spacing and laser output overlap occurred in horizontal angles proximate 0 deg, the pi/2 radian phase offset represented by diagram 700 results in desired line spacing in the horizontal angles proximate 0 deg. As described above, output from eye tracking sensor 112 of
In some embodiments, the methods and processes described herein may be tied to a computing system of one or more computing devices. In particular, such methods and processes may be implemented as a computer-application program or service, an application-programming interface (API), a library, and/or other computer-program product.
Computing system 800 includes a Logic machine 802 and a storage machine 804. Computing system 800 may optionally include a display subsystem 806, input subsystem 808, communication subsystem 810, and/or other components not shown in
Logic machine 802 includes one or more physical devices configured to execute instructions. For example, the logic machine may be configured to execute instructions that are part of one or more applications, services, programs, routines, libraries, objects, components, data structures, or other logical constructs. Such instructions may be implemented to perform a task, implement a data type, transform the state of one or more components, achieve a technical effect, or otherwise arrive at a desired result.
The logic machine may include one or more processors configured to execute software instructions. Additionally or alternatively, the logic machine may include one or more hardware or firmware logic machines configured to execute hardware or firmware instructions. Processors of the logic machine may be single-core or multi-core, and the instructions executed thereon may be configured for sequential, parallel, and/or distributed processing. Individual components of the logic machine optionally may be distributed among two or more separate devices, which may be remotely located and/or configured for coordinated processing. Aspects of the logic machine may be virtualized and executed by remotely accessible, networked computing devices configured in a cloud-computing configuration.
Storage machine 804 includes one or more physical devices configured to hold instructions executable by the logic machine to implement the methods and processes described herein. When such methods and processes are implemented, the state of storage machine 804 may be transformed—e.g., to hold different data.
Storage machine 804 may include removable and/or built-in devices. Storage machine 804 may include optical memory (e.g., CD, DVD, HD-DVD, Blu-Ray Disc, etc.), semiconductor memory (e.g., RAM, EPROM, EEPROM, etc.), and/or magnetic memory (e.g., hard-disk drive, floppy-disk drive, tape drive, MRAM, etc.), among others. Storage machine 804 may include volatile, nonvolatile, dynamic, static, read/write, read-only, random-access, sequential-access, location-addressable, file-addressable, and/or content-addressable devices.
It will be appreciated that storage machine 804 includes one or more physical devices. However, aspects of the instructions described herein alternatively may be propagated by a communication medium (e.g., an electromagnetic signal, an optical signal, etc.) that is not held by a physical device for a finite duration.
Aspects of logic machine 802 and storage machine 804 may be integrated together into one or more hardware-logic components. Such hardware-logic components may include field-programmable gate arrays (FPGAs), program- and application-specific integrated circuits (PASIC/ASICs), program- and application-specific standard products (PSSP/ASSPs), system-on-a-chip (SOC), and complex programmable logic devices (CPLDs), for example.
The terms “module,” “program,” and “engine” may be used to describe an aspect of Computing system 800 implemented to perform a particular function. In some cases, a module, program, or engine may be instantiated via Logic machine 802 executing instructions held by storage machine 804. It will be understood that different modules, programs, and/or engines may be instantiated from the same application, service, code block, object, library, routine, API, function, etc. Likewise, the same module, program, and/or engine may be instantiated by different applications, services, code blocks, objects, routines, APIs, functions, etc. The terms “module,” “program,” and “engine” may encompass individual or groups of executable files, data files, libraries, drivers, scripts, database records, etc.
It will be appreciated that a “service”, as used herein, is an application program executable across multiple user sessions. A service may be available to one or more system components, programs, and/or other services. In some implementations, a service may run on one or more server-computing devices.
When included, display subsystem 806 may be used to present a visual representation of data held by storage machine 804. This visual representation may take the form of a graphical user interface (GUI). As the herein described methods and processes change the data held by the storage machine, and thus transform the state of the storage machine, the state of display subsystem 806 may likewise be transformed to visually represent changes in the underlying data. Display subsystem 806 may include one or more display devices utilizing virtually any type of technology. Such display devices may be combined with Logic machine 802 and/or storage machine 804 in a shared enclosure, or such display devices may be peripheral display devices.
When included, input subsystem 808 may comprise or interface with one or more user-input devices such as a keyboard, mouse, touch screen, or game controller. In some embodiments, the input subsystem may comprise or interface with selected natural user input (NUI) componentry. Such componentry may be integrated or peripheral, and the transduction and/or processing of input actions may be handled on- or off-board. Example NUI componentry may include a microphone for speech and/or voice recognition; an infrared, color, stereoscopic, and/or depth camera for machine vision and/or gesture recognition; a head tracker, eye tracker, accelerometer, and/or gyroscope for motion detection and/or intent recognition; as well as electric-field sensing componentry for assessing brain activity.
When included, communication subsystem 810 may be configured to communicatively couple with one or more other computing devices. Communication subsystem 810 may include wired and/or wireless communication devices compatible with one or more different communication protocols. As non-limiting examples, the communication subsystem may be configured for communication via a wireless telephone network, or a wired or wireless local- or wide-area network. In some embodiments, the communication subsystem may allow Computing system 800 to send and/or receive messages to and/or from other devices via a network such as the Internet.
Another example provides a scanning display system comprising a laser light source comprising two or more offset lasers, a scanning mirror system configured to scan light from the laser light source in a first direction at a higher frequency, and in a second direction at a lower frequency to form an image, and a controller configured to control the scanning mirror system to scan the laser light an interlaced pattern to form the image, and to adjust one or more of a scan rate in the second direction and a phase offset between a first frame and a second frame of the interlaced image. In such an example, the scanning mirror system alternatively or additionally may comprise a first mirror configured to scan the laser light in the first direction, and a second mirror configured to scan the laser light in the second direction. In such an example, the controller alternatively or additionally may be configured to adjust the phase offset between the first frame and the second frame by adjusting a time at which the scanning mirror system initiates the scanning of the laser light in the second direction relative to the scanning of the laser light in the first direction. In such an example, the controller alternatively or additionally may be configured to adjust the phase offset between the first frame and the second frame based on a desired line spacing at a region in the image. In such an example, the region alternatively or additionally may be one of a plurality of regions in the image, and the controller alternatively or additionally may be configured to associate a respective phase offset with each of the plurality of regions. In such an example, the scanning display system alternatively or additionally may comprise an eye tracking sensor configured to detect a gaze direction of a user, and the controller alternatively or additionally may be configured to map the gaze direction to a region in the image, and to adjust one or more of the scan rate in the second direction and the phase offset based on the region in the image. In such an example, the controller alternatively or additionally may be configured to adjust the phase offset in a first manner based on mapping the gaze direction to a first region in the image, and to adjust the phase offset in a second manner based on mapping the gaze direction to a second region in the image. In such an example, the region alternatively or additionally may be a foveal region of the image, the image alternatively or additionally may comprise a non-foveal region, and the controller alternatively or additionally may be configured to increase the scan rate in the second direction in the non-foveal region and to decrease the scan rate in the second direction in the foveal region. In such an example, the two or more offset lasers alternatively or additionally may be vertically offset in a center-aligned orientation relative to the second scan direction. In such an example, the laser light source alternatively or additionally may be configured to output light of multiple colors. In such an example, the controller alternatively or additionally may be configured to compensate for a line spacing error in the rotated orientation by adjusting the scan rate in the second direction. In such an example, the scanning mirror system alternatively or additionally may be configured to scan a horizontal line of the image in a half period of a microelectromechanical actuator that drives the scanning mirror system. In such an example, the scanning display system alternatively or additionally may be configured to scan in the first direction at a frequency of 27 kHz to 35 kHz. In such an example, the controller alternatively or additionally may be configured to control the mirror system to form the image at a resolution between 1440p and 2160p.
Another example provides a method of displaying an image comprising directing light from two or more offset lasers toward a scanning mirror system, and scanning light from the two or more offset lasers in a first direction at a higher frequency and in a second direction at a lower frequency to thereby scan the laser light in an interlaced pattern and form the image. In such an example, the method alternatively or additionally may comprise mapping a gaze direction determined via an eye tracking sensor to a region in the image, and adjusting one or more of the scan rate in the second direction and the phase offset based on the region in the image. In such an example, scanning the light from the two or more offset lasers in the first direction alternatively or additionally may comprise scanning the light in the first direction at a frequency of 27 kHz to 35 kHz. In such an example, scanning the light from the two or more offset lasers alternatively or additionally may comprise scanning the light to form the image at a resolution between 1440p and 2160p.
Another example provides a scanning display system comprising a laser light source comprising two or more offset lasers, a scanning mirror system configured to scan light from the laser light source in a first direction at a higher frequency, and in a second direction at a lower frequency to form an image, an eye tracking sensor, and a controller configured to determine a gaze direction via data from the eye tracking sensor, to control the scanning mirror system to scan the laser light an interlaced pattern to form the image, and to adjust one or more of a scan rate in the second direction and a phase offset between a first frame and a second frame of the interlaced image based at least on the gaze direction. In such an example, the display system alternatively or additionally may comprise a head-mounted display system.
It will be understood that the configurations and/or approaches described herein are exemplary in nature, and that these specific embodiments or examples are not to be considered in a limiting sense, because numerous variations are possible. The specific routines or methods described herein may represent one or more of any number of processing strategies. As such, various acts illustrated and/or described may be performed in the sequence illustrated and/or described, in other sequences, in parallel, or omitted. Likewise, the order of the above-described processes may be changed.
The subject matter of the present disclosure includes all novel and non-obvious combinations and sub-combinations of the various processes, systems and configurations, and other features, functions, acts, and/or properties disclosed herein, as well as any and all equivalents thereof.
This application claims priority to U.S. Provisional Patent Application No. 62/467,086 filed Mar. 3, 2017, the entirety of which is hereby incorporated herein by reference.
Number | Date | Country | |
---|---|---|---|
62467086 | Mar 2017 | US |