Patent Application
20150116672
The present invention relates generally to scanning laser projection systems, and more specifically to safety and test mechanisms in scanning laser projection systems.
Laser Time of Flight (TOF) distance measurement systems typically measure the round-trip time of a laser light pulse that has reflected off a target. Laser TOF systems can be employed in scanning laser projectors to determine if an obstruction exists in a laser light path. When an obstruction exists, laser light sources may be turned off to avoid causing damage to the obstruction.
In the following detailed description, reference is made to the accompanying drawings that show, by way of illustration, specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It is to be understood that the various embodiments of the invention, although different, are not necessarily mutually exclusive. For example, a particular feature, structure, or characteristic described herein in connection with one embodiment may be implemented within other embodiments without departing from the scope of the invention. In addition, it is to be understood that the location or arrangement of individual elements within each disclosed embodiment may be modified without departing from the scope of the invention. The following detailed description is, therefore, not to be taken in a limiting sense, and the scope of the present invention is defined only by the appended claims, appropriately interpreted, along with the full range of equivalents to which the claims are entitled. In the drawings, like numerals refer to the same or similar functionality throughout the several views.
A proximity detector is used to enable a high brightness laser projector with a Class 2 laser classification. In some embodiments of the present invention, a scanning laser projector scans a modulated light beam that includes both visible and invisible light. An infrared (IR) laser light beam is scanned along with red, green, and blue laser light beams to project a visible image with an invisible (IR) overlay. If the IR laser light is incident upon an object, a portion of that light will be reflected back towards the projector. A first photodetector, referred to herein as a “TOF photodetector,” can be used to sense this light and enable calculation of the time of flight for the IR light signal to determine the distance between the projector and the sensed object.
Given current laser regulations, single points of failure should be considered within the system. Various embodiments of the present invention include circuits and systems to test both transmit and receive circuits of the proximity detection function. For example, additional photodetectors, referred to herein as “light source photodetectors,” may be included near the light sources to determine whether the laser light sources are functioning (transmit circuits). Also for example, a second IR light source may be located near, and partially directed at, the TOF photodetector. This second IR light source may be used to test the functionality of the TOF photodetector (receive circuits).
Periodically, the additional IR light source may be pulsed for a short duration, (e.g., during vertical flyback). When pulsed, the TOF photodetector detects the IR light and creates a photocurrent signal, which can be processed by the system circuitry and logic. The additional IR light source may be pulsed regularly to verify that the TOF photodetector is working in the absence of an object in the projector field of view creating a signal.
In addition to testing the TOF photodetector, the additional IR light source may be used to detect local obstructions that block the TOF photodetector from receiving reflected IR laser light. If, for example, a finger is placed over the TOF photodetector, but does not block the main scanning beam used to project the IR laser light, the proximity detection system will not be able to detect other objects in the projector's field of view and will report only that there are no objects within its detection range. Various embodiments of the present invention use the additional IR light source and the TOF photodetector as a local proximity detector to detect these local obstructions.
In operation, image processing component 102 processes video content at 101 using two dimensional interpolation algorithms to determine the appropriate spatial image content for each scan position. This content is then mapped to a commanded current for each of the red, green, and blue laser light sources such that the output intensity from the lasers is consistent with the input image content. In some embodiments, this process occurs at output pixel speeds in excess of 150 MHz.
Laser light source photodetectors 111, 121, 131, and 165 are used to test, verify, and calibrate the operation of laser light sources 110, 120, 130, and 164. For example, in some embodiments, laser light source photodetectors 111, 121, 131, and 165 are positioned to detect whether the corresponding laser light source is producing light. In some embodiments, the laser light source photodetectors are coupled (not shown) to a control circuit such as image processing component 102. This provides closed loop operation for control of the laser light sources, and allows for test and calibration of the laser light sources. In some embodiments, the laser light source photodetectors are placed to detect monochrome light beams as shown in
The modulated laser light beam 109 is then directed onto an ultra-high speed gimbal mounted two-dimensional bi-axial laser scanning mirror 116. In some embodiments, this bi-axial scanning mirror is fabricated from silicon using microelectromechanical system (MEMS) processes. In some embodiments, the MEMS device uses electromagnetic actuation, achieved using a miniature assembly containing the MEMS die, small subassemblies of permanent magnets and an electrical interface, although the various embodiments are not limited in this respect. For example, some embodiments employ electrostatic or piezoelectric actuation. Any type of mirror actuation may be employed without departing from the scope of the present invention.
A scanning mirror drive circuit (not shown) provides one or more drive signal(s) to control the angular motion of scanning mirror 116 to cause output beam 124 to generate a raster scan 126 across a projector field of view 128. In some embodiments, raster scan 126 is formed by combining a sinusoidal component on the horizontal axis and a sawtooth component on the vertical axis. In these embodiments, controlled output beam 124 sweeps back and forth left-to-right in a sinusoidal pattern, and sweeps vertically (top-to-bottom) in a sawtooth pattern with the display blanked during flyback (bottom-to-top).
Scanning laser projector 100 provides video projection using a scanning modulated laser beam as described above. Scanning laser projector 100 also provides a proximity detection function to detect an obstruction in the projector's field of view 128. The proximity detection may be part of a safety circuit that disables one or more light sources when an obstruction is detected. The proximity detection may also be part of a safety circuit that reduces light source output when an obstruction is detected. For example, light source output may be reduced below Class 2 power levels when an obstruction is detected. Disabling, turning off, or reducing output of light sources may protect the obstruction from damage. For example, if the obstruction is a human eye, then disabling, turning off, or reducing the output of the light sources will prevent damage to the eye. Proximity detection is provided by a combination of elements within scanning laser projector 100. For example, IR laser light source 164, TOF photodetector (PD) 152, and TOF computation and control component 190 can be used together to detect an obstruction in the field of view of scanning laser projector, and also to determine its proximity to the projector.
In some embodiments, light source 164 sources nonvisible light such as infrared light. In these embodiments, TOF PD 152 is able to detect the same wavelength of nonvisible light. For example, in some embodiments, light source 164 may be an infrared laser diode that produces light with a wavelength of substantially 808 nanometers (nm), and TOF PD 152 is a photodiode that detects light of the same wavelength.
In operation, TOF computation and control component 190 commands IR laser light source 164 to emit IR laser light when proximity detection is to take place. In some embodiments, this occurs during raster scan 126 (an example of non-flyback time), and in other embodiments, this occurs during the flyback time. TOF PD 152 detects reflected IR light, and TOF computation and control component determines the round trip time of flight of the reflected IR light. If the time of flight is below a threshold, then an object has been detected and scanning projector 100 can take appropriate action, such as disabling, shutting off, or reducing the output of the red, green, and blue laser light sources. For example, in some embodiments, TOF computation and control component 190 provides a first safety signal to image processing component 102 on node 165. In response to receiving an asserted safety signal on node 165, image processing component 102 commands the visible light sources to stop emitting light or to reduce the output of emitted light. An example of this proximity operation is shown in
TOF computation and control component 190 is a first safety circuit that performs proximity detection using a time of flight calculation. When an object is detected too close to the projector using time of flight calculations, the light sources are disabled or the output of the light sources is reduced.
Scanning laser projector 100 also includes additional infrared light source 154. In some embodiments, IR light source 154 is a light emitting diode (LED) that does not produce coherent light. In these embodiments, a portion of noncoherent IR light produced by the IR LED is detected by the photodetector. This may be used to test the functionality of the TOF photodetector. In some embodiments, IR 154 is driven during a flyback time, and in other embodiments, IR 154 is driven during a non-flyback time (e.g., during the raster scan).
In some embodiments, IR light source 154 is used to test the functionality of TOF photodetector 152, and is also used to detect local obstructions that block TOF photodetector 152. PD test and obstruction detection component 156 is coupled to IR light source 154 and TOF photodetector 152. In some embodiments, component 156 functions to drive IR light source 154 and receive a signal from TOF photodetector 152. The signal received from the photodetector may be interpreted as a successful test of the photodetector's functionality or may be interpreted as an indication of a local obstruction. In some embodiments, component 156 differentiates between these two cases based on received signal amplitude. Examples are further described below with reference to
PD test and obstruction detection component 156 is a second safety circuit that performs proximity detection using received signal strength. When an object is detected too close to the projector based on received signal strength, the light sources are disabled or the output of the light sources is reduced. For example, component 156 may provide a safety signal to image processing component 102 on node 157. In response to the safety signal on node 157, image processing component 102 may command the visible light sources to turn off, or to reduce output power below Class 2 levels.
The various components shown in
In some embodiments, when TOF computation and control component 190 determines that the obstruction is too close, image processing component 102 is commanded to reduce the output power of the visible light sources. For example, in some embodiments, the output power of the visible light sources is reduced to below Class 2 levels.
In some embodiments, when PD test and obstruction detection component 156 determines that a local obstruction is present, image processing component 102 is commanded to reduce the output power of the visible light sources. For example, in some embodiments, the output power of the visible light sources is reduced to below Class 2 levels.
Scanning projector 100 may receive image data from any image source. For example, in some embodiments, scanning projector 100 includes memory that holds still images. In other embodiments, scanning projector 100 includes memory that includes video images. In still further embodiments, scanning projector 100 displays imagery received from external sources such as connectors, wireless interface 410, a wired interface, or the like.
Wireless interface 410 may include any wireless transmission and/or reception capabilities. For example, in some embodiments, wireless interface 410 includes a network interface card (NIC) capable of communicating over a wireless network. Also for example, in some embodiments, wireless interface 410 may include cellular telephone capabilities. In still further embodiments, wireless interface 410 may include a global positioning system (GPS) receiver. One skilled in the art will understand that wireless interface 410 may include any type of wireless communications capability without departing from the scope of the present invention.
Processor 420 may be any type of processor capable of communicating with the various components in mobile device 400. For example, processor 420 may be an embedded processor available from application specific integrated circuit (ASIC) vendors, or may be a commercially available microprocessor. In some embodiments, processor 420 provides image or video data to scanning projector 100. The image or video data may be retrieved from wireless interface 410 or may be derived from data retrieved from wireless interface 410. For example, through processor 420, scanning projector 100 may display images or video received directly from wireless interface 410. Also for example, processor 420 may provide overlays to add to images and/or video received from wireless interface 410, or may alter stored imagery based on data received from wireless interface 410 (e.g., modifying a map display in GPS embodiments in which wireless interface 410 provides location coordinates).
Mobile device 500 includes scanning projector 100 to create an image with light at field of view 128. Mobile device 500 also includes many other types of circuitry; however, they are intentionally omitted from
Mobile device 500 includes display 510, keypad 520, audio port 502, control buttons 504, card slot 506, and audio/video (A/V) port 508. None of these elements are essential. For example, mobile device 500 may only include scanning projector 100 without any of display 510, keypad 520, audio port 502, control buttons 504, card slot 506, or A/V port 508. Some embodiments include a subset of these elements. For example, an accessory projector product may include scanning projector 100, control buttons 504 and A/V port 508.
Display 510 may be any type of display. For example, in some embodiments, display 510 includes a liquid crystal display (LCD) screen. Display 510 may always display the same content projected at field of view 128 or different content. For example, an accessory projector product may always display the same content, whereas a mobile phone embodiment may project one type of content at field of view 128 while displaying different content on display 510. Keypad 520 may be a phone keypad or any other type of keypad.
A/V port 508 accepts and/or transmits video and/or audio signals. For example, A/V port 508 may be a digital port that accepts a cable suitable to carry digital audio and video data such as a high definition multimedia interface (HDMI) port. Further, A/V port 508 may include RCA jacks to accept composite inputs. Still further, A/V port 508 may include a VGA connector to accept analog video signals. In some embodiments, mobile device 500 may be tethered to an external signal source through A/V port 508, and mobile device 500 may project content accepted through A/V port 508. In other embodiments, mobile device 500 may be an originator of content, and A/V port 508 is used to transmit content to a different device.
Audio port 502 provides audio signals. For example, in some embodiments, mobile device 500 is a media player that can store and play audio and video. In these embodiments, the video may be projected at field of view 128 and the audio may be output at audio port 502. In other embodiments, mobile device 500 may be an accessory projector that receives audio and video at A/V port 508. In these embodiments, mobile device 500 may project the video content at field of view 128, and output the audio content at audio port 502.
Mobile device 500 also includes card slot 506. In some embodiments, a memory card inserted in card slot 506 may provide a source for audio to be output at audio port 502 and/or video data to be projected at field of view 128. Card slot 506 may receive any type of solid state memory device, including for example, Multimedia Memory Cards (MMCs), secure digital (SD) memory cards, and microSD cards. The foregoing list is meant to be exemplary, and not exhaustive.
In some embodiments, IR 154 is driven with different signal strengths when verifying operation of PD 152 and when detecting a local obstruction. For example, IR 154 may be driven with a lower amplitude signal when verifying operation than when detecting an obstruction. Any combination of signal strengths and thresholds may be used when driving IR 154 to verify the operation of PD 152 or to detect a local obstruction without departing from the scope of the present invention.
Although not specifically shown in
Many other first person perspective simulations can also be created by gaming apparatus 800, for such activities as 3D seismic geo-prospecting, spacewalk planning, jungle canopy exploration, automobile safety instruction, medical education, etc. Tactile interface 844 may provide a variety of output signals, such as recoil, vibration, shake, rumble, etc. Tactile interface 844 may also include a touch-sensitive input feature, such as a touch sensitive display screen or a display screen that requires a stylus. Additional tactile interfaces, for example, input and/or output features for a motion sensitive probe are also included in various embodiments of the present invention.
Gaming apparatus 800 may also include audio output devices, such as integrated audio speakers, remote speakers, or headphones. These sorts of audio output devices may be connected to gaming apparatus 800 with wires or through a wireless technology. For example, wireless headphones 846 provide the user with sound effects via a Bluetooth connection, although any sort of similar wireless technology could be substituted freely. In some embodiments, wireless headphones 846 may include microphone 845 or binaural microphone 847, to allow multiple users, instructors, or observers to communicate. Binaural microphone 847 typically includes microphones on each ear piece, to capture sounds modified by the user's head shadow. This feature may be used for binaural hearing and sound localization by other simulation participants.
Gaming apparatus 800 may include any number of sensors 810 that measure distance, ambient brightness, motion, position, orientation, and the like. For example, gaming apparatus 800 may detect absolute heading with a digital compass, and detect relative motion with an x-y-z gyroscope or accelerometer. In some embodiments, gaming apparatus 800 also includes a second accelerometer or gyroscope to detect the relative orientation of the device, or its rapid acceleration or deceleration. In other embodiments, gaming apparatus 800 may include a Global Positioning Satellite (GPS) sensor, to detect absolute position as the user travels in terrestrial space.
Gaming apparatus 800 may include battery 841 and/or diagnostic lights 843. For example, battery 841 may be a rechargeable battery, and diagnostic lights 843 could indicate the current charge of the battery. In another example, battery 841 may be a removable battery clip, and gaming apparatus 800 may have an additional battery, electrical capacitor or super-capacitor to allow for continued operation of the apparatus while the discharged battery is replaced with a charged battery. In other embodiments, diagnostic lights 843 can inform the user or a service technician about the status of the electronic components included within or connected to this device. For example, diagnostic lights 843 may indicate the strength of a received wireless signal, or the presence or absence of a memory card. Diagnostic lights 843 could also be replaced by any small screen, such as an organic light emitting diode or liquid crystal display screen. Such lights or screens could be on the exterior surface of gaming apparatus 800, or below the surface, if the shell for this apparatus is translucent or transparent.
Other components of gaming apparatus 800 may be removable, detachable or separable from this device. For example, the projection apparatus 100 may be detachable or separable from gaming housing 840. In some embodiments, the subcomponents of the projection apparatus 100 may be detachable or separable from gaming housing 840, and still function.
Method 900 is shown beginning with block 910 in which a scanning mirror is illuminated with infrared laser light and visible laser light. In some embodiments, this corresponds to scanning mirror 116 (
At 940, visible laser light sources are shut off or the visible laser light output from the laser light sources is reduced when an obstruction is detected in the field of view. In some embodiments, the light is reduces or the laser light sources are shut off only when an obstruction is detected within a certain proximity of the projector. At 950, an infrared light emitting diode is driven during a flyback period to test the photodetector and/or to detect a local obstruction. In some embodiments, the IR LED is driven during a flyback period to test the photodetector, and is driven during a non-flyback period to detect local obstructions.
At 960, a signal is received at the photodetector, and the amplitude of the received signal is compared to a threshold to determine if a local obstruction is present. Examples of local obstructions and relative received signal amplitudes are described above with reference to
Although various invention embodiments have been thus far described as using infrared light when performing TOF proximity detection and local obstruction detection, the present invention is not so limited. For example, in some embodiments, the proximity detection and local obstruction detection utilize visible light. In these embodiments, one or more of the red, green, and/or blue light sources may be utilized, and PD 152 detects the corresponding color of light. Further, in some embodiments, either of the proximity detection and local obstruction detection may occur at any time. For example, either or both may occur during the raster scan or during the flyback time without departing from the scope of the present invention.
Although the present invention has been described in conjunction with certain embodiments, it is to be understood that modifications and variations may be resorted to without departing from the scope of the invention as those skilled in the art readily understand. Such modifications and variations are considered to be within the scope of the invention and the appended claims.
