The present disclosure relates to diffuse illumination and multimode illumination devices.
Some optical imaging systems are capable of providing distance measurements and/or a depth image of objects within a capture area. Such systems can be used, for example, to generate proximity data, distance data, or three-dimensional data.
An imaging system can include, for example, a projector having a light source for illuminating a scene, as well as a sensing device (e.g., one or more cameras) for receiving light reflected from the objects in the scene. In some cases, the light source includes a vertical-cavity surface-emitting laser (VCSEL) array, which is operable to illuminate a capture area. Depending on the implementation and requirements of the imaging system, the projector may be designed to produce substantially diffuse light (i.e., light with a relatively large angular spread) to be projected onto the scene. In other cases, the projector may be designed to produce light having substantially discrete features, such as a structured-light pattern or projected texture, to be projected onto the scene. In either case, light from the VCSEL array may be reflected off of one or more objects in the capture area and can be received within the sensing device. The reflected light may be detected by the one or more cameras and then analyzed, for example, to determine proximity, distance or other information.
The present disclosure describes illumination modules that are operable, in some implementations, to project a homogenous diffuse illumination onto a scene. Some implementations allow different subsets of light emitting elements to be addressed independently so that they can be turned on (or off) at different times, which can facilitate multi-mode operation.
In one aspect, for example, the present disclosure describes an apparatus including a light source, one or more optical elements, and control circuitry. The light source includes a first subset of light emitting elements and a different second subset of light emitting elements. Each of the light emitting elements of the first subset is operable to produce a respective light beam, and each of the light emitting elements of the second subset is operable to produce a respective light beam that is less diffuse than the light beams produced by the first subset of light emitting elements. The one or more optical elements are disposed so as to project the light beams produced by the first and second subsets of light emitting elements onto a scene. The control circuitry is operable to control respective durations for which the light emitting elements of the first and second subsets are on so that a resulting overall illumination projected onto the scene is substantially homogenous diffuse illumination.
Some implementations include one or more of the following features. For example, in some cases, the light emitting elements of the first and second subsets, and the one or more optical elements, are disposed such that the light beams produced by the second subset are projected onto the scene so as to at least partially fill gaps in illumination produced by the first subset of light emitting elements. In some cases, the control circuitry is operable to turn on the light emitting elements of the first subset for a first duration, and to turn on the light emitting elements of the second subset for a second duration while the light emitting elements of the first subset are on, wherein the second duration is shorter than the first duration. In some implementations. each of the first and second subsets of light emitting elements is composed of VCSELs. The VCSELs of the first subset can have a first aperture, and the VCSELs of the second subset can have a second aperture, wherein the first aperture is larger than the second aperture. In some cases, the VCSELs of the first subset have a rectangular (e.g., square) aperture or a hexagonal aperture. In some cases, the VCSELs of the first subset have an aperture shaped differently from a shape of an aperture of the VCSELs of the second subset.
In some implementations, the control circuitry is operable to turn on the second subset of light emitting elements in a second mode of operation to project, for example, a structured light pattern onto the scene.
The present disclosure also describes a method that includes turning on a first subset of light emitting elements (e.g., VCSELs) and projecting diffuse illumination onto a scene using light produced by the first subset of light emitting elements, and employing temporal light stitching to at least partially fill gaps in the diffuse illumination by turning on a second subset of light emitting elements (e.g., VCSELs) and projecting light produced by the second subset of light emitting elements onto the scene. The second subset of light emitting elements is on for a shorter duration than the first subset of light emitting elements.
In some implementations, the method further includes turning on a third subset of light emitting elements (e.g., VCSELs) and projecting light produced by the third subset of light emitting elements onto the scene. The third subset of light emitting elements is on for a duration shorter than the first subset of light emitting elements, and the light produced by the third subset and projected onto the scene at least partially fills additional gaps in the diffuse illumination. In some instances, the third subset of light emitting elements is on for a duration that differs from the duration for which the second subset of light emitting elements in on.
The present disclosure also describes an apparatus that includes an array of VCSELs, and one or more optical elements. Each of the VCSELs has a rectangular or hexagonal aperture, and each of the VCSELs being operable to produce a respective light beam. The one or more optical elements are disposed so as to project the light beams onto a scene. For a particular working distance, when the VCSELs in the array are on, a substantially gap-free homogenous diffuse illumination is projected onto the scene.
In some implementations, each of the VCSELs has a square aperture or a hexagonal aperture. In some instances, for the particular working distance, when the VCSELs in the array are on, there is no overlap between individual light beams produced by different ones of the VCSELs and projected onto the scene.
Some implementations include one or more of the following advantages. For example, a more homogenous diffuse illumination can be projected onto a scene in some instances. Further, various implementations allow different subsets of light emitting elements (e.g., VCSELs) to be addressed independently so that they can be turned on (or off) at different times, which can facilitate multi-mode operation. For example, in one mode, substantially diffuse illumination may be projected onto a scene, whereas in a second mode, a structured light pattern may be projected onto a scene.
Other aspects, features and advantages will be readily apparent from the following detailed description, the accompanying drawings, and the claims.
One aspect of this disclosure describes multimode illumination devices that can be incorporated, for example, into an imaging system. Such illumination devices are operable in multiple modes. For example, in some implementations, a multimode illumination device can be operated in a first mode to generate a first illumination and a second mode to generate a second illumination that is different from the first illumination.
As an example, in the first mode, the first illumination can be substantially diffuse light (i.e., light with a relatively large angular spread), whereas in the second mode, the illumination can include substantially discrete features, such as a structured-light pattern or projected texture, which can be useful for active stereo applications. In some instances, the first mode can be used, in combination with one or more cameras (e.g., a 3D camera and a RGB camera) to generate proximity or distance data, and the second mode can be used, in combination with the same or different cameras, to generate three-dimensional data or spectral data. The light sensitive device(s) can include, for example, a photodiode, an array of photodiodes, an image sensor, or a time-of-flight sensor.
In some implementations, multimode illumination modules can provide certain advantages. For example, multimode illumination modules may need a smaller footprint than two modules, each of which is configured to generate one of the two or more functions provided by the multimode illumination modules.
As shown in the example of
The light source 12 includes multiple light emitting elements, such as an array of VCSELs 16, which are operable to illuminate the scene. The VCSELs 16 are independently addressable. That is, individual VCSELs 16 (or subsets of VCSELs) can be turned on or off independently of other individual VCSELs (or subsets of VCSELs). In particular, the VCSEL array includes two or more VCSEL subarrays, which may be operated at the same time (i.e., the VCSELs in the subsarrays may produce optical emissions substantially at the same time) or which may be operated separately from each other (e.g., sequentially).
In some cases, as shown in
In some implementations, the VCSELs or other light emitting elements 16 in each of the subarrays may have different sizes. For example, as shown in
In some implementations, instead of – or in addition to – the subarrays having VCSELs of different sizes, each of the VCSELs 16 in one of the subarrays includes an integrated optical element through which the light produced by the VCSEL passes. For example, as shown in
Likewise, as shown in the example of
In some implementations, as shown in the examples of
In some implementations, the VCSELs 16 have circular apertures. Thus, the light output by an individual VCSEL 16 will appear as a dot (i.e., a circle) when projected onto a plane that is perpendicular to the direction of light emission. As indicated by
On the other hand, turning on the VCSELs having the smaller aperture at the same time and for the same duration as the VCSELs having the larger aperture can result in bright spots appearing in the image plane. That is because the light emitted by each respective one of the VCSELs having the smaller aperture will be focused on a smaller area than the light emitted by each respective one of the VCSELs having a larger aperture.
The following paragraphs describe various approaches for projecting a more homogenous diffuse onto a scene.
In accordance with a first approach, temporal light stitching is employed to fill gaps in the diffuse illumination. That is, the VCSELs having the smaller aperture (and resulting in a sharper, brighter spot) are turned on for a shorter duration that the VCSELs having the larger aperture (that provide relatively diffuse illumination). The period during which the two subarrays of VCSELs are on overlaps, but only partially. The duration for which the VCSELs having the smaller aperture are turned on is chosen such that the total optical power per area projected onto the scene by VCSELs having the smaller aperture is substantially the same as the total optical power per area projected onto the scene by VCSELs having the larger aperture. This scenario is illustrated in
In accordance with a second approach, instead of circular apertures, each VCSEL in one of the subarrays of the light source can have a rectangular (e.g., square) or hexagonal shape. This approach allows each respective light beam projected onto the scene to have a particular beam-waist such that a smooth stitching (gap-free illumination) can be designed for a fixed working distance (or working distance range). Further, at the particular working distance, there is little or no overlap in the individual light beams projected onto the scene. Thus, the resulting diffuse illumination can be highly uniform or homogenous.
In some implementations, the foregoing approach can be integrated into a multi-mode device. For example, in a first mode, a first subset of VCSELs having a rectangular or hexagonal shaped aperture can be turned on to project a substantially gap-free diffuse illumination onto a scene, whereas in a second mode, a second subset of VCSELs, each of which has a relatively small circular aperture, can be turned on (while the first subset of VCSELs is off) to project a structured light pattern onto a scene.
In some cases, features of the first and second approaches may be combined. Such an implementation can be advantageous, for example, when the object(s) in a scene to be illuminated are outside the ideal operational working range for which the hexagonal or rectangular array is optimized. For example, if the object(s) is outside the ideal working range (e.g., at a large distance z1), then there may be gaps 52 between the individual illuminated regions 50 on the scene that are illuminated by the VCSELs 48 having square aperture (see
Further, in some implementations, the light source can include more than two subsets (e.g., subarrays) of VCSELs. As shown in the example of
As indicated by
In some instances, the various illumination modules described above may be formed as an integrated photonic package.
Various aspects of the subject matter and the functional operations described in this specification can be implemented in digital electronic circuitry, or in computer software, firmware, or hardware, including the structures disclosed in this specification and their structural equivalents, or in combinations of one or more of them. Thus, aspects of the subject matter described in this specification can be implemented as one or more computer program products, i.e., one or more modules of computer program instructions encoded on a computer readable medium for execution by, or to control the operation of, data processing apparatus. The computer readable medium can be a machine-readable storage device, a machine-readable storage substrate, a memory device, a composition of matter effecting a machine-readable propagated signal, or a combination of one or more of them. The apparatus can include, in addition to hardware, code that creates an execution environment for the computer program in question, e.g., code that constitutes processor firmware.
A computer program (also known as a program, software, software application, script, or code) can be written in any form of programming language, including compiled or interpreted languages, and it can be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment. A computer program does not necessarily correspond to a file in a file system. A program can be stored in a portion of a file that holds other programs or data (e.g., one or more scripts stored in a markup language document), in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files that store one or more modules, sub programs, or portions of code). A computer program can be deployed to be executed on one computer or on multiple computers that are located at one site or distributed across multiple sites and interconnected by a communication network.
The processes and logic flows described in this specification can be performed by one or more programmable processors executing one or more computer programs to perform functions by operating on input data and generating output. The processes and logic flows can also be performed by, and apparatus can also be implemented as, special purpose logic circuitry, e.g., an FPGA (field programmable gate array) or an ASIC (application specific integrated circuit).
Processors suitable for the execution of a computer program include, by way of example, both general and special purpose microprocessors, and any one or more processors of any kind of digital computer. Generally, a processor will receive instructions and data from a read only memory or a random access memory or both. The essential elements of a computer are a processor for performing instructions and one or more memory devices for storing instructions and data. Computer readable media suitable for storing computer program instructions and data include all forms of non-volatile memory, media and memory devices, including by way of example semiconductor memory devices, e.g., EPROM, EEPROM, and flash memory devices; magnetic disks, e.g., internal hard disks or removable disks; magneto optical disks; and CD ROM and DVD-ROM disks. The processor and the memory can be supplemented by, or incorporated in, special purpose logic circuitry.
While this specification contains many specifics, these should not be construed as limitations on the scope of the invention or of what may be claimed, but rather as descriptions of features specific to particular embodiments of the invention. Certain features that are described in this specification in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable sub-combination. Moreover, although features may be described above as acting in certain combinations and even initially claimed as such, one or more features from a claimed combination can in some cases be excised from the combination, and the claimed combination may be directed to a sub-combination or variation of a sub-combination.
Similarly, while operations are depicted in the drawings in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. In certain circumstances, multitasking and parallel processing may be advantageous.
Various modifications will be readily apparent and can be made to the foregoing examples. Accordingly, other implementations also are within the scope of the claims.
This application claims the benefit of priority of U.S. Provisional Pat. Application Nos. 63/036,824, 63/036,831 and 63/036,835, all filed on Jun. 9, 2020, the disclosures of which are incorporated herein by reference in their entirety.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2021/065498 | 6/9/2021 | WO |
Number | Date | Country | |
---|---|---|---|
63036835 | Jun 2020 | US | |
63036824 | Jun 2020 | US | |
63036831 | Jun 2020 | US |