Embodiments described herein are related to optical sensing of physical phenomena, and in particular to coherent optical sensing such as self-mixing interferometry (SMI).
Electronic devices such as smart phones may include various sensors, which may sense physical phenomena such as movement, environmental conditions, and biometric data about a user. Additional sensors in electronic devices may provide more robust information to a user and/or unlock additional applications of the device. Given the wide range of applications for sensors in electronic devices, any new development in the configuration or operation of the sensors therein can be useful. New developments that may be particularly useful are developments that provide additional sensing capability, improve the accuracy of sensing physical phenomena, or reduce the cost of sensing.
Embodiments described herein relate to systems and methods for adaptive optical sensing based on predicted speckle. In one aspect, a method for operating an electronic device to sense physical phenomena includes generating, by an SMI sensor, an SMI signal; predicting, by processing circuitry, interference in the SMI signal caused by speckle; and operating the SMI sensor based on predicted interference in the SMI signal caused by speckle.
The method may further include emitting electromagnetic radiation from the SMI sensor, wherein the SMI signal is based at least in part on reflections of the emitted electromagnetic radiation. Operating the SMI sensor based on predicted interference in the SMI signal caused by speckle may include adjusting one or more characteristics of the electromagnetic radiation emitted form the SMI sensor based on predicted interference in the SMI signal caused by speckle. For example, emission of electromagnetic radiation may be enabled during a first set of time periods that is predicted to not include interference in the SMI signal caused by speckle, and disabled during a second set of time periods that is predicted to include interference in the SMI signal caused by speckle. Further, one or more of a power of the electromagnetic radiation emitted from the SMI sensor and a waveform of the electromagnetic radiation emitted from the SMI sensor may be adjusted based on predicted interference in the SMI signal caused by speckle.
In one aspect, operating the SMI sensor based on predicted interference in the SMI signal caused by speckle includes adjusting an optic associated with the SMI sensor based on predicted interference in the SMI signal caused by speckle.
The method may further include sampling, by the processing circuitry, the SMI signal. Operating the SMI sensor based on predicted interference in the SMI signal caused by speckle may include adjusting one or more characteristics of the sampling of the SMI signal based on predicted interference in the SMI signal caused by speckle. For example, one or more of a sampling rate of the SMI signal, a sampling window of the SMI signal, and a duty cycle of sampling of the SMI signal may be adjusted based on predicted interference in the SMI signal caused by speckle.
In one aspect, operating the SMI sensor based on predicted interference in the SMI signal caused by speckle includes adjusting one or more characteristics of a post-processing step of the SMI signal based on predicted interference in the SMI signal caused by speckle.
In one aspect, predicting interference in the SMI signal caused by speckle may be based on the SMI signal. Further, predicting interference in the SMI signal caused by speckle may be based on a history of the SMI signal over time.
In an additional aspect, an electronic device may include an SMI sensor and processing circuitry communicably coupled to the SMI sensor. The SMI sensor may be configured to emit electromagnetic radiation and generate an SMI signal based at least in part on reflections of the emitted electromagnetic radiation. The processing circuitry may be configured to predict interference in the SMI signal caused by speckle and operate the SMI sensor based on predicted interference in the SMI signal caused by speckle.
In one aspect, operating the SMI sensor based on predicted interference in the SMI sensor caused by speckle includes adjusting one or more characteristics of the electromagnetic radiation emitted from the SMI sensor. For example, emission of electromagnetic radiation may be enabled during a first set of time periods that is predicted to not include interference in the SMI signal caused by speckle, and disabled during a second set of time periods that is predicted to include interference in the SMI signal caused by speckle. Further, one or more of a power of the electromagnetic radiation emitted from the SMI sensor and a waveform of the electromagnetic radiation emitted from the SMI sensor may be adjusted based on predicted interference in the SMI signal caused by speckle.
In one aspect, the SMI sensor may further include an optic configured to direct the electromagnetic radiation towards a target area. Operating the SMI sensor based on predicted interference in the SMI signal caused by speckle may include adjusting the optic based on predicted interference in the SMI signal caused by speckle.
In one aspect, the processing circuitry may be further configured to sample the SMI signal. Operating the SMI sensor based on predicted interference in the SMI signal caused by speckle may include adjusting one or more characteristics of the sampling of the SMI signal based on predicted interference in the SMI signal caused by speckle. For example, one or more of a sampling rate of the SMI signal, a sampling window of the SMI signal, and a duty cycle of sampling of the SMI signal may be adjusted based on predicted interference in the SMI signal due to speckle.
In one aspect, operating the SMI sensor based on predicted interference in the SMI signal due to speckle includes adjusting one or more characteristics of a post-processing step of the SMI signal based on predicted interference in the SMI signal caused by speckle.
In one aspect, predicting interference in the SMI signal caused by speckle is based on the SMI signal. Further, predicting interference in the SMI signal caused by speckle may be based on a history of the SMI signal over time.
Reference will now be made to representative embodiments illustrated in the accompanying figures. It should be understood that the following descriptions are not intended to limit this disclosure to one included embodiment. To the contrary, the disclosure provided herein is intended to cover alternatives, modifications, and equivalents as may be included within the spirit and scope of the described embodiments, and as defined by the appended claims.
The use of the same or similar reference numerals in different figures indicates similar, related, or identical items.
The use of cross-hatching or shading in the accompanying figures is generally provided to clarify the boundaries between adjacent elements and also to facilitate legibility of the figures. Accordingly, neither the presence nor the absence of cross-hatching or shading conveys or indicates any preference or requirement for particular materials, material properties, element proportions, element dimensions, commonalities of similarly illustrated elements, or any other characteristic, attribute, or property for any element illustrated in the accompanying figures.
Additionally, it should be understood that the proportions and dimensions (either relative or absolute) of the various features and elements (and collections and groupings thereof) and the boundaries, separations, and positional relationships presented therebetween, are provided in the accompanying figures merely to facilitate an understanding of the various embodiments described herein and, accordingly, may not necessarily be presented or illustrated to scale, and are not intended to indicate any preference or requirement for an illustrated embodiment to the exclusion of embodiments described with reference thereto.
Coherent optical sensing, including Doppler velocimetry and heterodyning, can be used to measure physical phenomena including presence, distance, velocity, size, surface properties, and particle count. Interferometric sensors such as SMI sensors may be used to perform coherent optical sensing. An SMI sensor is defined herein as a sensor that is configured to generate and emit light from a resonant cavity of a semiconductor light source, receive a reflection or backscatter of the light (e.g., light reflected or backscattered from an object) back into the resonant cavity, coherently or partially coherently self-mix the generated and reflected/backscattered light within the resonant cavity, and produce an output indicative of the self-mixing (i.e., an SMI signal). The generated, emitted, and received light may be coherent or partially coherent, but a semiconductor light source capable of producing such coherent or partially coherent light may be referred to herein as a coherent light source. The generated, emitted, and received light may include, for example, visible or invisible light (e.g., green light, infrared (IR) light, or ultraviolet (UV) light). The output of an SMI sensor (i.e., the SMI signal) may include a photocurrent produced by a photodetector (e.g., a photodiode). Alternatively or additionally, the output of an SMI sensor may include a measurement of a current or junction voltage of the SMI sensor's semiconductor light source.
Generally, an SMI sensor may include a light source and, optionally, a photodetector. The light source and photodetector may be integrated into a monolithic structure. Examples of semiconductor light sources that can be integrated with a photodetector include vertical cavity surface-emitting lasers (VCSELs), edge-emitting lasers (EELs), horizontal cavity surface-emitting lasers (HCSELs), vertical external-cavity surface-emitting lasers (VECSELs), quantum-dot lasers (QDLs), quantum cascade lasers (QCLs), and light-emitting diodes (LEDs) (e.g., organic LEDs (OLEDs), resonant-cavity LEDs (RC-LEDs), micro LEDs (mLEDs), superluminescent LEDs (SLEDS), and edge-emitting LEDs (eLEDs)). These light sources may also be referred to as coherent light sources. A semiconductor light source may be integrated with a photodetector in an intra-cavity, stacked, or adjacent photodetector configuration to provide an SMI sensor.
While SMI sensors may be used to accurately sense various physical phenomena, the performance and/or accuracy of sensing physical phenomena thereof may suffer due to speckle of the emitted electromagnetic radiation. Speckle is interference resulting from the constructive and/or destructive addition of reflections or backscatters of the electromagnetic radiation emitted from a coherent light source. In the case of an SMI sensor, speckle may result in random modulation of an envelope of an SMI signal provided therefrom, as well as phase errors on a carrier frequency of the SMI signal. Destructive speckle may result in the envelope of the SMI signal fading below a noise floor, while constructive speckle may result in saturation of the SMI signal. In general, an SMI signal from an SMI sensor may fail to provide useful information for certain periods of time due to interference caused by speckle.
A scanning plan may be used to measure physical phenomena using one or more SMI sensors. A scanning plan may include a power of the electromagnetic radiation emitted from the one or more SMI sensors, a waveform of the electromagnetic radiation emitted from the one or more SMI sensors, a sampling rate of the SMI signals provided from the one or more SMI sensors, a sampling window size of the SMI signals provided from the one or more SMI sensors, and a polling rate (i.e., duty cycle or integration time) of the SMI signals provided from the one or more SMI sensors. Generally, a scanning plan seeks to balance sensing performance (e.g., resolution) with power consumption. For battery-operated electronic devices, this balance may be of particular importance to ensure adequate battery life for a consumer.
These foregoing and other embodiments are discussed below with reference to
The processing circuitry 104 may operate the SMI sensor 102 to generate the electromagnetic radiation in a desired manner. For example, the processing circuitry 104 may cause the SMI sensor 102 to be driven with a modulated voltage and/or current, which may change the electromagnetic radiation generated and emitted therefrom. Further, the processing circuitry 104 may operate the SMI sensor 102 to generate electromagnetic radiation having a particular waveform, or may operate the optic 108 of the SMI sensor to direct or focus the electromagnetic radiation in a desired manner. Adjusting the electromagnetic radiation generated and emitted from the SMI sensor 102 may result in improved accuracy, signal-to-noise ratio (SNR), or other performance improvements in various scenarios.
The processing circuitry 104 may also sample the SMI signal provided by the SMI sensor 102 in a desired manner. For example, the processing circuitry 104 may sample the SMI signal provided by the SMI sensor 102 at a sampling rate, within a sampling window, and at a sampling duty cycle. The processing circuitry 104 may adjust the sampling rate, sampling window, and sampling duty cycle to achieve a desired accuracy, SNR, or otherwise achieve a desired performance.
As described herein, the terms “processing circuitry” and “processor” refer to any software and/or hardware-implemented data processing device or circuit physically and/or structurally configured to instantiate one or more classes or objects that are purpose-configured to perform specific transformations of data including operations represented as code and/or instructions included in a program that can be stored within, and accessed from, a memory. This term is meant to encompass a single processor or processing unit, multiple processors, multiple processing units, analog or digital circuits, or other suitably configured computing element or combination of elements.
While the electronic device 100 shown in
To avoid the impact of fading and/or saturation events on the accuracy of measurement of physical phenomena from the SMI sensor 102, the processing circuitry 104 may be operated to continuously sample the SMI signal, ignoring samples that are above or below a threshold value or otherwise meet a criteria associated with fading and/or saturation of the signal. However, operating the electronic device 100 in this manner may result in high power consumption, as the SMI sensor 102 and processing circuitry 104 are still actively operating during the fading and/or saturation events. In an effort to improve power consumption of the electronic device 100 while maintaining or improving accuracy of measurement of physical phenomena from the SMI sensor 102, the processing circuitry 104 may be operated to predict interference in the SMI signal caused by speckle, and the SMI sensor 102 may be operated based on this predicted interference.
To illustrate these aspects,
Interference in the SMI signal due to speckle may be predicted (step 310). Predicting interference in the SMI signal due to speckle may be accomplished in any suitable manner. In various aspects, interference in the SMI signal due to speckle is predicted based on current and/or historical values of the SMI signal as sampled. In some aspects, interference in the SMI signal due to speckle may be based on one or more SMI signal parameters such as speckle contrast, which quantifies the number of speckles encountered in a given duration of time, length of correlation, which quantifies how soon (on average) a speckle is passed, level crossing rate, which quantifies how often (on average) envelope fading or saturation is encountered, and average interference duration, which quantifies how long (on average) a period of envelope fading or saturation lasts. First order, higher order, and nonlinear models based on one or more of these parameters, or any other parameters, may be used to predict upcoming fading and/or saturation events, during which action can be taken to both reduce the impact of the events on measurement accuracy as well as save power. Samples of the SMI signal may also be provided to a machine learning model, which may be trained to predict upcoming fading and/or saturation events in the SMI signal.
With this in mind, the SMI sensor can be operated based on predicted interference in the SMI signal caused by speckle (step 312). Operating the SMI sensor based on predicted interference in the SMI signal caused by speckle may include adjusting one or more of a power of the electromagnetic radiation emitted from the SMI sensor, a waveform of the electromagnetic radiation emitted from the SMI sensor, one or more operating characteristics of an optic associated with the SMI sensor (e.g., an aperture, a tilt, a focus, or any other optical characteristic). Operating the SMI sensor based on predicted interference in the SMI signal caused by speckle may also or alternatively include adjusting one or more aspects of sampling of the SMI signal such as one or more of a sampling rate, a sampling window, and a sampling duty cycle. In some aspects, the SMI sensor may be operated to enable emission of electromagnetic radiation during a first set of time periods that is predicted to not include interference in the SMI signal caused by speckle is not predicted, and disable emission of electromagnetic radiation during a second set of time periods that is predicted to not include interference in the SMI signal caused by speckle is predicted. The SMI sensor may be operated to reduce or minimize power consumption during periods of interference caused by speckle. This may in turn significantly reduce the overall power consumption of a system using an SMI sensor to measure physical phenomena. Operating the SMI sensor based on predicted interference in the SMI signal caused by speckle may also include adjusting one or more characteristics of a post-processing operation performed on samples of the SMI signal. For example, it may include adjusting one or more parameters associated with an analog or digital processing circuitry to which samples of the SMI signal are provided.
While discussed with respect to a single SMI sensor, the operations described in the method 300 of
To illustrate these principles,
Returning to
Sampling circuitry 606 may obtain samples of the SMI signal from the SMI sensor 102. Samples from the sampling circuitry 606 may be provided to analog front end (AFE) circuitry 608 and/or digital signal processing (DSP) circuitry 610, which may demodulate or otherwise process the samples into a desired form. The plan generation circuitry 604 may be communicably coupled to the sampling circuitry 606, the AFE circuitry 608, and the DSP circuitry 610 to adjust one or more operating parameters as discussed herein based on predicted interference in the SMI signal caused by speckle. Sensing circuitry 612 may convert demodulated or otherwise processing samples from the AFE circuitry 608 and/or the DSP circuitry 610 into measurements of physical phenomena. As discussed herein, this may be accomplished in any suitable manner such as by one or more mathematical operations or by a machine learning model.
Notably, the functional blocks discussed with respect to
The processor may be implemented as any electronic device capable of processing, receiving, or transmitting data or instructions, whether such data or instructions is in the form of software or firmware or otherwise encoded. For example, the processor 704 may include a microprocessor, central processing unit (CPU), an application-specific integrated circuit (ASIC), a digital signal processor (DSP), a controller, or a combination of such devices. As described herein, the term “processor” or “processing circuitry” is meant to encompass a single processing unit, multiple processors, multiple processing units, or other suitably configured computing element or elements. In some embodiments, the processor 704 may provide part or all of the processing systems, processing circuitry, or processors described with reference to any of
It should be noted that the components of the electronic device 700 can be controlled by multiple processors. For example, select components of the electronic device 700 (e.g., the sensor system 710) may be controlled by a first processor and other components of the electronic device 700 (e.g., the electronic display 702) may be controlled by a second processor, where the first and second processors may or may not be in communication with each other.
The power source 706 can be implemented with any device capable of providing energy to the electronic device 700. For example, the power source 706 may include one or more batteries or rechargeable batteries. Additionally or alternatively, the power source 706 may include a power connector or power cord that connects the electronic device 700 to another power source, such as a wall outlet.
The memory 708 may store electronic data that can be used by the electronic device 700. For example, the memory 708 may store electrical data or content such as, for example, audio and video files, documents and applications, device settings and user preferences, timing signals, control signals, and data structures and databases. The memory 708 may include any type of memory. By way of example only, the memory 708 may include random access memory (RAM), read-only memory (ROM), flash memory, removeable memory, other types of storage elements, or combinations of such memory types.
The electronic device 700 may also include one or more sensor systems 710 positioned almost anywhere on the electronic device 700. For example, the sensor system 710 may include any and all of the sensors discussed herein with respect to
The I/O mechanism 712 may transmit or receive data from a user or another electronic device. The I/O mechanism 712 may include the electronic display 702, a touch sensing input surface, a crown, one or more buttons (e.g., a graphical user interface “home” button), one or more cameras (including an under-display camera), one or more microphones or speakers, one or more ports such as a microphone port, and/or a keyboard. Additionally or alternatively, the I/O mechanism 712 may transmit electronic signals via a communications interface, such as a wireless, wired, and/or optical communications interface. Examples of wireless and wired communications interfaces include, but are not limited to, cellular and Wi-Fi communications interfaces.
While discussed above with respect to SMI sensors, the principles of the present disclosure apply to any sensors that suffer from interference in the signals therefrom due to speckle. For example, the principles of the present disclosure may apply to any coherent optical sensors and ultrasonic sensors. Those skilled in the art will readily appreciate the application of the principles herein to various types of sensors that suffer from interference due to speckle.
Thus, it is understood that the foregoing and following descriptions of specific embodiments are presented for the limited purposes of illustration and description. These descriptions are not targeted to be exhaustive or to limit the disclosure to the precise forms recited herein. To the contrary, it will be apparent to one of ordinary skill in the art that many modifications and variations are possible in view of the above teachings.
As used herein, the phrase “at least one of” preceding a series of items, with the term “and” or “or” to separate any of the items, modifies the list as a whole, rather than each member of the list. The phrase “at least one of” does not require selection of at least one of each item listed; rather, the phrase allows a meaning that includes at a minimum one of any of the items, and/or at a minimum one of any combination of the items, and/or at a minimum one of each of the items. By way of example, the phrases “at least one of A, B, and C” or “at least one of A, B, or C” each refer to only A, only B, or only C; any combination of A, B, and C; and/or one or more of each of A, B, and C. Similarly, it may be appreciated that an order of elements presented for a conjunctive or disjunctive list provided herein should not be construed as limiting the disclosure to only that order provided.
One may appreciate that although many embodiments are disclosed above, that the operations and steps presented with respect to methods and techniques described herein are meant as exemplary and accordingly are not exhaustive. One may further appreciate that alternate step order or fewer or additional operations may be required or desired for particular embodiments.
Although the disclosure above is described in terms of various exemplary embodiments and implementations, it should be understood that the various features, aspects and functionality described in one or more of the individual embodiments are not limited in their applicability to the particular embodiment with which they are described, but instead can be applied, alone or in various combinations, to one or more of some embodiments, whether or not such embodiments are described and whether or not such features are presented as being a part of a described embodiment. Thus, the breadth and scope of the present description should not be limited by any of the above-described exemplary embodiments but is instead defined by the claims herein presented.
This application is a nonprovisional and claims the benefit under 35 U.S.C. § 119(e) of U.S. Provisional Patent Application No. 63/356,949, filed Jun. 29, 2022, the contents of which are incorporated herein by reference as if fully disclosed herein.
Number | Date | Country | |
---|---|---|---|
63356949 | Jun 2022 | US |