Patent Application
20230096718
The present disclosure relates to an optoelectronic device and a method for determining the distribution of a substance in a sample. Further, the present disclosure relates to an optoelectronic device for hyperspectral analysis of a sample.
Infrared spectroscopy can be used to investigate the constituents of a sample. However, known methods for infrared spectroscopy do not provide spatial information about the distribution of a constituent over the sample.
It is an objective to provide an optoelectronic device which makes it possible to determine the distribution of a substance at different positions in a sample. Furthermore, a corresponding method for determining the distribution of a substance in a sample is to be disclosed.
It is an objective to provide an optoelectronic device which, in the form of a very compact component, enables high-resolution 2D grayscale images of a sample to be recorded for several different wavelength ranges emitted onto the sample.
An optoelectronic device includes an arrangement comprising a plurality of emitter elements, an arrangement comprising a plurality of time-of-flight detector elements, and an evaluation unit.
The plurality of emitter elements are configured to sequentially emit light or electromagnetic radiation of different wavelength ranges. For example, it may be provided that exactly one or more of the emitter elements emit light in a first wavelength range and exactly one or more of the remaining emitter elements emit light in a second wavelength range. This can be continued accordingly. In particular, the emission of light of different wavelength ranges does not occur overlapping in time, but one after the other. Between the emission of light of different wavelength ranges, a pause can be provided in each case during which no light is emitted. The plurality of emitter elements can, for example, be arranged in an array, i.e. a regular arrangement.
The light emitted from the emitter elements is used to irradiate a sample arranged such that a portion of the light is reflected from the sample to the time-of-flight detector elements.
The time-of-flight detector elements are configured to detect light emitted by the emitter elements and reflected from the sample. In particular, each of the time-of-flight detector elements is capable of measuring the intensity of the reflected light incident on the respective time-of-flight detector element. Further, each of the time-of-flight detector elements is configured to perform a measurement to determine the distance between the point of reflection of the light from the sample and the respective time-of-flight detector element.
Time-of-flight methods, also called runtime methods, are used to measure distances. In the present application, the time-of-flight of the light can be used to determine the distance from the reflection point on the sample to the respective time-of-flight detector element. The working principle of the time-of-flight detector elements may be, for example, to determine the phase difference between emitted and reflected light. Due to the plurality of time-of-flight detector elements used, a spatially three-dimensional image or reflection image of the sample can be generated. Conventional time-of-flight detectors that can be used in the optoelectronic device include CMOS elements with 2-tap or 4-tap functionality. The time-of-flight detector elements may be arranged in an array. Further, the time-of-flight detector elements may be, for example, the pixels of a time-of-flight camera chip.
The time-of-flight detector elements do not have to be able to automatically determine the distance from the reflection point to the respective time-of-flight detector element. The time-of-flight detector elements can provide measurement results from which the respective distance can be determined. For example, the evaluation unit can be configured to determine the various distances of the reflection points on the sample to the time-of-flight detector elements from the measurement data provided by the time-of-flight detector elements. In particular, the distance of the emitter elements from the sample may be known.
The evaluation unit receives information about the light detected by the respective time-of-flight detector elements for each wavelength range emitted by the emitter elements. For example, the evaluation unit can obtain information about the intensity of the detected light. Furthermore, for each wavelength range emitted by the emitter elements, the evaluation unit determines the distance of the respective time-of-flight detector element to the reflection point of the light on the sample. From this data, the evaluation unit generates a spatially three-dimensional image of the sample for each wavelength range emitted by the emitter elements.
From the multiple three-dimensional reflection images of the sample generated for different wavelength ranges, the evaluation unit can determine the distribution of a substance in the sample. In particular, the evaluation unit can generate a three-dimensional map or representation showing the occurrence or concentration of the substance at different positions in the sample.
With the described technique, three-dimensional maps of the distribution of not only one, but several ingredients of the sample can be generated.
Provided that light of certain wavelengths is not reflected at the surface of the sample, but only deeper within the sample, for example because the outer layers of the sample are transparent to this radiation, tomographic images of the sample can be generated.
The emitter elements can, for example, be light-emitting diodes (LEDs), in particular LED chips or monolithic LEDs with separately controllable segments. VCSELs (vertical-cavity surface-emitting lasers), in particular VCSEL chips, are suitable for particularly good depth resolution because they have very fast switching times in the nanosecond range.
The light emitted by the emitter elements can be, for example, light in the visible range, ultraviolet (UV) light and/or infrared (IR) light. For the application described here, light from the near-infrared spectral range with wavelengths especially in the range of 780 nm to 3 μm is advantageous.
The wavelength ranges that the emitter elements emit sequentially may each extend over suitable wavelengths. It may also be provided that at least some or all of the wavelength ranges are relatively small and contain substantially only one wavelength. For example, the emitter elements may sequentially emit light at wavelengths of 750 nm, 800 nm, 850 nm, and 900 nm or other wavelengths.
The optoelectronic device according to the first aspect of the application can be used, for example, in mobile applications, in particular in portable devices. The optoelectronic device is particularly suitable for determining the ingredients of foodstuffs.
The optoelectronic device can comprise a memory unit to which the evaluation unit has access and in which at least a portion of the absorption spectrum of the substance to be examined is stored. The evaluation unit can determine the distribution of the substance in the sample from the three-dimensional images taken for the various wavelength ranges, using the at least portion of the absorption spectrum.
The absorption spectrum stored in the memory unit can extend over a certain wavelength range, for example over the infrared or near-infrared spectral range. Further, the stored absorption spectrum may include at least those wavelengths at which the substance exhibits high or maximum light absorption. In the wavelength range(s) where the absorption is high, little light is reflected, while in the remaining wavelength range(s) much light is reflected. By evaluating the reflected light, conclusions can be drawn about the presence or concentration of the substance under investigation at various locations in the sample.
The arrangement comprising the plurality of emitter elements may be arranged in a first cavity of the optoelectronic device, while the arrangement comprising the plurality of time-of-flight detector elements is arranged in a second cavity of the optoelectronic device. The first cavity and the second cavity may be adjacent.
The optoelectronic device according to the first aspect may comprise a control unit for controlling the emitter elements and the time-of-flight detector elements, and for time-coordinating the emitter elements and the time-of-flight detector elements.
Furthermore, the control unit can be integrated together with the evaluation unit in a common component. For example, the control unit and the evaluation unit can be integrated together in an integrated circuit (IC). The emitter elements can be arranged on the integrated circuit.
At least one optical lens can be arranged between the sample and the time-of-flight detector elements to focus the light reflected from the sample onto the detector elements and obtain a sharp image of the sample. Without a sharp image of the sample, the two-dimensional spatial information would be lost. For example, the optical lens may be exactly one camera lens, or an array of optical lenses may be provided, each of the optical lenses being associated with a time-of-flight detector element.
A method according to a second aspect of the present application is for determining the distribution of a substance in a sample. According to the method, emitter elements of an arrangement comprising a plurality of emitter elements sequentially emit light of different wavelength ranges. The light emitted by the emitter elements is reflected from a sample, and time-of-flight detector elements of an arrangement comprising a plurality of time-of-flight detector elements detect the light reflected from the sample. Further, the time-of-flight detector elements each perform a measurement to determine the distance of the reflection point of the light on the sample from the respective time-of-flight detector element. For each wavelength range emitted by the emitter elements, a three-dimensional image of the sample is generated based on the light detected by the time-of-flight detector elements and the distance of the reflection point of the light from the respective time-of-flight detector element. From the reflection images for the different wavelength ranges, the distribution of a substance in the sample is determined.
The method for determining the distribution of a substance in a sample according to the second aspect of the application may comprise the above-described embodiments of the optoelectronic device according to the first aspect of the application.
Individual aspects and features of the foregoing embodiments and examples may be readily combined with each other without affecting the principle of the invention. Furthermore, aspects and features of the preceding embodiments and examples may be combined with the further optoelectronic device now described without thereby impairing the principle according to the invention. This includes, among other things, the type and design of the arrangement of the plurality of emitter elements or the emitter elements themselves, the control unit and the evaluation unit, the first cavity and the second cavity, and the type and design of the at least one optical lens.
An optoelectronic device according to a second aspect of the present application comprises an arrangement with a plurality of emitter elements, an arrangement, with a plurality of detector elements, in particular a camera with a plurality of pixels, and an evaluation unit.
The plurality of emitter elements are configured to sequentially emit light or electromagnetic radiation of different wavelength ranges. For example, it may be provided that exactly one or more of the emitter elements emit light in a first wavelength range and exactly one or more of the remaining emitter elements emit light in a second wavelength range. This can be continued accordingly. The wavelength ranges may also partially overlap spectrally. In particular, the emission of light of different wavelength ranges does not take place overlapping in time, but one after the other. Between the radiation of light of different wavelength ranges, a pause can be provided in each case during which no light radiation takes place. The plurality of emitter elements can, for example, be arranged in an array, i.e., a regular arrangement. In particular, the emitter elements may be arranged on a driving device, e.g., a CMOS chip, so that each of the emitter elements is uniquely electrically and mechanically connected to a driving circuit. By the fact that the several emitter elements emit light or electromagnetic radiation of different wavelength ranges one after the other and thus are operated in a pulsed mode, so to speak, the influence of disturbing ambient light on the optoelectronic device can be reduced.
The light emitted from the emitter elements is used to irradiate a sample arranged such that a portion of the light is reflected from the sample to the plurality of detector elements. The detector elements are configured to detect the light emitted by the emitter elements and reflected by the sample. In particular, each of the detector elements can measure the intensity of the reflected light incident on the respective detector element. For example, the arrangement of the plurality of detector elements may be formed by a camera component having a plurality of pixels (detector elements) arranged to detect electromagnetic radiation. In particular, the detector elements may be configured to detect electromagnetic radiation over the entire spectral range. This can be advantageous in particular because the individual detector elements do not have to be able to resolve spectrally and thus manufacturing costs can be saved. Furthermore, smaller detector elements with a lower resolution can be used, since the entire detection range of the detector elements is used and this does not have to be limited by further processing of the chip.
The evaluation unit receives information about the light detected by each of the detector elements for each wavelength range emitted by the emitter elements. For example, the evaluation unit can receive information about the intensity of the detected light.
For example, from the multiple reflectance images of the sample generated for different wavelength ranges, the evaluation unit can determine the distribution of a substance in the sample. In particular, the evaluation unit can generate a two-dimensional overall image of the sample, which shows the occurrence or concentration of a substance at different positions of the sample. The overall image comprises several image points, each of which comprises a superposition of the light of the different wavelength ranges reflected from the sample and detected by the detector elements.
With the described technique, two-dimensional overall images of the distribution of not only one, but several ingredients of the sample can be created.
In some embodiments, a detector element is associated with each image point of the overall image and the overall image contains a superposition of all wavelength regions detected by that detector element in that image point.
In some embodiments, the arrangement with the plurality of emitter elements and the arrangement with the plurality of detector elements are arranged in a common housing. In this regard, the arrangement with the plurality of emitter elements is arranged in a first cavity in the housing and the arrangement with the plurality of detector elements is arranged in a second cavity in the housing.
In some embodiments, the first and second cavities are optically separated from each other by means of a partition wall. The partition wall can be of the same material as the housing. In particular, the partition wall can optically separate an emission area and a detection area of the optoelectronic device from each other.
In some embodiments, the optoelectronic device is in the form of a leadframe or ceramic package. In this regard, the package or the sidewalls of the package and the partition wall may be formed from a polymer such as an epoxy. In particular, the housing or the sidewalls of the housing and the partition wall may be formed from an epoxy potting material comprising, for example, a polymer matrix (epoxy resins, hardeners and accelerators) and optionally comprising fillers and/or reinforcing materials and/or pigments and/or release agents. The support of the leadframe or ceramic package may be formed, in particular, by a leadframe or a ceramic support from which the side walls of the housing and the partition wall extend upwardly. The sidewalls of the package and the partition wall may form the two cavities in which the arrangement with the plurality of emitter elements and the arrangement with the plurality of detector elements are arranged.
In some embodiments, the optoelectronic device is in the form of a chip-size package. In particular, this can mean that the optoelectronic device comprises a housing with a footprint that is no more than 20% larger than that of the emitter elements, detector elements and possibly the evaluation unit arranged in the housing. The electrical connections of the optoelectronic device can be located in particular on a bottom side of the housing, so that the optoelectronic device is suitable for SMD assembly, for example.
In some embodiments, one or more optical lenses are arranged in front of the plurality of detector elements and/or in front of the plurality of emitter elements. For example, an optical lens in front of the plurality of emitter elements may be configured to project the light emitted from the emitter elements onto a sample to be examined, whereas an optical lens in front of the plurality of detector elements may be configured to image the image of the sample to be examined, in particular the light reflected from the sample to be examined, onto the detector elements. The lenses may be refractive or diffractive, in particular they may be flat metal lenses. In a particular embodiment, the housing serves not only to mechanically and electrically accommodate the emitter and detector elements and the drive and readout device, but also to mechanically attach the optical lenses on the emission and detection side.
In some embodiments, the plurality of emitter elements emit light in the infrared spectral range. However, the multiple emitter elements may also emit light in the UV to mid-infrared range.
In some embodiments, the plurality of emitter elements emit broadband light. A wavelength filter can be arranged above the individual emitter elements or above at least some of the emitter elements. The wavelength filters are arranged above the emitter elements such that the emitter elements emit light or electromagnetic radiation of different wavelength ranges to the outside.
In some embodiments, at least two emitter elements of the plurality of emitter elements emit light at the same wavelength. Further, multiple segments comprising at least two emitter elements may also emit light at the same wavelength. Similarly, it is conceivable that at least two emitter elements of the plurality of emitter elements may emit light of a particular wavelength. This may be advantageous, for example, in order to compensate for a low efficiency of the emitter or detector elements in a certain wavelength range, or to increase the efficiency of the optoelectronic device if certain wavelength ranges are particularly relevant for the use of the optoelectronic device.
In some embodiments, a converter element for converting the light emitted by the emitter element is arranged above at least one of the at least two emitter elements that emit light at the same wavelength. Further, all of the emitter elements may also emit light with the same wavelength, and a converter element for converting the light emitted from the respective emitter element is arranged above at least some of the emitter elements. The converter elements are arranged above the emitter elements in such a way that these emit light or electromagnetic radiation of different wavelength ranges to the outside.
In some embodiments, electrical connections for the arrangement of the plurality of emitter elements and the arrangement of the plurality of detector elements are formed on a bottom surface of the optoelectronic device. This allows the optoelectronic device to be surface mountable and to be small in size, for example.
In some embodiments, the optoelectronic device comprises a control unit for controlling the emitter elements and/or for controlling the detector elements. The control unit may be configured to include a pixelated driver circuit, and to control each emitter element individually via a unique connection. The control unit can further be configured in such a way that it comprises a further pixelated driver circuit and that it can control each detector element individually via a unique connection.
In some embodiments, the evaluation unit and/or the control unit is integrated into a common housing of the optoelectronic device.
In the following, non-limiting embodiments are explained in more detail with reference to the accompanying drawings. In these schematically show:
In the following detailed description, reference is made to the accompanying drawings, which form a part of this description and in which non-limiting embodiments may be practiced are shown for illustrative purposes. Since components of embodiments may be positioned in a number of different orientations, the directional terminology is for illustrative purposes and is not limiting in any way. It is understood that other embodiments may be used and structural or logical changes may be made without departing from the scope of protection. It is understood that the features of the various embodiments described herein may be combined with each other, unless specifically indicated otherwise. Therefore, the following detailed description is not to be construed in a limiting sense. In the figures, identical or similar elements are provided with identical reference signs where appropriate.
The optoelectronic device 10 includes an arrangement 11 comprising a plurality of emitter elements 12 and an arrangement 13 comprising a plurality of time-of-flight detector elements 14. Furthermore, an evaluation unit and a control unit are integrated in an integrated circuit 15.
The arrangement 11 with the emitter elements 12 is mounted on the integrated circuit 15, which is arranged together with the arrangement 11 in a first cavity. The arrangement 13 with the time-of-flight detector elements 14 is arranged in a second cavity. In the present embodiment, the time-of-flight detector elements 14 are the pixels of a CMOS time-of-flight camera chip. A camera lens 16 is arranged above the arrangement 13 as a lens.
During operation of the optoelectronic device 10, the emitter elements 12 sequentially emit light of different wavelengths or wavelength ranges. In the arrangement 11, each of the emitter elements 12 emits light at a wavelength or in a wavelength range that is different from the wavelength or wavelength range of the light emitted by the remaining emitter elements 12.
The light emitted by the emitter elements 12 is at least partially incident on a sample 17, the contents of which are to be examined by means of the optoelectronic device 10. A portion of the light is reflected from the sample to the camera lens 16. The light passes through the camera lens 16 and falls on the time-of-flight detector elements 14. The outlined path of the light is illustrated by arrows 18 and 19 in
Each of the time-of-flight detector elements 14 measures the intensity of light incident on the respective time-of-flight detector element 14. Furthermore, each of the time-of-flight detector elements 14 performs a measurement which allows to determine the distance between the reflection point of the light at the sample 17 and the respective time-of-flight detector element 14.
The time-of-flight detector elements 14 may be, for example, CMOS detector pixels 20 that operate according to so-called quadrature modulation. The equivalent circuit of a detector pixel 20 is shown in
The detector pixel 20 includes a photodiode 21 and two capacitors 22 and 23, each of which can be connected between a supply voltage VDD and a ground VSS by means of switches 24 to 26. Switch 24 is connected between the supply voltage VDD and a common node 27. Switches 25 and 26 are connected between the common node 27 and capacitors 22 and 23, respectively.
The operation of the detector pixel 20 is shown schematically in
Based on the above, capacitor 22 is charged by photodiode 21 during the emission of one light pulse, while capacitor 23 is charged by photodiode 21 between the emission of two successive light pulses.
Since the light emitted from the emitter element 12 is first reflected from the sample 17, it reaches the photodiode 21 with a certain time delay, as shown in the second row of
Consequently, for each wavelength or wavelength range emitted by the emitter elements 12, the evaluation unit has available both the light intensity of the reflected light detected by the time-of-flight detector elements 14 and the distance of the respective time-of-flight detector element 14 from the reflection point on the sample 17. From these data, the evaluation unit generates a spatially three-dimensional image of the sample 17 for each wavelength or range of wavelengths emitted by the emitter elements 12.
As an example,
The absorption spectrum of the substance to be examined or at least a portion of the absorption spectrum is stored in a memory unit to which the evaluation unit has access. With the help of the absorption spectrum and the four three-dimensional reflection images of the apple, the evaluation unit can generate a three-dimensional representation shown in
The optoelectronic device 100 includes an arrangement 110 configured as an array comprising a plurality of emitter elements 120, and an arrangement 130 comprising a plurality of detector elements. In this regard, the arrangement of the plurality of detector elements is shown only as a block comprising multiple detector elements (not shown). The detector elements may be formed, for example, by the pixels of a CMOS camera chip.
The arrangement 110 with the emitter elements 120 is arranged in a first cavity 162. The arrangement 130 with the detector elements is arranged in a second cavity 163. The two cavities are separated from each other by a partition wall 166, in particular optically separated from each other. The two cavities and the partition wall 166 are formed by a housing 164, in which the arrangement 110 with the emitter elements 120 and the arrangement 130 with the detector elements are arranged. Furthermore, an evaluation unit not shown here and a control unit may also be arranged in the housing 164.
During operation of the optoelectronic device 100, the emitter elements 120 sequentially emit light of different wavelengths or wavelength ranges at least partially onto a sample. For example, an optical lens 160 in front of the plurality of emitter elements may be configured to project the light emitted by the emitter elements onto the sample to be examined. The optoelectronic device 100 can then be used to examine constituents of the sample. A portion of the light is reflected from the sample to a further optical lens 161. The light passes through the further optical lens 161 and falls on the arrangement 130 comprising the detector elements. The further optical lens 161 in front of the plurality of detector elements may be configured to image the image of the sample under investigation, in particular the light reflected from the sample under investigation, onto the detector elements. Each of the detector elements then measures the intensity of the light falling on the respective detector element.
Referring to
In contrast, the arrangement 110 shown in
As shown in
According to
| Number | Date | Country | Kind |
|---|---|---|---|
| 10 2020 202 823.0 | Mar 2020 | DE | national |
The present application is a national stage entry according to 35 U.S.C. § 371 of PCT application No.: PCT/EP2021/054007 filed on Feb. 18, 2021; which claims priority to German patent application DE 10 2020 202 823.0, filed on Mar. 5, 2020; all of which are incorporated herein by reference in their entirety and for all purposes.
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/EP2021/054007 | 2/18/2021 | WO |
