This application claims the benefit of priority from Japanese Patent Application No. 2022-039145 filed on Mar. 14, 2022, the entire contents of which are incorporated herein by reference.
The present disclosure relates to a detection device.
United States Patent Application Publication No. 2018/0012069 describes an optical sensor in which a plurality of photoelectric conversion elements such as photodiodes are arranged on a semiconductor substrate. In the optical sensor, signals output from the photoelectric conversion elements change with an amount of irradiating light, thereby enabling detection of biometric information.
Japanese Patent Application Laid-open Publication No. 2019-180861 describes a configuration to acquire an oxygen saturation level in blood (hereinafter, called “blood oxygen saturation level” (SpO2)) using pulse waves acquired using infrared light and pulse waves acquired using red light. The blood oxygen saturation level (SpO2) refers to a ratio of an amount of oxygen actually bound to hemoglobin to the total amount of oxygen under the assumption that the oxygen is bound to all the hemoglobin in the blood.
For example, when acquiring subcutaneous information such as the pulse waves, accurate data may not always be acquired depending on the distribution of subcutaneous blood vessels. When accurately acquiring time-variable data such as the pulse waves, the detection needs to be performed at a higher frame rate. While it is conceivable to extract the highly accurate data from data acquired by a plurality of optical sensors, the configuration including the multiple optical sensors may reduce the frame rate for acquiring detection values of the multiple optical sensors. Furthermore, the computational load for calculating the pulse waves and the blood oxygen saturation level (SpO2) may increase.
It is an object of the present disclosure to provide a detection device capable of achieving a higher frame rate of detection operation and a reduction in load of arithmetic processing in a configuration including a plurality of optical sensors.
A detection device according to an embodiment of the present disclosure includes a sensor unit that has a detection area divided into a plurality of partial detection areas, a control circuit that has a first mode of acquiring data for each of the partial detection areas based on a detection value acquired from the partial detection area and a second mode of selecting the partial detection areas in which a signal strength of the data acquired in the first mode is relatively higher among the partial detection areas, and acquiring biometric data of an object to be detected based on a detection value acquired by coupling the selected partial detection areas in parallel, and an amplifying circuit configured to receive the detection value acquired in the second mode.
The following describes modes (embodiments) for carrying out the present disclosure in detail with reference to the drawings. The present disclosure is not limited to the description of the embodiments to be given below. Components to be described below include those easily conceivable by those skilled in the art or those substantially identical thereto. In addition, the components to be described below can be combined as appropriate. What is disclosed herein is merely an example, and the present disclosure naturally encompasses appropriate modifications easily conceivable by those skilled in the art while maintaining the gist of the disclosure. To further clarify the description, the drawings may schematically illustrate, for example, widths, thicknesses, and shapes of various parts as compared with actual aspects thereof. However, they are merely examples, and interpretation of the present disclosure is not limited thereto. The same component as that described with reference to an already mentioned drawing is denoted by the same reference numeral through the description and the drawings, and detailed description thereof may not be repeated where appropriate.
The detection device 1 is electrically coupled to a host 200. The host 200 is, for example, a higher-level control device for an apparatus (not illustrated) to which the detection device 1 is applied. The host 200 performs a predetermined biometric information acquisition process based on data output from the detection device 1.
The sensor base material 21 is electrically coupled to a control substrate 121 through a flexible printed circuit board 71. The flexible printed circuit board 71 is provided with the detection circuit 48. The control substrate 121 is provided with the control circuit 122, the power supply circuit 123, and an output circuit 126.
The detection circuit 48 is, for example, an analog front-end (AFE) circuit. The detection circuit 48 detects output values of the sensor unit 10.
The control circuit 122 includes, for example, a control integrated circuit (IC) that outputs logic control signals. The control circuit 122 may be, for example, a programmable logic device (PLD) such as a field-programmable gate array (FPGA).
The control circuit 122 supplies control signals to the sensor unit 10 and the detection circuit 48. The control circuit 122 supplies control signals to the first and the second light sources 61 and 62. In the present disclosure, the control circuit 122 is a component that executes each process of the overall detection operation in the detection device 1, including an entire detection area data acquisition process, a partial detection area selection process, a partial detection area setting process, and a pulse wave data acquisition process, which are to be described later, based on detection values acquired by the detection circuit 48.
The power supply circuit 123 supplies power supply voltages for components, including, for example, a sensor power supply potential VDD_ORG, a reference potential Vref (refer to
The output circuit 126 is, for example, a Universal Serial Bus (USB) controller IC, and controls communication between the control circuit 122 and the host 200.
The sensor base material 21 has a detection area AA and a peripheral area GA. The detection area AA is an area provided with a plurality of optical sensors PD (refer to
The first direction Dx is one direction in a plane parallel to the sensor base material 21. The second direction Dy is one direction in the plane parallel to the sensor base material 21, and is a direction orthogonal to the first direction Dx. The second direction Dy may non-orthogonally intersect the first direction Dx. A third direction Dz is a direction orthogonal to the first direction Dx and the second direction Dy, and is a direction normal to the sensor base material 21.
The first light sources 61 are provided on the first light source base material 51, and are arranged along the second direction Dy. The second light sources 62 are provided on the second light source base material 52, and are arranged along the second direction Dy. The first light source base material 51 and the second light source base material 52 are electrically coupled, through terminals 124 and 125, respectively, provided on the control substrate 121, to the control circuit 122 and the power supply circuit 123.
For example, inorganic light-emitting diodes (LEDs) or organic electroluminescent (EL) diodes (organic light-emitting diodes (OLEDs)) are used as the first and the second light sources 61 and 62. The first and the second light sources 61 and 62 emit first light and second light, respectively, having different wavelengths.
The first light emitted from the first light sources 61 is reflected, for example, on a surface of an object to be detected, such as a finger or a wrist of a subject, and is incident on the sensor unit 10. As a result, the sensor unit 10 can detect a fingerprint by detecting a shape of asperities on a surface of a finger Fg or the like. The second light emitted from the second light sources 62 is, for example, reflected in the finger Fg or the like, or transmitted through the finger Fg or the like, and is incident on the sensor unit 10. As a result, the sensor unit 10 can detect information on a living body in the finger, the wrist, and the like of the subject. Examples of the information on the living body include pulse waves, pulsation, and a vascular image of the subject. That is, the detection device 1 may be configured as a fingerprint detection device to detect the fingerprint or a vein detection device to detect a vascular pattern of, for example, veins.
The first light may have a wavelength of from 520 nm to 600 nm, for example, a wavelength of approximately 500 nm, and the second light may have a wavelength of from 780 nm to 950 nm, for example, a wavelength of approximately 850 nm. In this case, the first light is visible light in blue or green (blue light or green light), and the second light is infrared light. The sensor unit 10 can detect the fingerprint based on the first light emitted from the first light sources 61. The second light emitted from the second light sources 62 is reflected in, or transmitted through or absorbed by the object to be detected, and is incident on the sensor unit 10. As a result, the sensor unit 10 can detect the biometric data such as the pulse waves and the vascular image (vascular pattern) as the information on the living body in the finger, the wrist, and the like of the subject.
Alternatively, the first light may have a wavelength of from 600 nm to 700 nm, for example, approximately 660 nm, and the second light may have a wavelength of from 780 nm to 950 nm, for example, approximately 850 nm. In this case, the sensor unit 10 can detect a blood oxygen level in addition to the pulse waves, the pulsation, and the vascular image as the information on the living body based on the first light emitted from the first light sources 61 and the second light emitted from the second light sources 62. As described above, the detection device 1 includes the first and the second light sources 61 and 62, and performs the detection based on the first light and the detection based on the second light, and thereby can detect the various types of information on the living body.
Each of the optical sensors PD provided in the partial detection area PAA is an organic photodiode (OPD), and outputs an electrical signal corresponding to light emitted thereto to the detection circuit 48.
The detection circuit 48 includes an amplifying circuit 42 and an analog-to digital (A/D) conversion circuit 43 (hereinafter also called “ADC 43”) as a basic configuration for performing the detection operation.
As illustrated in
Specifically, the power supply circuit 123 supplies the sensor power supply potential VDD_ORG to the cathode of the optical sensor PD over the reset period RST, the exposure period CH, and the read period RD. The first light (or the second light) is emitted from the first light sources 61 (or the second light sources 62) over the reset period RST, the exposure period CH, and the read period RD.
The control circuit 122 controls a switch RSW and a switch SSW of the detection circuit 48 to be on during the reset period RST. As a result, the reference potential Vref applied to the non-inverting input (+) of the amplifying circuit 42 is supplied to the anode of the optical sensor PD, and thus, a reverse bias is applied between the anode and the cathode of the optical sensor PD. At this time, the optical sensor PD is charged with an electric charge corresponding to the reverse bias voltage.
The control circuit 122 controls the switch SSW to be off during the exposure period CH. This operation gradually discharges the electric charge with which the optical sensor PD has been charged by the light irradiation.
The control circuit 122 controls the switch SSW to be on, and the switch RSW to be off during the read period RD. This operation moves the electric charge that has charged the optical sensor PD to a negative feedback capacitor Cfb of the amplifying circuit 42 in the detection circuit 48, and sets the output voltage of the amplifying circuit 42 to a voltage corresponding to the electric charge stored in the negative feedback capacitor Cfb. The output voltage of the amplifying circuit 42 is converted into a digital value by the ADC 43.
As illustrated in
In the comparative example illustrated in
The detection operation in the comparative example illustrated in
The following describes an example of acquiring the pulse waves serving as biometric information for calculating an oxygen saturation level in blood (hereinafter, called “blood oxygen saturation level” (SpO2)) as a specific example of the information on the living body acquired by the detection device 1.
In the case of acquiring the human blood oxygen saturation level (SpO2), a pulse wave acquired using the first light (red light) and a pulse wave acquired using the second light (infrared light) are used. Specifically, for example, visible light in red (red light) having a wavelength of from 600 nm to 700 nm, specifically, approximately 660 nm is employed as the first light emitted from the first light sources 61, and infrared light having a wavelength of from 780 nm to 950 nm, specifically, approximately 850 nm is employed as the second light emitted from the second light sources 62.
In the detection operation example illustrated in
In the subsequent one frame period 1F, the control circuit 122 turns on the second light sources 62 to emit the second light (infrared light), sequentially H-controls each of the SEL signals, and performs the detection operation described above during the H period of each of the SEL signals. This operation acquires second detection values DET2(1), DET2(2), . . . , DET2(9) for the partial detection areas PAA(1), PAA(2), . . . , PAA(9), respectively.
Thus, by alternately providing the frame to turn on the first light sources 61 to emit the first light (red light) and the frame to turn on the second light sources 62 to emit the second light (infrared light), pulse wave data generated by the first detection values DET1(1), DET1(2), . . . , DET1(9) acquired using the first light (red light) and pulse wave data generated by the second detection values DET2(1), DET2(2), . . . , DET2(9) acquired using the second light (infrared light) can be used to calculate the blood oxygen saturation level (SpO2).
Since the calculation of the blood oxygen saturation level (SpO2) uses the pulse wave acquired using the first light (red light) and the pulse wave acquired using the second light (infrared light), the gap in detection timing between the first detection values DET1 acquired using the first light and the second detection signals DET2 acquired using the second light is preferably smaller.
However, in the detection operation example illustrated in
In addition, if the first detection values DET1(1), DET1(2), . . . , DET1(9) and the second detection values DET2(1), DET2(2), . . . , DET2(9) for all the partial detection areas PAA(1), PAA(2), . . . , PAA(9), respectively, in the detection area AA are transmitted to the host 200 and the host 200 calculates the blood oxygen saturation level (SpO2), the amount of transmitted data and the load in arithmetic processing on the side of the host 200 may increase.
In contrast to the detection operation example illustrated in
The signal strength of the pulse wave data acquired in each of the partial detection areas PAA in the detection area AA differs depending on the distribution of subcutaneous blood vessels in the finger of the subject. The signal strength of the pulse wave data is represented by the alternating-current (AC) component of the pulse wave data illustrated in
In the present disclosure, as illustrated in, for example,
The following describes a configuration and an operation in the configuration including the optical sensors PD that can achieve a higher frame rate of the detection operation and a further reduction in the load of the arithmetic processing when acquiring the pulse wave data than the above-described detection operation of the comparative example illustrated in
In the first example illustrated in
The FF 11 of the partial detection area PAA(1) receives an STV signal and a CK signal. The FFs 11 of the partial detection area PAA(2) and the subsequent partial detection areas PAA receive the output of the FF 11 at the previous stage and the CK signal. The switch transistor SWTR in each of the partial detection areas PAA(p) is selectively supplied with an ENB signal by an SRout signal and an xSRout signal output from the FF 11. The STV signal, the CK signal, and the ENB signal are output from the control circuit 122. The xSRout signal is a logically inverted signal of the SRout signal.
Specifically, the control circuit 122 acquires detection values DET(p) for a plurality of frames in each of the partial detection areas PAA(p) in the detection area AA. A number of frames F when acquiring the detection values DET(p) for a plurality of frames is set to a number of times (for example, approximately ten times) by which a peak of the pulse wave can be acquired.
Specifically, the control circuit 122 generates time-domain data DAT(p) that represents a time transition of the detection values DET(p) for a plurality of frames in each of the partial detection areas PAA(p) in the detection area AA. Then, based on the ratio of an AC component DAT(AC) to a direct-current (DC) component DAT(DC) of each piece of the time-domain data DAT(p) (DAT(AC)/DAT(DC)×100 [%]), the partial detection areas PAA to be used in the pulse wave data acquisition process (Step S104) are selected.
The AC component DAT(AC) of the time-domain data DAT(p) is obtained, for example, by performing a high-pass filter (HPF) process on the time-domain data DAT(p). This operation removes the DC component DAT(DC) from the time-domain data DAT(p) to obtain the AC component DAT(AC). The DC component DAT(DC) of the time-domain data DAT(p) is obtained, for example, by performing a low-pass filter (LPF) process on the time-domain data DAT(p). This operation removes the AC component DAT(AC) from the time-domain data DAT(p) to obtain the DC component DAT(DC).
The control circuit 122 selects, for example, the partial detection areas PAA in which the ratio of the AC component DAT(AC) to the DC component DAT(DC) of the time-domain data DAT(p) (DAT(AC)/DAT(DC)×100 [%]) is equal to or higher than a predetermined value (for example, 1 [%]) from among the partial detection areas PAA(p).
The mode of selection of the partial detection areas PAA in the partial detection area selection process (Step S102) is not limited thereto. The control circuit 122 may employ, for example, a mode of selecting, for example, the partial detection areas PAA in which the ratio of the AC component DAT(AC) to the DC component DAT(DC) of the time-domain data DAT(p) (DAT(AC)/DAT(DC)×100 [%]) is included in a predetermined number Q (Q=P/10, for example) of highest-ranked ratios among the partial detection areas PAA(p).
The control circuit 122 sets the STV signal to the set value (“0” or “1”) for each of the partial detection areas PAA(p), and sequentially outputs the STV signal. This operation writes the set value corresponding each of the FFs 11 of the partial detection areas PAA(p).
In this state, the detection operation described above is performed by alternately providing the frame to turn on the first light sources 61 to emit the first light (red light) and the frame to turn on the second light sources 62 to emit the second light (infrared light).
Specifically, the control circuit 122 acquires the first detection values DET1 obtained by superimposing the detection values in the selected partial detection areas PAA during the one frame period 1F in which the first light sources 61 are turned on to emit the first light (red light).
The control circuit 122 also acquires the second detection values DET2 obtained by superimposing the detection values in the selected partial detection areas PAA during the one frame period 1F in which the second light sources 62 are turned on to emit the second light (infrared light).
In the pulse wave data acquisition process (Step S104), the detection values DET obtained by superimposing the detection values in the partial detection areas PAA in which “1” has been written to the FFs 11 are acquired in the one frame period 1F. This process can perform the detection operation at a higher frame rate than that of the detection operation example of the comparative example illustrated in
In an aspect of the present disclosure, the control circuit 122 may calculate the blood oxygen saturation level (SpO2). Even in this case, the detection operation can be performed at a higher frame rate and the load of the arithmetic processing can be lower than in the comparative example illustrated in
Furthermore, the pulse wave data acquisition process (Step S104) can improve the accuracy of acquisition of the pulse wave data and the accuracy of calculation of the blood oxygen saturation level (SpO2) because the superimposed values of the detection values in the partial detection areas PAA are acquired.
In an aspect of the present disclosure, in the pulse wave data acquisition process (Step S104), the capacitance value of the negative feedback capacitor Cfb of the amplifying circuit 42 in the detection circuit 48 may be, for example, variable according to the number of the parallelly coupled optical sensors PD.
While
Specifically, when the switch transistor SWTR is L-controlled and a MODE signal is at an “H” potential, the reference potential Vref is applied to the anode of the optical sensor PD. The MODE signal is output from the control circuit 122. The MODE signal is controlled to have an “L” potential in the entire detection area data acquisition process (Step S101), and to have the “H” potential in the partial detection area setting process (Step S103) and the pulse wave data acquisition process (Step S104). This operation applies the reference potential Vref to the anode of the optical sensor PD in the deselected partial detection area PAA in the pulse wave data acquisition process (Step S104).
In an aspect of the present disclosure, in the pulse wave data acquisition process (Step S104), for example, the amount of light of the first and the second light sources 61 and 62 may be variable according to the number of the parallelly coupled optical sensors PD. The amount of light of the first and the second light sources 61 and 62 can be changed, for example, by making the light source drive voltage applied to the first and the second light sources 61 and 62 variable. Specifically, the amount of light of the first and the second light sources 61 and 62 is reduced as the number of the parallelly coupled optical sensors PD increases. The aspect is not limited to that of making the light source drive voltage applied to the first and the second light sources 61 and 62 variable, but only needs to be that where the amount of light of the first and the second light sources 61 and 62 is controllable.
In an aspect of the present disclosure, in the pulse wave data acquisition process (Step S104), for example, the exposure period CH may be variable according to the number of the parallelly coupled optical sensors PD. Specifically, the exposure period CH is shortened as the number of the parallelly coupled optical sensors PD increases. This aspect can achieve a further higher frame rate in the pulse wave data acquisition process (Step S104).
In the present disclosure, the example has been described where the pulse wave data of all the partial detection areas PAA(p) in the detection area AA is acquired in the entire detection area data acquisition process (Step S101) of the detection process flow illustrated in
The second embodiment has a configuration that enables acquisition of, for example, high-definition biometric data, such as the vascular image (vascular pattern), in addition to the pulse wave. As illustrated in
As illustrated in
As illustrated in
In the second embodiment, the sensor unit 10 includes a first drive circuit 15a, a second drive circuit 15b, and an output switching circuit 16. The first drive circuit 15a, the second drive circuit 15b, and the output switching circuit 16 are provided, for example, in the peripheral area GA.
Data<m, n> is selectively read by a G<n> signal and an xG<n> signal into the SRAM 13 in each of the partial detection areas PAA(m, n). The data<m, n> is output from the first drive circuit 15a. The G<n> signal and xG<n> signal are output from the second drive circuit 15b. The xG<n> signal is a logically inverted signal of the G<n> signal. When the G<n> signal is at the “H” potential and the xG<n> signal is at the “L” potential, the partial detection areas(m, n) in the row n are selected.
Specifically, in the entire detection area data acquisition process (Step S101) illustrated in
The output switching circuit 16 is provided with M switch circuits corresponding to the partial detection areas PAA arranged in the second direction Dy in the column m (refer to
One end of each of the switch circuits of the output switching circuit 16 is coupled to the partial detection areas PAA in the column m. The other ends of the P switch circuits of the output switching circuit 16 are bundled together and coupled to each of the M/P amplifying circuits 42. Specifically, when the number of divisions in the first direction Dx of the detection area AA is 100 and the other ends of five of the switch circuits are bundled, 20 of the amplifying circuits 42 are provided.
Specifically, the control circuit 122 acquires the detection values DET<m, n> for a plurality of frames in each of the partial detection areas PAA(m, n) in the detection area AA. The number of frames F when acquiring the detection values DET<m, n> for a plurality of frames is set to the number of times (for example, approximately ten times) by which a peak of the pulse wave can be acquired.
In the entire detection area data acquisition process (Step S101) illustrated in
In the example illustrated in
In the partial detection area selection process (Step S102) illustrated in
Specifically, the control circuit 122 generates the time-domain data DAT<m, n> using the detection values DET<m, n> for a plurality of frames in each of the partial detection areas PAA(m, n) in the detection area AA. Then, based on the ratio of the AC component DAT(AC) to the direct-current (DC) component DAT(DC) of each piece of the time-domain data DAT<m, n> (DAT(AC)/DAT(DC)×100 [%]), the partial detection areas PAA to be used in the pulse wave data acquisition process (Step S104) illustrated in
The control circuit 122 sets the DATA signal to the set value (“0” or “1”) for each of the partial detection areas PAA(m, n), and sequentially outputs the DATA signal.
In the second embodiment, as illustrated in
In this state, the detection operation described above is performed by alternately providing the frame to turn on the first light sources 61 to emit the first light (red light) and the frame to turn on the second light sources 62 to emit the second light (infrared light).
Specifically, the control circuit 122 acquires the first detection values DET1 obtained by superimposing the detection values in the selected partial detection areas PAA for each unit of the M/P amplifying circuits 42 during the one frame period 1F in which the first light sources 61 are turned on to emit the first light (red light).
The control circuit 122 also acquires the second detection values DET2 obtained by superimposing the detection values in the selected partial detection areas PAA for each unit of the M/P amplifying circuits 42 during the one frame period 1F in which the second light sources 62 are turned on to emit the second light (infrared light).
In the present embodiment, in the pulse wave data acquisition process (Step S104), the detection value DET obtained by superimposing the detection values in the selected partial detection areas PAA are acquired for each unit of the M/P amplifying circuits 42 during the one frame period 1F. As a result, in the configuration that enables the acquisition of, for example, the high-definition biometric data, such as the vascular image (vascular pattern), the detection operation can be performed at a higher frame rate when acquiring the pulse wave, and the amount of transmitted data and the load of the arithmetic processing can be reduced when the host 200 calculates the blood oxygen saturation level (SpO2). The aspect may be employed where the control circuit 122 calculates the blood oxygen saturation level (SpO2). Even in this case, the detection operation can be performed at a higher frame rate when acquiring the pulse wave, and the load of the arithmetic processing can be reduced.
Furthermore, the pulse wave data acquisition process (Step S104) can improve the accuracy of acquisition of the pulse wave data and the accuracy of calculation of the blood oxygen saturation level (SpO2) because the superimposed values of the detection values in the partial detection areas PAA are acquired.
Even in the present embodiment, in the same manner as in the first embodiment, the aspect may be employed where the capacitance value of the negative feedback capacitor Cfb of the amplifying circuit 42 in the detection circuit 48 is, for example, variable according to the number of the parallelly coupled optical sensors PD in the pulse wave data acquisition process (Step S104) illustrated in
Specifically, for example, the aspect may be employed where the negative feedback capacitor Cfb of the amplifying circuit 42 in the detection circuit 48 is a variable capacitor, as illustrated in
For example, the aspect may also be employed where the negative feedback capacitors Cfb can be coupled in parallel, and the number of the parallelly coupled negative feedback capacitors Cfb is changed according to the number of the parallelly coupled optical sensors PD.
Specifically, when the switch transistor SWTR is L-controlled and the MODE signal is at the “H” potential, the reference potential Vref is applied to the anode of the optical sensor PD. The MODE signal is output from the control circuit 122. The MODE signal is controlled to have the “L” potential in the entire detection area data acquisition process (Step S101) illustrated in
Even in the present embodiment, in the same manner as in the first embodiment, the aspect may be employed where, for example, the amount of light of the first and the second light sources 61 and 62 is variable according to the number of the parallelly coupled optical sensors PD in the pulse wave data acquisition process (Step S104) illustrated in
Even in the present embodiment, in the same manner as in the first embodiment, the aspect may be employed where, for example, the exposure period CH is variable according to the number of the parallelly coupled optical sensors PD in the pulse wave data acquisition process (Step S104) illustrated in
While the preferred embodiments of the present disclosure have been described above, the present disclosure is not limited to the embodiments described above. The content disclosed in the embodiments is merely an example, and can be variously modified within the scope not departing from the gist of the present disclosure. Any modifications appropriately made within the scope not departing from the gist of the present disclosure also naturally belong to the technical scope of the present disclosure. At least one of various omissions, substitutions, and changes of the components can be made without departing from the gist of the embodiments and the modifications described above.
Number | Date | Country | Kind |
---|---|---|---|
2022-039145 | Mar 2022 | JP | national |