Patent Application
20220074797
The present disclosure relates to an imaging device and a calibration method.
In recent years, there is a technology for performing calibration of a temperature sensor by acquiring a value of temperature data output as a predetermined test temperature in advance in the temperature sensor mounted on an imaging device or the like (for example, see PTL 1).
[PTL 1] JP 2012-220437 A
However, in the technology of the related art, when the number of test temperatures at which calibration is performed is increased to improve accuracy of the temperature sensors, a large amount of time or equipment is necessary for the calibration. Therefore, there is a concern about an increase in manufacturing cost.
Accordingly, the present disclosure proposes an imaging device and a calibration method capable of improving the accuracy of calibration without an increase in the number of test temperatures at which the calibration is performed.
According to an aspect of the present invention, an imaging device is provided. The imaging device includes a pixel array unit including pixels, an analog signal generation unit, an A/D conversion unit, and a switch. The analog signal generation unit generates an analog signal based on a temperature around the pixel array unit. The A/D conversion unit converts the analog signal into a digital signal. The switch cuts off the analog signal to be supplied to the A/D conversion unit.
According to an aspect of the present invention, a calibration method is provided. The calibration method includes a signal cutting step, a first A/D conversion step, an analog signal outputting step, a second A/D conversion step, and a calculation step. In the signal cutting step, an analog signal generated based on a temperature is cut off. In the first A/D conversion step, the cutoff analog signal is converted into a first digital signal. In the analog signal outputting step, the analog signal is output. In the second A/D conversion step, the analog signal is converted into a second digital signal. In the calculation step, a parameter of a correction calculation expression for correcting a digital signal obtained through A/D conversion from an analog signal generated based on a temperature around a pixel array unit is calculated based on the first and second digital signals.
According to the present disclosure, it is possible to improve the accuracy of calibration without an increase in the number of test temperatures at which the calibration is performed. The advantageous effects described here are not necessarily limited and other advantageous effects desired to be described in the present disclosure may be obtained.
Hereinafter, each embodiment of the present disclosure will be described in detail with reference to the drawings. In each of the following embodiments, the same reference numerals are given to the same units and repeated description thereof will be omitted.
In recent years, there is a technology for performing calibration of a temperature sensor by acquiring a value of temperature data output as a predetermined test temperature in advance in the temperature sensor mounted on an imaging device or the like.
However, in the technology of the related art, when the number of test temperatures at which calibration is performed is increased to improve accuracy of the temperature sensors, a large amount of time or equipment is necessary for the calibration. Therefore, there is a concern about an increase in manufacturing cost.
On the other hand, when the number of test temperatures at which calibration is performed is reduced, it is difficult to obtain parameters of a correction calculation expression for correcting temperature data with high accuracy. Thus, it is difficult to improve the accuracy of a temperature sensor.
Accordingly, an improvement in accuracy of calibration is expected without an increase in the number of test temperatures at which the calibration is performed.
[Configuration of Imaging Device]
The pixel array unit 10, the system control unit 12, the vertical driving unit 13, the column reading circuit unit 14, the column signal processing unit 15, the horizontal driving unit 16, the signal processing unit 17, and the temperature measurement unit 18 are provided on the same semiconductor substrate or a plurality of stacked semiconductor substrates which are connected electrically.
In the pixel array unit 10, effective unit pixels (hereinafter referred to as “unit pixels”) 11 that include photoelectric conversion elements (photodiodes) capable of photoelectrically converting and accumulating a charge amount in accordance with an amount of incident light and outputting the charge amount as a signal are arrayed 2-dimensionally in a matrix form. The unit pixel 11 is an example of a pixel.
The pixel array unit 10 may include a region in which dummy unit pixels with a structure that has no photodiodes, light-shielding unit pixels in which incident light is blocked from the outside by shielding a light reception surface from light, and the like are disposed in a row and/or column form in addition to the effective unit pixels 11.
The light-shielding unit pixels may have a similar configuration to the effective unit pixels 11 except for the structure in which the light reception surface is shielded from light. Hereinafter, photocharges with a charge amount in accordance with an amount of incident light are simply referred to as “charges” and the unit pixels 11 are simply referred to as “pixels” in some cases.
In the pixel array unit 10, a pixel driving line LD is formed for each row in the right and left directions (an array direction of the pixels in the pixel row) in the drawing and a vertical pixel wiring LV is formed for each column in the upper and lower directions (an array direction of the pixels in the pixel column) in the drawing in the pixel array of the matrix form. One end of the pixel driving LD is connected to an output end corresponding to each row of the vertical driving unit 13.
The column reading circuit unit 14 includes at least a circuit that supplies a constant current to the unit pixels 11 for each column in a selected row in the pixel array unit 10, a current mirror circuit, and a switching switch of the unit pixels 11 which is a reading target.
The column reading circuit unit 14 forms an amplifier along with a transistor in a selected pixel in the pixel array unit 10, switches a photocharge signal into a voltage signal, and outputs the voltage signal to the vertical pixel wiring LV.
The vertical driving unit 13 includes a shift register or an address decoder and drives all the unit pixels 11 of the pixel array unit 10 simultaneously or each unit pixel 11 in a row unit or the like. The vertical driving unit 13 includes a reading scan system, a sweeping scan system, or a batch sweeping and batch transferring system although a specific configuration is not illustrated.
The reading scan system selects and scans the unit pixels 11 of the pixel array unit 10 in order in the row unit to read pixel signals from the unit pixels 11. In the case of row driving (a rolling shutter operation), for sweeping, sweeping scanning is performed earlier by a time of a shutter speed than reading scanning in a reading row in which reading scanning is performed by a reading scanning system.
In the case of global exposure (a global shutter operation), batch sweeping is performed earlier by a time of a shutter speed than batch transferring. Through the sweeping, unnecessary charges are swept (reset) from the photodiodes of the unit pixels 11 in a reading row. Through sweeping (resetting) of unnecessary charges, a so-called electronic shutter operation is performed.
Here, the electronic shutter operation is an operation of discarding unnecessary photocharges collected in the photodiodes until just before and newly starting exposure (starting accumulation of photocharges).
A signal read through the reading operation in the reading scanning system corresponds to an amount of light incident after the immediately previous reading operation or the electronic shutter operation. In the case of row driving, a period from a reading timing in the immediately previous reading operation or a sweeping timing in the electronic shutter operation to a reading timing in a present reading operation is an accumulation time (an exposure time) of the photocharges in the unit pixels 11. In the case of global exposure, a time from the batch sweeping to batch transferring is an accumulation time (an exposure time).
A pixel signal output from each unit pixel 11 in a pixel row selected and scanned by the vertical driving unit 13 is supplied to the column signal processing unit 15 through each vertical pixel wiring LV. The column signal processing unit 15 performs predetermined signal processing on the pixel signal output from each unit pixel 11 in the selected row via the vertical pixel wiring LV for each pixel column of the pixel array unit 10 and temporarily retains the pixel signal after signal processing.
Specifically, the column signal processing unit 15 performs at least noise removal, for example, CDS (correlated double sampling) as signal processing. Through the CDS processing by the column signal processing unit 15, fixed pattern noise specific to the pixels such as reset noise or a variation in a threshold of an amplification transistor AMP is removed.
The column signal processing unit 15 includes a plurality of A/D conversion units 15a, 15b, and the like (see
The horizontal driving unit 16 includes a shift register or an address decoder and sequentially selects unit pixels corresponding to the pixel columns of the column signal processing unit 15. Through the selection scanning by the horizontal driving unit 16, digital pixel signals processed by the column signal processing unit 15 are sequentially output to the signal processing unit 17.
The system control unit 12 includes a timing generator that generates various timing signals. The system control unit 12 performs driving control on the vertical driving unit 13, the column reading circuit unit 14, the column signal processing unit 15, and the horizontal driving unit 16 based on various timing signals generated by the timing generator.
The imaging device 1 further includes the signal processing unit 17, a data storage unit (not illustrated), and the temperature measurement unit 18. The signal processing unit 17 has at least an addition processing function and performs various kinds of signal processing such as addition processing on the pixel signals output from the column signal processing unit 15.
The data storage unit temporarily stores data necessary for signal processing when the signal processing unit 17 performs the signal processing. The signal processing unit 17 and the data storage unit may be processes by an external signal processing unit, for example, a DSP (Digital Signal Processor), or software provided on a different substrate from the imaging device 1 or may be mounted on the same substrate as the imaging device 1.
The temperature measurement unit 18 is provided near the pixel array unit 10, measures temperature around the pixel array unit 10, and outputs the temperature data based on the measured temperature as a digital signal. The temperature data is an example of a digital signal. The details of the temperature measurement unit 18 will be described later.
In the imaging device 1 according to the embodiment, a fail-safe operation at low temperature or high temperature can be performed based on the temperature data around the pixel array unit 10 output from the temperature measurement unit 18.
The fail-safe operation is, for example, an operation of stopping the imaging device 1 at low temperature or high temperature or an operation of sending an error signal to give a warning to the outside. Thus, it is possible to realize the imaging device 1 with high reliability.
In the imaging device 1 according to the embodiment, temperature information around the pixel array unit 10 output from the temperature measurement unit 18 in various kinds of signal processing of the column signal processing unit 15, the signal processing unit 17, and the like can be added to parameters.
For example, in noise reduction, shading correction, or the like, the temperature information around the pixel array unit 10 can be added to parameters. Thus, it is possible to perform various kinds of signal processing with high accuracy.
[Configuration of Temperature Measurement Unit]
Next, the details of the temperature measurement unit 18 will be described with reference to
As illustrated in
The PTAT current generation unit 20 outputs a PTAT current Ip (see
A base of the transistor Q1 and a collector of the transistor Q2 are short-circuited. Thus, the transistors Q1 and Q2 form one pn junction diode.
An anode of the diode formed by the transistor Q1 is connected to a negative input terminal of the operational amplifier OP and a drain of the transistor P1. An anode of a diode formed by the transistor Q2 is connected to one end of the resistor R1.
The transistor Q2 is formed with a size ratio (a junction area) which is M times the size of the transistor Q1. The value of the size ratio M is a value for determining characteristics of the temperature measurement unit 18 and is appropriately determined so that specifications required for the temperature measurement unit 18 are satisfied.
One end of the resistor R1 is connected to the collector of the transistor Q2 and the other end of the resistor R1 is connected to a positive input terminal of the operational amplifier OP and a drain of the transistor P2.
The positive input terminal of the operational amplifier OP is connected to the other end of the resistor R1 and is connected to the drain of the transistor P2. The negative input terminal of the operational amplifier OP is connected to an emitter of the transistor Q1 and the drain of the transistor P1. An output terminal of the operational amplifier OP is connected to the gates of the transistors P1 and P2.
In the embodiment, p-type MOS transistors with the same size are used as the transistors P1 to P3. The gates of the transistors P1 to P3 are short-circuited and the sources of the transistors P1 to P3 are connected to a power voltage Vdd.
Next, a circuit operation of the PTAT current generation unit 20 will be described. The operational amplifier OP operates so that potentials of the positive input terminal and the negative input terminal are equal (virtual short-circuiting). That is, the operational amplifier OP controls voltages of the gates of the mutually short-circuited transistors P1 and P2 so that the voltages of the drains of the transistors P1 and P2 are equal.
The currents of the drains of the transistors P1 and P2 are controlled by controlling the voltages of the gates of the transistors P1 and P2. Here, since gate-source voltages Vgs of the transistors P1 and P2 are equal, a drain current with the same value flows in the transistors P1 and P2. Accordingly, the current with the same value is applied to the transistors Q1 and Q2.
As described above, the transistor Q1 is formed by one npn transistor and the transistor Q2 is formed by M npn transistors. Thus, a current flowing in each npn transistor included in the transistor Q2 is less than a current flowing in one npn transistor included in the transistor Q1.
Accordingly, a base-emitter voltage Vbe1 of the transistor Q1 is greater than a base-emitter voltage Vbe2 of the transistor Q2. As a result, a voltage corresponding to a difference between the base-emitter voltage Vbe1 and the base-emitter voltage Vbe2 is applied to the resistor R1.
Here, since the difference between the base-emitter voltage Vbe1 and the base-emitter voltage Vbe2 has a positive correlation with temperature, a current flowing in the resistor R1 also has a positive correlation with temperature. Since a current flowing in the resistor R1 is a drain current of the transistor P2, a drain current of the transistor P2 also has a positive correlation with temperature.
The transistors P1, P2, and P3 form a current mirror circuit and drain currents of the transistors P1 and P2 are a drain current of the transistor P3 as they are. The drain current of the transistor P3 flows in the transistor N1.
The transistors N1 and N2 form the current mirror circuit, and thus a drain current of the transistor N1 is a drain current of the transistor N2 as it is. The drain current of the transistor N2 is the PTAT current Ip which is an output current of the PTAT current generation unit 20.
Since the PTAT current Ip is equal to the drain current of the transistor P2 that has the positive correlation with temperature, the PTAT current Ip has a positive correlation with temperature like the drain current of the transistor P2.
Hereinafter, temperature dependency is obtained by obtaining the PTAT current Ip through calculation.
A potential V1 of the collector of the transistor Q1 and a potential V2 of the collector of the transistor Q2 are given by the following Expressions (1) and (2).
V1=(k/q)·T·ln(l1/ls) (1)
V2=(k/q)·T·ln(l1/(M·is)) (2)
Here, k is the Boltzmann's constant (1.38×10−23 (J/K)), q is an elementary charge (1.6×1019 (C)), T is absolute temperature (K), and Is is a reverse saturation current (A).
A drain current I1 of the transistor P1 is given by the following Expression (3).
I1=(V1−V2)/R1 (3)
Here, the drain current I1 of the transistor P1 is equal to the PTAT current Ip, and thus the PTAT current Ip is given by the following Expression (4).
Ip=I1=(k/q)·T·ln(M)/R1 (4)
As understood from Expression (4), by connecting M npn transistors which are the same as the transistor Q1 in parallel to form the transistor Q2, it is possible to cancel a value of the reverse saturation current Is of the npn transistor at the drain current I1 of the transistor P1.
Accordingly, according to the embodiment, it is possible to output the PTAT current Ip that has the positive correlation with temperature. The PTAT current generation unit 20 according to the embodiment is not limited to the example of
The cutoff switch 21 cuts off the PTAT current Ip supplied from the PTAT current generation unit 20. The cutoff switch 21 is provided, for example, between the PTAT current generation unit 20 and the current-voltage conversion unit 22.
The cutoff switch 21 is not limited to the case in which the cutoff switch 21 is provided, for example, between the PTAT current generation unit 20 and the current-voltage conversion unit 22, the cutoff switch 21 may be provide inside the PTAT current generation unit 20 (for example, between the transistors P3 and N1 illustrated in
The current-voltage conversion unit 22 is, for example, a resistor provided between the power voltage Vdd and the cutoff switch 21. The current-voltage conversion unit 22 converts the PTAT current Ip of the analog signal supplied from the PTAT current generation unit 20 via the cutoff switch 21 into a PTAT voltage Vp. That is, the PTAT voltage Vp is an analog signal that has a positive correlation with temperature.
The correction unit 24 corrects the temperature data output from the A/D conversion unit 23 and outputs the corrected temperature data to the outside of the temperature measurement unit 18. For example, the correction unit 24 can correct the temperature data by reading a parameter 26 stored in the storage unit 25 and inputting the parameter 26 and the temperature data into a predetermined correction calculation expression E (see
The parameter 26 can be calculated by acquiring a value of the temperature data output as a predetermined temperature (for example, 60° C.) in advance, for example, before shipping of the imaging device 1.
The storage unit 25 that stores the parameter 26 is configured as a storage medium such as a semiconductor memory or a hard disk and stores a program and data for processing performed by the temperature measurement unit 18. A part of the program and data according to the present disclosure may be acquired from an external data source (for example, a data server, a network storage, or an externally attached memory) without being stored in the storage unit 25.
In the embodiment, in each imaging device 1, by performing the foregoing calibration, it is possible to output the highly accurate temperature data in which a manufacturing variation or the like is corrected.
In the embodiment, the correction unit 24 can output further highly accurate temperature data by including a parameter of the power voltage Vdd in the correction calculation expression E. This is because the PTAT current Ip which is a source of the temperature data varies with a variation in the power voltage Vdd. When the parameter of the power voltage Vdd is included in the correction calculation expression E, the temperature measurement unit 18 may have a function of monitoring the power voltage Vdd.
[Calibration Method]
Next, the details of the calibration method in the temperature measurement unit 18 will be described with reference to
In the embodiment, by causing the cutoff switch 21 to enter a cutoff state, the PTAT current Ip supplied from the PTAT current generation unit 20 is cut off. Thus, an output of the PTAT current Ip can be set to zero, and thus a state in which a test temperature is zero (K) can be simulated in the temperature measurement unit 18.
Subsequently, in the embodiment, the current-voltage conversion unit 22 converts the cutoff PTAT current Ip into a PTAT voltage Vp and the A/D conversion unit 23 converts the PTAT voltage Vp to temperature data Do.
In the embodiment, as illustrated in
Subsequently, in the embodiment, by causing the cutoff switch 21 to enter a connection state, the PTAT current Ip is supplied from the PTAT current generation unit 20 to the current-voltage conversion unit 22. In the embodiment, the imaging device 1 is in an environment of a predetermined temperature T1. That is, a text temperature for calibration is set to the temperature T1.
Subsequently, in the embodiment, the PTAT current Ip supplied from the PTAT current generation unit 20 is converted into the PTAT voltage Vp by the current-voltage conversion unit 22. The PTAT voltage Vp is converted into temperature data D1 by the A/D conversion unit 23. In the embodiment, as illustrated in
Subsequently, in the embodiment, the parameter 26 (see
That is, in the embodiment, when calibration is performed at one test temperature (the temperature T1), the two correction points P0 and P1 more than the number of test temperatures can be plotted on the rectangular coordinate system. Accordingly, according to the embodiment, it is possible to improve accuracy of the calibration without an increase in the number of test temperatures at which the calibration is performed.
In the embodiment, as illustrated in
This is because it is not appropriate that the temperature data is considered to be zero (LSB) when the test temperature is zero (K) (that is, the PTAT current Ip is zero) since offset occurs in the output value in the A/D conversion unit 23, the current-voltage conversion unit 22, or the like, as described above.
As described above, in the embodiment, by performing processing to cut off the PTAT current Ip with the cutoff switch 21, it is possible to improve the accuracy of the calibration without an increase in the number of test temperatures at which the calibration is performed.
In the example of
As illustrated in
The parameter 26 (see
When three or more correction points P0, P1, P2, P3, and the like can be plotted, the correction calculation expression E may be piecewise approximated (brokenly approximated), as illustrated in
In the embodiment, of a plurality of electrode pads provided in the imaging device 1, two electrode pads may be set as thermocouple pads and test temperatures may be measured in the above-described calibration processing using the two thermocouple pads.
Thus, even when an in-plane temperature distribution of a wafer is not uniform in each calibration processing of the plurality of imaging devices 1 which are a wafer state before individual chips are cut off, the above-described calibration processing can be performed with high accuracy.
[Modification Examples of Temperature Measurement Unit]
Next, various modification examples of the temperature measurement unit 18 will be described with reference to
As illustrated in
In this way, by sharing the A/D conversion unit 15a between the column signal processing unit 15 and the temperature measurement unit 18, it is possible to simplify a circuit configuration of the entire imaging device 1. Thus, according to Modification Example 3, it is possible to reduce cost of the imaging device 1.
Thus, since results of the plurality steps of A/D conversion processing are averaged and random noise can be reduced, it is possible to measure the temperature around the pixel array unit 10 with higher accuracy.
As in the example of
That is, the correction unit 24 may calculate the parameter 26 based on the plurality of pieces of temperature data converted based on which cutoff PTAT current IP by the plurality of A/D conversion units, and the plurality of pieces of temperature data converted by the plurality of A/D conversion units based on the PTAT current Ip at the predetermined test temperature.
Thus, it is possible to further improve the accuracy of the calibration without an increase in the number of test temperatures at which the calibration is performed.
In the examples of
For example, when the A/D conversion unit is provided inside each unit (for example, the signal processing unit 17) of the imaging device 1 illustrated in
[Details of Processing Performed by Temperature Measurement Unit]
Next, the details of processing performed by the temperature measurement unit 18 according to the embodiment will be described with reference to
First, the temperature measurement unit 18 controls the cutoff switch 21 such that f the PTAT current Ip supplied from the PTAT current generation unit 20 is cut off (step S101). Then, the temperature measurement unit 18 converts the cutoff PTAT current Ip into the temperature data Do (step S102).
For example, in the temperature measurement unit 18, the current-voltage conversion unit 22 converts the cutoff PTAT current Ip into the PTAT voltage Vp and the A/D conversion unit 23 converts the PTAT voltage Vp into the temperature data D0. The temperature measurement unit 18 stores the temperature data Do corresponding to the test temperature of zero (K) in the storage unit 25 (step S103).
Subsequently, the temperature measurement unit 18 causes the cutoff switch 21 to enter the connection state and the PTAT current Ip is output from the PTAT current generation unit 20 to the current-voltage conversion unit 22 (step S104). Then, the temperature measurement unit 18 sets the number of test temperatures N to zero (step S105) and adds 1 to the number of test temperatures N (step S106).
Subsequently, the temperature measurement unit 18 sets the test temperature to a predetermined temperature TN (step S107). Then, the temperature measurement unit 18 converts the PTAT current IP at a temperature TN into temperature data DN (step S108).
For example, in the temperature measurement unit 18, the current-voltage conversion unit 22 converts the PTAT current Ip at the temperature TN into the PTAT voltage Vp and the A/D conversion unit 23 converts the PTAT voltage Vp into the temperature data DN. Then, the temperature measurement unit 18 stores the temperature data DN at the temperature TN in the storage unit 25 (step S109).
Subsequently, the temperature measurement unit 18 determines whether the number of test temperatures N is a predetermined number of correction points (step S110). When the number of test temperatures N is the predetermined number of correction points (Yes in step S110), the temperature measurement unit 18 calculates the parameter 26 calculates the parameter 26 of the correction calculation expression E based on pieces of stored temperature data D0, . . . , DN (step S111).
Finally, the temperature measurement unit 18 stores the calculated parameter 26 of the correction calculation expression E in the storage unit 25 (step S112) and ends the processing. When the number of test temperatures N is not the predetermined number of correction points in step S110 (No in step S110), the processing returns to step S106.
In the embodiment, the processing of the above-described steps S104 to S110 may be performed earlier than the processing of steps S101 to S103. When the number of test temperatures N is equal to or greater than 2, the processing of steps S101 to S103 may be performed between the processing of steps S107 to S109 at a certain test temperature and the processing of steps S107 to S109 at a subsequent test temperature.
Subsequently, in the temperature measurement unit 18, the current-voltage conversion unit 22 converts the PTAT current Ip into the PTAT voltage Vp (step S202). Then, in the temperature measurement unit 18, the A/D conversion unit 23 performs A/D conversion from the PTAT voltage Vp to the temperature data (step S203).
Subsequently, the temperature measurement unit 18 reads the parameter 26 of the correction calculation expression E stored in the storage unit 25 to the correction unit 24 (step S204). Then, in the temperature measurement unit 18, the correction unit 24 corrects the temperature data obtained through the A/D conversion by the A/D conversion unit 23 based on the read parameter 26 of the correction calculation expression E (step S205).
Finally, the temperature measurement unit 18 outputs the corrected temperature data to the outside (step S206) and ends the processing.
The imaging device 1 according to the embodiment includes the pixel array unit 10 that includes the pixels (the unit pixels 11), the analog signal generation unit (the PTAT current generation unit 20), the A/D conversion unit 23 (15a and 15b), and the switch (the cutoff switch 21). The analog signal generation unit (the PTAT current generation unit 20) generates the analog signal (the PTAT current Ip) based on the temperature around the pixel array unit 10. The A/D conversion unit 23 (15a and 15b) converts the analog signal (the PTAT current Ip) into the digital signal (the temperature data). The switch (the cutoff switch 21) cuts off the analog signal (the PTAT current Ip) to be supplied to the A/D conversion unit 23 (15a and 15b).
Thus, it is possible to improve the accuracy of the calibration without an increase in the number of test temperatures at which the calibration is performed.
In the imaging device 1 according to the embodiment, the switch (the cutoff switch 21) is provided between the analog signal generation unit (the PTAT current generation unit 20) and the A/D conversion unit 23 (15a and 15b).
Thus, it is possible to perform the cutting reliably before the PTAT current Ip output from the PTAT current generation unit 20 is supplied to the A/D conversion unit 23.
In the imaging device 1 according to the embodiment, the pixels (the unit pixels 11) generate the image data which is an analog signal and the A/D conversion unit 15a (15b) performs the A/D conversion on the image data.
Thus, since the circuit configuration of the entire imaging device 1 can be simplified, it is possible to reduce cost of the imaging device 1.
The imaging device 1 according to the embodiment further includes the correction unit 24 that corrects the digital signal (the temperature data).
Thus, in each imaging device 1, it is possible to output highly accurate temperature data in which a manufacturing variation or the like is corrected.
In the imaging device 1 according to the embodiment, the correction unit 24 calculates the parameter 26 of the correction calculation expression E for correcting the digital signal (the temperature data) based on a first digital signal (the temperature data Do) and a second digital signal (the temperature data DN). The first digital signal (the temperature data Do) is generated by performing the A/D conversion on the analog signal (the PTAT current Ip) cut off by the switch (the cutoff switch 21). The second digital signal (the temperature data DN) is generated by performing the A/D conversion on the analog signal (the PTAT current Ip) generated by the analog signal generation unit (the PTAT current generation unit 20).
Thus, it is possible to improve the accuracy of the calibration without an increase in the number of test temperatures at which the calibration is performed.
In the imaging device 1 according to the embodiment, the plurality of A/D conversion units 15a, 15b, and the like are provided. The correction unit 24 calculates the parameter 26 of the correction calculation expression E based on the first digital signal (the temperature data Do) and the second digital signal (the temperature data DN) each converted by the plurality of A/D conversion units 15a, 15b, and the like.
Thus, it is possible to further improve the accuracy of the calibration without an increase in the number of test temperatures at which the calibration is performed.
In the imaging device 1 according to the embodiment, the correction unit 24 corrects the digital signal (the temperature data) based on a measurement value of the power voltage Vdd.
Thus, it is possible to output the temperature data with higher accuracy.
In the imaging device 1 according to the embodiment, the analog signal (the PTAT current Ip) is a current value.
Thus, it is possible to generate the analog signal proportional to absolute temperature using the PTAT current generation unit 20.
A calibration method according to the embodiment includes a signal cutting step, a first A/D conversion step, an analog signal outputting step, a second A/D conversion step, and a calculation step. In the signal cutting step (step S101), the analog signal (the PTAT current Ip) generated based on a temperature is cut off. In the first A/D conversion step (step S102), the cutoff analog signal (the PTAT current Ip) is converted into the first digital signal (the temperature data Do). In the analog signal outputting step (step S104), the analog signal (the PTAT current Ip) is output.
In the second A/D conversion step (step S108), the analog signal (the PTAT current Ip) is converted into the second digital signal (the temperature data DN). In the calculation step (step S111), the parameter 26 of the correction calculation expression E for correcting the digital signal (the temperature data) converted from the analog signal (the PTAT current Ip) generated based on the temperature around the pixel array unit 10 through the A/D conversion is calculated. In the calculation step (step S111), the parameter 26 of the correction calculation expression E is calculated based on the first digital signal (the temperature data Do) and the second digital signal (the temperature data DN).
Thus, it is possible to improve the accuracy of the calibration without an increase in the number of test temperatures at which the calibration is performed.
[Application Example to Moving Body]
The technology of the present disclosure (the present technology) can be applied in various products. For example, the technology of the present disclosure may be realized as a device mounted on any type of moving body such as an automobile, an electric automobile, a hybrid electric automobile, a motorcycle, a bicycle, a personal mobility, an airplane, a drone, a ship, and a robot.
A vehicle control system 12000 includes a plurality of electronic control units connected via a communication network 12001. In the example illustrated in
The driving system control unit 12010 controls an operation of a device related to a driving system of a vehicle in accordance with various programs. For example, the driving system control unit 12010 functions as a control device such as a driving force generation device that generates a driving force of a vehicle, such as an internal combustion engine or a driving motor, a driving force transmission mechanism that transmits a driving force to wheels, a steering mechanism that adjusts a rudder angle of the vehicle, and a braking device that generates a braking force of the vehicle.
The body system control unit 12020 controls operations of various devices equipped in a vehicle body in accordance with various programs. For example, the body system control unit 12020 functions as a keyless entry system, a smart key system, a power window device, or a control device of various lamps such as a head lamp, a back lamp, a brake lamp, a turn signal, and a fog lamp. In this case, radio waves transmitted from a portable device with which a key is substituted or signals of various switches may be input to the body system control unit 12020. The body system control unit 12020 receives an input of the radio waves or the signals and controls a door locking device, a power window device, lamps, and the like of the vehicle.
The vehicle exterior information detection unit 12030 detects external information of the vehicle on which the vehicle control system 12000 is mounted. For example, the imaging unit 12031 is connected to the vehicle exterior information detection unit 12030. The vehicle exterior information detection unit 12030 causes the imaging unit 12031 to capture vehicle exterior images and receives the captured images. Based on the received images, the vehicle exterior information detection unit 12030 may perform an object detection process or a distance detection process for people, vehicles, obstacles, signs, letters on road surfaces, and the like.
The imaging unit 12031 is an optical sensor that receives light and outputs an electric signal in accordance with an amount of received light. The imaging unit 12031 can output the electric signal as an image or can also output the electric signal as distance measurement information. The light received by the imaging unit 12031 may be visible light or may be invisible light such as infrared light.
The vehicle interior information detection unit 12040 detects vehicle interior information. For example, a driver state detection unit 12041 that detects a driver state is connected to the vehicle interior information detection unit 12040. The driver state detection unit 12041 includes, for example, a camera that images a driver. Based on detection information input from the driver state detection unit 12041, the vehicle interior information detection unit 12040 may calculate a fatigue degree or a concentration degree of the driver or may determine whether the driver is dozing.
The microcomputer 12051 can calculate a control target value of the driving force generation device, the steering mechanism, or the braking device based on information regarding the vehicle exterior and interior acquired by the vehicle exterior information detection unit 12030 or the vehicle interior information detection unit 12040, and can output a control instruction to the driving system control unit 12010. For example, the microcomputer 12051 can perform coordinated control for realizing an ADAS (Advanced Driver Assistance System) function including vehicle collision avoidance, shock alleviation, following travel based on an inter-vehicle distance, vehicle speed maintenance travel, a vehicle collision warning, or a vehicle lane deviation warning.
The microcomputer 12051 can perform coordinated control for automated driving or the like in which autonomous travel is performed without an operation of a driver by controlling the driving force generation device, the steering mechanism, the braking device, and the like based on information regarding the vicinity of the vehicle acquired by the vehicle exterior information detection unit 12030 or the vehicle interior information detection unit 12040.
The microcomputer 12051 can output a control instruction to the body system control unit 12020 based on information regarding the vehicle exterior acquired by the vehicle exterior information detection unit 12030. For example, the microcomputer 12051 can perform coordinated control for achieving antidazzle such as switching of a high beam to a low beam by controlling the head lamp in accordance with a position of a front vehicle or an oncoming vehicle detected by the vehicle exterior information detection unit 12030.
The sound and image output unit 12052 transmits an output signal of at least one of a sound and an image to an output device capable of notifying an occupant of the vehicle or the vehicle exterior of information visually or auditorily. In the example of
In
The imaging units 12101, 12102, 12103, 12104, and 12105 are provided, for example, at positions such as a front nose, side mirrors, a rear bumper, a backdoor, and an upper portion of a front glass of the vehicle interior of the vehicle 12100. The imaging unit 12101 provided in the front nose and the imaging unit 12105 provided in the upper portion of the front glass inside the vehicle mainly acquire images on the front side of the vehicle 12100. The imaging units 12102 and 12103 provided in the side mirrors mainly acquire images on the lateral sides of the vehicle 12100. The imaging unit 12104 provided in the rear bumper or the backdoor mainly acquires images on the rear side of the vehicle 12100. The imaging unit 12105 included in the upper portion of the front glass inside the vehicle is mainly used to detect front vehicles or pedestrians, obstacles, traffic signals, traffic signs, lanes, and the like.
At least one of the imaging units 12101 to 12104 may have a function of acquiring distance information. For example, at least one of the imaging units 12101 to 12104 may be a stereo camera including a plurality of imaging elements or may be an imaging element that has pixels for phase difference detection.
For example, the microcomputer 12051 can extract a 3-dimensional object traveling at a predetermined speed (for example, 0 km/h or more) in substantially the same direction as that of the vehicle 12100 which is particularly a closest 3-dimensional object on a travel road of the vehicle 12100 as a front vehicle by obtaining a distance from each 3-dimensional object within the imaging ranges 12111 to 12114 and a temporal change of the distance (a relative speed to the vehicle 12100) based on the distance information obtained from the imaging units 12101 to 12104. Further, the microcomputer 12051 can set an inter-vehicle distance which is guaranteed in advance before a front vehicle and perform automated brake control (also including following stop control) or automated acceleration control (also including following start control). In this way, it is possible to perform the coordinated control for automated driving or the like in which autonomous travel is performed without an operation of a driver.
For example, the microcomputer 12051 can classify and extract 3-dimensional object data regarding 3-dimensional objects into motorcycles, normal vehicles, large vehicles, pedestrians, electric poles, and the like into other 3-dimensional objects based on the distance information obtained from the imaging units 12101 to 12104, and can use the 3-dimensional objects for automatic avoidance of obstacles. For example, the microcomputer 12051 identifies obstacles around the vehicle 12100 as obstacles which can be recognized by the driver of the vehicle 12100 and obstacles which it is difficult to recognize. Then, the microcomputer 12051 determines a collision risk indicating a risk of collision with each obstacle. In a situation in which there is a possibility of collision at which the collision risk is equal to or greater than a set value, driving support for collision avoidance can be performed by outputting a warning to the driver via the audio speaker 12061 or the display unit 12062 or performing forced deceleration or avoidance steering via the driving system control unit 12010.
At least one of the imaging units 12101 to 12104 may be an infrared camera that detects infrared light. For example, the microcomputer 12051 can recognize pedestrians by determining whether there are the pedestrians in images captured by the imaging units 12101 to 12104. The pedestrians are recognized, for example, in an order in which feature points in the images captured by the imaging units 12101 to 12104 serving as infrared cameras are extracted and an order in which a pattern matching process is performed on a series of feature points indicating the contour of an object to determine whether there is a pedestrian. When the microcomputer 12051 determines that there is the pedestrian in the images captured by the imaging units 12101 to 12104 and recognizes the pedestrian, the sound and image output unit 12052 controls the display unit 12062 such that a rectangular contour line for emphasizing the recognized pedestrian is superimposed and displayed. The sound and image output unit 12052 may control the display unit 12062 such that an icon or the like indicating the pedestrian is displayed at a desired position.
The example of the vehicle control system to which the technology according to the present disclosure is applied has been described above. The technology of the present disclosure can be applied to the imaging unit 12031 and the like in the above-described configuration. Specifically, the imaging device 1 in
The advantageous effects described in the present specification are merely exemplary and are not limited, and other advantageous effects may be obtained.
The present technology can be configured as follows.
(1) An imaging device including:
a pixel array unit including pixels;
an analog signal generation unit configured to generate an analog signal based on a temperature around the pixel array unit;
an A/D conversion unit configured to convert the analog signal into a digital signal; and
a switch configured to cut off the analog signal to be supplied to the A/D conversion unit.
(2)
The imaging device according to (1), wherein the switch is provided between the analog signal generation unit and the A/D conversion unit.
(3)
The imaging device according to (1) or (2), wherein
the pixel generates image data which is an analog signal, and
the A/D conversion unit performs A/D conversion on the image data.
(4)
The imaging device according to any one of (1) to (3), further including a correction unit configured to correct the digital signal.
(5)
The imaging device according to (4), wherein the correction unit calculates a parameter of a correction calculation expression for correcting the digital signal based on a first digital signal obtained through A/D conversion from the analog signal cut off by the switch and a second digital signal obtained through A/D conversion from the analog signal generated by the analog signal generation unit.
(6)
The imaging device according to (5), wherein
a plurality of the A/D conversion units are provided, and
the correction unit calculates the parameter of the correction calculation expression based on the first and second digital signals each converted by the plurality of A/D conversion units.
(7)
The imaging device according to any one of (4) to (6), further including the correction unit corrects the digital signal based on a measurement value of a power voltage.
(8)
The imaging device according to any one of (1) to (7), further including the analog signal is a current value.
(9)
A calibration method including:
a signal cutting step of cutting off an analog signal generated based on a temperature;
a first A/D conversion step of converting the cutoff analog signal into a first digital signal;
an analog signal outputting step of outputting the analog signal;
a second A/D conversion step of converting the analog signal into a second digital signal; and
a calculation step of calculating a parameter of a correction calculation expression for correcting a digital signal obtained through A/D conversion from an analog signal generated based on a temperature around a pixel array unit, based on the first and second digital signals.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2019-002937 | Jan 2019 | JP | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/JP2019/048063 | 12/9/2019 | WO | 00 |
