1. Field of the Invention
The present invention relates to a solid-state image sensor and an electronic device including the same.
2. Description of the Related Art
There has recently been devised a device such as an image sensor in which an analog signal processing unit and a digital signal processing unit including a logic, a memory, and the like are embedded in one chip. For example, an analog signal processing unit and a digital signal processing unit are formed in different semiconductor layers and stacked in the wafer level or chip level, thereby forming a one-chip device without loss of integration in each layer.
Blocks 91, 92, 93, and 94 shown in
The first semiconductor layer 90 and the second semiconductor layer 96 shown in
To connect signals of different semiconductor layers, a stable common potential (ground: to be referred to as GND hereinafter) needs to be set. However, the impedance between GNDs cannot be neglected in local GND connection. For this reason, a potential is formed between the GNDs of the layers and dynamically fluctuates in every operation wherein a current flows.
When a synchronization circuit design that operates based on a specific clock is employed on the digital layer side, the state of a status holding element (flip-flop circuit: to be referred to as an FF element hereinafter) is switched in synchronism with each edge (leading/trailing) of the clock. Hence, an enormous number of FF elements simultaneously consume the current. A current to be consumed by a combination logic (a combination circuit formed from an AND element/OR element and the like) connected to the output of the FF element also flows at the same timing.
The current consumption at the same timing on the digital layer side raises the potential of the digital-side GND and affects as an apparent power supply fluctuation. As a result, when A/D-converting a signal potential from the above-described stacked analog signal processing unit and acquiring a digital signal, the acquired potential of the analog signal or a reference potential used by the A/D converter fluctuates. This finally leads to periodic noise caused by digital signal processing and degrades image quality.
The present invention has been made in consideration of the above-described problems, and suppress image quality degradation caused by noise in an image sensor constructed by stacking an analog signal processing unit and a digital signal processing unit.
According to the first aspect of the present invention, there is provided a stacked-type solid-state image sensor including a first semiconductor layer in which an imaging pixel portion including a plurality of pixels arranged in a matrix is implemented, and a second semiconductor layer in which a digital signal processing unit is implemented, comprising: a first timing control unit configured to generate a drive timing signal of the imaging pixel portion; an A/D converter configured to convert an analog signal output from each pixel of the imaging pixel portion into a digital signal; a second timing control unit configured to generate a drive timing signal of the A/D converter; and a status generation unit configured to receive an event signal generated by at least one of the first timing control unit and the second timing control unit and generate a status signal to restrict an operation of the digital signal processing unit.
According to the second aspect of the present invention, there is provided a method of controlling a stacked-type solid-state image sensor including a first semiconductor layer in which an imaging pixel portion including a plurality of pixels arranged in a matrix is implemented, and a second semiconductor layer in which a digital signal processing unit is implemented, comprising: a first timing control step of generating a drive timing signal of the imaging pixel portion; an A/D conversion step of converting an analog signal output from each pixel of the imaging pixel portion into a digital signal; a second timing control step of generating a drive timing signal in the A/D conversion step; and a status generation step of receiving an event signal generated in at least one of the first timing control step and the second timing control step and generating a status signal to restrict an operation of the digital signal processing unit.
Further features of the present invention will become apparent from the following description of exemplary embodiments with reference to the attached drawings.
The embodiments of the present invention will now be described in detail with reference to the accompanying drawings.
This embodiment is directed to the structure of a solid-state image sensor. An semiconductor element that implements the image sensor according to this embodiment has a stacked structure of a first semiconductor layer in which an analog signal processing unit such as an imaging pixel portion is implemented and a second semiconductor layer in which a digital signal processing unit is implemented.
Referring to
In addition to the digital signal processing unit 114, a drive control unit 111, an A/D conversion unit 112, a clock supply unit 113, a clock generation unit 115, a drive control unit 116, a buffer 117, and a driver element 118 are implemented in the second semiconductor layer 11. The A/D conversion unit 112 converts an analog signal output from each pixel of the imaging pixel portion 101 into a digital signal. The drive control unit 111 drives the A/D conversion unit 112. Note that the A/D conversion unit 112 is provided in correspondence with each column of the imaging pixel portion 101.
The digital signal processing unit 114 includes a logic circuit and an SRAM that are characteristic parts in the second semiconductor layer. Examples of the logic in the image sensor are correction (shading correction, defective pixel correction, and the like) of errors caused by the imaging pixel portion 101, processing of a digital signal as image information, and I/F processing of transferring data to the device of the subsequent stage as a system using the image sensor. However, the processes are not concerned with the characteristic parts of this embodiment, and a detailed description thereof will be omitted. The second semiconductor layer 11 is also provided with the buffer 117 used to adjust the timing of transfer data as part of I/F processing of transferring data to the device of the subsequent stage, and the driver element 118 assigned a physical layer. They are not characteristic components, and a description thereof will be omitted.
The digital signal processing unit 114 shown in
A clock as the base of the clock supply unit 113 is supplied from the clock generation unit 115. The clock generation unit 115 obtains a desired frequency by multiplying/dividing a master clock via an oscillation unit. In many cases, a PLL (Phase Locked Loop) circuit is used to adjust the phase. The clock generation unit 115 supplies the clock to the digital signal processing unit 114 via the clock supply unit 113. The clock generation unit 115 also supplies the clock to the drive control unit 102 (timing control unit) that controls a drive timing signal, the drive control unit 111 of the A/D conversion unit 112, and the drive control unit 116 of the buffer 117. The clock rate is adjusted to a frequency suitable to each process by the multiplication/division processing of the clock generation unit 115.
A transfer transistor 32 serves as a transfer gate that transfers the charges accumulated in the PD 31 to the FD unit 34, and is controlled by the transfer signal sig_301. A reset transistor 33 is a transistor configured to reset the PD 31 and the FD unit 34, and is controlled by the reset signal sig_302. An amplification transistor 35 is an amplifier that amplifies a signal. A select transistor 36 serving as a signal readout unit outputs the signal amplified by the amplification transistor 35 as a signal sig_304 of a vertical signal line. The select transistor 36 is controlled by the selection signal sig_303.
In this embodiment, the semiconductor element of the image sensor is defined as a stacked type. Considering that the signal sig_304 is transferred for A/D conversion from the first layer that performs analog signal processing to the second layer that performs digital signal processing, the operation on the digital signal processing side is suppressed during the fluctuation period of the signal sig_304, thereby suppressing periodic noise.
In this embodiment, a clock gating status signal sig_603 is generated so as to mask the clock edges of the clock signal of the digital signal processing unit intermittently or during a predetermined period before and after the potential fluctuation of the output signal sig_304 before and after the reset signal sig_302 and the transfer signal sig_301 in the selected state of the selection signal sig_303.
A signal sig_601 in
The drive control unit 102 shown in
When a signal obtained by inverting the logic of the status signal sig_603 in
The system is designed such that the clock frequency of the digital signal processing unit 114 becomes much higher than the clock signal for operation control of the drive control unit 102 of the imaging pixel portion 101. This can avoid a failure in system establishment caused by insertion of the clock masking period in the digital signal processing unit 114.
In the first embodiment, operation control (clock masking processing) of the digital signal processing unit resulting from the operations of imaging pixel portion drive signals (signals sig_301, sig_302, and sig_303 shown in
Each of the unit pixels 30 outputs the signal from a select transistor 36 to a vertical signal line (corresponding to a signal sig_304). In this embodiment, the signal sig_304 (and the vertical signal lines in the horizontal direction) is transferred at the boundary between the first semiconductor layer 10 in which the imaging pixel portion 101 is implemented and a second semiconductor layer 11 in which a digital signal processing unit is implemented.
In the first semiconductor layer 10 shown in
In this embodiment, the A/D conversion unit 112 shown in
A comparator 41 compares the analog signal sig_304 with the reference signal sig_401. For example, if the potential of the analog signal sig_304 is higher than that of the reference signal sig_401, the comparator 41 outputs a high state. A counter 42 executes a count operation in the up (or down) direction during clock input. A differential circuit 43 extracts a change in the signal output from the comparator 41. An AND element 44 masks the output from the differential circuit 43 by a status. A register 45 stores/holds the value of the counter 42 in accordance with the event of the output of the differential circuit 43 masked by the AND element 44.
Referring to
Referring to
The reset signal sig_404 initializes the count value of the counter 42 to 0. The count direction status signal sig_403 changes to the low state when counting the state of a potential VRST after a reset transistor 33 is turned on, and changes to the high state when counting the state of a potential (VRST+VSIG) after a transfer transistor 32 is turned on. The counter 42 is decremented in the low state of the count direction status signal sig_403 and incremented in the high state.
Referring to
Upon receiving the processing status from the reference generation control unit 1113, the reference generation count unit 1112 outputs, to the A/D converters 40, the count clock signal sig_402 of the counter 42 during VRST count period and the (VRST+VSIG) count period. The reference generation count unit 1112 also includes a counter (not shown) that executes lamp down count in synchronism with the event of the count clock signal sig_402.
The count clock signal sig_402 is sent during a period in which the counter 42 can sufficiently perform count and comparison of the pixel output signal sig_304 and the reference signal sig_401 during the VRST count period and the (VRST+VSIG) count period. For example, if the target A/D conversion has a size of 12 bits, a count range of 4,096 is necessary. However, the period can be shortened because the full range is not necessary for the VRST count period.
The reference signal output unit 1111 shown in
The control signal generation unit 1114 shown in
After sending the reset signal sig_404, the control signal generation unit 1114 sends the lamp status signal sig_704 to the reference generation control unit 1113 as an event signal to request the start of the A/D conversion operation. Upon receiving the lamp status signal, the reference generation control unit 1113 starts control to perform the A/D conversion operation of the potential VRST in the signal sig_304 (or a vertical signal line at an arbitrary horizontal position equivalent to the signal sig_304). The operation control period in which the A/D conversion operation of the potential VRST is performed is defined as step S0.
During the period of step S0, the reference generation count unit 1112 shown in
During the period of step S0, the counter 42 in the A/D converter 40 counts down from the initial value. When a comparison output signal sig_406 of the comparator 41 in the A/D converter 40 is inverted, the differential circuit 43 sends an event signal to the counter 42, thereby stopping the down-count operation. After completion of sending of the count clock signal sig_402 during a predetermined period (the reset operation period of the image sensor and the reference scan period determined by the resolution of the A/D converter) and lamp level transition of the reference signal sig_401, the reference generation count unit 1112 maintains the stop states of the reference signal sig_401 and the count clock signal sig_402.
Upon receiving the transfer signal sig_301 from the drive control unit 102 shown in
During the period of step S1, the reference generation count unit 1112 sends the count clock signal sig_402 to the A/D converters 40 as in step S0. At the same time, an operation of decrementing (or incrementing in reverse use) the lamp level is performed during the progress period of the count clock signal sig_402. The sending period of the count clock signal sig_402 at this time needs to cover the full range of the resolution of the A/D converter, unlike step S0.
During the period of step S1, the counter 42 in the A/D converter 40 counts up from the count state stopped in step S0, and finally obtains a count value corresponding to the value of the potential (VRST+VSIG). In this case as well, when the state of the comparison output signal sig_406 of the comparator 41 in the A/D converter 40 is inverted, the differential circuit 43 sends an event signal to the counter 42, thereby stopping the up-count operation. After completion of sending of the count clock signal sig_402 during a predetermined period and lamp level transition of the reference signal sig_401, the reference generation count unit 1112 maintains the stop states of the reference signal sig_401 and the count clock signal sig_402, as in the period of step S0.
During the operation period of step S1, an AND logic between the event signal of the differential circuit 43 and the state of the count direction status signal sig_403 holds, and the register 45 holds the current value of the counter 42 as the count value corresponding to the final value of the potential (VRST+VSIG). The register holding value is transferred to a digital signal processing unit 114 shown in
According to this embodiment, in step S0, the event of the event signal sig_701 shown in
When a signal obtained by inverting the logic of the status signal sig_703 in
The system is designed such that the clock frequency of the digital signal processing unit 114 becomes much higher than the count clock signal sig_402 to the A/D converter 40. This can avoid a failure in system establishment caused by insertion of the clock masking period in the digital signal processing unit 114. However, if the clock stop period (for example, the period in which the signal sig_703 shown in
Referring to
Referring to
The control unit 2109 includes a CPU, memory, and the like, and controls the units of the portable telephone 2100 in accordance with a control program stored in the memory (not shown). An operation unit 2110 includes a power button, number keys, and various operation keys used by the user to input data. A card IF 2111 records/reproduces various kinds of data in/from a memory card 2112. An external IF 2113 transmits data stored in the nonvolatile memory 2108 or the memory card 2112 to an external device, and receives data transmitted from the external device. The external IF 2113 performs communication by a known communication method such as a wired communication method such as USB or wireless communication.
The speech communication function of the portable telephone 2100 will be described next. To call the communication partner, the user inputs the number of the communication partner by operating the number keys of the operation unit 2110 or causes the display unit 2107 to display the address book stored in the nonvolatile memory 2108, selects the communication partner, and instructs a call. When a call is instructed, the control unit 2109 causes the communication unit 2101 to call the communication partner. When the communication partner receives the call, the communication unit 2101 outputs the speech data of the partner to the speech processing unit 2102 and also transmits the speech data of the user to the partner.
To transmit email, the user instructs mail creation using the operation unit 2110. When instructed to create mail, the control unit 2109 displays a screen for mail creation on the display unit 2107. The user inputs a transmission destination address and a text using the operation unit 2110 and instructs transmission. When instructed to transmit the mail, the control unit 2109 sends the address information and the data of the mail text to the communication unit 2101. The communication unit 2101 converts the mail data into a format suitable for communication and sends it to the transmission destination. Upon receiving email, the communication unit 2101 converts the data of the received mail into a format suitable for display and displays it on the display unit 2107.
The shooting function of the portable telephone 2100 will be described next. When the user sets the shooting mode by operating the operation unit 2110 and instructs to shoot a still image or moving image, the imaging unit 2105 shoots still image data or moving image data and sends it to the image processing unit 2106. The image processing unit 2106 processes the shot still image data or moving image data and stores it in the nonvolatile memory 2108. The image processing unit 2106 also sends the shot still image data or moving image data to the card IF 2111. The card IF 2111 stores the still image data or moving image data in the memory card 2112.
The portable telephone 2100 can transmit a file including the thus shot still image or moving image data as an attached file of email. More specifically, when transmitting email, the user selects an image file stored in the nonvolatile memory 2108 or the memory card 2112 and instructs to transmit it as an attached file.
The portable telephone 2100 can also transmit a file including shot still image or moving image data to an external device such as a PC or another telephone via the external IF 2113. By operating the operation unit 2110, the user selects an image file stored in the nonvolatile memory 2108 or the memory card 2112 and instructs to transmit it. The control unit 2109 controls the external IF 2113 so as to read out the selected image file from the nonvolatile memory 2108 or the memory card 2112 and transmit it to an external device.
Embodiment(s) of the present invention can also be realized by a computer of a system or apparatus that reads out and executes computer executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be referred to more fully as a ‘non-transitory computer-readable storage medium’) to perform the functions of one or more of the above-described embodiment(s) and/or that includes one or more circuits (e.g., application specific integrated circuit (ASIC)) for performing the functions of one or more of the above-described embodiment(s), and by a method performed by the computer of the system or apparatus by, for example, reading out and executing the computer executable instructions from the storage medium to perform the functions of one or more of the above-described embodiment(s) and/or controlling the one or more circuits to perform the functions of one or more of the above-described embodiment(s). The computer may comprise one or more processors (e.g., central processing unit (CPU), micro processing unit (MPU)) and may include a network of separate computers or separate processors to read out and execute the computer executable instructions. The computer executable instructions may be provided to the computer, for example, from a network or the storage medium. The storage medium may include, for example, one or more of a hard disk, a random-access memory (RAM), a read only memory (ROM), a storage of distributed computing systems, an optical disk (such as a compact disc (CD), digital versatile disc (DVD), or Blu-ray Disc (BD)™), a flash memory device, a memory card, and the like.
While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.
This application claims the benefit of Japanese Patent Application No. 2014-081439, filed Apr. 10, 2014 which is hereby incorporated by reference herein in its entirety.
Number | Date | Country | Kind |
---|---|---|---|
2014-081439 | Apr 2014 | JP | national |