This application claims priority from Korean Patent Application No. 10-2016-0154951, filed on Nov. 21, 2016 in the Korean Intellectual Property Office, the disclosure of which is incorporated herein by reference in its entirety.
Example embodiments of the inventive concept relate to an event-based sensor comprising a power control circuit.
Human-computer interaction (HCI) between humans and computers is undertaken using user interfaces. Various types of user interfaces, recognizing user input, can provide natural interactions between humans and computers. To recognize a user input, various types of sensor may be used. To provide natural interactions, sensors that respond quickly to the user input are required. In addition, in the case of various types of mobile devices, there is a need for consuming low amounts of power while performing many smart functions through user interfaces. Accordingly, sensors, having low power consumption, fast response rates, and improved reliability suitable for sensing purposes are required.
According to an aspect of an example embodiment, there is provided an event-based sensor which may include: a pixel array having a plurality of pixels, and configured to output an activation signal in response to sensing an input to the pixel array; and a controller configured to output a control signal for supplying power selectively to the pixels based on the activation signal or a user input so that a portion of the pixels is powered on while another portion of the pixels is powered off.
According to an aspect of an example embodiment, there is provided an event-based sensor which may include: a pixel circuit configured to output an activation signal in response to sensing an input to the pixel circuit; and a power control circuit to supply or interrupt power to the pixel circuit based on a control signal input to the power control circuit.
According to an aspect of an example embodiment, there is provided an event-based sensor which may include: a pixel array having a plurality of pixels each of which is configured to sense an input and output an activation signal in response to the input; and a controller configured to output a control signal to control selective power supply to the pixels by pixel according to an operating mode determined based on characteristics of the activation signal or a user input.
The above, and other aspects, features, and advantages of the example embodiments will be more clearly understood from the following detailed description when taken in conjunction with the accompanying drawings, in which:
Example embodiments will hereinafter be described in detail, with reference to the attached drawings. The same reference numerals in the drawings denote identical elements.
The controller 111 may include a signal processor 112 and a control block 113. As illustrated in
The control block 113 may output a first control signal, supplying or interrupting power to at least a portion of the pixels included in the pixel array 115. Each of the pixels of the pixel array 115 may include a pixel circuit, sensing a change in the intensity of light. The pixel circuit may continuously consume current, in order to sense a change in the intensity of light. The control block 113 may reduce power consumption of the pixel array 115 by supplying power to necessary pixels or interrupting power to unnecessary pixels, using the first control signal.
The event-based sensor 110 may operate in different operating modes, depending on circumstances or a system design. Although described in detail below, the operating modes of the event-based sensor 110 may include a sub-sampling mode, a region of interest mode, a region blocking mode, a region monitoring mode, and a random access mode. The sub-sampling mode may authorize sensing at a sensing resolution lower than a maximum sensing resolution of the event-based sensor 110. The region of interest mode may authorize sensing within a region of interest. The region blocking mode may block sensing within a blocking region. The region monitoring mode may authorize sub-sampling within a monitoring region. The random access mode may authorize or block sensing in pixel units through random access.
Although not illustrated in the drawings, according to an example embodiment, an internal or external processor of the event-based sensor 110 may set an operating mode of the event-based sensor 110, based on the event signal output by the signal processor 112. For example, when the dynamic input is not sensed by the event-based sensor 110 or an event signal is not output by the signal processor 112 during a predetermined time interval after the event-based sensor 110 is powered on, the internal or external processor may set the operating mode of the event-based sensor 110 to the sub-sampling mode to reduce a sensing resolution of the pixel array 115, thus lowering power consumption of the event-based sensor 110.
A first control signal may include a row control signal EN_Y[i], controlling a row of a pixel array 220, and a column control signal EN_X[j], controlling a column of the pixel array 220. The row control block 211 may output the row control signal EN_Y[i] to pixels of the pixel array 220 through a control line in a horizontal direction, and the column control block 212 may output the column control signal EN_X[j] to the pixels of the pixel array 220 through a control line in a vertical direction. Here, i represents a row of the pixels, and j represents a column of the pixels.
The pixel array 220 may include an m×n number of pixels. The control block 210 may output the first control signal, supplying or interrupting power to at least a portion of the pixels of the pixel array 220. For example, the control block 210 may output a row control signal EN_Y[0] and a column control signal EN_X[0] corresponding to a digital signal (hereinafter, referred to as ‘digital high’), being in a high state, in order to supply power to a pixel 221. As mentioned above, the control block 210 may output the first control signal, based on an operating mode of an event-based sensor.
Each of the pixels of the pixel array 220 may include a pixel circuit, outputting an activation signal, in response to a dynamic input. For example, the pixel circuit may output the activation signal when a change in the intensity of light incident on the pixel array 220 exceeds a predetermined threshold value.
The pixel circuit may consume power to sense the dynamic input. The pixels of the pixel array 220 may supply or interrupt power to a corresponding pixel circuit, based on the first control signal. For example, upon receiving the row control signal EN_Y[0] and the column control signal EN_X[0] corresponding to digital high, the pixel 221 may supply power to the pixel circuit thereof. Conversely, upon receiving the row control signal EN_Y[i] and the column control signal EN_X[j] corresponding to a digital signal (hereinafter, ‘digital low’), being in a low state, the pixels, except for the pixels 221, may interrupt power to the pixel circuit.
Each of the pixels of the pixel array 220 may include a power control circuit, controlling power supplied to the pixel circuit. The power control circuit may include at least one of a logic gate element, a memory cell, or a transistor. As illustrated in
The power control circuit 310 may receive a first control signal from the control block 210. The first control signal may include a row control signal EN_Y and a column control signal EN_X. The power control circuit 310 may connect the power device 330 to the pixel circuit 320 or disconnect the power device 330 from the pixel circuit 320, based on the first control signal. The power device 330 may supply power to the pixel circuit 320, depending on a connection between the power device 330 and the pixel circuit 320. The pixel circuit 320 may sense a dynamic input, using power supplied by the power device 330, and may output an activation signal. The power control circuit 310 may have various structures for controlling the connection between the power device 330 and the pixel circuit 320.
The power control circuit 410 may include a logic gate circuit 411 and a switch 412. As illustrated in
The logic gate circuit 411 may output a second control signal, corresponding to a result of a logic operation, based on the first control signal. The logic gate circuit 411 may perform the logic operation, based on the first control signal, and may output the second control signal, according to the result of the logic operation. For example, when the row control signal EN_Y and the column control signal EN_X correspond to digital high, the AND gate of the logic gate circuit 411 may output the second control signal, corresponding to digital high. Alternatively, when at least one of the row control signal EN_Y and the column control signal EN_X corresponds to digital low, the AND gate of the logic gate circuit 411 may output the second control signal, corresponding to digital low. When the logic gate circuit 411 includes a logic gate of a different type from that of the AND gate, the logic gate circuit 411 may output the second control signal, according to a logic operation of the logic gate.
The switch 412 may open or close a connection between a power device 430 and the pixel circuit 420, based on the second control signal. For example, the switch 412 may close the connection between the power device 430 and the pixel circuit 420, based on the second control signal, corresponding to digital high, and may open the connection between the power device 430 and the pixel circuit 420, based on the second control signal, corresponding to digital low. Depending on operations of the switch 412, power supplied by the power device 430 may be supplied or interrupted to the pixel circuit 420. As illustrated in
When generating a second control signal using a logic gate circuit, pixels disposed in the same row or column may interfere with each other. For example, it may be assumed that the pixels generate the second control signal, using an AND gate. A control block may output a row control signal EN_Y[0-1] and a column control signal EN_X[0-1], corresponding to digital high, in order to supply power to a pixel P[1,1] disposed in a first row and a first column of the pixels and a pixel P[2,2] disposed in a second row and a second column of the pixels. Here, according to the row control signal EN_Y[0-1] and the column control signal EN_X[0-1], power may be supplied to a pixel P[1,2] disposed in the first row and the second column of the pixels, and a pixel P[2,1] disposed in the second row and the first column of the pixels, as well as to the pixels P[1,1] and P[2,2]. When a memory cell 511 is used, interference between such pixels may be removed.
The power control circuit 510 may include a memory cell 511 and a switch 512. The memory cell 511 may be a static random access memory (SRAM). A row control signal EN_Y and a column control signal EN_X may be used as a word line signal and a bit line signal in the memory cell 511, respectively. The memory cell 511 may store data, based on a first control signal. For example, the memory cell 511 may store data, corresponding to digital high, in the memory cell 511, according to an address, indicated by the row control signal EN_Y and the column control signal EN_X, corresponding to an address of the memory cell 511. Although not illustrated in the drawings, a data line for storing data may be connected to the memory cell 511. The memory cell 511 may output stored data to the switch 512. As the second control signal, the data output by the memory cell 511 may be provided to the switch 512.
The switch 512 may open or close a connection between the power device 530 and the pixel circuit 520, based on the data stored in the memory cell 511. For example, the switch 512 may close the connection between the power device 530 and the pixel circuit 520, based on the second control signal, corresponding to digital high, and may open the connection between the power device 530 and the pixel circuit 520, based on the second control signal, corresponding to digital low. Depending on operations of the switch 512, power supplied by the power device 530 may be supplied or interrupted to the pixel circuit 520. As illustrated in
As illustrated in
The power control circuit 610 may include a transistor 611 and a transistor 612. The transistors 611 and 612 may be p-type metal-oxide-semiconductor (PMOS) transistors. The transistor 611 may receive an inverted signal
Although not illustrated in the drawings, two n-type metal-oxide-semiconductor (NMOS) transistors may be connected in series between the pixel circuit 620 and a ground 640, instead of the transistors 611 and 612. Here, the column control signal EN_X and the row control signal EN_Y may not be inverted.
Referring to
As an example, a control block of an event-based sensor may output the row control signal EN_Y and the column control signal EN_X, corresponding to digital high, in order to supply power to the pixel circuit 620. Here, the inverted signals
As another example, the control block of the event-based sensor may output the row control signal EN_Y and the column control signal EN_X, corresponding to digital low, in order to block power supplied to the pixel circuit 620. Here, the inverted signal
As described above, the power control circuit 610, including two transistors, according to the example embodiment of
When digital high is input to gates (G1 and G2) of the transistors 711 and 712, drains (D1 and D2) of the transistors 711 and 712 may be floating. The floating of the drain (D2) may cause a malfunction in which power to the pixel circuit 730 is not interrupted at an appropriate point in time. By preventing the drain (D2) from floating, the pull down transistors 721 and 722 may avoid such a malfunction.
The pull down transistors 721 and 722 may be NMOS transistors. Referring to
Thus, according to operations of the pull down transistors 721 and 722, a malfunction that may occur due to floating of the drain (D2) may be prevented.
An event-based sensor may include a common pull down transistor 822. The common pull down transistor 822 may be disposed inside or outside a pixel array. Here, the common pull down transistor 822 may draw out electric charges, floating on a drain (D1) of the transistor 811, to a ground 852, based on an inverted signal
Different from
As described above, the event-based sensor 920 may operate in various operating modes, depending on circumstances or a system design. The operating modes of the event-based sensor 920 may include a sub-sampling mode, a region of interest mode, a region blocking mode, a region monitoring mode, and a random access mode. The processor 910 may set an operating mode of the event-based sensor 920, based on an event signal output by the event-based sensor 920. The event-based sensor 920 may initially operate in a fully activated mode. The fully activated mode may allow power to be supplied to all pixels of a pixel array.
The sub-sampling mode may be provided to reduce a sensing resolution of the pixel array. According to an example embodiment, when a dynamic input is not sensed by the event-based sensor 920 during a predetermined time interval after the event-based sensor 920 is fully activated, the processor 910 may set the operating mode of the event-based sensor 920 to the sub-sampling mode. Also, when the number of event signals received from the event-based sensor 920 during the time interval is lower than a predetermined threshold, the processor 910 may set the operating mode of the event-based sensor 920 to the sub-sampling mode.
The sub-sampling mode may allow power to be supplied to only a selected portion of pixels, included in an area of the pixel array having a certain size, and power, supplied to the other pixels, to be interrupted. The processor 910 may reduce power consumption of the event-based sensor 920 through the sub-sampling mode, when a dynamic input is not sensed or an event signal is not received from the event-based sensor 920 during a predetermined period of time after the event-based sensor 920 is powered on. When the number of activation signals or event signals received during a predetermined time interval) exceeds a predetermined threshold in the sub-sampling mode, the operating mode of the event-based sensor 920 may be switched from the sub-sampling mode to the fully activated mode.
The region of interest mode may be provided to supply power to pixels included in a region of interest. According to an example embodiment, when a dynamic input is sensed in or from only a certain region or a certain set of pixels of the pixel array during a predetermined time interval, the processor 910 may set the operating mode of the event-based sensor 920 to the region of interest mode. For example, when an event signal or an activation signal, received during the predetermined time interval, is limited to the certain region, or an input area is limited to the certain region by a user interface or the like, the processor 910 may set the operating mode of the event-based sensor 920 to the region of interest mode. The region of interest mode may allow the certain region to be set as a region of interest.
The region of interest mode may also allow power to be supplied to only pixels included in the region of interest, and power, supplied to the other pixels, to be interrupted. The processor 910 may indicate pixels to be powered on and pixels to be powered off via a third control signal. The processor 910 may reduce power consumption of the event-based sensor 920 through the region of interest mode when a dynamic input is generated only in the region of interest. After the operating mode of the event-based sensor 920 is set as the region of interest mode, when a predetermined time has elapsed or the restriction by the user interface is released, the operating mode of the event-based sensor 920 may be switched from the region of interest mode to the fully activated mode.
The region blocking mode may be provided to interrupt power to the pixels included in a blocking region. According to an example embodiment, when it is determined that an event signal is generated in a certain region or a certain set of pixels of the pixel array by a useless event, the processor 910 may set the operating mode of the event-based sensor 920 to the region blocking mode. The useless event may include a dynamic input generated by a flickering object, such as a display image, a tree shaken with wind, snow, rain, and sun. The processor 910 may set the operating mode of the event-based sensor 920 to the region blocking mode, based on the cumulative number of events generated in this region. The region blocking mode may allow this region to be set as a blocking region.
The region blocking mode may also allow power, supplied to pixels included in the blocking region, to be interrupted, and power to be supplied to only the other pixels. The processor 910 may indicate pixels to be powered on and pixels to be powered off via the third control signal. The processor 910 may reduce power consumption of the event-based sensor 920 through the region blocking mode when a dynamic input is generated in this region by the flickering object. After the operating mode of the event-based sensor 920 is set as the region blocking mode, when a predetermined time has elapsed, the operating mode of the event-based sensor 920 may be switched from the region blocking mode to the fully activated mode.
The region monitoring mode may be provided to reduce a sensing resolution of a monitoring region. According to an example embodiment, when it is determined that a dynamic input is not sensed from a certain region of the pixel array during a predetermined time interval, or an event signal is generated in this region by a useless event, the processor 910 may set the operating mode of the event-based sensor 920 to the region monitoring mode. The useless event may include the dynamic input generated by the flickering object. When the number of event signals, output from the pixels included in this region during the predetermined time interval, is less than a predetermined threshold, or the cumulative number of events generated in this region exceeds a predetermined threshold, the processor 910 may set the operating mode of the event-based sensor 920 to the region monitoring mode. The region monitoring mode may allow this region to be set as a monitoring region.
The region monitoring mode may allow power to be supplied to only a portion of pixels included in the monitoring region, and power, supplied to the other pixels outside the monitoring region, to be interrupted. The processor 910 may indicate pixels to be powered on and pixels to be powered off via the third control signal. The processor 910 may reduce power consumption of the event-based sensor 920 through the region monitoring mode when a dynamic input is not sensed from this region during a predetermined time interval, or a dynamic input is generated in this region by the flickering object. When the number of event signals received during a predetermined time interval exceeds a predetermined threshold, or a predetermined time interval has elapsed after the operating mode of the event-based sensor 920 is set as the region monitoring mode, the operating mode of the event-based sensor 920 may be switched from the region monitoring mode to the fully activated mode.
The random access mode may be provided to authorize or block sensing in pixel units. The random access mode may allow certain pixels of the pixel array, to be powered on or off. According to an example embodiment, when it is determined that a certain pixel of the pixel array is overheated, a malfunction is sensed from this pixel, or this pixel is dead, the processor 910 may set the operating mode of the event-based sensor 920 to the random access mode. The processor 910 may set the operating mode of the event-based sensor 920 to the random access mode, according to temperature of this pixel, or as a normal event signal is not received from this pixel. The random access mode may allow this pixel to be powered off, and the other pixels to be powered on. The processor 910 may indicate pixels to be powered on and pixels to be powered off via the third control signal.
The random access mode may allow a portion of the pixels of the pixel array to be separately powered off to thus be used in parallel to the other modes. The processor 910 may reduce power consumption of the event-based sensor 920 through the random access mode and may prevent a malfunction due to a portion of the pixels of the pixel array when the portion of the pixels is problematic. When a temperature of an overheated pixel normally drops, the processor 910 may output the third control signal to supply power back to the pixel.
Referring to
The power control circuit 1410 may include a logic gate circuit and a switch 1411. The logic gate circuit may include logic gates 1416, 1417, and 1418. The logic gate 1416 may be supplied with the row control signal EN_Y1 and the column control signal EN_X1, and the logic gate 1417 may be supplied with the row control signal EN_Y2 and the column control signal EN_X2. The logic gate 1418 may be supplied with output signals of the logic gates 1416 and 1417. The logic gate 1418 may output the second control signal, based on the output signals of the logic gates 1416 and 1417.
The switch 1411 may open or close a connection between a power device 1430 and the pixel circuit 1420, based on the second control signal. For example, the switch 1411 may close the connection between the power device 1430 and the pixel circuit 1420, based on the second control signal, corresponding to digital high, and may open the connection between the power device 1430 and the pixel circuit 1420, based on the second control signal, corresponding to digital low. Depending on operations of the switch 1411, power supplied by the power device 1430 may be supplied or interrupted to the pixel circuit 1420.
For example, each pixel, corresponding to the region 1610 for ¼ sampling, of pixels included in the region 1605 may include a power control circuit having a structure in which the power control circuit includes a memory cell as illustrated in
In addition to the above-described example embodiments, the structure of the per-pixel power control circuit included in the pixel array 1600 can be modified. Thus, various operating modes of the pixel array 1600 may be implemented.
The operations or steps of the methods or algorithms described above can be embodied as computer readable codes on a computer readable recording medium, or to be transmitted through a transmission medium. The computer readable recording medium is any data storage device that can store data which can be thereafter read by a computer system. Examples of the computer readable recording medium include read-only memory (ROM), random-access memory (RAM), compact disc (CD)-ROM, digital versatile disc (DVD), magnetic tape, floppy disk, and optical data storage device, not being limited thereto. The transmission medium can include carrier waves transmitted through the Internet or various types of communication channel. The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.
At least one of the components, elements, modules or units represented by a block as illustrated in
While exemplary embodiments have been shown and described above, it will be apparent to those skilled in the art that modifications and variations could be made without departing from the scope of the present inventive concept, as defined by the appended claims.
Number | Date | Country | Kind |
---|---|---|---|
10-2016-0154951 | Nov 2016 | KR | national |