This application claims the benefit of priority from Japanese Patent Application No. 2023-085627 filed on May 24, 2023, the entire contents of which are incorporated herein by reference.
The present disclosure relates to a detection device.
Methods for distinguishing microorganisms with a lens-less imaging system using a photosensor have been disclosed (for example, Japanese Patent Application Laid-open Publication No. 2018-033430 (JP-A-2018-033430)). In a lens-less imaging system of JP-A-2018-033430, light emitted from a point light source passes through a culture medium in a culture vessel and a colony of microorganisms such as bacteria (object to be detected) on the culture medium, and enters a photosensor. The photosensor acquires colony formation images (scattered light patterns) of the microorganisms as pixel data.
In such a lens-less imaging system, the intensity of the amount of light received by each detection element (hereinafter, also referred to as “received light intensity”) varies depending on the relative positional relation with the point light source. Therefore, for example, it is conceivable to correct the pixel data according to the received light intensity, but system-derived noise components included in the pixel data may be amplified to cause false detection.
It is an object of the present disclosure to provide a detection device capable of reducing the effects of the system-derived noise components.
A detection device according to an embodiment of the present disclosure includes a planar detection device comprising a plurality of photodetection elements arranged in a planar configuration, a light source device disposed so as to face the planar detection device, and a light-transmitting mounting substrate on which a plurality of objects to be detected are mounted, the light-transmitting mounting substrate being disposed between the planar detection device and the light source device. The planar detection device includes a detection area in which a plurality of sensor pixels comprising the photodetection elements are arranged in a first direction and a second direction orthogonal to the first direction, a detection circuit configured to acquire a sensor value of each of the sensor pixels, and a control circuit configured to generate an image in the detection area by applying a filter according to a received light intensity to a value calculated based on the sensor value of each of the sensor pixels.
The following describes a mode (embodiment) for carrying out the present disclosure in detail with reference to the drawings. The present disclosure is not limited to the description of the embodiment to be given below. Components to be described below include those easily conceivable by those skilled in the art or those substantially identical thereto. In addition, the components to be described below can be combined as appropriate. What is disclosed herein is merely an example, and the present disclosure naturally encompasses appropriate modifications easily conceivable by those skilled in the art while maintaining the gist of the present disclosure. To further clarify the description, the drawings may schematically illustrate, for example, widths, thicknesses, and shapes of various parts as compared with actual aspects thereof. However, they are merely examples, and interpretation of the present disclosure is not limited thereto. The same component as that described with reference to an already mentioned drawing is denoted by the same reference numeral through the present disclosure and the drawings, and detailed description thereof may not be repeated where appropriate.
In the present specification and claims, in expressing an aspect of disposing another structure above a certain structure, a case of simply expressing “above” includes both a case of disposing the other structure immediately above the certain structure so as to contact the certain structure and a case of disposing the other structure above the certain structure with still another structure interposed therebetween, unless otherwise specified.
The optical sensor 10 is provided with a detection area AA that is provided with a plurality of sensor pixels 3 on an array substrate 2 formed using a substrate 21 as a base. In the present disclosure, a planar detection device includes the optical sensor 10, the detection circuit 11, and the control circuit 70.
A first direction Dx is one direction in a plane parallel to the substrate 21. A second direction Dy is one direction in the plane parallel to the substrate 21, and is a direction orthogonal to the first direction Dx. A third direction Dz is a direction orthogonal to the first direction Dx and the second direction Dy, and is a direction normal to a principle surface of the substrate 21. The term “plan view” refers to a positional relation when viewed from a direction orthogonal to the substrate 21.
The optical sensor 10 is a planar detection device that includes a plurality of photodiodes (photodetection elements) 30 arranged in a planar configuration. Specifically, the sensor pixels 3 are, for example, lined up in the first direction Dx and the second direction Dy, thus being arranged in a matrix having a row-column configuration. The sensor pixels 3 are not limited to being arranged in this manner, and may be arranged in a staggered manner in the detection area AA.
Each of the sensor pixels 3 is an optical sensor including a corresponding one of the photodiodes 30 as a photodetection element. Each of the photodiodes 30 outputs an electrical signal (potential) corresponding to light emitted thereto. More specifically, the photodiode 30 is an organic photodiode (OPD) using an organic semiconductor or a positive-intrinsic-negative (PIN) photodiode.
In the light source device 80, a light-emitting element 82 is provided on a light source substrate 81 that is provided so as to face the array substrate 2 of the optical sensor 10 in the third direction Dz. The light-emitting element 82 is configured as a light-emitting diode (LED), for example.
In the present disclosure, the detection device 1 includes a mounting substrate 101 on which the objects to be detected 100 is mounted, and a cover member 103. The mounting substrate 101 and the cover member 103 are light-transmitting plate-like members formed of glass, for example. Specifically, the mounting substrate 101 and the cover member 103 are a Petri dish, for example.
The objects to be detected 100 are cultured on a culture medium 102 provided on the mounting substrate 101. The objects to be detected 100 and the mounting substrate 101 are provided with the cover member 103 thereover, and placed between the optical sensor 10 and the light source device 80. More specifically, in the detection device 1, the mounting substrate 101 and the cover member 103 (objects to be detected 100), and the light source device 80 are arranged in this order above the optical sensor 10.
Light L emitted from the light-emitting elements 82 passes through the mounting substrate 101, the culture medium 102, and the cover member 103, and irradiates the detection area AA. The intensity of light received by the sensor pixels 3 (hereinafter, also referred to as “received light intensity”) differs between areas overlapping the objects to be detected 100 and areas not overlapping the objects to be detected 100. The optical sensor 10 can capture an image of a colony (objects to be detected 100) on the culture medium 102 by differences in the received light intensity that differs among the sensor pixels 3.
A peripheral area GA outside the detection area AA of the substrate 21 is provided with first gate line drive circuits 15AA and 15AB, second gate line drive circuits 15BA and 15BB, and a signal line selection circuit 16.
The first gate line drive circuits 15AA and 15AB are arranged with the detection area AA interposed therebetween in the first direction Dx. The second gate line drive circuits 15BA and 15BB are arranged with the detection area AA interposed therebetween in the first direction Dx. The signal line selection circuit 16 is provided between the detection area AA and the detection circuit 11 along a side of the detection area AA that extends in the first direction Dx. The arrangements of the first gate line drive circuits 15AA and 15AB, the second gate line drive circuits 15BA and 15BB, and the signal line selection circuit 16 are not limited to these arrangements. Specifically, for example, an aspect may be employed in which the group of the first gate line drive circuits 15AA and 15AB and the group of the second gate line drive circuits 15BA and 15BB are configured as one first gate line drive circuit and one second gate line drive circuit, respectively, and the first gate line drive circuit and the second gate line drive circuit are arranged with the detection area AA interposed therebetween in the first direction Dx.
The first gate line (reset control scan line GLrst), the second gate line (read control scan line GLrd), and the signal line SL are each coupled to a plurality of the sensor pixels 3 in the detection area AA. Specifically, the first gate line (reset control scan line GLrst) and the second gate line (read control scan line GLrd) extend in the first direction Dx and are coupled to a plurality of the sensor pixels 3 arranged in the first direction Dx. The signal lines SL extend in the second direction Dy, and are each coupled to a plurality of the sensor pixels 3 arranged in the second direction Dy. The signal line SL is wiring through which signals from a plurality of transistors (read transistor Mrd and source follower transistor Msf) are output.
The reset transistor Mrst, the read transistor Mrd, and the source follower transistor Msf are provided correspondingly to one photodiode 30. The transistors included in the sensor pixel 3 are each configured as an n-type thin-film transistor (TFT). However, each of the transistors is not limited thereto, and may be configured as a p-type TFT.
A reference potential Vcom is applied to the anode of the photodiode 30. The cathode of the photodiode 30 is coupled to one of the source and the drain of the reset transistor Mrst and the gate of the source follower transistor Msf.
The gate of the reset transistor Mrst is coupled to the first gate line (reset control scan line GLrst). The other of the source and the drain of the reset transistor Mrst is supplied with a reset potential Vrst. Turning on the reset transistor Mrst (into a conducting state) resets the cathode potential of the photodiode 30 to the reset potential Vrst. The reference potential Vcom is lower than the reset potential Vrst, and the photodiode 30 is driven in a reverse-biased manner.
The source follower transistor Msf is coupled between a terminal supplied with a power supply potential Vsf and the read transistor Mrd. The gate of the source follower transistor Msf is coupled to the cathode of the photodiode 30. The gate of the source follower transistor Msf is supplied with a voltage corresponding to the received light intensity of the photodiode 30. As a result, the source follower transistor Msf outputs an electrical signal (potential) corresponding to the received light intensity of the photodiode 30 to the read transistor Mrd.
The read transistor Mrd is coupled between the source of the source follower transistor Msf and the signal line SL. The gate of the drive transistor Mrd is coupled to the second gate line (read control scan line GLrd). Turning on the read transistor Mrd outputs the signal output from the source follower transistor Msf, that is, the electrical signal (potential) corresponding to the received light intensity of the photodiode 30 as a detection signal Vdet to the output signal line SL.
In
The first gate line drive circuits 15AA and 15AB are circuits that drive a plurality of the first gate lines (reset control scan lines GLrst) in the detection area AA. The first gate line drive circuits 15AA and 15AB are shift register circuits, for example.
In the present disclosure, the first gate line drive circuits 15AA and 15AB sequentially select the first gate lines (reset control scan lines GLrst) based on various control signals including, for example, start pulse signals STV and clock pulse signals supplied from the detection circuit 11, and supply first gate drive signals (reset control signals) to the selected the first gate lines (reset control scan lines GLrst). In other words, the first gate line drive circuits 15AA and 15AB simultaneously supply the first gate drive signals (reset control signals) to the sensor pixels 3 arranged in the first direction Dx, and sequentially supply the first gate drive signals (reset control signals) to the sensor pixels 3 arranged in the second direction Dy. This operation resets the potentials of the photodiodes 30 of the sensor pixels 3 coupled to the first gate lines (reset control scan lines GLrst) selected by the first gate line drive circuits 15AA and 15AB of the sensor pixels 3.
The second gate line drive circuits 15BA and 15BB are circuits that drive a plurality of the second gate lines (read control scan lines GLrd) in the detection area AA. The second gate line drive circuits 15BA and 15BB are shift register circuits, for example.
In the present disclosure, the second gate line drive circuits 15BA and 15BB sequentially select the second gate lines (read control scan lines GLrd) based on the various control signals including, for example, the start pulse signals STV and the clock pulse signals supplied from the detection circuit 11, and supply second gate drive signals (read control signals) to the selected second gate lines (read control scan lines GLrd). In other words, the second gate line drive circuits 15BA and 15BB simultaneously supply the second gate drive signals (read control signals) to the sensor pixels 3 arranged in the first direction Dx, and sequentially supply the second gate drive signals (read control signals) to the sensor pixels 3 arranged in the second direction Dy. This operation reads the electrical signals (potentials) of the sensor pixels 3 coupled to the second gate lines (read control scan lines GLrd) selected by the second gate line drive circuits 15BA and 15BB as the detection signals Vdet.
The signal line selection circuit 16 is a switch circuit that selects any one of the signal lines SL and couples it to the detection circuit 11. The signal line selection circuit 16 is a multiplexer, for example.
As illustrated in
The detection signal amplitude adjustment circuit 41 is a circuit that adjusts the amplitude of the detection signal Vdet output from the optical sensor 10, and is configured with an amplifier, for example. The A/D conversion circuit 42 converts an analog signal output from the detection signal amplitude adjustment circuit 41 into a digital signal. The signal processing circuit 43 performs signal processing on the digital signal from the A/D conversion circuit 42 and stores the sensor value Raw for each of the sensor pixels 3 in the buffer circuit 44. More specifically, the signal processing circuit 43 sets the sensor value Raw for each of the sensor pixels 3 to the difference between the detection value acquired in a reset period of the sensor pixel 3 and the detection value acquired in a read period of the sensor pixel 3.
Based on various control signals supplied from the control circuit 70 (refer to
The detection timing control circuit 45 is also a circuit that supplies respective control signals to the first gate line drive circuits 15AA and 15AB, the second gate line drive circuits 15BA and 15BB, and the signal line selection circuit 16 and controls operations of these circuits to perform a detection operation in the detection area AA. The detection timing control circuit 45 supplies the various control signals including, for example, the start pulse signals and the clock pulse signals to the first gate line drive circuits 15AA and 15AB and the second gate line drive circuits 15BA and 15BB. The detection timing control circuit 45 also supplies signal line selection signals to the signal line selection circuit 16.
Signal transmission among the control circuit 70, the detection circuit 11, and the light source device 80 is performed, for example, by a serial peripheral interface (SPI) that is a clock synchronization type serial interface. The present disclosure is not limited by the signal transmission method among the control circuit 70, the optical sensor 10, and the light source device 80.
As illustrated in
The data acquisition circuit 71 transmits the read control signal to the detection circuit 11, acquires the sensor value Raw for each of the sensor pixels 3, and stores it in the data storage circuit 72 in association with positional information on the sensor pixel 3 in the detection area AA. The data processing circuit 73 performs a correction process on the sensor value Raw of each of the sensor pixels 3 stored in the data storage circuit 72. The image generation circuit 74 generates a colony formation image on the culture medium 102 by binarizing the corrected values after the correction process.
The light source control circuit 75 controls the lighting operation of the light-emitting elements 82 in synchronization with the detection operation in the detection circuit 11. Specifically, when the light source device 80 is configured with a plurality of the light-emitting elements 82, the light source control circuit 75 stores information on lighting patterns of on (lit) and off (unlit) of the light-emitting elements 85, and transmits light emission control signals in accordance with the information on the lighting patterns to the light source device 80.
The intensity of the amount of light received by the sensor pixel 3 in the detection area AA (hereinafter, also referred to as “received light intensity”) varies depending on the relative positional relation with the light-emitting element 82. Specifically, the received light intensity of the sensor pixel 3 located away from the light-emitting element 82 has a relatively smaller value than the received light intensity of the sensor pixel 3 located immediately below the light-emitting element 82.
The colony formation image can be considered to be generated as described below. Firstly, the reciprocal Raw(p)−1 of the sensor value Raw(p) for each of the sensor pixels 3 acquired in the initial state in which the colony is not formed on the culture medium 102 is held as a correction coefficient Cf(p) for the sensor pixel 3 (Cf(p)=Raw(p)−1). Secondly, a corrected value Cor(p) (=Raw(p)×Cf(p)) obtained by multiplying the sensor value Raw(p) by the correction coefficient Cf(p) is applied.
The sensor value of the sensor pixel 3 having a smaller received light intensity has a relatively larger ratio of system-derived noise components that are independent of the received light intensity. In addition, the correction coefficient that multiplies the sensor value of the sensor pixel 3 having a smaller received light intensity is relatively larger. Therefore, the system-derived noise components may be amplified to cause false detection.
The following describes a specific example of a detection process of the embodiment that can reduce the system-derived noise components in the detection device 1 having the configuration described above.
The following describes an aspect of the present disclosure in which a filter (low-pass filter (LPF)) process is performed on the corrected value Cor(p) of the sensor pixel 3, and if a value (Diff(p) illustrated in
In the present disclosure, the relation between the received light intensity Li and the cutoff frequency fc illustrated in
In the present disclosure, for example, an infinite impulse response (IIR) filter and a finite impulse response (FIR) filter are exemplified as methods for performing the filter (LPF) process. The number of taps and filter coefficients of the IIR filter or the FIR filter only need to be appropriately set according to the cutoff frequency fc of the filter. The number of taps of the IIR filter or the FIR filter may be constant (for example, a third order filter) regardless of the cutoff frequency fc of the filter.
In the detection process illustrated in
The optimal value of the cutoff frequency fc in the filter (LPF) process varies depending on the sensor value acquiring period and the range of the received light intensity Li in the detection area AA. Specifically, the optimal value of the cutoff frequency fc in the filter (LPF) process decreases as the sensor value acquiring period increases and increases as the sensor value acquiring period decreases. The cutoff frequency fc in the filter (LPF) process only needs to be set so as to be higher for the sensor pixel 3 having the higher received light intensity Li and lower for the sensor pixel 3 having the lower received light intensity Li, as illustrated in
The first process (Step S100) illustrated in
In the first process illustrated in
The data processing circuit 73 performs the process of calculating the reciprocal of the sensor value Raw(p) to calculate the correction coefficient Cf(p) for each of the sensor pixels 3 (Step S102).
The data processing circuit 73 calculates the received light intensity Li(p) of each of the sensor pixels 3 by normalizing the sensor value Raw(p) by the maximum value Raw_max of the sensor values Raw in the detection area AA (Li(p)=Raw(p)/Raw_max) (Step S103), reads the cutoff frequency fc corresponding to the calculated light intensity Li(p) from the conversion table illustrated in
The second process (Step S200) illustrated in
In the second process illustrated in
The data processing circuit 73 performs the correction process on the sensor value Raw(p) (Step S202). Specifically, the data processing circuit 73 calculates the corrected value Cor(p) for each of the sensor pixels 3 by multiplying the sensor value Raw(p) by the correction coefficient Cf(p).
A threshold determination process between the determination value Diff(p) for each of the sensor pixels 3 and the determination threshold Diff_th is performed (Step S205) as described below. Firstly, the data processing circuit 73 reads the corrected values Cor(p) for each of the sensor pixels 3 for a plurality of frames (for example, the corrected values Cor(p) for three frames if the number of taps of the filter is three (third order filter)) to be used in the filter (LPF) process. Secondly, the filter (LPF) process with the cutoff frequency fc(p) applied to the corrected values Cor(p) read for each of the sensor pixels 3 for a plurality of frames is performed (Step S203). Thirdly, the determination value Diff(p) for each of the sensor pixels 3 is calculated by subtracting the value CorAF(p) after filter processing from one (Step S204).
If the determination value Diff(p) is equal to or higher than the determination threshold Diff_th (Diff(p)≥Diff_th; Yes at Step S205), the data processing circuit 73 sets a binarized data Dbin(p) for each of the sensor pixels 3 to “1” (Dbin(p)=1, at Step S206), and stores the set data in the data storage circuit 72.
If the determination value Diff(p) is lower than the determination threshold Diff_th (Diff(p)<Diff_th; No at Step S205), the data processing circuit 73 sets the binarized data Dbin(p) for each of the sensor pixels 3 to “0” (Dbin(p)=0, at Step S207), and stores the set data in the data storage circuit 72.
In the present embodiment, the determination threshold Diff_th is stored in the data storage circuit 72 in advance. Specifically, a determination value Diff_sat when the colony formation is saturated is set to “0.65”, and the determination threshold Diff_th is set to “0.15”, for example.
The image generation circuit 74 reads the binarized data Dbin(p) for each of the sensor pixels 3 stored in the data storage circuit 72, and generates a binarized colony formation image (Step S208).
After generating the colony formation image (Step S208), the detection device 1 repeats the process at Step S201 onward. This processing allows the colony forming process on the culture medium 102 to be acquired as an image.
A solid line drawn in
The correction coefficient Cf(p) that multiplies the sensor value Raw(p) in the correction process at Step 5202 becomes larger at the periphery of the detection area AA where the received light intensity Li is lower. As a result, a larger amount of the system-derived noise components appears in the corrected value Cor(p) before the execution of the filter (LPF) process.
Therefore, if the value (1−Cor(p)) obtained by subtracting the corrected value Cor(p) before the execution of the filter (LPF) process from one is used as the determination value, the system-derived noise components amplified by the correction coefficient Cf(p) become equal to or higher than the determination threshold Diff_th (Diff(p)≥Diff_th; Yes at Step S205) as indicated by the dashed line in
In the detection process according to the embodiment described above, the determination value Diff(p) having the reduced system-derived noise components can be obtained by applying the filter (LPF) process with the cutoff frequency fc appropriately set according to the received light intensity Li. This processing can prevent the system-derived noise components from being erroneously determined to be a colony.
While the preferred embodiment of the present disclosure has been described above, the present disclosure is not limited to the embodiment described above. The content disclosed in the embodiment is merely an example, and can be variously modified within the scope not departing from the gist of the present disclosure. Any modifications appropriately made within the scope not departing from the gist of the present disclosure also naturally belong to the technical scope of the present disclosure. At least one of various omissions, substitutions, and changes of the components can be made without departing from the gist of the embodiments and the modifications described above.
Number | Date | Country | Kind |
---|---|---|---|
2023-085627 | May 2023 | JP | national |