The disclosure relates to a fingerprint identification apparatus and a fingerprint identification method, specifically, to a fingerprint identification apparatus and a fingerprint identification method capable of providing a plurality of effective images of a fingerprint in a limited time.
In conventional fingerprint recognition, a finger is in contact with a predetermined area on the panel in a limited time so that the fingerprint is obtained by an image sensor disposed in or under the panel. In the limited time, in addition to performing the fingerprint recognition function, the touch and display functions need performing also. Therefore, the actual time for performing the fingerprint recognition function is short.
Further, in performing the fingerprint recognition function, the image sensor is exposed to light in an exposure time, which cannot be shorten. The appropriate exposure time is determined by auto exposure (AE) process to avoid overexposing and underexposing, so that one image obtained by the image sensor is not too bright or too dark. However, the AE process is time-consuming, so not so many images are obtained in a short time. In addition, the AE process is suitable for judgment based on visualization and cannot guarantee an optimized image for fingerprint recognition.
The disclosure is directed to a fingerprint identification apparatus and a fingerprint identification method capable of providing a plurality of effective images of a fingerprint in a limited time.
The disclosure provides a fingerprint identification apparatus including a fingerprint identification device and a touch and display integration circuit. The touch and display integration circuit is configured to perform a touch and display function in each of a plurality of touch and display periods during a total contact time. An object touches a predetermined area of a display panel during the total contact time. The fingerprint identification device is configured to obtain a plurality of sample images of the object in each of a plurality of sensing periods during the total contact time. Two adjacent sensing periods have at least one of the touch and display periods therebetween.
In one embodiment of the disclosure, the plurality of sensing periods comprise a first sensing period and a last sensing period, and the fingerprint identification device is reset at a beginning of the first sensing period and at an end of the last sensing period.
In one embodiment of the disclosure, the fingerprint identification device is not reset between the beginning of the first sensing period and the end of the last sensing period.
In one embodiment of the disclosure, the plurality of sensing periods further comprise at least one intervening sensing period arranged between the first sensing period and the last sensing period.
In one embodiment of the disclosure, the plurality of sensing periods and the plurality of touch and display periods are alternately arranged during the total contact time.
In one embodiment of the disclosure, the fingerprint identification device is disposed in the display panel and above the touch and display integration circuit.
In one embodiment of the disclosure, the fingerprint identification device is integrated with the touch and display integration circuit in the display panel.
In one embodiment of the disclosure, the fingerprint identification device comprises an optical image sensor having a photodiode, and the photodiode is reset to reset the fingerprint identification device.
The disclosure provides a fingerprint identification method of a fingerprint identification apparatus having a fingerprint identification device and a touch and display integration circuit. An object is in contact with a predetermined area of a display panel during a total contact time. The fingerprint identification method includes the steps of performing, by the touch and display integration circuit, a touch and display function in each of a plurality of touch and display periods during the total contact time; obtaining, by the fingerprint identification device, a plurality of sample images of the object in each of a plurality of sensing periods during the total contact time; and obtaining a result image according to the plurality of sample images of the object in each of the plurality of sensing periods during the total contact time, wherein two adjacent sensing periods have at least one of the touch and display periods therebetween.
In one embodiment of the disclosure, the plurality of sensing periods comprise a first sensing period and a last sensing period, the fingerprint identification method further includes steps of resetting the fingerprint identification device at a beginning of the first sensing period; and resetting the fingerprint identification device at an end of the last sensing period.
In one embodiment of the disclosure, the fingerprint identification device is not reset between the beginning of the first sensing period and the end of the last sensing period.
In one embodiment of the disclosure, step of obtaining, by the fingerprint identification device, the plurality of sample images of the object in each of the plurality of sensing periods during the total contact time includes sub-steps of obtaining a first sample image; calculating an effect of environment light based on the first sample image; and obtaining other sample images of the plurality of sample images according to the effect of environment light.
In one embodiment of the disclosure, the object is a finger, step of obtaining the result image according to the plurality of sample images of the object in each of the plurality of sensing periods during the total contact time includes a sub-step of determining the result image according to a contrast between ridges and valleys of a fingerprint of the finger in the plurality of sample images in each of the plurality of sensing periods.
In one embodiment of the disclosure, step of obtaining the result image according to the plurality of sample images of the object in each of the plurality of sensing periods during the total contact time includes a sub-step of determining the result image by averaging the plurality of sample images in each of the plurality of sensing periods.
In one embodiment of the disclosure, the plurality of sensing periods comprise at least one intervening sensing period between the first sensing period and the last sensing period.
In one embodiment of the disclosure, the plurality of sensing periods and the plurality of touch and display periods are alternately arranged during the total contact time.
In one embodiment of the disclosure, the fingerprint identification device includes an optical image sensor having a photodiode, and the photodiode is reset to reset the fingerprint identification device.
Based on above, in the disclosure, two adjacent sensing periods have at least one of the touch and display periods therebetween, a plurality of sample images of the finger are obtained in each of the sensing periods. In addition, the first sample image in each of the sensing periods is used to calculate in order to obtain the effect of environment light, and the other sample images in the same sensing period are obtain by eliminating the effect of environment light. Further, the sensing periods have the first sensing period and the last sensing period. The fingerprint identification device is reset at the beginning of the first sensing period and is reset at the end of the last sensing period, and the fingerprint identification device is exposed to light from the beginning of the first sensing period to the end of the last sensing period. Therefore, in a limited time, a plurality of sample images with good quality are provided to the end process. The image with good quality is an effective image without effect of environment light. That is to say, the effective image clearly shows the ridges and valleys of the fingerprint of the finger. Consequently, it guarantees to obtain an optimized image of the finger in a limited and short time.
To make the aforementioned more comprehensible, several embodiments accompanied with drawings are described in detail as follows.
The accompanying drawings are included to provide a further understanding of the disclosure, and are incorporated in and constitute a part of this specification. The drawings illustrate exemplary embodiments of the disclosure and, together with the description, serve to explain the principles of the disclosure.
Further, an object 160, such as a finger of the user, is in contact with a predetermined area of the display panel 110a for fingerprint identification purpose. The touch and display integration circuit 130 is configured to perform touch and display function. The fingerprint identification device 140 is configured to sense the fingerprint of the finger 160. Herein, the fingerprint identification device 140 may be realized by an optical image sensor having a photodiode. The touch and display integration circuit 130 may be realized by combining two chips into one or by integrating touch controller and display driver. The disclosure is not limited thereto.
Normally, the finger 160 touches the display panel 110a or 110b during a total contact time T so that the fingerprint of the finger 160 is obtained. The total contact time T may be equal to 100 milliseconds or 150 milliseconds, the disclosure is not limited thereto. In the present application, the fingerprint identification device 140 and the touch and display integration circuit 130, either integrated or separated, used time-sharing method in the total contact time T in order to obtain the fingerprint of the finger 160. The details will be described hereinafter.
In the present embodiment, the arrangement is that there is one sensing period arranged after two touch and display periods, but the disclosure is not limited thereto. Further, there are two sensing periods in the present embodiment, but the disclosure is not limited thereto. In the present embodiment, the sensing period SP1 is called as the first sensing period SP1, and the sensing period SP2 is called as the last sensing period SP2. In other embodiments, there may be a plurality of intervening sensing periods between the first sensing period SP1 and the last sensing period SP2. Next, along time axis, the first sensing period SP1 and the last sensing period SP2 are described as follows.
It should be noted here, the fingerprint identification device 140 is reset at the timepoint T0, but the fingerprint identification device 140 is not reset again after obtaining the first sample image SI11, after obtaining the second sample image SI12, after obtaining the third sample image SI13, or after the first sensing period SP1 ends. That is to say, after reset, the fingerprint identification device 140 is exposed from the timepoint T0 (such as the photodiode of the fingerprint identification device 140 is exposed in order to obtain sample images of the fingerprint of the finger). Therefore, the first sample image SI11, and the second sample image SI12, and the third sample image SI13 have different brightness values. In other words, the brightness of the third sample image SI13 is greater than the brightness of the second sample image SI12, and the brightness of the second sample image SI12 is greater than the brightness of the first sample image SI11.
However, after the first sample image SI11 is obtained, the first sample image SI11 is used to calculate the effect of the environment light. The environment light may be the light from the outside of the display panel and the backlight of the display panel, but the disclosure is not limited thereto. Further, the effect of the environment light is eliminated when obtaining the second sample image SI12 and the third sample image SI13.
It should be noted here, the end of the last sensing period SP2 is also the end of the total contact time T. That is to say, the end of the last sensing period SP2 is the end of the process to obtain the fingerprint of the finger 160. However, the disclosure is not limited thereto. The end of the last sensing period SP2 may be sooner than the end of the total contact time T in other embodiment.
After the last sensing period SP2 ends, the fingerprint identification device 140 is reset again, thus the fingerprint identification device 140 is not exposed to light anymore. That is to say, the fingerprint identification device 140 is reset at the beginning of the first sensing period SP1 and is reset again at the end of the last sensing period SP2. In addition, the fingerprint identification device 140 is not reset between the beginning of the first sensing period SP1 and the end of the last sensing period SP2. In other words, the photodiode or the image sensor of the fingerprint identification device 140 is continuously exposed to light from the beginning of the first sensing period SP1 to the end of the last sensing period SP2.
In the present embodiment, a plurality of sample images SI11 to SI13 of the finger 160 are obtained in the sensing period SP1, and a plurality of sample images SI21 to SI24 of the finger 160 are obtained in the sensing period SP2. In addition, the first sample image SI11 in the sensing period SP1 is used to calculate in order to obtain the effect of environment light, and the other sample images SI12 and SI13 in the sensing period SP1 are obtained by eliminating the effect of environment light. Similarly, the first sample image SI21 in the sensing period SP2 is used to recalculate in order to obtain the effect of environment light, and the other sample images SI22 to SI24 in the sensing period SP2 are obtained by eliminating the effect of environment light. Further, the sensing periods have the first sensing period SP1 and the last sensing period SP2. The fingerprint identification device 140 is reset at the beginning of the first sensing period SP1 and is reset at the end of the last sensing period SP2, and the fingerprint identification device 140 is exposed to light from the beginning of the first sensing period SP1 to the end of the last sensing period SP2. Therefore, in a limited time, a plurality of sample images SI11 to SI13 and a plurality of sample images SI21 to SI24 with good quality (or effective images without effect of environment light) are provided to the end process. Consequently, it guarantees to obtain an optimized image of the finger in a limited and short time.
Further, in the present embodiment, the sensing periods SP1a to SP3a and the touch and display periods TDP1a to TDP3a are alternately arranged during the total contact time Ta. In other words, the sensing periods SP1a to SP3a and the touch and display periods TDP1a to TDP3a are arranged one after another. However, the disclosure is not limited thereto.
In step S300, there may be three sub-steps S310, S320, and S330 in obtaining the sample images of the object in each of the sensing periods. The sensing period SP1 is used as example hereinafter. In sub-step S310, the first sample image SI11 is obtained. Next, in sub-step S320, an effect of environment light is calculated based on the first sample image SI11. Further, in sub-step S330, the other sample images SI12 and SI13 of the sample images are obtained according to the effect of environment light.
After the last sensing period SP2 ends, the fingerprint identification device 140 is reset. In other words, the fingerprint identification device 140 is reset at the end of the last sensing period SP2 (step S400).
Next, in step S500, a result image is obtained according to the sample images SI11 to SI13 and the sample images SI21 to SI24 of the object 160 in the sensing periods SP1 and SP2 during the total contact time T. There may be two alternative sub-steps S510a or S510b in the step S500. In the sub-step S510a, the result image is determined according to the contrast between ridges and valleys of the fingerprint of the finger 160 in the sample images SI11 to SI13 and SI21 to SI24 in the sensing periods SP1 and SP2. As an alternative way, in the sub-step S510b, the result image is determined by averaging the sample images SI11 to SI13 and SI21 to SI24 in the sensing periods SP1 and SP2. In other ways, the result image may have the highest brightness contrast between ridges and valleys of the fingerprint is one of the sample images SI11 to SI13 and the sample images SI21 to SI24. The result image is picked from the sample images SI11 to SI13 and the sample images SI21 to SI24 by artificial intelligence (AI) or other method. The disclosure is not limited thereto.
In summary, two adjacent sensing periods have at least one of the touch and display periods therebetween, and a plurality of sample images of the finger are obtained in each of the sensing periods. In addition, the first sample image in each of the sensing periods is used to calculate in order to obtain the effect of environment light, and the other sample images in the same sensing period are obtain by eliminating the effect of environment light. Further, the sensing periods have the first sensing period and the last sensing period. The fingerprint identification device is reset at the beginning of the first sensing period and is reset at the end of the last sensing period, and the fingerprint identification device is exposed to light from the beginning of the first sensing period to the end of the last sensing period. Therefore, in a limited time, a plurality of sample images with good quality are provided to the end process. The image with good quality is an effective image without effect of environment light. That is to say, the effective image clearly shows the ridges and valleys of the fingerprint of the finger. Consequently, it guarantees to obtain an optimized image of the finger in a limited and short time.
Moreover, since the optimized image of the finger is obtained without using the AE process, so as to avoid the possibility that the exposure time is not converged in a limited time.
It will be apparent to those skilled in the art that various modifications and variations can be made to the disclosed embodiments without departing from the scope or spirit of the disclosure. In view of the foregoing, it is intended that the disclosure covers modifications and variations provided that they fall within the scope of the following claims and their equivalents.
This application claims the priority benefit of U.S. provisional application Ser. No. 62/789,968, filed on Jan. 8, 2019. The entirety of the above-mentioned patent applications is hereby incorporated by reference herein and made a part of this specification.
Number | Date | Country | |
---|---|---|---|
62789968 | Jan 2019 | US |