The invention relates to an image scanning device and an image scanning method, and particularly, to an image scanning device and an image scanning method capable of acquiring complete image information.
At present, in fingerprint identification solutions of electronic devices, the under-screen fingerprint identification technology in which a user directly touches the screen for fingerprint identification has gradually become the mainstream. If the area of the fingerprint identification sensor under the screen is increased, the technical effect of performing fingerprint identification at multiple positions on the screen can be achieved. However, conventional electronic devices do not use the under-screen fingerprint identification sensor for applications other than the fingerprint identification, which wastes the image acquisition function of the under-screen fingerprint identification sensor. Therefore, the application of the under-screen fingerprint identification sensor to fields other than the fingerprint identification is the goal that those skilled in the art should strive for.
In view of this, the invention provides an image scanning device and an image scanning method, which can acquire complete image information.
The invention provides an image scanning device which includes a display emitting red light, green light and blue light respectively to expose an object when the object is in contact with the display; a sensor disposed below the display and obtaining a first image corresponding to the red light, a second image corresponding to the green light, and a third image corresponding to the blue light; and a processing module coupled to the sensor and the display and generating an object image corresponding to the object according to the first image, the second image, and the third image.
The invention provides an image scanning method adapted for an image scanning device. The image scanning device includes a display and a sensor disposed below the display. The image scanning method includes steps as follows. The display emits red light, green light, and blue light respectively to expose an object when the object is in contact with the display; a first image corresponding to the red light, a second image corresponding to the green light, and a third image corresponding to the blue light are obtained by the sensor; and an object image corresponding to the object is generated according to the first image, the second image, and the third image.
In summary, in the image scanning device and the image scanning method of the invention, the sensor is disposed below the display. The display emits red light, green light, and blue light to expose the object when the object is in contact with the display, the sensor obtains the first image, the second image, and the third image, and then the processing module generates the object image according to the first image, the second image, and the third image. Since the object is in direct contact with the display and the light source is emitted by the display, the generated object image may not be subjected to the interference of the external light source nor to the distortion of the image capturing edge of the lens.
In order to make the features and advantages of the invention comprehensible, embodiments accompanied with drawings are described in detail below.
The accompanying drawings are included to provide a further understanding of the invention, and are incorporated in and constitute a part of this specification. The drawings illustrate embodiments of the invention and together with the description serve to explain the principles of the invention.
Reference will now be made in detail to the exemplary embodiments of the invention, examples of which are illustrated in the accompanying drawings. Whenever possible, the same reference numerals are used to represent the same or similar parts in the accompanying drawings and description.
Referring to
In one embodiment, when an object to be measured (e.g. a business card and the like) is in contact with the display 110 (e.g., the object to be measured is disposed on the display 110), the processing module 130 may instruct the display 110 to emit red light, green light, and blue light respectively to expose the object, and the sensor 120 obtains a first image corresponding to red light, a second image corresponding to green light, and a third image corresponding to blue light. The processing module 130 generates an object image corresponding to the object according to the first image, the second image, and the third image. Since the sensor 120 has a large sensing area, the object image generated by the processing module 130 is a one-to-one color scan image of the corresponding object, and the object image can represent the complete data of the object.
The sensor 120 is disposed below the display 110, so the first image, the second image, and the third image obtained by the sensor 120 may include images of components such as wires and fences between the top of the sensor 120 and the display 110. The processing module 130 first performs a background subtraction operation (i.e., the backgrounds are removed in the images) on the first image, the second image, and the third image, and then generates an object image according to the first image, the second image, and the third image after subtracting the backgrounds. For example, the processing module 130 may determine image pixels of the components and image pixels of the non-component in the first image (or the second image, the third image). For each image pixel of the components, the processing module 130 may obtain the image pixels of the non-component around the image pixel of the components to calculate the pixel value by interpolation, and replace the image pixel of the components with the calculated result to complete the background subtraction operation.
In one embodiment, the processing module 130 calculates the mixing ratio of the red, green, and blue according to the first image, the second image, and the third image after subtracting the backgrounds. Moreover, an object image is generated according to the mixing ratio of the red, green, and blue as well as the first image, the second image, and the third image after subtracting the backgrounds. For example, the processing module 130 may calculate the red channel grayscale value of each pixel in the first image, the green channel grayscale value of each pixel in the second image, and the blue channel grayscale value of each pixel in the third image after subtracting the background, and the processing module 130 may mix the red channel grayscale value, the green channel grayscale value, and the blue channel grayscale value of each pixel to restore the color of the object to generate a color object image.
In one embodiment, if the area of the object is greater than the area of the sensor 120, the processing module 130 obtains multiple stitched images of the object and matches multiple feature points of the object in the multiple stitched images to stitch the multiple stitched images into an object image. Each stitched image can be obtained by being exposed to red light, green light and blue light respectively emitted by the display 110 three times, by subtracting the background, and then by performing color restoration. Specifically, when the area of the object is greater than the area of the sensor 120, the user can perform a swipe operation on the object on the sensor 120 to obtain multiple stitched images of the object. The processing module 130 can identify one or more feature points on each stitched image, match the common feature points of any two or more stitched images to perform image stitching, and then stitch multiple stitched images into a complete object image.
Referring to
In step S202, the first image corresponding to the red light, the second image corresponding to the green light, and the third image corresponding to the blue light are obtained through the sensor.
In step S203, an object image corresponding to the object is generated according to the first image, the second image, and the third image.
In summary, in the image scanning device and the image scanning method of the invention, the sensor is disposed below the display. The display emits red light, green light, and blue light to expose the object when the object is in contact with the display, the sensor obtains the first image, the second image, and the third image, and then the processing module generates the object image according to the first image, the second image, and the third image. Since the object is in direct contact with the display and the light source is emitted by the display, the generated object image may not be subjected to the interference of the external light source nor to the distortion of the image capturing edge of the lens.
It will be apparent to those skilled in the art that various modifications and variations can be made to the structure of the present invention without departing from the scope or spirit of the invention. In view of the foregoing, it is intended that the present invention cover modifications and variations of this invention provided they fall within the scope of the following claims and their equivalents.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/CN2020/095329 | 6/10/2020 | WO |
Number | Date | Country | |
---|---|---|---|
62963546 | Jan 2020 | US |