Patent Application
20230324342
The application claims priority to and the benefit of Korean Patent Application No. 10-2022-0043594, filed Apr. 7, 2022, in the Korean Intellectual Property Office, the entire content of which is hereby incorporated by reference.
The present disclosure relates to a method and system for calibrating an ultrasonic sensor.
With the development of information technology, the importance of display devices, which are a connection medium between users and information, has been emphasized. In response to this, the use of display devices such as liquid crystal display devices, organic light emitting display devices, and/or the like has been increasing.
According to consumer demand, a display device may include various sensors such as a touch sensor, a fingerprint sensor, an illuminance sensor, and/or a camera. For example, the fingerprint sensor may be attached to a rear surface of a display panel to recognize ridges and valleys of a fingerprint based on information of a carrier (for example, ultrasonic wave or light) passing through the display panel.
However, deviations may occur in a process of manufacturing a sensor and a process of attaching the sensor to the display panel, and calibration may be desired or required after attaching the sensor to the display panel.
Aspects of one or more embodiments of the present disclosure are directed towards a method and system for calibrating an ultrasonic sensor in which the uniformity can be improved by directly calibrating each portion of an ultrasonic image.
Additional aspects will be set forth in part in the description which follows and, in part, will be apparent from the description, or may be learned by practice of the presented embodiments of the disclosure.
A method for calibrating an ultrasonic sensor according to one or more embodiments of the present disclosure may include: transmitting a first ultrasonic signal from the ultrasonic sensor toward a first surface of a contact device when a model is on the first surface of the contact device; generating ultrasonic images by sampling a first ultrasonic echo signal, the first ultrasonic echo signal comprising a reflected signal of the first ultrasonic signal, at a plurality of reception time points; detecting portions of the ultrasonic images, wherein detected portions of the ultrasonic images are most similar to corresponding portions of a reference image of the model when compared to other portions of the ultrasonic images having same positions as the detected portions and detected at different reception time points of the plurality of reception time points than the detected portions; and storing the reception time points corresponding to the detected portions of the ultrasonic images.
In one or more embodiments, positions of the corresponding portions of the reference image may include first coordinates on a first axis extending in a first direction and second coordinates on a second axis extending in a second direction perpendicular to the first direction (e.g., the positions defining the corresponding portion of the reference image include the first coordinates and the second coordinates).
In one or more embodiments, the positions of the detected portions of the ultrasonic images may include the first coordinates and the second coordinates, and the reception time points corresponding to the detected portions of the ultrasonic images may differ from each other at at least two of the first coordinates.
In one or more embodiments, thicknesses of the ultrasonic sensor at at least two of the first coordinates may differ from each other.
In one or more embodiments, degrees of bending of the ultrasonic sensor at at least two of the first coordinates may differ from each other.
In one or more embodiments, the positions of at least two of the detected portions may have the same first coordinates and may have different second coordinates.
A method for calibrating an ultrasonic sensor according to one or more embodiments of the present disclosure may include: transmitting ultrasonic signals of a plurality of frequencies from the ultrasonic sensor toward a first surface of a contact device when a model is on the first surface of the contact device; generating ultrasonic images by sampling ultrasonic echo signals, the ultrasonic echo signals including reflected signals of the ultrasonic signals, at a plurality of reception time points; detecting portions of the ultrasonic images, wherein detected portions of the ultrasonic images are most similar to corresponding portions of a reference image of the model compared to other portions of the ultrasonic images having same positions as the detected portions and detected at different reception time points of the plurality of reception time points than the detected portions; and storing the reception time points and the frequencies corresponding to the detected portions of the ultrasonic images.
In one or more embodiments, positions of the corresponding portions of the reference image may include first coordinates on a first axis extending in a first direction and second coordinates on a second axis extending in a second direction perpendicular to the first direction.
In one or more embodiments, positions of the detected portions of the ultrasonic images may include the first coordinates and the second coordinates, and at least two of the detected portions may have the same second coordinates, the same frequency and different reception time points.
In one or more embodiments, at least two of the detected portions may have the same first coordinates, different frequencies and independent reception time points.
In one or more embodiments, at least two of the detected portions of the ultrasonic images may have different frequencies, and different reception time points.
In one or more embodiments, at least two of the detected portions may have the same first coordinates, the same reception time point, and different frequencies.
In one or more embodiments, at least two of the detected portions may have the same second coordinates, the same frequency, and different reception time points.
A system for calibrating an ultrasonic sensor according to one or more embodiments of the present disclosure may include: a contact device having a first surface; an ultrasonic sensor configured to transmit an ultrasonic signal toward the first surface and to generate an ultrasonic image based on an ultrasonic echo signal, the ultrasonic echo signal including a reflected signal of the ultrasonic signal; and a measuring device configured to determine parameters of the ultrasonic sensor using the ultrasonic echo signal. The ultrasonic sensor is configured to transmit a first ultrasonic signal toward the first surface when a model is on the first surface, and to generate ultrasonic images by sampling a first ultrasonic echo signal, the first ultrasonic echo signal including a reflected signal of the first ultrasonic signal, at a plurality of reception time points, and the measuring device configured to detect portions of the ultrasonic images that are most similar to corresponding portions of a reference image of the model compared to other portions of the ultrasonic images having same positions as the detected portions and detected at different reception time points of the plurality of reception time points than the detected portions, and to store the reception time points of the plurality of reception time points corresponding to detected portions of the ultrasonic images as first parameters.
In one or more embodiments, positions of the corresponding portions of the reference image may include first coordinates on a first axis extending in a first direction and second coordinates on a second axis extending in a second direction perpendicular to the first direction.
In one or more embodiments, positions of the detected portions of the ultrasonic images may include the first coordinates and the second coordinates and wherein the reception time points corresponding to the detected portions may differ from each other at at least two of the first coordinates.
In one or more embodiments, the positions of at least two of the detected portions may have the same first coordinates and different second coordinates.
In one or more embodiments, the ultrasonic sensor may further be configured to transmit a second ultrasonic signal toward the first when the model is on the first surface, and to generate ultrasonic images by sampling a second ultrasonic echo signal, the second ultrasonic echo signal including a reflected signal of the second ultrasonic signal at a plurality of reception time points. A frequency of the first ultrasonic signal and a frequency of the second ultrasonic signal may be different from each other, and the measuring device may further be configured to store frequencies corresponding to the detected portions of the ultrasonic images as second parameters.
In one or more embodiments, positions of the corresponding portions of the reference image may include first coordinates on a first axis extending in a first direction and second coordinates on a second axis extending in a second direction perpendicular to the first direction, positions of the detected portions of the ultrasonic images may include the first coordinates and the second coordinates, and at least two of the detected portions may have the same second coordinates, the same frequency, and different reception time points, and at least two of the detected portions may have the same first coordinates, different frequencies, and different reception time points.
In one or more embodiments, positions of the corresponding portions of the reference image may include first coordinates on a first axis extending in a first direction and second coordinates on a second axis extending in a second direction perpendicular to the first direction, positions of the detected portions of the ultrasonic images comprises the first coordinates and the second coordinates, and at least two of the detected portions may have the same first coordinates, the same reception time point, and different frequencies, and at least two of the detected portions may have the same second coordinates, the same frequency, and different reception time points.
The accompanying drawings, which are included to provide a further understanding of the present disclosure, and are incorporated in and constitute a part of this specification, illustrate example embodiments of the present disclosure, and, together with the description, serve to explain aspects, features, and/or principles of the present disclosure.
Hereinafter, various embodiments of the present disclosure will be described in more detail with reference to the accompanying drawings so that those of ordinary skill in the art may easily implement the present disclosure. The present disclosure may be embodied in various different forms and is not limited to the embodiments described herein. Rather, these embodiments are provided as examples so that this disclosure will be thorough and complete, and will fully convey the aspects and features of the present disclosure to those skilled in the art. Accordingly, processes, elements, and techniques that are not necessary to those having ordinary skill in the art for a complete understanding of the aspects and features of the present disclosure may not be described.
In order to clearly describe the present disclosure, parts that are not related to the description may not be provided, and the same or similar components are denoted by the same reference numerals throughout the specification. Therefore, the reference numerals described above may also be used in other drawings.
In addition, the size and thickness of each component shown in the drawings may be exaggerated for convenience of description, and thus the present disclosure is not necessarily limited to those shown in the drawings. In the drawings, thicknesses may be exaggerated to clearly express the layers and regions.
In addition, in the description, the expression “is the same” may mean “substantially the same”. That is, it may be the same enough to convince those of ordinary skill in the art to be the same. In other expressions, “substantially” may not be provided.
It will be understood that, although the terms “first,” “second,” “third,” etc., may be used herein to describe various elements, components, regions, layers and/or sections, these elements, components, regions, layers and/or sections should not be limited by these terms. These terms are used to distinguish one element, component, region, layer or section from another element, component, region, layer or section. Thus, a first element, component, region, layer or section described below could be termed a second element, component, region, layer or section, without departing from the spirit and scope of the present disclosure.
It will be understood that when an element or layer is referred to as being “on,” “connected to,” or “coupled to” another element or layer, it can be directly on, connected to, or coupled to the other element or layer, or one or more intervening elements or layers may be present. In addition, it will also be understood that when an element or layer is referred to as being “between” two elements or layers, it can be the only element or layer between the two elements or layers, or one or more intervening elements or layers may also be present.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the present disclosure. As used herein, the singular forms “a” and “an” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprises,” “comprising,” “includes,” and “including,” when used in this specification, specify the presence of the stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items.
Further, the use of “may” when describing embodiments of the present disclosure refers to “one or more embodiments of the present disclosure.” As used herein, the terms “use,” “using,” and “used” may be considered synonymous with the terms “utilize,” “utilizing,” and “utilized,” respectively.
Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the present disclosure belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and/or the present specification, and should not be interpreted in an idealized or overly formal sense, unless expressly so defined herein.
Referring to
The display panel 10 may include display pixels DPX. The display pixels DPX may be arranged on a plane defined by a first direction X and a second direction Y. The display pixels DPX are not necessarily arranged in a flat shape, but may also be arranged in a curved shape. For example, a side surface of the display panel 10 may have a curved shape, and the display pixels DPX disposed on the side surface of the display panel 10 may be arranged in a curved shape. The display pixels DPX may display an image by emitting light in a third direction Z. When a user looks at a first surface 10a of the display panel 10, the user can view the displayed image. A detailed configuration of the display panel 10 may be in accordance with the related art. The first direction X, the second direction Y, and the third direction Z may be directions orthogonal to each other.
The ultrasonic sensor 20 may include a sensor controller 201, an ultrasonic transceiver 202, and a memory 203. The ultrasonic sensor 20 (or the ultrasonic transceiver 202) may be positioned to overlap a first area AR1 of the display panel 10. For example, the ultrasonic sensor 20 (or the ultrasonic transceiver 202) may be positioned to be attached to a second surface 10b of the display panel 10. The second surface 10b may be opposite to the first surface 10a. The ultrasonic sensor 20 may be a sensor utilizing ultrasonic waves as a carrier, and may be utilized as a fingerprint sensor, a health check sensor (for example, for sensing blood flow, pulse, etc. of a finger), and/or any other suitable sensor utilizing ultrasonic waves. However, for convenience of description, it is assumed that the ultrasonic sensor 20 is a fingerprint sensor hereinafter.
The ultrasonic sensor 20 may be to transmit an ultrasonic signal toward the first surface 10a, and may generate an ultrasonic image based on an ultrasonic echo signal which is a reflected signal of the ultrasonic signal. For example, when the sensor controller 201 determines parameters (for example, a frequency of the ultrasonic signal and a reception time point of the ultrasonic echo signal) of the ultrasonic signal read from the memory 203, the ultrasonic transceiver 202 may be to transmit the ultrasonic signal corresponding to the determined parameters. In one or more embodiments, when the ultrasonic transceiver 202 receives (that is, samples) the ultrasonic echo signal corresponding to the parameters, the sensor controller 201 may generate the ultrasonic image utilizing the ultrasonic echo signal. In this case, the sensor controller 201 may generate a plurality of ultrasonic images corresponding to a plurality of reception time points or frequencies of the ultrasonic echo signal. A difference between a transmission time point of the ultrasonic signal and a reception time point of the ultrasonic echo signal may be defined as a reception delay time (or range gate delay). Hereinafter, it is assumed that the transmission time point of the ultrasonic signal is constant (e.g., the same). Accordingly, different reception time points may refer to different reception delay times. Because the ultrasonic sensor 20 may be configured utilizing a related product or a related technology in the art, a detailed description thereof will not be provided.
A contact device for the ultrasonic sensor 20 (e.g., a device to be contacted to use the ultrasonic sensor 20) may not necessarily be limited to the display panel 10. For example, the contact device may be a non-display device such as a cover for the ultrasonic sensor 20. For example, when there is no air gap between the first surface 10a and the second surface 10b, any contact device for the ultrasonic sensor 20 may be applied to embodiments of the present disclosure. When there is an air gap between the first surface 10a and the second surface 10b, it may be difficult for the ultrasonic sensor 20 to exhibit effective performance because the ultrasonic signal does not pass well. Hereinafter, the reference number “10” will refer to a contact device 10 instead of the display 10.
A measuring device 30 may be configured as a general-purpose computer or a measurement-only computer. The measuring device 30 may be to transmit/receive data to/from the sensor controller 201. For example, the measuring device 30 may determine parameters of the ultrasonic sensor 20 utilizing the ultrasonic echo signal. The parameters may include a first parameter (for example, the reception time point of the ultrasonic echo signal) and a second parameter (for example, the frequency of the ultrasonic signal). The parameters determined by the measuring device 30 may be stored in the memory 203 of the ultrasonic sensor 20 and utilized in the end user environment.
Referring to
Here, the model FFG may be similar to or the same as a sensing target of the ultrasonic sensor 20. For example, when the ultrasonic sensor 20 is a fingerprint sensor, the sensing target may be a fingerprint. In this case, a surface of the model FFG in contact with the first surface 10a may have ridges and valleys like or similar to a human fingerprint. For example, the model FFG may be made of a material such as rubber or polydimethylsiloxane (PDMS).
Next, the ultrasonic sensor 20 may generate an ultrasonic image by sampling a first ultrasonic echo signal usr1 which is a reflected signal of the first ultrasonic signal ust1 at a specific reception time point.
The generated ultrasonic images may vary according to a combination of the frequency of the first ultrasonic signal ust1 and the reception time point of the first ultrasonic echo signal usr1. In this case, the measuring device 30 may select an ultrasonic image having the highest similarity to a reference image from among the generated ultrasonic images. For example, the reference image may be an image in which the ridges and valleys of the model FFG are clearly distinguished, and may be prepared in advance. The reference image and the ultrasonic images may be objects defined by first coordinates on a first axis extending in the first direction X and second coordinates on a second axis extending in the second direction Y perpendicular to the first direction X. The measuring device 30 may store a combination of the frequency and the reception time point corresponding to the selected ultrasonic image in the memory 203 of the ultrasonic sensor 20 as parameters.
The calibration process described in
However, in reality, an ultrasonic sensor 20′ may have deviations (distribution of characteristics of transducers, deviation of thickness by location, etc.) occurring in a manufacturing process, and deviations (degree of inclination and bending) may occur in a process of attaching the ultrasonic sensor 20′ to the display panel 10.
For example, based on a central position 20C of the ultrasonic sensor 20′, a first position 20S1 may be thinner and a second position 20S2 may be thicker. For example, thicknesses of the ultrasonic sensors 20′ corresponding to the first coordinates may be different from each other. In one or more embodiments, the thickness of the ultrasonic sensor 20′ may be constant, but the second position 20S2 may be bent in a direction opposite to the third direction Z. For example, the degrees of bending of the ultrasonic sensor 20′ corresponding to the first coordinates may be different from each other.
In this case, based on the reception delay time of the central position 20C of the ultrasonic sensor 20′, the reception delay time of the first position 20S1 may be shorter and the reception delay time of the second position 20S2 may be longer.
Referring to
In the embodiment(s) of
For example, the measuring device 30 may determine the reception time point utilized to generate an ultrasonic image 400 having high luminance at the central position 20C as a first parameter of the ultrasonic sensor 20. Accordingly, when the calibrated ultrasonic sensor 20′ senses the model FFG, an ultrasonic image CIM_ref identical to the ultrasonic image 400 can be generated. In this case, dark portions may occur in the ultrasonic image at (e.g., defined by) positions 20S1 and 20S2 other than the central position 20C, and it may be difficult to recognize a fingerprint.
Ultrasonic images 400M4 to 400P4 of
In the present embodiment, the measuring device 30 may detect portions ptM4, ptM3, ptM2, ptM1, ptz, ptP1, ptP2, ptP3, and ptP4 of the ultrasonic images 400M4 to 400P4 most similar to each of portions of the reference image, and store the reception time points corresponding to the detected portions ptM4 to ptP4 of the ultrasonic images 400M4 to 400P4 in the memory 203 as first parameters.
For example, the measuring device 30 may determine the reception time point utilized to generate the ultrasonic image 400 including a portion ptz having high luminance at the central position 20C as a first parameter for the central position 20C. In one or more embodiments, the measuring device 30 may determine the reception time point utilized to generate the ultrasonic image 400M4 including a portion ptM4 having high luminance at the first position 20S1 as a first parameter for the first position 20S1. In one or more embodiments, the measuring device 30 may determine the reception time point utilized to generate the ultrasonic image 400P4 including a portion ptP4 having high luminance at the second position 20S2 as a first parameter for the second position 20S2. Similarly, the measuring device 30 may determine the reception time points utilized to generate the ultrasonic images 400M3, 400M2, 400M1, 400P1, 400P2, and 400P3 including portions ptM3, ptM2, ptM1, ptP1, ptP2, and ptP3 having high luminance at different positions as first parameters for each position.
Accordingly, when the calibrated ultrasonic sensor 20′ senses the model FFG, portions ptM4 to ptP4 of the ultrasonic images 400M4 to 400P4 may be generated. The ultrasonic sensor 20′ may generate an ultrasonic image CIM by combining the portions ptM4 to ptP4 to correspond to each position. In this case, the portions ptM4 to ptP4 may not overlap each other. For example, the first coordinates of the portions ptM4 to ptP4 may not overlap each other. For example, the ultrasonic sensor 20′ may complete the ultrasonic image CIM by interpolating adjacent boundaries of the portions ptM4 to ptP4 in empty areas where the portions ptM4 to ptP4 do not exist.
According to the present embodiment(s), a clear (or high-brightness) ultrasonic image CIM can be generated not only at the central position 20C but also at other positions 20S1 and 20S2, and a fingerprint can be easily recognized in all portions of the ultrasonic image CIM.
The first parameter (reception time points) and the second parameter (frequency) stored in the memory 203 based on the embodiment(s) of
In the embodiment(s) of
Referring to
Referring to
Referring to
Referring to
For example, in the embodiments of
Aspects of the method and system for calibrating an ultrasonic sensor according to one or more embodiments of the present disclosure can improve the uniformity by directly calibrating each portion of an ultrasonic image.
The [digital circuit] may be implemented with logic gates as illustrated [in
The sensor and/or any other relevant devices or components according to embodiments of the present invention described herein may be implemented utilizing any suitable hardware, firmware (e.g. an application-specific integrated circuit), software, or a combination of software, firmware, and hardware. For example, the various components of the sensor may be formed on one integrated circuit (IC) chip or on separate IC chips. Further, the various components of the sensor may be implemented on a flexible printed circuit film, a tape carrier package (TCP), a printed circuit board (PCB), or formed on one substrate. Further, the various components of the sensor may be a process or thread, running on one or more processors, in one or more computing devices, executing computer program instructions and interacting with other system components for performing the various functionalities described herein. The computer program instructions are stored in a memory which may be implemented in a computing device using a standard memory device, such as, for example, a random access memory (RAM). The computer program instructions may also be stored in other non-transitory computer readable media such as, for example, a CD-ROM, flash drive, or the like. Also, a person of skill in the art should recognize that the functionality of various computing devices may be combined or integrated into a single computing device, or the functionality of a particular computing device may be distributed across one or more other computing devices without departing from the scope of the present disclosure.
The drawings referred to heretofore and the detailed description of the present disclosure described above are merely illustrative of the present disclosure. It is to be understood that the present disclosure has been disclosed for illustrative purposes only and is not intended to limit the meaning or scope of the present disclosure as set forth in the claims. Therefore, those skilled in the art will appreciate that various modifications and equivalent embodiments are possible without departing from the scope of the present disclosure. Accordingly, the true technical protection scope of the present disclosure should be determined by the technical idea of the appended claims and their equivalents.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10-2022-0043594 | Apr 2022 | KR | national |
