Patent Application
20180082049
This application claims priority to Sweden Application No. 1651254-3, filed on Sep. 22, 2016, the disclosure of which is incorporated herein by reference in its entirety.
The present disclosure relates to an electronic device and corresponding method further enhancing how and what type of user guidance is given to a user operating a fingerprint sensor comprised with the electronic device. The present disclosure also related to a corresponding computer program product.
Various types of biometric systems are used more and more in order to provide for increased security for accessing an electronic device, thereby providing an enhanced user convenience. In particular, fingerprint sensors have been successfully integrated in such devices, for example, thanks to their small form factor, high performance and user acceptance. Among the various available fingerprint sensing principles (such as capacitive, optical, thermal, ultrasonic, etc.), capacitive sensing is most commonly used, in particular in applications where size and power consumption are important issues.
To save cost and valuable surface space, there is an effort towards smaller and smaller fingerprint sensors. In contrast to “all at once” fingerprint scanners, which capture an image of an entire fingerprint at the same time, such smaller fingerprint sensors may be substantially smaller than the user's fingerprint. By imaging only a portion of a fingerprint at any given time, the size and cost of a partial fingerprint sensor can be made considerably smaller and cheaper than that of a full fingerprint sensor. A plurality of the smaller fingerprint image portions are then combined into a complete fingerprint image, e.g. by means of feature extraction.
For allowing the smaller fingerprint image portions to be combined with each other, it is desirable if each of the fingerprint image portions has a sufficient level of quality. This typically place constrains on how the finger is contacting the fingerprint sensor. Due to various human factors issues, it is not so easy for the user to know exactly how to position his finger in relation to the fingerprint sensor, and different users will place their fingers in different ways. In order to account for this type of variation, modern partial fingerprint sensors often incorporate mechanical means for guiding the user (e.g. a depression) and/or finger position sensors to determine the finger position in relation to the fingerprint sensor.
An example of a solution to this problem is presented in WO2016137388, implementing a feedback functionality for guiding a user to correct positioning of the finger in relation to the fingerprint sensor. However, even though WO2016137388 solves many of the problems mentioned above, there would still be of interest to allow for even further targeted user guidance for instructing the user to correctly position his finger in relation to the fingerprint sensor.
In view of the above-mentioned and other drawbacks of the prior art, it is an object of the present disclosure to aid the user's placement of the finger on the fingerprint sensor by providing proper guidance for the purpose of ensuring optimal performance of interaction with the fingerprint sensor.
According to an aspect of the present disclosure, it is therefore provided a method of guiding a user of an electronic device, the electronic device comprising a display unit configured to display a graphical user interface (GUI), a fingerprint sensor having an array of pixels and configured for capturing a fingerprint representation of a fingerprint pattern of a finger of the user, and processing circuitry connected to and configured to control the operation of the display unit and the fingerprint sensor, wherein the method comprises the steps of displaying, within the GUI, a first user guidance to the user for positioning the finger at the fingerprint sensor, wherein the first user guidance is provided for positioning the finger at a first desired center portion in relation to a relative coordinate system for the fingerprint sensor, acquiring, subsequent to displaying the first user guidance, a first image using the fingerprint sensor, determining, using the processing circuitry, a first level of user conformity by correlating a position of the finger within the first image and a content of the first user guidance, displaying, within the GUI, a second user guidance to the user, wherein the second user guidance is provided for positioning the finger at a second desired center portion in relation to a relative coordinate system for the fingerprint sensor, acquiring, subsequent to displaying the second user guidance, a second image using the fingerprint sensor, determining, using the processing circuitry, a second level of user conformity by correlating a position of the finger within the second image and a content of the second user guidance and determining, using the processing circuitry, a level of user guidance influence by comparing the first and the second level of user conformity.
The present disclosure provides a solution that further specifies what and how the user is guided to in the best possible position his finger in relation to a fingerprint sensor comprised with an electronic device. By implementation of the novel concept of determining a level of user conformity and determining such a level for at least a first and a second user guidance presented to a user, it may in accordance to the present disclosure be possible how a user in fact is influenced by the user guidance. In line with the present disclosure, a level of user guidance influence level is therefore accordingly determined based on a comparison of how well the user is acting in conformity to the first and the second user guidance.
This becomes specifically interesting as the level of user guidance influence may be applied to further guiding of the user in operating the electronic device. That is, if it is determined that the user in fact is positively influenced by the user guidance and hence in fact is understanding the user guidance (typically indicated by an in comparison high level of user guidance influence), further user guidance (such as e.g. a third subsequent user guidance) may be selected to in comparison “more complicated”, and not so basic as otherwise would be necessary is the user does not really understand how to act in view of a presented user guidance (which normally would be the case if an in comparison low level of user guidance influence is determined). Thus, how well the user conforms to the received instructions will control how and/or what further information is presented to the user.
Accordingly, there is in line with the present disclosure be possible to structure the user guidance provided to the user in a form of information hierarchy, where initially basic information/guidance that is intended to be easily understood by a user is presented first. Once it is “understood” (determined) by the electronic device (based on the determined level of user guidance influence) that the user understands the information/guidance presented and acts accordingly, the user is given more detailed information that closely relates to the user's ability to conform with the provided information/guidance, preferably specifically targeted for a task at hand. By this implementation of hierarchical user guidance, it will be possible to structurally train the user to use the fingerprint sensor in the most optimal way, staring with simple instructions and continue with more complicated guidance with an improving (increasing) user guidance influence level.
The use of the fingerprint sensor may in some embodiments relate to general unlocking of the electronic device or for accessing e.g. an application installed with the device. In such an embodiment it is necessary that a fingerprint image acquired by the fingerprint sensor has an in comparison high quality to allow for fast/swift unlocking of the electronic device without having to request the user to place his finger at the fingerprint sensor for a multiple of times. Thus, if the user is “trained” using the hierarchical user guidance concept as is presented in accordance to the present disclosure, future fingerprint image acquisitions may directly be made with a higher quality as compared to if e.g. no continuous guidance (as is common in modern implementations of electronic devices comprising a fingerprint sensor) is given to the user for better understanding of how the fingerprint sensor is best used.
In line with the above, if the user has been trained to directly (once the user is to unlock the device) position his finger in an in comparison “optimal way”, it may in some implementations also be possible to allow for an increased security level (i.e. to reduce the false acceptance rate, FRR, further as compared to a normal implementation) for unlocking the electronic device, as it is previously known that the “rightful owner” of the electronic device is expected to position his finger at the fingerprint sensor in such a way that a high quality fingerprint image is to be expected, where a desirable amount of fingerprint features are to be expected and possible to use for authenticating the user.
The expression display unit should in accordance to the present disclosure be interpreted in the broadest sense, as well as how to provide a GUI. That is, the display unit may possibly comprise e.g. an LCD screen or similar. However, the display unit may alternatively be implemented using a light emitting diodes (LEDs) for providing the GUI.
In another embodiment the hierarchical user guidance concept as is presented in accordance to the present disclosure may be used for training the user for other uses of the fingerprint sensor, i.e. not only for using the fingerprint sensor to unlock the electronic device. Such uses may for example relate to using the fingerprint sensor to control a position of a “pointer/cursor” shown in the graphical user interface (GUI) provided within the display unit comprised with the electronic device. That is, in some embodiment the user may “move around” his finger at the fingerprint sensor, where the movement of the finger will reflect as movement of the pointer/cursor within the GUI. To “master” such a functionality it is normally necessary to properly train the user in correct movement patterns, how hard to place his finger at the fingerprint sensor for achieving a desirable fingerprint image quality level, where the outer boundaries of the fingerprint sensor are (what area to move the finger within), etc.
In an alternative embodiment of the present disclosure, it may additionally be possible to use the determined level of user guidance influence for defining an experience level for the user, and further use this information for selecting what information that is to be presented to the user. That is, in the most general sense of the present disclosure it is determined the user is influenced by the given instructions/guidance. On the other hand, having a high level of user guidance influence to instructions/guidance does not necessarily directly mean that the user has a high experience level. However, if adapting the method according to the present disclosure to allow for a determination of both the level of user guidance influence and how experienced the user is, it could be possible to even further guide the user in his use of the fingerprint sensor.
It should be understood that the user guidance provided to the user may be configured in many different ways to best instruct the user in how the fingerprint sensor is to be used. Possibly, the user guidance provided to the user within the GUI may accordingly comprise at least one of an animated icon, a dialogue box and an informative film. It could also be possible to provide haptic feedback to the user as part of the user guidance.
Furthermore, it should also be understood that both of the determined level of user guidance influence and the determined level of experience may be used by further components of the electronic device in giving instructions, guidance and feedback to the user. That is, if it previously has been determined a level of user guidance influence and an experience level, then subsequently used functions (possibly presented in an application running at the electronic device and possibly non-related to the fingerprint sensor) may adapt its user interface to match the determined user guidance influence and experience level. Thus, a user that has been determined to not easily understand the provided instructions may be given slightly different instructions to better handle the application.
Still further, the expression “processing circuitry” as used above should be understood to include any type of computing device, such as an ASIC, a micro-processor, etc. It should also be understood that the actual implementation of such a processing circuitry may be divided between more than a single device/circuit.
According to another aspect of the present disclosure, there is provided an electronic device, comprising a display unit configured to display a graphical user interface (GUI), a fingerprint sensor having an array of pixels and configured for capturing a fingerprint representation of a fingerprint pattern of a finger of a user, and processing circuitry electrically connected to the fingerprint sensor and the display unit, wherein the processing circuitry is configured to display, within the GUI, a first user guidance to the user for positioning the finger at the fingerprint sensor, wherein the first user guidance is provided for positioning the finger at a first desired center portion in relation to a relative coordinate system for the fingerprint sensor, acquire, subsequent to displaying the first user guidance, a first image using the fingerprint sensor, determine, using the processing circuitry, a first level of user conformity by correlating a position of the finger within the first image and a content of the first user guidance, display, within the GUI, a second user guidance to the user, wherein the second user guidance is provided for positioning the finger at a second desired center portion in relation to a relative coordinate system for the fingerprint sensor, acquiring, subsequent to displaying the second user guidance, a second image using the fingerprint sensor, determine, using the processing circuitry, a second level of user conformity by correlating a position of the finger within the second image and a content of the second user guidance, and determine, using the processing circuitry, a level of user guidance influence by comparing the first and the second level of user conformity.
According to a further aspect of the present disclosure, there is provided a computer program product comprising a non-transitory computer readable medium having stored thereon computer program means for controlling an electronic device, the electronic device comprising a fingerprint sensing system including a fingerprint sensor and processing circuitry, the fingerprint sensing system adapted for forming a fingerprint representation of a fingerprint pattern of a finger of a user, wherein the computer program product comprises code for displaying, within the GUI, a first user guidance to the user for positioning the finger at the fingerprint sensor, wherein the first user guidance is provided for positioning the finger at a first desired center portion in relation to a relative coordinate system for the fingerprint sensor, code for acquiring, subsequent to displaying the first user guidance, a first image using the fingerprint sensor, code for determining a first level of user conformity by correlating a position of the finger within the first image and a content of the first user guidance, code for displaying, within the GUI, a second user guidance to the user, wherein the second user guidance is provided for positioning the finger at a second desired center portion in relation to a relative coordinate system for the fingerprint sensor, code for acquiring, subsequent to displaying the second user guidance, a second image using the fingerprint sensor, code for determining a second level of user conformity by correlating a position of the finger within the second image and a content of the second user guidance, and code for determining a level of user guidance influence by comparing the first and the second level of user conformity.
A software executed by the server for operation in accordance to the present disclosure may be stored on a computer readable medium, being any type of memory device, including one of a removable nonvolatile random access memory, a hard disk drive, a floppy disk, a CD-ROM, a DVD-ROM, a USB memory, an SD memory card, or a similar computer readable medium known in the art.
In summary, the present disclosure generally relates to a method of guiding a user of an electronic device, the electronic device comprising a display unit configured to display a graphical user interface (GUI), a fingerprint sensor having an array of pixels and configured for capturing a fingerprint representation of a fingerprint pattern of a finger, and processing circuitry connected to and configured to control the operation of the display unit and the fingerprint sensor, wherein the method comprises the steps of displaying, within the GUI, a first user guidance to the user for positioning the finger at the fingerprint sensor, acquiring, subsequent to displaying the first user guidance, a first image using the fingerprint sensor, determining, using the processing circuitry, a first level of user conformity by correlating a position of the finger within the first image and a content of the first user guidance, displaying, within the GUI, a second user guidance to the user, acquiring, subsequent to displaying the second user guidance, a second image using the fingerprint sensor, determining, using the processing circuitry, a second level of user conformity by correlating a position of the finger within the second image and a content of the second user guidance, and determining, using the processing circuitry, a level of user guidance influence by comparing the first and the second level of user conformity.
The present disclosure provides a solution that further specifies what and how the user is instructed to position his finger in relation to a fingerprint sensor comprised with an electronic device.
Further features of, and advantages with, the present disclosure will become apparent when studying the appended claims and the following description. The skilled addressee realize that different features of the present disclosure may be combined to create embodiments other than those described in the following, without departing from the scope of the present disclosure.
The various aspects of the present disclosure, including its particular features and advantages, will be readily understood from the following detailed description and the accompanying drawings, in which:
The present disclosure will now be described more fully hereinafter with reference to the accompanying drawings, in which currently preferred embodiments of the present disclosure are shown. This present disclosure may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided for thoroughness and completeness, and fully convey the scope of the present disclosure to the skilled person. Like reference characters refer to like elements throughout.
Turning now to the drawings and to
Preferably and as is apparent for the skilled person, the mobile phone 100, 100′, 100″ shown in
With reference to
In accordance with the present disclosure, the fingerprint sensor 102 and the operation for acquiring a fingerprint image is achieved using a conceptualized fingerprint sensor system 300 as is illustrated in
The fingerprint sensor system 300 comprises the fingerprint sensor 102 and a processing circuitry, such as a control unit 302 for controlling the fingerprint sensor 102. The fingerprint sensor system 300 further comprises a memory, such as a database 304, e.g. storing a fingerprint template for the user, as well as for storing user guidance data to be presented to the user using the GUI. The control unit 302 may each include a microprocessor, microcontroller, programmable digital signal processor or another programmable device. The control unit 302 may also, or instead, each include an application specific integrated circuit, a programmable gate array or programmable array logic, a programmable logic device, or a digital signal processor. Where the control unit 302 includes a programmable device such as the microprocessor, microcontroller or programmable digital signal processor mentioned above, the processor may further include computer executable code that controls operation of the programmable device. It should be understood that all or some parts of the functionality provided by means of the control unit 302 (or generally discussed as “processing circuitry”) may be at least partly integrated with the fingerprint sensor 102.
During use of e.g. the mobile phone 100, for example for unlocking the mobile phone 100, the user is required to arrange his finger onto the fingerprint sensor 102. In some implementations, the fingerprint sensor 102 may be integrated with the mobile phone 100 in such a way that it will not be readily apparent for the user exactly where on the front of the mobile phone 100 to place his finger, specifically for allowing the acquisition of a fingerprint image having a desired quality level. If the quality level is below a specified threshold, the user is generally repeatedly instructed to place his finger at the fingerprint sensor 102 until a fingerprint image having the desired quality level has been acquired. The level of quality may in one embodiment be defined as an indication of the possibility of successful feature extraction (i.e. being a representation of the fingerprint), for example, where sufficient contrast between ridges and valleys of the fingerprint is identifiable. Successful feature extraction is typically essential for achieving a successful enrollment as well as verification/authentication of the users fingerprint, e.g. for use in unlocking the mobile phone 100, for verifying a purchase, etc.
As understood, in case position of the fingerprint sensor 102 is not readily apparent for the user (such as on the back as is shown in
An unapparent integration of the fingerprint sensor 102 may for example be if the fingerprint sensor is arranged to fully coincide with a front of the mobile phone 100, e.g. such that all of the front of the mobile phone 102 is “flat”, i.e. without any (or only limited) mechanical guidance for the user in using the fingerprint sensor 102.
Accordingly, it is desirable to provide sufficient, personalized and direct user guidance to the user. In addition, it is preferred if the user guidance in fact is giving the user a feeling that he is in fact is learning something from the user guidance, not being interpreted as repeated and therefore annoying.
During operation of the inventive mobile phone 100, 100′, 100′, with further reference to
Following this determination, a second user guidance is displayed, S4, within the GUI 106. Subsequently to displaying the second user guidance, a second image of the finger is acquired, S5, using the fingerprint sensor 102. Based on the second fingerprint image, a second level of user conformity is determined, S6, by correlating a position of the finger within the second image and a content of the second user guidance. Based on the two determinations (i.e. first and second) of user conformity, the control unit 302 subsequently determines, S7, a level of user guidance influence by comparing the first and the second level of user conformity.
In a typical implementation, if both the first level of user conformity and the second level of user conformity is above a predetermined threshold, this will generate a high level of user guidance influence, i.e. how well the (first and second) user guidance has been understood by the user. On the other hand, if both the first and the second level of user conformity are below the predetermined threshold, this will typically generate a low level of user guidance influence. Additionally, in case one of the first and the second level of user conformity is above the predetermined threshold and the other level of user conformity is below the predetermined threshold, then this typically will generate a medium level of user guidance influence. Accordingly, further user guidance provided to the user may be allowed to depend on the determined level of user guidance influence, where more in-depth user guidance typically will be given to a user having a high level of user guidance influence.
In
To exemplify, in
In
In addition, if it has been determined that the user has a high level of user guidance influence, it is possible to provide further information/data with the presented user guidance. In
As indicated above the concept as provided in accordance to the present disclosure may be implemented in other types of electronic devices, i.e. not necessarily in relation to electronic devices such as mobile phones, laptops, tablets, etc. Rather, the concept as provided in line with the present disclosure may be implemented also in such an electronic device as a door handle 602 for e.g. a vehicle. In such an implementation the fingerprint sensor 102 could for example be implemented in a “hidden” manner, such as at an inside 604 of the door handle 602. The door handle may further be provided with a plurality of LEDs 606 forming the display unit adapted to present the GUI. The LEDs 606 are in such an implementation adapted to display the first and the second user guidance.
The control functionality of the present disclosure may be implemented using existing computer processors, or by a special purpose computer processor for an appropriate system, incorporated for this or another purpose, or by a hardwire system. Embodiments within the scope of the present disclosure include program products comprising machine-readable medium for carrying or having machine-executable instructions or data structures stored thereon. Such machine-readable media can be any available media that can be accessed by a general purpose or special purpose computer or other machine with a processor. By way of example, such machine-readable media can comprise RAM, ROM, EPROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to carry or store desired program code in the form of machine-executable instructions or data structures and which can be accessed by a general purpose or special purpose computer or other machine with a processor. When information is transferred or provided over a network or another communications connection (either hardwired, wireless, or a combination of hardwired or wireless) to a machine, the machine properly views the connection as a machine-readable medium. Thus, any such connection is properly termed a machine-readable medium. Combinations of the above are also included within the scope of machine-readable media. Machine-executable instructions include, for example, instructions and data which cause a general purpose computer, special purpose computer, or special purpose processing machines to perform a certain function or group of functions.
Although the figures may show a sequence the order of the steps may differ from what is depicted. Also two or more steps may be performed concurrently or with partial concurrence. Such variation will depend on the software and hardware systems chosen and on designer choice. All such variations are within the scope of the disclosure. Likewise, software implementations could be accomplished with standard programming techniques with rule-based logic and other logic to accomplish the various connection steps, processing steps, comparison steps and decision steps. Additionally, even though the present disclosure has been described with reference to specific exemplifying embodiments thereof, many different alterations, modifications and the like will become apparent for those skilled in the art.
In addition, variations to the disclosed embodiments can be understood and effected by the skilled addressee in practicing the present disclosure, from a study of the drawings, the disclosure, and the appended claims. Furthermore, in the claims, the word “comprising” does not exclude other elements or steps, and the indefinite article “a” or “an” does not exclude a plurality.
| Number | Date | Country | Kind |
|---|---|---|---|
| 16512543 | Sep 2016 | SE | national |
