The present specification relates to authentication, particularly in multi-device scenarios.
Performing authentication of devices and users through different means is known. There remains a need for improvement in authentication methods in multi-device systems.
In a first aspect, this specification provides an apparatus comprising: means for generating electromagnetic radiation; means for enabling capturing one or more biometric features of a user using the electromagnetic radiation, wherein the one or more biometric features of the user are usable for authenticating a user identity of the user; means for transmitting data using said electromagnetic radiation, wherein at least part of the transmitted data is usable for at least one of authenticating or connecting to one or more user devices.
In some examples, the means for transmitting data comprise means for modulating said electromagnetic radiation at least one of spatially, or temporally.
In some examples, the one or more biometric features of the user comprise blood vessel patterns of the user.
In some examples, the electromagnetic radiation comprises at least one of visible light or infrared radiation.
In some examples, the means for generating electromagnetic radiation comprises means for illuminating a first side of an ear of the user, and wherein the capturing one or more biometric features comprises means for capturing a blood vessel pattern of the ear from a second side of the ear.
In some examples, the means for capturing one or more biometric features comprise one or more imaging sensors.
In some examples, the apparatus is part of one of a mobile communication device, head worn device, or ear worn device.
In some examples, at least one of the one or more user devices is a mobile communication device, head worn device, or ear worn device.
In some examples, the means for generating electromagnetic radiation comprise at least one of one or more infrared light emitting devices, a facial detecting means, a proximity sensor, a device display screen, or a device flashlight.
In some examples, the capturing one or more biometric features is performed at at least one of the one or more user devices.
In some examples, the means comprise: at least one processor; and at least one memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to: generate electromagnetic radiation; enable capturing one or more biometric features of a user using the electromagnetic radiation, wherein the one or more biometric features of the user are usable for authenticating a user identity of the user; transmit data using said electromagnetic radiation, wherein at least part of the transmitted data is usable for at least one of authenticating or connecting to one or more user devices.
In a second aspect, the specification describes a method comprising: generating electromagnetic radiation; enabling capturing one or more biometric features of a user using the electromagnetic radiation, wherein the one or more biometric features of the user are usable for authenticating a user identity of the user; transmitting data using said electromagnetic radiation, wherein at least part of the transmitted data is usable for at least one of authenticating or connecting to one or more user devices.
In some examples, transmitting data comprises modulating said electromagnetic radiation at least one of spatially, or temporally.
In some examples, the one or more biometric features of the user comprise blood vessel patterns of the user.
In some examples, the electromagnetic radiation comprises at least one of visible light or infrared radiation.
In some examples, generating electromagnetic radiation comprises illuminating a first side of an ear of the user, and wherein the capturing one or more biometric features comprises means for capturing a blood vessel pattern of the ear from a second side of the ear.
In some examples, capturing one or more biometric features is performed using one or more imaging sensors.
In some examples, the method is performed in an apparatus that is part of one of a mobile communication device, head worn device, or ear worn device.
In some examples, at least one of the one or more user devices is a mobile communication device, head worn device, or ear worn device.
In some examples, generating electromagnetic radiation is performed using at least one of one or more infrared light emitting devices, a facial detecting means, a proximity sensor, a device display screen, or a device flashlight.
In some examples, the capturing one or more biometric features is performed at at least one of the one or more user devices.
In a third aspect, this specification describes an apparatus configured to perform any method as described with reference to the second aspect.
In a fourth aspect, this specification describes computer-readable instructions which, when executed by computing apparatus, cause the computing apparatus to perform any method as described with reference to the second aspect.
In a fifth aspect, this specification describes a computer program comprising instructions for causing an apparatus to perform at least the following: generating electromagnetic radiation; enabling capturing one or more biometric features of a user using the electromagnetic radiation, wherein the one or more biometric features of the user are usable for authenticating a user identity of the user; transmitting data using said electromagnetic radiation, wherein at least part of the transmitted data is usable for at least one of authenticating or connecting to one or more user devices.
In a sixth aspect, this specification describes a computer-readable medium (such as a non-transitory computer-readable medium) comprising program instructions stored thereon for performing at least the following: generating electromagnetic radiation; enabling capturing one or more biometric features of a user using the electromagnetic radiation, wherein the one or more biometric features of the user are usable for authenticating a user identity of the user; transmitting data using said electromagnetic radiation, wherein at least part of the transmitted data is usable for at least one of authenticating or connecting to one or more user devices.
In a seventh aspect, this specification describes an apparatus comprising: at least one processor; and at least one memory including computer program code which, when executed by the at least one processor, causes the apparatus to: generate electromagnetic radiation; enable capturing one or more biometric features of a user using the electromagnetic radiation, wherein the one or more biometric features of the user are usable for authenticating a user identity of the user; transmit data using said electromagnetic radiation, wherein at least part of the transmitted data is usable for at least one of authenticating or connecting to one or more user devices.
In an eighth aspect, this specification describes an apparatus comprising: a first module configured to generate electromagnetic radiation; a second module configured to enable capturing one or more biometric features of a user using the electromagnetic radiation, wherein the one or more biometric features of the user are usable for authenticating a user identity of the user; and a third module configured to transmit data using said electromagnetic radiation, wherein at least part of the transmitted data is usable for at least one of authenticating or connecting to one or more user devices.
In a ninth aspect, this specification describes an apparatus comprising: means for receiving electromagnetic radiation from a first user device; means for capturing one or more biometric features of a user using the electromagnetic radiation, wherein the one or more biometric features of the user are usable for authenticating a user identity of the user; means for receiving data through said electromagnetic radiation, wherein at least part of the data is usable for at least one of authenticating or connecting to the first user device.
In a tenth aspect, this specification describes a method comprising: receiving electromagnetic radiation from a first user device; capturing one or more biometric features of a user using the electromagnetic radiation, wherein the one or more biometric features of the user are usable for authenticating a user identity of the user; receiving data through said electromagnetic radiation, wherein at least part of the data is usable for at least one of authenticating or connecting to the first user device.
In an eleventh aspect, this specification describes an apparatus configured to perform any method as described with reference to the tenth aspect.
In a twelfth aspect, this specification describes computer-readable instructions which, when executed by computing apparatus, cause the computing apparatus to perform any method as described with reference to the tenth aspect.
In a thirteenth aspect, this specification describes a computer program comprising instructions for causing an apparatus to perform at least the following: receiving electromagnetic radiation from a first user device; capturing one or more biometric features of a user using the electromagnetic radiation, wherein the one or more biometric features of the user are usable for authenticating a user identity of the user; receiving data through said electromagnetic radiation, wherein at least part of the data is usable for at least one of authenticating or connecting to the first user device.
In a fourteenth aspect, this specification describes a computer-readable medium (such as a non-transitory computer-readable medium) comprising program instructions stored thereon for performing at least the following: receiving electromagnetic radiation from a first user device; capturing one or more biometric features of a user using the electromagnetic radiation, wherein the one or more biometric features of the user are usable for authenticating a user identity of the user; receiving data through said electromagnetic radiation, wherein at least part of the data is usable for at least one of authenticating or connecting to the first user device.
In a fifteenth aspect, this specification describes an apparatus comprising: at least one processor; and at least one memory including computer program code which, when executed by the at least one processor, causes the apparatus to: receive electromagnetic radiation from a first user device; capture one or more biometric features of a user using the electromagnetic radiation, wherein the one or more biometric features of the user are usable for authenticating a user identity of the user; receive data through said electromagnetic radiation, wherein at least part of the data is usable for at least one of authenticating or connecting to the first user device.
In a sixteenth aspect, this specification describes an apparatus comprising: a fourth module configured to receive electromagnetic radiation from a first user device; a fifth module configured to capture one or more biometric features of a user using the electromagnetic radiation, wherein the one or more biometric features of the user are usable for authenticating a user identity of the user; and a sixth module configured to receive data through said electromagnetic radiation, wherein at least part of the data is usable for at least one of authenticating or connecting to the first user device.
In a seventeenth aspect, this specification describes a system comprising:
Example embodiments will now be described, by way of example only, with reference to the following schematic drawings, in which:
The scope of protection sought for various embodiments of the invention is set out by the independent claims. The embodiments and features, if any, described in the specification that do not fall under the scope of the independent claims are to be interpreted as examples useful for understanding various embodiments of the invention. In the description and drawings, like reference numerals refer to like elements throughout.
In some examples, identity of the user 12 may need to be authenticated by one or both of the devices 11 and 13. Additionally, or alternatively, in a scenario where the user 12 may wish to use the devices 11 and 13 in conjunction with each other (e.g. pair the devices 11 and 13 for use with each other), the devices 11 and 13 may also need to authenticate each other. For example, the first device 11 may be a smartphone or tablet, and the second device 13 may be an earphone (or any head-worn or ear-worn device such as smart glasses), and the user 12 may wish to pair and connect the two devices 11 and 13 together (e.g. to play audio from the smartphone on the earphones).
Furthermore, if there are a plurality of devices in the proximity of the user 12, the devices 11 and 13 may need to accurately identify each other. Such authentication or identification procedures may generally use Wi-Fi or Bluetooth communication channels for communication between various devices.
User devices such as mobile devices (phones, tablets) and devices (e.g. peripheral devices) that are used with such mobile devices, such as earphones, headphones, speakers, smartwatches, or the like, are used by individuals on a regular basis. In order to use a plurality of such devices together (e.g. perform multi-device interactions), device association (pairing or other coupling methods) between the devices may need to be initiated.
Because wireless communication is invisible to a user (e.g. the user cannot see the wireless links between the devices), the user may not be sure which devices are actually being connected, which may open a possibility for security breaches (e.g. Man-in-the-Middle attacks where a malicious third party may secretly relay, monitor, and possibly modify communication between the two parties who assume that they are directly communicating with each other). As such, in multi-device systems, improved authentication techniques may be desirable.
The procedure of connecting devices for multi-device interactions may be referred to as device binding or ecosystem binding, device association, pairing, or coupling.
In some examples, biometric identification techniques can be used for the user authentication. Specifically, the analysis of the patterns of blood vessels may be used to identify the user, as subcutaneous blood vessels of the human body form a distinctive pattern for each person.
Some example embodiments below provide improved techniques for performing said authentication and/or identification procedures.
In some examples, the electromagnetic radiation (22, 31) may be used for data communication, for example, by modulating the electromagnetic radiation spatially and/or temporally. The modulation procedure may be dependent on the wavelength of the electromagnetic radiation. For example, the first device 11 may send data (e.g. for device identification and/or authentication) to the second device 13 via a communication channel formed through the electromagnetic radiation (22,31). The second device 13 may need to be in proximity of the first device 11 in order to communicate via a communication channel formed through the electromagnetic radiation (22,31).
The algorithm 40 may start with operation 42, where an electromagnetic radiation (22,31) may be generated, for example, by the first device 11. Next, at operation 44, capturing of one or more biometric features of the user 12 may be enabled using said electromagnetic radiation. For example, the one or more biometric features may be captured by the first device 11 (e.g. by way of reflected electromagnetic radiation) and/or by the second device 13 (e.g. by way of reflected electromagnetic radiation or the electromagnetic radiation transmitted through tissue of the user's body part, such as an ear). In one example, one of the devices 11 and 13 may capture the one or more biometric features, and then may send information of the captured one or more biometric features to the other one of the devices 11 and 13. The one or more biometric features of the user may be usable for authenticating a user identity of the user. At operation 46, data may be transmitted (e.g. by the first device 11 to the second device 13, or vice versa) using the electromagnetic radiation (e.g. through a first communication channel formed through the electromagnetic radiation). At least part of the transmitted data may be usable for at least one of authenticating or connecting to one or more user devices. In some examples, data may be transmitted by way of modulating the electromagnetic radiation spatially and/or temporally.
In some examples, after the first device 11 is connected to the second device 13 using the first communication channel formed through the electromagnetic radiation (22, 31), the devices 11 and 13 may continue communicating through said first communication channel, although that would require the devices 11 and 13 to remain in close proximity (e.g. so that the electromagnetic radiation generated by the first device 11 may be captured by the second device 13). Alternatively, or in addition, the devices 11 and/or 13 may set up a second communication channel (e.g. via Wifi, Bluetooth, or other short range radio communication) in order to communicate once the devices have been authenticated with each other. For example, the first communication channel may be used for exchanging information (e.g. initialization information) required for setting up the second communication channel. The second communication channel may provide a better speed and the connection may have a wider range (e.g. the devices 11 and 13 may be farther apart from each other) than the first communication channel. As such, the first communication channel may be used for an initial secure connection through which the devices may be identified and authenticated, and subsequently the devices may communicate through the second communication channel.
At operation 52, a user identity is authenticated, for example, based on the one or more biometric features captured at operation 44. For example, the one or more biometric features may comprise the blood vessel (e.g. vein) patterns of the user, which may be unique to each user, and may thus be usable for authenticating the user identity. The user identity may be authenticated at one or both the devices 11 and 13. In one example, only one of the devices 11 and 13 may authenticate the user identity, and may communicate to the other one of the devices 11 and 13 that the user identity has been authenticated.
At operation 54, a user device, such as the first device 11 and/or the second device 13, may be authenticated and/or identified, based, at least in part, on the data transmitted using the electromagnetic radiation (22, 31). For example, the first device 11 may transmit data to and/or receive data from the second device 13 via a communication channel formed through the electromagnetic radiation, where the data may comprise authentication and/or identification information relating to first device 11 and/or the second device 13. Similarly, the second device 13 may transmit data to and/or receive data from the first device 11 via a communication channel formed through the electromagnetic radiation, where the data may comprise authentication and/or identification information relating to the first device 11 and/or the second device 13.
As such, the example embodiments may provide techniques for user authentication, device authentication, and secure communication channel setup for the creation of multidevice ecosystem and device-to-device communication. In an example embodiment, the communication between the first device 11 and second device 13 may be set up such that the data being transferred may be encoded using information of one or more biometric features (e.g. captured at operation 44) of the user 12. Said encoding may be suitable for associating a plurality of devices with each other for use by a specific user.
In one example, the first device 11 and/or the second device 13 may be any handheld or head worn device that may comprise at least one of: a) a photo detector and/or imaging sensor (e.g. for capturing biometric feature(s) of the user); or b) module for generating electromagnetic radiation (e.g. illumination) for communication between devices (e.g. including communication for device identification and/or authentication) and/or authentication of the user (e.g. blood vessel pattern capture). For example, the first device 11 and/or the second device 13 may be a mobile phone, earbuds or a headset for augmented reality, virtual reality and/or mixed reality applications. For example, the user (e.g. user 12) may wear a headset (e.g. first device 11) and may hold their mobile phone (e.g. second device 13) near their ear such that one of the devices may generate illumination, such that said device, or the other device may capture a blood vessel pattern of the user's ear for user authentication, and said illumination may be used for pairing the mobile phone and the headset with each other (device identification and/or authentication between the headset and the mobile phone). A similar procedure may also be used for pairing the mobile phone and/or headset with audio devices such as earphones, earbuds, or the like.
For example, the second device 13 may comprise photodetectors and/or image sensors (e.g. organic photo detector sensing technologies) for capturing image 64, where image 64 comprises blood vessel pattern(s) of at least part of the ear 62 (e.g. earlobe, outer ear (pinna), and/or ear canal). The blood vessel pattern (biometric features) may be unique to the user, such that the user may be authenticated based on the image 64. The authentication may be performed at one or both of the devices 11 and 13. The electromagnetic radiation 61 and/or 63 may be used for transferring data between the first device 11 and the second device 13, where the data may be encoded (e.g. with information of biometric features of the user), and may be used for device identification and/or authentication and may further be used for setting up a further communication channel for subsequent communication between the first device 11 and second device 13.
In an example embodiment, prior to performing user authentication, information of the user's biometric features (e.g. blood vessel patterns of one or each of the user's ears, or specifically the earlobes, outer ear, and/or ear canal) may be stored, for example at one or both of the devices 11 and 13, or remotely at a server (e.g. cloud server). The user authentication may then be performed based on whether the captured biometric features match the stored biometric features.
In one example, device borrowing may be enabled by allowing other users' biometric features to be stored and/or shared prior to user authentication. For example, a user who is not the owner of a device may be identified as a user with limited access. As such, if biometric features of a user are captured, and it is identified that the user is not the owner of the device, said user may be authenticated to be able to have limited access to the device (e.g. only allowed to use applications and/or functions defined by a primary user (owner) or predefined in default settings of the device (e.g. a camera of a mobile device, personalization settings (e.g. brightness, volume, or the like), flashlight), but restricted from using other functionalities of the mobile device).
In an example embodiment, for initially capturing and storing the user's biometric features, user interface guidance may be provided (e.g. by the first device 11) to the user for positioning the first device 11 accurately for illuminating the ear 62 (or at least part of the ear 62, such as the earlobe, outer ear, and/or ear canal). One or more images of at least part of the ear 62 may be captured, and the one or more images may be analysed using pattern recognition techniques for determining one or more biometric features (e.g. blood vessel patterns). As such, one or more unique features and/or patterns of the blood vessels may be identified and encoded into a template for the user's ear. The template may then be stored securely at a user device (e.g. first device 11, mobile phone of the user), or at a network server. In one example, blood vessel patterns for the template can be captured by illuminating at least part of the ear with visible or infrared light (electromagnetic radiation), and photographing the reflected light (e.g. by the same device that generates the light) or transmitted light (e.g. by another device on another side of at least part of the ear), as blood vessels absorb infrared light more than the surrounding tissue and appear darker in the acquired image.
User device 71 may comprise means 74 for generating electromagnetic radiation. For example, the means 74 may be located near the ears of a user when the user device 71 is worn by the user, such that the means may generate electromagnetic radiation usable for capturing blood vessel patterns of one or each of the user's ears. In one example, the means 74 may comprise infrared one or more light emitting devices (e.g. LED array) which generate infrared radiation. In another example, the means 74 may comprise a proximity sensor, which may generate electromagnetic radiation such as infrared radiation.
User device 72 may comprise means 75 for generating electromagnetic radiation. For example, the means 75 may be located near the ears of a user when the user device 75 is worn by the user, such that the means may generate electromagnetic radiation usable for capturing blood vessel patterns of the user's ears. In one example, the means 75 may comprise one or more infrared light emitting devices which generate infrared radiation. In another example, the means 75 may comprise a proximity sensor, which may generate electromagnetic radiation such as infrared radiation.
User device 73 (mobile device) may comprise means 76 and/or means 77 for generating electromagnetic radiation. For example, means 76 may be a facial detecting means (e.g. face identity projector) of the user device 73. The facial detecting means may produce infrared emission of wavelengths above 780 nm, which may be used for capturing blood vessel patterns of the ear of the user when the mobile device is held near the user's ear.
In another example, the means 77 may comprise the display of the mobile phone, which may generate visible light and/or infrared light for illumination of the user's ear when the mobile device is held near the user's ear, thus enabling capturing of blood vessel patterns of the user's ear.
In another example, the user device 73 may comprise a proximity sensor that may be embedded in the user device 73, which proximity sensor produces infrared radiation usable for capturing biometric features of the user.
In another example, the user device 73 may comprise a flash light (white light emitting device) which may generate visible light with wavelengths in the range 400 nm to 750 nm. The flash light may generate light in two modes, such as a normal imaging mode and blood vessel illumination mode, where the two modes may generate light of different wavelengths. For example, the blood vessel illumination mode may be used for generating illumination suitable for capturing blood vessel pattern(s) of the user's ear.
In some examples, one or more of the user devices 71, 72, and 73 may further comprise means for receiving electromagnetic radiation and/or capturing one or more biometric features of the user. For example, the means for receiving electromagnetic radiation may comprise sensors (e.g. photodetector, infrared radiation sensor, or the like) that may detect electromagnetic radiation, and may in turn capture one or more biometric features of one or each of the user's ear. In some examples, the same user device (71, 72, 73) may be able to generate the illumination, as well as receive the illumination (e.g. reflected electromagnetic radiation) and capture the one or more biometric feature. Alternatively, a first user device (e.g. user device 73 such as a mobile phone) may generate the illumination, and a second user device (e.g. user device 72, such as earpods) may receive the illumination and capture the one or more biometric features, or vice versa.
Operation 82 comprises receiving electromagnetic radiation from a first user device, such as the first user device 11. For example, if the operation 82 is being performed at the first device 11, the received electromagnetic radiation may be a reflected electromagnetic radiation (e.g. reflected from an ear of the user). Alternatively, if the operation 82 is being performed at the second device 13, the received electromagnetic radiation may be received through a tissue of an ear of the user.
At operation 84, one or more biometric features of a user may be captured using the electromagnetic radiation. The one or more biometric features of the user may be usable for authenticating a user identity of the user. As discussed earlier, the one or more biometric features may be captured using a photo detector and/or imaging sensor.
At operation 86, data may be received through said electromagnetic radiation. At least part of the data may be usable for at least one of authenticating or connecting to the first user device. The data may be based on modulating of the said electromagnetic radiation spatially and/or temporally.
For completeness,
The processor 302 is connected to each of the other components in order to control operation thereof.
The memory 304 may comprise a non-volatile memory, such as a hard disk drive (HDD) or a solid-state drive (SSD). The ROM 312 of the memory 304 stores, amongst other things, an operating system 315 and may store software applications 316. The RAM 314 of the memory 304 is used by the processor 302 for the temporary storage of data. The operating system 315 may contain computer program code which, when executed by the processor implements aspects of the algorithms 200, 40, 50, and 80 described above. Note that in the case of small device/apparatus the memory can be most suitable for small size usage i.e. not always hard disk drive (HDD) or solid-state drive (SSD) is used.
The processor 302 may take any suitable form. For instance, it may be a microcontroller, a plurality of microcontrollers, a processor, or a plurality of processors.
The processing system 300 may be a standalone computer, a server, a console, or a network thereof. The processing system 300 and needed structural parts may be all inside device/apparatus such as IoT device/apparatus i.e. embedded to very small size
In some example embodiments, the processing system 300 may also be associated with external software applications. These may be applications stored on a remote server device/apparatus and may run partly or exclusively on the remote server device/apparatus. These applications may be termed cloud-hosted applications. The processing system 300 may be in communication with the remote server device/apparatus in order to utilize the software application stored there.
Embodiments of the present invention may be implemented in software, hardware, application logic or a combination of software, hardware and application logic. The software, application logic and/or hardware may reside on memory, or any computer media. In an example embodiment, the application logic, software or an instruction set is maintained on any one of various conventional computer-readable media. In the context of this document, a “memory” or “computer-readable medium” may be any non-transitory media or means that can contain, store, communicate, propagate or transport the instructions for use by or in connection with an instruction execution system, apparatus, or device, such as a computer.
Reference to, where relevant, “computer-readable storage medium”, “computer program product”, “tangibly embodied computer program” etc., or a “processor” or “processing circuitry” etc. should be understood to encompass not only computers having differing architectures such as single/multi-processor architectures and sequencers/parallel architectures, but also specialised circuits such as field programmable gate arrays FPGA, application specify circuits ASIC, signal processing devices/apparatus and other devices/apparatus. References to computer program, instructions, code etc. should be understood to express software for a programmable processor firmware such as the programmable content of a hardware device/apparatus as instructions for a processor or configured or configuration settings for a fixed function device/apparatus, gate array, programmable logic device/apparatus, etc.
As used in this application, the term “circuitry” refers to all of the following: (a) hardware-only circuit implementations (such as implementations in only analogue and/or digital circuitry) and (b) to combinations of circuits and software (and/or firmware), such as (as applicable): (i) to a combination of processor(s) or (ii) to portions of processor(s)/software (including digital signal processor(s)), software, and memory (ies) that work together to cause an apparatus, such as a server, to perform various functions) and (c) to circuits, such as a microprocessor(s) or a portion of a microprocessor(s), that require software or firmware for operation, even if the software or firmware is not physically present.
If desired, the different functions discussed herein may be performed in a different order and/or concurrently with each other. Furthermore, if desired, one or more of the above-described functions may be optional or may be combined. Similarly, it will also be appreciated that the flow charts of
It will be appreciated that the above described example embodiments are purely illustrative and are not limiting on the scope of the invention. Other variations and modifications will be apparent to persons skilled in the art upon reading the present specification.
Moreover, the disclosure of the present application should be understood to include any novel features or any novel combination of features either explicitly or implicitly disclosed herein or any generalization thereof and during the prosecution of the present application or of any application derived therefrom, new claims may be formulated to cover any such features and/or combination of such features.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2317468.3 | Nov 2023 | GB | national |