Patent Application
20160239687
The present description generally relates to access restricted devices and more particularly to enabling access based upon simultaneous keyboard entries and gestures.
Access restricted devices may use a password entry upon a keyboard to enable increased access to the device. Increased access includes unlocking the device, allowing a user access to the applications, processes and resources associated with a device. Such devices include cell phones, tablets, laptops, and computers. Still other methods of enabling access to a device include a gesture or a match of biometric identification such as a fingerprint or rental scan.
The description includes a method comprising enabling increased access to a restricted access device based upon a gesture event contemporaneously occurring while receiving a predetermined keyboard entry from a user accessing the restricted access device.
The description also includes a restricted access device comprising: a keyboard processing module for receiving a keyboard input signal from a keyboard having a plurality of keys for receiving a keyboard entry and determining the keyboard entry corresponds to a password; a gesture processing module for processing a gesture input signal from a gesture detector for detecting a gesture event and for determining the gesture event corresponds to a predetermined gesture event; and an access controller coupled to the keyboard processing module and the gesture processing module for increasing access to the restricted access device based upon the determining of the gesture event occurring contemporaneously with the password.
The description also includes a non-transitory computer program product comprising a storage medium readable by a processing circuit and storing instructions for execution by the processing circuit of an application server for performing a method comprising enabling increased access to a restricted access device based upon a gesture event contemporaneously occurring while receiving a predetermined keyboard entry from a user accessing the restricted access device.
The accompanying figures wherein reference numerals refer to identical or functionally similar elements throughout the separate views, and which together with the detailed description below are incorporated in and form part of the specification, serve to further illustrate various embodiments and to explain various principles and advantages all in accordance with the present description, in which:
As required, detailed embodiments are disclosed herein; however, it is to be understood that the disclosed embodiments are merely examples and that the systems and methods described below can be embodied in various forms. Therefore, specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a basis for the claims and as a representative basis for teaching one skilled in the art to variously employ the present subject matter in virtually any appropriately detailed structure and function. Further, the terms and phrases used herein are not intended to be limiting, but rather, to provide an understandable description of the concepts.
The description of the present disclosure has been presented for purposes of illustration and description, but is not intended to be exhaustive or limited in the form disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope of the description. The embodiment was chosen and described in order to best explain the principles of the description and the practical application, and to enable others of ordinary skill in the art to understand the description for various embodiments with various modifications as are suited to the particular use contemplated.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the description. As used herein, the singular forms “a”, “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise.
The terms “comprises” and/or “comprising,” specify the presence of stated features, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
Disclosed is a password-entry system on a mobile, or other, device (e.g. tablet computer or smart phone) that uses a simultaneous facial gesture to affect the nature of the text password. For example, a portion of the alphanumeric password may need to be entered while the facial gesture is a smile, but the last character of the password needs to be entered while the facial gesture is not a smile. This increases security for a given number of input characters. Extensions include virtual universes where alphanumeric passwords depend upon avatar facial expression and/or gestures.
User password entry, using real or virtual keys, may be cumbersome on a mobile device, or other device. By combining facial expression or gesture (e.g. smile) with text password entry, a user may have a more secure password for a given number of key selections. Contemporaneous facial gestures during password entry may also thwart “shoulder surfing” where another looks over the shoulder of a user during password entry to steal a password. It may further deter theft if a potential burglar knows that password entry is difficult due to requirements with respect to contemporaneous facial gestures.
Combining facial gestures (e.g. smile, blink, frown, open mouth, closed mouth,) with password entry, a user may have a more secure password for a given number of key selections. For example, consider a password consisting of 6 characters: c1, c2, c3, c4, c5, and c6. As an example, if c5 was dependent on facial gesture, then the number of possibilities now is expanded to include: c1, c2, c3, c4, c5 (contemporaneous smile/frown), and c6. This provides an additional security feature. The user's password cannot be easily guessed or hacked since the device/application/files are not accessible if the password entry is not simultaneously accompanied by the appropriate facial gesture or expression during the alphanumeric entry password process. Many devices are equipped with cameras, thus facilitating this implementation.
A combination of letters and facial gesture may be hashed with a private key. The facial gesture may often be hidden and undetectable unless watching a person enter the password. This may be implemented with two different authentication streams by two different servers. For example, on a second authentication server, the key before and after was X, and the user smiled. Facial gesture and text are combined as a function of a private key
Note that this invention may have a human-accessibility aspect in that the number of typed characters may be reduced. In one example the reduction may be for someone with hand-control deficits but who retains facial or other motor control. For example, instead of eight characters, a user with motor deficit or painful hand muscles may only now need to enter four characters, with contemporaneous facial gestures detected by a camera that is already in a user's device. Note also that for the purpose of accessibility (e.g. a blind user, stroke victim, etc.), in a related embodiment, the combination of letters and gestures need not involve facial expressions but may involve some other type of gesture movement over which a user may have adequate control. For example, a hand motion, speaking a certain word while pressing a key, or some other type of movement or gesture that may be made contemporaneously, or at the same time a key or password is selected. In addition, to protect a user who may not be fully aware that someone else is nearby and “shoulder surfing” in an attempt to observe password entry and steal the password, verbal or other cues or gestures may guard against misappropriating the password.
In another example, an animation of facial gestures may be used, in a manner similar as described for the static facial gestures, to provide an additional variable for alphanumerical password entry. For example, the password of “robot” may require a fast or slow pursing of the lips (which may be represented as sinusoidal amplitude through time) during the entry of the letter “t” to enter unlock the corresponding process or application. Filters may be applied to the facial gesture animation signal so as to filter out spurious noise and to make it easier for users to enter facial patterns, such as “fast” versus “slow” smile oscillations. Additionally, a contemporaneous input of a user's voice such as a tone, whistle, exhalation noise, or song (sung or hummed) may be employed either as a gesture or in combination with a static or animated facial gesture, as an extra layer of security.
Context, including authentication setting and time of day may also be used in relation to the authentication system. Additionally, for reasons of safety, this password may have additional advantages. For example, the facial gesture may be used only during certain times of day or in certain settings, such as driving. The device may either be configured to accept these alternate passwords in these settings, or the user may have an alternate password entry method available. For example, in the unexpected event that the setting is not secure for facial gesture passwords, where other may observe these gestures the alternate gestures may be used. For example, a user who is driving can enter keystrokes c1, c2, c3, followed by a facial gesture combined with c4, thus providing a password with fewer alphanumeric keystrokes and a margin of safety. In another example, the user may enter the full password using only alphanumeric key strokes c1, c2, c3, c4, c5, c6 in a restaurant. This affords the user a simpler and safer entry method while driving, and a more secure entry method while in a public place. Furthermore, certain mappings may be set by the user from certain key combinations onto certain facial gestures for the purpose of entering a password. For example, “sm” may correspond to the characters c5 and c6 in the user's password, and the user may have mapped these to a smile facial gesture. This mapping then provides for entering text using facial gestures.
Also described is a password entry device able to learn the correspondence between certain key combinations and certain facial gestures over time, where a user may “teach” the system that, for example, “sm” corresponds to the smile gesture by smiling whenever “sm” is entered. After several times entering the full password in this way, the system may automatically permit or inquire of a user to whether the shortened password with a smile during the entry of c5 and c6 as an alternate password. Similarly, the password entry device may optionally learn the correspondence between vocal output (e.g. humming of certain songs) and certain key combinations of facial gestures over time. The system may automatically permit a user to hum a song as a shortened password but only in familiar surroundings such as their home, as indicated by a GPS reading on their smartphone, while requiring fuller multi-modal password entry in new locations.
The current invention does not involve the positive identification of an individual and is therefore not a biometric invention. Thus, the disclosure has potential advantages when a device is shared between multiple individuals, such as a home theater system with a password protected movie purchasing feature. In this setting, any of several users may want to enable a password protected movie. Common facing gestures may be learned by anyone wishing to use the device, and may be performed in conjunction with alphanumeric keystrokes by anyone. The system authenticates by identifying a smile or a frown or other gesture in combination with a password, but not the specific biometrics uniquely identifying the individual face making these gestures. Access may be enabled by anyone entering the keyboard password and corresponding gestures.
Another potential advantage includes the ability for a single device to maintain a password for different individuals who share a portion but not all of a style of alphanumeric keyboard as their languages entry device. For example, a Chinese, Russian, and English speaking individual may share a device with a password comprising only numeric keystrokes and facial gestures. This is because Arabic numbers are widely shared on devices, and because facial gestures are universally recognized while the language specific alpha characters may differ widely between languages.
In a virtual universe or 3D game, in which users are represented by avatars that traverse a 3-D virtual environment, the facial gesture passwords may make use of avatar facial expressions that are contemporaneous with text input. For example, password entry may be affected by facial expression of the avatar with respect to the environment. For example, a password of “robot” may require that the letter “b” be typed, or spoken, when the avatar has a certain facial expression or is posed in a sitting position or is exhibiting a certain other gesture. When online financial transitions in a virtual universe take place involving substantial amounts of money, such extra security measures in the virtual universe may have the advantage of being useful in deterring the misappropriation of passwords and avoiding the consequences.
In another example, an element of randomness may be incorporated into the password entry. For example, the multi-factor authentication may be strengthened using random combinations of simultaneous or sequential password entry with multiple facial expressions. For example, to set up this authentication method, the user may do the following: 1) choose/enter a unique password, 2) choose four unique facial expressions (e.g. smile, wink left eye, turn head right, open mouth), record the four unique facial expressions. The authentication system may prompt user “in random order” to simultaneously or sequentially enter the password while performing one or more of the chosen facial expressions. Thus, the user authentication prompts may follow randomly selected combinations (changes each time user authenticates), e.g. turn head right, smile+enter password, wink left eye, and execute authentication.
In an example of a home theater implementation, different levels of complexity of the password/gesture combination allow for a possibly greater component access. For example, a simple password (4 characters+smile) that allows general access to control home theater components, while purchasing movies requires a more complex password (8 character+minimum 3 gestures).
The description includes a user input device sensitive to gestures (e.g. a facial gesture like a smile), an alphanumeric input device such as a keyboard, and the creation of a password that simultaneously combines the concurrent entry of the facial gesture and alphanumeric input. The device includes any of: phone, computer, e-book, tablet computer, camera, smart wallet, smart card, watch. The alphanumeric device includes any of: real keyboard, virtual keyboard, pointer, speech system, gesture recognizer, or a virtual tablet in a virtual world. The facial gesture may be animated (e.g. an oscillation of a smile and a frown for 1 second). The user may be represented in a virtual universe, and the password entry is affected by avatar facial gesture or avatar body position (e.g. sitting vs. standing).
It should be further appreciated that any portion or combination of the processes, controls and modules of
If the appropriate gesture is required and has not occurred, then step 418 executes and access to the restricted access device is not increased. Step 408 determines the context of the authentication entry if the appropriate gesture was received (of if no gesture was received if none was required at the keystroke of step 404). Depending upon the context, as shortened password may be enabled. For example if the device is a cellphone, then a shortened password may be enabled when the context is operation within a moving vehicle, while a standard or lengthened password may be required when the device is stationary or at certain times of day. The lengthened password may or may not require a contemporaneous gesture. For the purposes of this description, all context variable passwords are considered to be within the scope of this description. In other examples, shortened passwords may always be enabled or always disabled, independent of the context. In another example, a longer password may require no gestures, while a shortened password may be utilized if an appropriate gesture or gestures are provided during entry of a first portion of the password.
If a shortened password is to be considered, then step 412 determines if enough keyboard entries have been made for a shortened password. For example, a device may require a twelve character password if no appropriate gestures were received and a seven character password (the seven characters may be considered the first portion of the twelve character password or a first password with the twelve characters being a second password) with three gestures at appropriate keystrokes as shown in
If not enough entries are received at step 414 then optional steps 420-426 are executed prior to returning to step 404 to receive another keyboard entry. Steps 420-426 enable leaning of gestures either for enhanced authentication security or for a shortened password or for both. In other examples, the context of the authentication may also be learned for use in later executions of step 408. Step 420 determines if any gesture has been associated with this keyboard entry. For example, the user could be winking during the keyboard entry. If so, then data from one or more prior authentications are examined to determine if the gesture had occurred previously at this keyboard entry at step 422. If so, then step 424 associates the gesture with the keyboard entry to either enhance the security of the authentication process or to enable shortening of the authentication process. Step 426 then enables shortening of the password as previously described. Additional user or device administrator input may be required to enable the process of steps 420-426 and to select between a shortened password or an enhanced authentication or both.
The description herein describes a method comprising enabling increased access 426 to a restricted access device 150 based upon a gesture event 110 occurring while receiving a predetermined keyboard entry 120 from a user accessing the restricted access device. The enabling is independent of biometric information indicative of the user. The gesture event may be a facial gesture 112, 114 received from the user. The gesture event may include at least one of a hand gesture 110 and a spoke utterance received from the user. The restricted access device 250 may include a display 280 and the gesture event 210 may be a gesture made by an avatar rendered on the display by the restricted access device. The gesture event may include a facial gesture received from the user, the facial gesture including at least one of a smile, a frown, a blink, a wink, an open mouth and a closed mouth made by the user performing the keyboard entry. In another example, the gesture event may be an animated facial gesture received from the user, the animated facial gesture may include an at least one change from at least one of a smile, a frown, a straight face, a blink, a wink, an open mouth and a closed mouth to at least one of a smile, a frown, a blink, a wink, an open mouth and a closed mouth, the predetermined keyboard entry may include a password requiring multiple keyboard activations, and the gesture event may occur between a first keyboard activation and a last keyboard activation of the password. The number of keyboard activations in the password may be increased, 414, based upon the gesture event not being received. In another example, the predetermined keyboard entry may include a password requiring multiple keyboard activations 190, 192, 194, the gesture event may include at least a first gesture 110 and a second gesture 112 received from the user, and the enabling enables the increased access 416 based upon the first gesture 110 being received during a predetermined keyboard activation 120 of the password and the second gesture 112 being received during a another predetermined keyboard activation 122 of the password. In another example, an operational context of the restricted access device may be determined 408; and the number of keyboard activations in the password and a number of gestures in the gesture event may be modified 410 based upon the operational context. In another example a received gesture event 406 is received while receiving a keyboard entry 404 at the restricted access device; and the password may be shortened 426, wherein the enabling is based upon the received gesture event and the shortened password.
In another example, the description provides a restricted access device 350 comprising a keyboard processing module 372 for receiving a keyboard input signal from a keyboard 370 having a plurality of keys for receiving a keyboard entry and determining the keyboard entry to correspond to a password, and a gesture processing module 362 for processing a gesture input signal from a gesture detector 360 for detecting a gesture event and for determining the gesture event corresponds to a predetermined gesture event; and an access controller 374 coupled to the keyboard processing module 372 and the gesture processing module 362 for increasing access 416 to the restricted access device based upon the determining of the gesture event occurring contemporaneously with the password. The restricted access device may further comprise the keyboard 370 and the gesture detector 360 comprising a camera 160 for capturing an image of a face of user 100 operating the keyboard and performing a facial gesture event, wherein the access controller 374 further includes a facial gesture detector and the predetermined gesture event corresponds to a predetermined facial gesture event by the user, thereby increasing access to the restricted access device based upon a user operating the keyboard to enter the password while contemporaneously performing a facial gesture. In another example, the keyboard processing module further determines the keyboard entry to correspond to a second password having a first portion and a second portion, the first portion corresponding the password. The access controller further increases access to the restricted access device based upon the second password and an absence of the gesture event corresponding to the predetermined gesture. In another example, the predetermined keyboard entry includes a password requiring multiple keyboard activations, the gesture event includes at least a first gesture and a second gesture received from the user, and the enabling enables the increased access based upon the first gesture being received during a predetermined keyboard activation of the password and the second gesture being received during a another predetermined keyboard activation of the password.
In another example, a non-transitory computer program product comprises a storage medium readable by a processing circuit and storing instructions for execution by the processing circuit of an application server for performing a method comprising enabling increased access to a restricted access device based upon a gesture event occurring while contemporaneously receiving a predetermined keyboard entry from a user accessing the restricted access device. The gesture event may be an animated facial gesture received from the user, the animated facial gesture including an at least one change from at least one of a smile, a frown, a straight face, a blink, a wink, an open mouth and a closed mouth to at least one of a smile, a frown, a blink, a wink, an open mouth and a closed mouth. The predetermined keyboard entry includes a password requiring multiple keyboard activations, and the gesture event occurs between a first keyboard activation and a last keyboard activation of the password. The method may further comprise increasing a number of keyboard activations in password requiring multiple keyboard activations based upon the gesture event not being received.
The present invention may be a system, a method, and/or a computer program product. The computer program product may include a computer readable storage medium (or media) having computer readable program instructions thereon for causing a processor to carry out aspects of the present invention.
The computer readable storage medium can be a tangible device that can retain and store instructions for use by an instruction execution device. The computer readable storage medium may be, for example, but is not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. A non-exhaustive list of more specific examples of the computer readable storage medium includes the following: a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanically encoded device such as punch-cards or raised structures in a groove having instructions recorded thereon, and any suitable combination of the foregoing. A computer readable storage medium, as used herein, is not to be construed as being transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission media (e.g., light pulses passing through a fiber-optic cable), or electrical signals transmitted through a wire.
Computer readable program instructions described herein can be downloaded to respective computing/processing devices from a computer readable storage medium or to an external computer or external storage device via a network, for example, the Internet, a local area network, a wide area network and/or a wireless network. The network may comprise copper transmission cables, optical transmission fibers, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. A network adapter card or network interface in each computing/processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium within the respective computing/processing device.
Computer readable program instructions for carrying out operations of the present invention may be assembler instructions, instruction-set-architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state-setting data, or either source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like, and conventional procedural programming languages, such as the “C” programming language or similar programming languages. The computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider). In some embodiments, electronic circuitry including, for example, programmable logic circuitry, field-programmable gate arrays (FPGA), or programmable logic arrays (PLA) may execute the computer readable program instructions by utilizing state information of the computer readable program instructions to personalize the electronic circuitry, in order to perform aspects of the present invention.
Aspects of the present invention are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer readable program instructions.
These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer readable program instructions may also be stored in a computer readable storage medium that can direct a computer, a programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer readable storage medium having instructions stored therein comprises an article of manufacture including instructions which implement aspects of the function/act specified in the flowchart and/or block diagram block or blocks.
The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process, such that the instructions which execute on the computer, other programmable apparatus, or other device implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts or carry out combinations of special purpose hardware and computer instructions.
The description of the present application has been presented for purposes of illustration and description, but is not intended to be exhaustive or limited to the description in the form disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope of the description. The example was chosen and described in order to best explain the principles of the description and the practical application, and to enable others of ordinary skill in the art to understand the description for various examples with various modifications as are suited to the particular use contemplated.
| Number | Date | Country | |
|---|---|---|---|
| Parent | 14199467 | Mar 2014 | US |
| Child | 15135636 | US |
