Devices, e.g., tablets, smart phones, laptops having a touch screen, etc., are increasingly being used as a replacement for a full computer. Because of the increased processing power available to these mobile devices, they are more capable than ever before. It is because of this increased capability that they have become so popular as an alternative to a typical computer or laptop.
However, some aspects of these devices are still lacking compared to their older less portable counterparts. For example, touch as a method of input, one of the most useful features, can sometimes be a hindrance of a mobile device. Specifically, it can be difficult to enter large amounts of information on a touch surface, compared to a more tactile system (e.g., physical keyboard and mouse). This difficulty exists for many reasons, for example the lack of tactile feedback, size constraints, etc. Without tactile feedback, it can be difficult for a user to determine if they are pressing an input key, and if that input key is the desired key. This lack of responsive feedback can lead to a user shifting their fingers to an incorrect location during use, thus resulting in improper input to a device.
In summary, one aspect provides a method, comprising: detecting, using a processor, user input to a surface, the user input being associated with a virtual interface; identifying, within the user input, a palm input pattern; and adjusting the virtual interface based on at least one aspect of the identified palm pattern.
Another aspect provides an information handling device, comprising: a processor; a memory device that stores instructions executable by the processor to: detect user input to a surface, the user input being associated with a virtual interface; identify, within the user input, a palm input pattern; adjust the virtual interface based on at least one aspect of the identified palm pattern.
A further aspect provides a product, comprising: a storage device having code stored therewith, the code being executable by a processor and comprising: code that detects user input to a surface, the user input being associated with a virtual interface; code that identifies, within the user input, a palm input pattern; code that adjusts the virtual interface based on at least one aspect of the identified palm pattern.
The foregoing is a summary and thus may contain simplifications, generalizations, and omissions of detail; consequently, those skilled in the art will appreciate that the summary is illustrative only and is not intended to be in any way limiting.
For a better understanding of the embodiments, together with other and further features and advantages thereof, reference is made to the following description, taken in conjunction with the accompanying drawings. The scope of the invention will be pointed out in the appended claims.
It will be readily understood that the components of the embodiments, as generally described and illustrated in the figures herein, may be arranged and designed in a wide variety of different configurations in addition to the described example embodiments. Thus, the following more detailed description of the example embodiments, as represented in the figures, is not intended to limit the scope of the embodiments, as claimed, but is merely representative of example embodiments.
Reference throughout this specification to “one embodiment” or “an embodiment” (or the like) means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment. Thus, the appearance of the phrases “in one embodiment” or “in an embodiment” or the like in various places throughout this specification are not necessarily all referring to the same embodiment.
Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of embodiments. One skilled in the relevant art will recognize, however, that the various embodiments can be practiced without one or more of the specific details, or with other methods, components, materials, et cetera. In other instances, well known structures, materials, or operations are not shown or described in detail to avoid obfuscation.
As discussed herein, touch devices and/or touch interfaces have many advantages, but also many disadvantages. For example, currently, typing or interfacing with virtual buttons (e.g., an onscreen/virtual keyboard, virtual mouse, virtual application, etc.) on a screen or flat surface lacks tactile feedback. Tactile feedback is typically helpful as it provides information to a user regarding their desired input, such as the click sound when pressing a key on a keyboard. Additionally, it can help a user gauge if their input position is off or a skew. For example, if a user where typing using a typical physical keyboard (e.g., mechanical, rubber dome, etc.) they would be able to identify a change in feel if their fingers had drifted slightly off skew from the keyboard.
Thus, flat touch surfaces (e.g., a touch display, touch surface, projection surface, etc.) are more prone to position drifting and erroneous input by a user. Currently, the most common solution, in order to ensure proper entry on a touch surface, is a user to look at their fingers and the virtual interface (e.g., on-screen keyboard) as they type, readjusting their position as necessary. However, this solution is cumbersome and may detract the user from content they are interacting with. This method also makes it very difficult to type one document while reading another.
Alternatively, a current software solution that requires the user to place their fingers onto the touch screen for tracking exists. Once the fingers are detected, the home keys may be relocated underneath each respective finger. However, this solution is still inefficient as it requires a user contact the screen with eight fingers, and the user must keep those fingers in contact with the virtual keyboard, which can be uncomfortable and lead to hand fatigue.
The above technical issues present problems for a user when they are attempting to use their touch device (e.g., mobile device) to enter long or detailed information, such as composing an email, writing a document, etc. Generally, when a user is typing for an extended period of time (e.g., more than one minute), they will rest the base of their palms on an adjacent surface (e.g., a keyboard wrist rest, desk, laptop base, etc.). Thus, a solution that utilizes this additional data (i.e., wrist contact location) creates a much more convenient solution to the technical problem of typing on a touch surface.
Without tactile cues for alignment, a user may move their hands during prolonged use, or position their hands in subtly different locations upon subsequent uses of the virtual interface (e.g., virtual keyboard). Accordingly, an embodiment provides a method of receiving, at a touch surface device one or more palm contacts. Analyzing the palm contact signatures and their relationship to finger contact points associated with the graphical user interface (GUI) and compensating for potential finger drift.
Another embodiment provides a new data set to improve the accuracy and immediacy of prediction used for adjusting the touch zones associated to any virtual interface or GUI in which the user rests their palms on a touch sensitive surface. Thus, because an embodiment uses palm data it also has the potential to adjust any input zones prior to the user touching the surface (e.g., touch screen) with their fingers. Thus, this technical improvement allows for adjustment to occur faster, be more dynamically accurate and occur with less abruptly.
The illustrated example embodiments will be best understood by reference to the figures. The following description is intended only by way of example, and simply illustrates certain example embodiments.
While various other circuits, circuitry or components may be utilized in information handling devices, with regard to smart phone and/or tablet circuitry 100, an example illustrated in
There are power management chip(s) 130, e.g., a battery management unit, BMU, which manage power as supplied, for example, via a rechargeable battery 140, which may be recharged by a connection to a power source (not shown). In at least one design, a single chip, such as 110, is used to supply BIOS like functionality and DRAM memory.
System 100 typically includes one or more of a WWAN transceiver 150 and a WLAN transceiver 160 for connecting to various networks, such as telecommunications networks and wireless Internet devices, e.g., access points. Additionally, devices 120 are commonly included, e.g., an image sensor such as a camera, an audio capture device such as a microphone, etc. System 100 often includes a touch screen 170 for data input and display/rendering. Additionally, a touch controller may be used, which receives touch input (e.g., a track/touch pad). System 100 also typically includes various memory devices, for example flash memory 180 and SDRAM 190.
The example of
In
In
The system, upon power on, may be configured to execute boot code 290 for the BIOS 268, as stored within the SPI Flash 266, and thereafter processes data under the control of one or more operating systems and application software (for example, stored in system memory 240). An operating system may be stored in any of a variety of locations and accessed, for example, according to instructions of the BIOS 268. As described herein, a device may include fewer or more features than shown in the system of
Information handling device circuitry, as for example outlined in
Referring now to
Referring back to
In a further embodiment, the palm signature associated with the user profile may be created based on historical user input. For example, an embodiment may detect a new user's palm(s) resting on the touch surface. The new user's detected palm signature may be stored and compared against future palm detections. Over time, an embodiment can compare subsequent palm input patterns and improve the accuracy of the user's palm signature.
Additionally or alternatively, a palm signature creation wizard may be activated by a user. During this process, an embodiment may request the user place their palm(s) on the touch surface in a natural and comfortable manner. An embodiment may also request additional user information (e.g., physical characteristics of the user's hands or palms). Based on this process, an embodiment may generate a high quality signature which allows for improved future matching accuracy. In addition, an embodiment may still improve or build upon the user's palm signature during future uses. This allows for potential changes in the user's hands (e.g., weight gain or loss, injury, etc.) without affecting detection accuracy.
Referring briefly to
In a further embodiment, the characteristics of each palm point of contact 520 (e.g., the center line and angle) may be associated with one or more finger locations relative to the onscreen keyboard at 550. Thus, as discussed herein, a palm signature, such as that shown in
Referring again to
Alternatively, if the current palm input is determined to be associated with a known user at 330, an embodiment may then determine if the current pattern matches the known pattern (e.g., palm signature) with respect to the virtual interface (e.g., virtual keyboard) at 350. For example, determining if the palm contact points (e.g., 520 of
However, if an embodiment determines at 350 that the current input pattern does not match the known user's at 350, an embodiment may adjust the virtual interface at 370. The virtual interface may be adjusted in a variety of ways. For example, an embodiment may adjust the GUI display of the virtual interface, such as that shown in
Alternatively, an embodiment may only adjust the input locations of the virtual keyboard while allowing the GUI display to remain fixed. Thus, although the image of a particular key or keys (e.g., the home keys) is fixed, the touch locations (i.e., the location where a user must make contact to register a specific input) may be adjusted. This would allow a user to continue typing or entering information regardless of how the virtual keyboard is displayed. Similar to the above example, the adjustment may comprise adjusting the orientation of the one or more input locations associated with the virtual keyboard.
In one embodiment, the detected palm input pattern, may only correspond to a single palm. For example if a user only uses their right hand to interact with the virtual keyboard. Thus, an embodiment may determine based on only a single palm input pattern that the virtual keyboard requires adjustment, (e.g., an adjustment as discussed herein). In a further embodiment, a portion of the virtual keyboard may be treated independently of the whole. For example, if a user only rests their right palm on the touch surface, an embodiment may only adjust the right hand portion of the virtual keyboard.
Additionally or alternatively, a user may rest both palms on the touch surface; however, an embodiment may still adjust portions of the virtual keyboard independently. For example, a left palm signature may be associated with a left portion of the virtual keyboard (e.g., the key column containing 5, t, g, b and all keys to the left) and a right palm signature may be associated with a right portion of the virtual keyboard (e.g., the key column containing 6, y, h, n, and all the keys to the right). Thus, an embodiment may adjust the left and right portions of the virtual keyboard according to their respective palm pattern, thereby creating a split or ergonomic keyboard.
Accordingly, as illustrated by the example embodiments and figures, an embodiment provides a method for detecting user input to a surface device. Identifying a palm pattern within the user input. Determining if that palm pattern matches any known user profiles, and if so checking to determine if the palm pattern is at the correct or expected orientation with respect to the virtual keyboard. If it is determined that the palm input pattern is skewed, an embodiment may adjust the virtual keyboard (e.g., change the orientation) in order to accommodate the skewing of the user's palms and by association a user's fingers.
The various embodiments described herein thus represent a technical improvement to accepting user input on a touch surface, by creating a palm signature associated with a specific user. The palm signature is also associated with one or more anticipated finger locations with respect to the virtual keyboard. An embodiment may, based on the signature, evaluate current palm input and determine if the virtual keyboard should be adjusted to allow for more accurate user entry.
As will be appreciated by one skilled in the art, various aspects may be embodied as a system, method or device program product. Accordingly, aspects may take the form of an entirely hardware embodiment or an embodiment including software that may all generally be referred to herein as a “circuit,” “module” or “system.” Furthermore, aspects may take the form of a device program product embodied in one or more device readable medium(s) having device readable program code embodied therewith.
It should be noted that the various functions described herein may be implemented using instructions stored on a device readable storage medium such as a non-signal storage device that are executed by a processor. A storage device may be, for example, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a storage medium would include the following: a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a storage device is not a signal and “non-transitory” includes all media except signal media.
Program code embodied on a storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, et cetera, or any suitable combination of the foregoing.
Program code for carrying out operations may be written in any combination of one or more programming languages. The program code may execute entirely on a single device, partly on a single device, as a stand-alone software package, partly on single device and partly on another device, or entirely on the other device. In some cases, the devices may be connected through any type of connection or network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made through other devices (for example, through the Internet using an Internet Service Provider), through wireless connections, e.g., near-field communication, or through a hard wire connection, such as over a USB connection.
Example embodiments are described herein with reference to the figures, which illustrate example methods, devices and program products according to various example embodiments. It will be understood that the actions and functionality may be implemented at least in part by program instructions. These program instructions may be provided to a processor of a device, a special purpose information handling device, or other programmable data processing device to produce a machine, such that the instructions, which execute via a processor of the device implement the functions/acts specified.
It is worth noting that while specific blocks are used in the figures, and a particular ordering of blocks has been illustrated, these are non-limiting examples. In certain contexts, two or more blocks may be combined, a block may be split into two or more blocks, or certain blocks may be re-ordered or re-organized as appropriate, as the explicit illustrated examples are used only for descriptive purposes and are not to be construed as limiting.
As used herein, the singular “a” and “an” may be construed as including the plural “one or more” unless clearly indicated otherwise.
This disclosure has been presented for purposes of illustration and description but is not intended to be exhaustive or limiting. Many modifications and variations will be apparent to those of ordinary skill in the art. The example embodiments were chosen and described in order to explain principles and practical application, and to enable others of ordinary skill in the art to understand the disclosure for various embodiments with various modifications as are suited to the particular use contemplated.
Thus, although illustrative example embodiments have been described herein with reference to the accompanying figures, it is to be understood that this description is not limiting and that various other changes and modifications may be affected therein by one skilled in the art without departing from the scope or spirit of the disclosure.
Number | Name | Date | Kind |
---|---|---|---|
5835079 | Shieh | Nov 1998 | A |
5856824 | Shieh | Jan 1999 | A |
6084576 | Leu | Jul 2000 | A |
6898299 | Brooks | May 2005 | B1 |
7277891 | Howard | Oct 2007 | B2 |
7742626 | Kamata | Jun 2010 | B2 |
8027518 | Baker | Sep 2011 | B2 |
8064645 | Sezille | Nov 2011 | B1 |
8345008 | Lee | Jan 2013 | B2 |
8543833 | Geiger | Sep 2013 | B2 |
8760424 | Laubach | Jun 2014 | B2 |
8836643 | Romera Joliff | Sep 2014 | B2 |
9104308 | Au | Aug 2015 | B2 |
9203835 | Jakobsson | Dec 2015 | B2 |
9418274 | Aoki | Aug 2016 | B2 |
9436304 | Leiba | Sep 2016 | B1 |
9442575 | Kandadai | Sep 2016 | B1 |
9448642 | Law | Sep 2016 | B2 |
9448651 | Zhai | Sep 2016 | B2 |
9489086 | Marsden | Nov 2016 | B1 |
9817490 | Zhang | Nov 2017 | B2 |
9946409 | Ivanov | Apr 2018 | B2 |
10048861 | Bozzini | Aug 2018 | B2 |
10102416 | Nada | Oct 2018 | B2 |
10126942 | Marsden | Nov 2018 | B2 |
20020087894 | Foley | Jul 2002 | A1 |
20020130844 | Natoli | Sep 2002 | A1 |
20050024324 | Tomasi | Feb 2005 | A1 |
20050122313 | Ashby | Jun 2005 | A1 |
20050275637 | Hinckley | Dec 2005 | A1 |
20070070051 | Westerman | Mar 2007 | A1 |
20080162649 | Lee | Jul 2008 | A1 |
20080226136 | Takaku | Sep 2008 | A1 |
20080266143 | Ohshita | Oct 2008 | A1 |
20090085877 | Chang | Apr 2009 | A1 |
20090146957 | Lee | Jun 2009 | A1 |
20090237361 | Mosby | Sep 2009 | A1 |
20090243798 | Fukuda | Oct 2009 | A1 |
20100117961 | Westerman | May 2010 | A1 |
20100127995 | Rigazio | May 2010 | A1 |
20100231522 | Li | Sep 2010 | A1 |
20100259561 | Forutanpour | Oct 2010 | A1 |
20100302155 | Sands | Dec 2010 | A1 |
20100302165 | Li | Dec 2010 | A1 |
20110074692 | Causey | Mar 2011 | A1 |
20110134032 | Chiu | Jun 2011 | A1 |
20110148770 | Adamson | Jun 2011 | A1 |
20110187647 | Woloszynski | Aug 2011 | A1 |
20110296333 | Bateman | Dec 2011 | A1 |
20120050187 | Chen | Mar 2012 | A1 |
20120075192 | Marsden | Mar 2012 | A1 |
20120131490 | Lin | May 2012 | A1 |
20120133589 | Marsden | May 2012 | A1 |
20120146912 | Chen | Jun 2012 | A1 |
20120169611 | Chen | Jul 2012 | A1 |
20120182238 | Lee | Jul 2012 | A1 |
20120182296 | Han | Jul 2012 | A1 |
20120260207 | Treskunov | Oct 2012 | A1 |
20120280916 | Xia | Nov 2012 | A1 |
20120306767 | Campbell | Dec 2012 | A1 |
20120311476 | Campbell | Dec 2012 | A1 |
20130057475 | Duggan | Mar 2013 | A1 |
20130155070 | Luo | Jun 2013 | A1 |
20130222247 | Liu | Aug 2013 | A1 |
20130275907 | Lau | Oct 2013 | A1 |
20130283057 | Hama | Oct 2013 | A1 |
20130308834 | Suzuki | Nov 2013 | A1 |
20140168083 | Ellard | Jun 2014 | A1 |
20140337786 | Luo | Nov 2014 | A1 |
20150029319 | Hama | Jan 2015 | A1 |
20150116086 | Kim | Apr 2015 | A1 |
20150242118 | Zhang | Aug 2015 | A1 |
20150269783 | Yun | Sep 2015 | A1 |
20150363038 | Luo | Dec 2015 | A1 |
20160026309 | Wu | Jan 2016 | A1 |
20160026329 | Fadell | Jan 2016 | A1 |
20160054818 | Zhang | Feb 2016 | A1 |
20160077616 | Durojaiye | Mar 2016 | A1 |
20160085564 | Arcese | Mar 2016 | A1 |
20160098142 | Winebrand | Apr 2016 | A1 |
20160188145 | Vida | Jun 2016 | A1 |
20160328604 | Bulzacki | Nov 2016 | A1 |
20170003876 | Marsden | Jan 2017 | A1 |
20170102867 | Bernard | Apr 2017 | A1 |
20170185287 | Unruh | Jun 2017 | A1 |
20180032146 | Yun | Feb 2018 | A1 |
20180032245 | Wu | Feb 2018 | A1 |
Number | Date | Country |
---|---|---|
WO-2016010524 | Jan 2016 | WO |
Entry |
---|
Himberg, “On-line Personalization of a Touch Screen Based Keyboard”, published on Jan. 12, 2003, [online] http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.88.4784&rep=rep1&type=pdf (Year: 2003). |
Number | Date | Country | |
---|---|---|---|
20170212676 A1 | Jul 2017 | US |