Patent Application
20160041674
1. Field of the Disclosure
This disclosure relates to human-computer interfaces in general and more particularly, to apparatus and method for controlling a touchscreen display for operation by one hand.
2. Background of the Disclosure
Electronic devices, such as portable electronic devices, have gained worldwide popularity due to their broad applications. Portable electronic devices may include, for example, smartphones, wireless personal digital assistants (PDAs), tablets, laptop computers with wireless or Bluetooth capabilities, cellular telephones, etc. A user may use, for example, a smartphone to perform a variety of functions including making telephone calls, sending electronic messages, taking photos, reading articles, and other functions, by installing applications.
With the increasing number of applications, users tend to install more and more applications on their portable electronic devices. At the same time, users have started reading articles on their portable electronic devices. To accommodate users' various usages, manufacturers have brought into the market portable electronic devices that have relatively large touchscreens to enable rendering of more icons and contents. This, however, gives rise to problems for users who use one hand to operate portable electronic devices. For example, if a user uses the left hand to operate a portable electronic device and touches the touchscreen with the left thumb, the left thumb may not reach icons that are located far from the thumb location on the touchscreen.
To solve this problem, existing technologies relating to Human-Computer Interaction may provide a settings menu, by which a user sets his/her hand use preference. For example, if a user prefers to use the left hand while operating a portable electronic device, the user can set a corresponding user preference on the settings menu. After setting the user preference, icons on the user's portable electronic device touchscreen are displayed on the left hand side, such that the left thumb of the user can reach all the icons displayed on the touchscreen of the portable electronic device.
However, the existing technologies are not only complicated but also require presetting. Situations may arise in which a user has a need to use the right hand, even though the user usually uses the left hand to operate the user's portable electronic device. As an example, with the left hand being occupied, the user may need to instead use the right hand to operate the portable electronic device (e.g., to use an application on the portable device). Due to this need, the user may not have time to preset a user preference regarding which hand to use. As a result, a user may drop a portable electronic device while trying to reach an icon displayed on the touchscreen according to the preset preference and located far away from, e.g., the right thumb, while the left hand (corresponding to the preset) is occupied.
According to a first aspect of the present disclosure, there is provided a method for controlling a touchscreen display for operation by one hand, comprising: receiving, via the touchscreen, at least one point of contact on the touchscreen generated by one or more fingers of a user, the touchscreen including a plurality of icons; detecting, by at least one processing device, a total number of the points of contact on the touchscreen and respective coordinates of the points of contact; determining, based on the total number of the points of contact and the respective coordinates of the points of contact, which hand the user is using to operate the touchscreen; and controlling the touchscreen to display the plurality of icons based on a result of the determining.
According to a second aspect of the present disclosure, there is provided an apparatus for controlling a touchscreen display for operation by one hand, comprising: a storage module configured to store computer executable instructions; and a processor, executing the computer executable instruction, configured to: receive, via the touchscreen, at least one point of contact on the touchscreen generated by one or more fingers of a user, the touchscreen including a plurality of icons; detect a total number of the points of contact on the touchscreen and respective coordinates of the points of contact; determine, based on the total number of the points of contact and the respective coordinates of the points of contact, which hand the user is using to operate the touchscreen; and control the touchscreen to display the plurality of icons based on a result of determining.
According to a third aspect of the present disclosure, there is provided a computer-readable medium including instructions, which, when executed by at least one processor, cause the processor to perform a method for controlling a touchscreen display for operation by one hand, the method comprising: receiving, via the touchscreen, at least one point of contact on the touchscreen generated by one or more fingers of a user, the touchscreen including a plurality of icons; detecting a total number of the points of contact on the touchscreen and respective coordinates of the points of contact; determining, based on the total number of the points of contact and the respective coordinates of the points of contact, which hand the user is using to operate the touchscreen; and controlling the touchscreen to display the plurality of icons based on a result of the determining.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments and, together with the description, serve to explain principles of the invention.
Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. The following description refers to the accompanying drawings in which the same numbers in different drawings represent the same or similar elements unless otherwise represented. The implementations set forth in the following description of exemplary embodiments do not represent all implementations consistent with the invention. Instead, they are merely examples of systems and methods consistent with aspects related to the invention as recited in the appended claims.
Exemplary embodiments may take the form of hardware embodiments, or embodiments combining both hardware and software. For example, an apparatus may be configured to contain one or more circuits for performing a function of controlling a display on a touchscreen for operation by one hand of a user. As another example, an apparatus may be configured to perform a function of controlling a display on a touchscreen for operation by one hand of a user by implementing a software application.
Apparatus 100 includes one or more processors, such as, for example, processor 102, also known as a central processing unit (CPU). Apparatus 100 also includes a storage module 104, an input module 106, an output module 108, and a communication module 110. Processor 102 may be one or more known processing devices, such as a microprocessor from the Pentium™ family manufactured by Intel™ or the Turion™ family manufactured by AMD™. Processor 102 may include a single core or multiple core processor system that provides the ability to perform parallel processing. For example, processor 102 may be a single core processor that is configured with virtual processing technologies known to those skilled in the art. In certain embodiments, processor 102 may use logical processors to simultaneously execute and control multiple processes. Processor 102 may implement virtual machine technologies, or other similar known technologies, to provide the ability to execute, control, run, manipulate, store, etc., multiple software processes, applications, programs, etc. In another embodiment, processor 102 includes a multiple-core processor arrangement (e.g., dual or quad core) that is configured to provide parallel processing functionalities to allow apparatus 100 to execute multiple processes simultaneously. One of ordinary skill in the art would understand that other types of processor arrangements could be implemented that provide for the capabilities disclosed herein.
Storage module 104 includes one or more storage devices configured to store information used by processor 102 (or another component) to perform certain functions according to exemplary embodiments. The one or more storage devices may include, for example, a hard drive, a flash drive, an optical drive, a random-access memory (RAM), a read-only memory (ROM), or any other computer-readable medium known in the art. Storage module 104 can store instructions to enable processor 102 to execute one or more applications, network communication processes, and any other type of application or software known to be available on computing devices. Additionally or alternatively, instructions, application programs, etc., may be stored in an external storage or available from a memory over a network. The one or more storage devices of storage module 104 may be volatile or non-volatile, magnetic, semiconductor, optical, removable, non-removable, or other type of storage device or tangible computer-readable medium.
Input module 106 includes one or more input devices and/or mechanisms to receive input from user 150. For example, input module 106 may include a keyboard, a keypad, a mouse, a joystick, a stylus, a button, a thumbwheel, a touchscreen, or any other input device configured to receive input from user 150. In exemplary embodiments, input module 106 may include touchscreen 112, which is configured to detect touch gestures of user 150 and convert the touch gestures to electronic signals for controlling the display on touchscreen 112.
Output module 108 includes a display device, a speaker, a vibration generator, or any other output device known in the art. In exemplary embodiments, output module 108 is configured to provide feedback to user 150. For example, output module 108 is configured to receive signals from processor 102 and generate a graphical user interface screen including a plurality of graphical elements. These graphical elements may include, for example, icons associated with applications installed on apparatus 100 and stored in storage module 104, menus, buttons, sliding bars, interface controls, etc. In exemplary embodiments, touchscreen 112 is configured to function as output module 108, on which the plurality of graphical elements are displayed.
Communication module 110 is configured to communicate with a telephone network, a wireless cellular network, or a computer network as known in the art. For example, communication module 110 may include a modem configured to provide network communication with a telephone network or a wireless cellular network. Alternatively, communication module 110 may include an Ethernet interface, a Wi-Fi interface, or a Bluetooth® interface to provide network communication with an Ethernet, a local area network (LAN), a wide area network (WAN), or any other computer networks.
In exemplary embodiments, user 150 operates apparatus 100 through touchscreen 112 using, for example, hands or fingers. User 150 touches touchscreen 112 with one or more fingers while operating apparatus 100. The one or more fingers of user 150 generate at least one point of contact on touchscreen 112. Processor 102 is configured to detect the coordinates of the point(s) of contact generated by the one or more fingers of user 150 according to the electronic signals generated by touchscreen 112. In further exemplary embodiments, if user 150 uses four fingers, processor 102 can be configured to determine whether user 150 is using the left hand or the right hand, based on respective coordinates of the points of contact generated by the four fingers on touchscreen 112.
In exemplary embodiments, processor 102 is configured to determine an invisible dividing line on touchscreen 112 (“dividing line”). According to the illustrated embodiments, processor 102 can be configured to determine a dividing line 200 in the middle of touchscreen 112 based on coordinate information, as shown in
In one exemplary embodiment, processor 102 is configured to use dividing line 200 to determine whether user 150 is using the left hand or the right hand while operating apparatus 100. For example, if user 150 uses four fingers to touch touchscreen 112, four points of contact are generated on touchscreen 112. In other embodiments, the total number of the points of contact generated by the fingers of user 150 can be greater or fewer than four, such that a different number of points of contact can be used to be the total number of the points of contact for determining whether user 150 is using the left hand or the right hand.
In one exemplary embodiment, as shown in
If processor 102 determines that user 150 is using the left hand, processor 102 determines that user 150 intends to use the left hand to operate touchscreen 112. Accordingly, in such a case, processor 102 is configured to cause touchscreen 112 to display an interface screen notifying user 150 that touchscreen 112 is set in a left-hand-operation mode. Similarly, if processor 102 determines that user 150 is using the right hand, processor 102 determines that user 150 intends to use the right hand to operate touchscreen 112. Accordingly, in such a case, processor 102 is configured to cause touchscreen 112 to display an interface screen notifying user 150 that touchscreen 112 is set in a right-hand-operation mode.
Thus, processor 102 is configured to control the display of touchscreen 112 based on which hand of user 150 is being used to operate touchscreen 112. According to the illustrated embodiments, touchscreen 112 displays graphic elements including, for example, icons.
In exemplary embodiments, the size of the icons display zone is set within the range of the left thumb or the right thumb of user 150, such that the thumb of user 150 can reach all the icons displayed in the icons display zone. In one exemplary embodiment, processor 102 is configured to provide mechanisms that enable user 150 to set the size of the icons display zone. For example, user 150 can preset the size of the icons display zone on a settings menu. When processor 102 determines which hand user 150 is using, the icons display zone is adjusted according to the size user 150 has preset.
In exemplary embodiments, the shape of the icons display zone can be preset by user 150. For example, user 150 can preset the shape of the icons display zone to be fan-shaped. As another example, the shape of the icons display zone can be preset as square, circular, or another shape that enables the left or the right thumb of user 150 to reach all the icons displayed therein. According to the illustrated embodiments, processor 102 is configured to preset a fan-shaped icons display zone as a default icons display zone. For example, as illustrated above, if processor 102 determines that user 150 is using the left hand or the right hand, the fan-shaped icons display zone is located at the bottom corner of the left side or the right side of touchscreen 112, respectively.
In exemplary embodiments, processor 102 provides mechanisms that enable user 150 to preset the location of the icons display zone on touchscreen 112. In one exemplary embodiment, if user 150 is using the left hand, as shown in
In a further exemplary embodiment, if user 150 presets the location of the icons display zone, the shape of the icons display zone can be adjusted accordingly. For example, when the icons display zone is located at the bottom left or right corner of touchscreen 112, processor 102 can cause touchscreen 112 to display the icons display zone as fan-shaped. However, when the icons display zone is located along the middle of the left or right side of touchscreen 112, processor 102 can cause touchscreen 112 to display the icons display zone as approximately semicircular.
Additionally or alternatively, processor 102 can determine which hand user 150 intends to use by detecting whether user 150 presses a button. In one exemplary embodiment, apparatus 100 is configured to include a left button and a right button on both the left and the right side. If user 150 intends to use the left hand, user 150 presses the left button. Similarly, if user 150 intends to use the right hand, user 150 presses the right button. Functions regarding displaying the icons, and presetting the size, the location, and/or the shape of the icons display zones are the same as or similar to those exemplary embodiments provided above, so that further detailed description is omitted.
In the illustrated embodiments, if user 150 touches touchscreen 112 with one or more fingers, at least one point of contact is generated on touchscreen 112. Processor 102 is configured to determine the number of points of contact generated by the one or more fingers of user 150. In one exemplary embodiment, user 150 may use four fingers to operate touchscreen 112. In this exemplary embodiment, processor 102 can be configured to determine whether there are four points of contact on touchscreen 112 generated by the four fingers of user 150 (step 602).
To filter noise (e.g., accidental touching or touching not by user 150), processor 102 is configured to wait for a predetermined period of time before confirming that there are four points of contact on touchscreen 112 generated by user 150. For example, processor 102 waits for 10 ms before confirming whether there are four points of contact generated on touchscreen 112 (step 603).
If processor 102 confirms that there are four points of contact on touchscreen 112, processor 102 initiates a counter K at a value of 0 (step 604).
Processor 102 is configured to check the total number of the points of contact and their coordinates to determine whether user 150 intends to use the left hand or the right hand to operate touchscreen 112. For example, in the present embodiment, the predetermined total number of the points of contact is four, but another number can be the total number of the points of contact for determining whether user 150 intends to use the left hand or the right hand. If the total number of the points of contact is predetermined to be four, processor 102 can be configured to determine whether there are only four points of contact. In such a case, processor 102 can also be configured to detect the coordinates of the four points of contact to determine whether user 150 intends to use the left hand or the right hand to operate touchscreen 112 (step 605).
For example, if processor 102 determines there are four points of contact and that the respective coordinates of the four points of contact all fall to the left side of dividing line 200, i.e., on the left side of touchscreen 112, processor 102 determines that user 150 is using the right hand. As another example, if processor 102 determines there are four points of contact and that the respective coordinates of the four points of contact all fall to the right side of dividing line 200, i.e., on the right side of touchscreen 112, processor 102 determines that user 150 is using the left hand.
However, if processor 102 determines that there are greater or fewer than a predetermined total number of points of contact detected on touchscreen 112, and/or the distribution of the points of contact is not consistent with a predetermined distribution, processor 102 determines that an invalid operation or other operation has occurred (step 606). For example, if the predetermined total number of points of contact is four, and processor 102 determines that there are greater or fewer than four points of contact detected on touchscreen 112, processor 102 determines that an invalid operation or other operation has occurred. As another example, while processor 102 determines that there are only four points of contact on touchscreen 112, if the respective coordinates of the four points of contact do not all fall on the left or the right side of touchscreen 112, processor 102 also determines that an invalid operation or other operation has occurred. In such case, the process flows to step 612.
If the predetermined total number of the points of contact for determining whether user 150 is using the left hand or the right hand is four, while processor 102 is determining whether there are only four points of contact on touchscreen 112, and the respective coordinates of the four points of contact all fall on one side of touchscreen 112, the counter K is incremented by 1 ms (step 607). Processor 102 is configured then to determine whether the counter K has incremented to a predetermined period of time, such as, for example, 50 ms (step 608). If counter K has incremented to a number exceeding 50 ms, processor 102 is configured to wait for a predetermined period of time, such as, for example, 10 ms, before confirming that there are only four points of contact, and that the respective coordinates of the four points of contact all fall on one side of touchscreen 112 (step 609).
According to the illustrated embodiments, if processor 102 confirms that there are only four points of contact, and the respective coordinates of the four points of contact all fall on one side of touchscreen 112, processor 102 is configured to cause touchscreen 112 to generate an interface screen notifying user 150 that touchscreen 112 has been set in either a left-hand-operation mode, or a right-hand-operation mode, depending on which hand user 150 is using when operating touchscreen 112 (step 610).
Processor 102 is configured to control the display of icons on touchscreen 112 based on which hand user 150 is using (step 611). For example, if user 150 is using the left hand to hold apparatus 100 and touch touchscreen 112, processor 102 can be configured to determine that user 150 intends to use the left hand to operate touchscreen 112, and accordingly cause touchscreen 112 to display icons on the left side of touchscreen 112. On the other hand, if user 150 is using the right hand to hold apparatus 100 and touch touchscreen 112, processor 102 can be configured to determine that user 150 intends to use the right hand to operate touchscreen 112, and accordingly cause touchscreen 112 to display icons on the right side of touchscreen 112. A detailed description regarding how the icons are displayed on touchscreen 112 has been provided above, and is therefore omitted.
Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. The scope of the invention is intended to cover any variations, uses, or adaptations of the invention following the general principles thereof and including such departures from the present disclosure as come within known or customary practice in the art. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.
It will be appreciated that the present invention is not limited to the exact construction that has been described above and illustrated in the accompanying drawings, and that various modifications and changes can be made without departing from the scope thereof. It is intended that the scope of the invention only be limited by the appended claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 201310153827.1 | Apr 2013 | CN | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/CN13/76421 | 5/29/2013 | WO | 00 |
