Patent Grant
8610682
Touchscreen displays play a prominent role in the design of many electronic devices such as, for example, personal digital assistants (PDAs), satellite navigation devices, and mobile devices. Touchscreen displays can detect the presence and location of a touch command (e.g., by one or more fingers) within a display area. In turn, the presence and location of the touch command can be processed by the electronic device to allow a user to have the ability to interact with what is shown on the touchscreen display.
Among other benefits, touchscreen displays and associated touch gestures (also referred to herein as “commands”) recognized by electronic devices incorporating the touchscreen displays allow users to execute software functions (e.g., zoom in/out of a software map application) using, for example, a finger gesture (e.g., long-press finger gesture or a finger flick gesture). As software applications become more sophisticated in nature, additional gestures can be used to execute new functions associated with the applications.
Methods and systems are needed to enable additional operations on a touchscreen display using a gesture command.
Embodiments include a method for defining a touch gesture on a touch sensing device. The method includes receiving a touch gesture at the touch sensing device, determining that the touch gesture is not associated with any operations, and providing an indication of one or more operations the touch sensing device can perform in response to the touch gesture. The method can further include receiving a selection of an operation, and associating the touch gesture with the selected operation.
Embodiments additionally include a computer program product that includes a computer-usable medium with computer program logic recorded thereon for enabling a processor to execute an operation associated with a touch gesture on a touch sensing device. The computer program logic includes the following: first computer readable program code that enables a processor to receive a touch gesture at the touch sensing device; second computer readable program code that enables a processor to determine that the touch gesture is not associated with any operations, third computer readable program code that enables a processor to provide an indication of one or more operations the touch sensing device can perform in response to the touch gesture; fourth computer readable program code that enables a processor to receive a selection of an operation; and fifth computer readable program code that enables a processor to associate the touch gesture with the selected operation.
Embodiments further include a system for executing a touch gesture. The system includes a touch sensing device and a computing device. The computing device is configured to perform the following functions: receive a touch gesture at the touch sensing device; determine that the touch gesture is not associated with any operations; provide an indication of one or more operations the touch sensing device can perform in response to the touch gesture; receive a selection of an operation; and associate the touch gesture with the selected operation.
Further features and advantages described herein, as well as the structure and operation of various embodiments, are described in detail below with reference to the accompanying drawings. It is noted that the following description is not limited to the specific embodiments described herein. Such embodiments are presented herein for illustrative purposes only. Additional embodiments will be apparent to persons skilled in the relevant art based on the teachings contained herein.
The accompanying drawings, which are incorporated herein and form a part of the specification, illustrate embodiments and, together with the description, further serve to explain the principles herein and to enable a person skilled in the relevant art to make and use the embodiments described herein.
The following detailed description refers to the accompanying drawings that illustrate exemplary embodiments. Other embodiments are possible, and modifications can be made to the embodiments within the spirit and scope of the detailed description.
It would be apparent to one of skill in the relevant art that the embodiments, as described below, can be implemented in many different embodiments of software, hardware, firmware, and/or the entities illustrated in the figures. Any actual software code with the specialized control of hardware to implement embodiments is not limiting of the detailed description. Thus, the operational behavior of embodiments will be described with the understanding that modifications and variations of the embodiments are possible, given the level of detail presented herein.
In an embodiment, computing device 130 is configured to execute instructions and to carry out operations associated with computer system 100. Computing device 130 can control the reception and manipulation of input and output data from input device 110 and display device 120, according to an embodiment. In an embodiment, computing device 130 can be implemented on a single computing device such as, for example and without limitation, a stand-alone device. Examples of computing device 130 include, but are not limited to, a central processing unit, an application-specific integrated circuit, and other types of computing devices that have at least one processor and memory. In another embodiment, computing device 130 can have multiple processors and multiple shared or separate memory components such as, for example and without limitation, one or more computing devices incorporated in a clustered computing environment or a server farm. The computing process performed by the clustered computing environment, or server faun, may be carried out across multiple processors located at the same or different locations.
In reference to
Input device 110 is also operatively coupled to computing device 130. In an embodiment, the user can make a selection on the GUI for the system application via input device 110. Input device 110 can include a touch sensing device configured to receive an input from a user's touch or a touch gesture from an external touch device (e.g., stylus device) and send the touch information to computing device 130, according to an embodiment. In turn, computing device 130 executes an operation associated with the touch information. The touch sensing device can be, for example and without limitation, a capacitive sensing device, a resistive sensing device, a surface acoustic wave sensing device, a pressure sensing device, an optical sensing device, and other similar types of sensing devices. In one embodiment, input device 110 can be presence sensitive and not require a touch, in addition to or instead of being a touch sensitive device.
In an embodiment, input device 110 can include a touch screen device integrated with a display device 120. The touch screen device can be integrated with display device 120, or it may be a separate component device from display device 120, according to an embodiment. In positioning the touch screen device over or in front of display device 120, the user can manipulate the GUI for the system application via one or more touch gesture (e.g., finger gestures or an external touch device) applied to input device 110. For instance, the user can press a button displayed by the GUI or drag an object in the system application from one end to another end of display device 120 using finger gestures or an external touch device.
In reference to
For example, a user of the input device 110 can perform a swipe left to right command on the input device 110. The computing device 130 can receive the touch gesture information associated with the left to right swipe and determine that this particular touch gesture is not associated with an operation. The computing device 130 can then provide and display a menu on the display device 120 and input can be received on the input device 110 from a user selecting one of the operations in the menu. The computing device 130 can associate the touch gesture with an operation selected by the user.
A touch gesture can be mapped to a particular feature of the GUI for the system application as determined by a user of the device, according to an embodiment. For instance, in an email application, various touch gestures can be mapped to various features of the application such as, for example and without limitation, a switching between labels function, a switching between folders function, a switching between email accounts function, and other functions associated with the email application. Based on the description herein, a person skilled in the relevant art will recognize that other software applications can include functions determined by users to be mapped to corresponding touch gestures can be used with the embodiments described herein.
Initially, the touch information corresponding to the touch gesture received by input device 110 is transferred to computing device 130. The computing device 130 can make a determination that the touch gesture is not associated with an operation and that this is the first instance of the touch gesture being received within a particular system application. Once this determination is made, the computing device 130 can provide a menu of one or more operations that can be associated with the touch gesture. Once an indication is received of a selected operation, the operation is associated with the touch gesture, and the computing device 1130 can execute the operation associated with the touch command the next time the specific touch gesture is received.
As understood by a person skilled in the relevant art, computing device 130 can execute a touch operation program, or a gesture operation program, that can store a set of instructions that recognizes the occurrence of various touch gestures and informs a system application running on computer system 100 what operations to execute in response to the touch command. Some or all of these gestures can be mapped to operations as determined and set by a user of the device 110.
In one embodiment, the operations are specific to the particular system application that is receiving input at the time of the gesture on the device 110. For example, a user using an email application may indicate using their finger a swipe left to right gesture on the display of the device 110. The computing device 130 can provide a menu of operations specific to the email application if a determination is made that the touch gesture is not associated with an operation. The computing device 130 can provide an indication of one or more operations the touch sensing device can perform in response to the touch gesture. The operations within an email application can include, for example, switching between email applications, switching between email accounts, switching between one or more labels associated with emails in the email application, switching between one or more folders associated with the email application, or to do nothing. Therefore, these operations are specific to the system application, in this example, an email application. In other embodiments, the operations are universal operations that are applicable to all system applications that can be provided on the device 100.
In one embodiment, the touch gestures can include a swipe from left to right on the input device 110, a swipe from right to left on the input device 110, a swipe from left to right on the input device 110, an up swipe on the input device 110 or a down swipe on the input device 110.
Based on the description herein, a person skilled in the relevant art will recognize that method 200 can be executed on other types of computer systems (e.g., computer 400 of
Further, for ease of explanation, method 200 will be described in the context of a mobile device with a mobile device user applying a finger touch gesture on a touch screen device of the mobile device. A person skilled in the relevant art will recognize that method 200 can be executed on other types of electronic devices such as, for example and without limitation, a personal digital assistant, a laptop, and other similar types of electronic devices. Further, a person skilled in the relevant art will recognize that the touch screen device of the mobile device can be configured to recognize other sources of the touch gesture such as, for example and without limitation, a stylus device. These other types of electronic devices and sources of the touch gesture are within the scope and spirit of the embodiments described herein.
In an embodiment, an appropriate single-touch gesture is based on a single, touch to the touch screen device (e.g., via the mobile device user's finger). An operation can be mapped to the single-touch gesture and can be executed by a computing device of the mobile device (e.g., computing device 130 of
In step 210, a touch gesture is received at the mobile device. The touch gesture can be detected by the touch screen of the mobile device.
In step 220, a determination can be made that the touch gesture received is not associated with an operation. Therefore, the touch gesture can be determined to be a first instance of the touch gesture received.
In step 230, an indication of one or more operations the touch sensing device can perform in response to the touch gesture is provided. In reference to step 230 of FIG. 2, the computing device can then provide an indication of one or more operations the touch sensing device can perform in response to the touch gesture that allows for a user that performed the touch gesture to define an operation to associate with the touch gesture.
In step 240, a selection of an operation is received. The selection can be a user selecting one of the menu operations. For example, in the email application, a user can select to associate the gesture with scrolling between various labels associated with the emails in the email application, scrolling between different folders associated with the email application, scrolling between different email accounts or applications, or to do nothing.
In step 250, the touch gesture is associated with the selected operation. For example, in the email application, if the selected operation was to scroll between different labels, then the touch gesture is associated with this operation. Therefore, the next time the user of the mobile device performs this operation, emails associated with a first label are displayed to the user.
In the case where the touch gesture is received within an email application, the operations presented can be associated with operations that are continuous. Therefore, if the operation selected is the operation to scroll between labels, the first time the touch gesture is received, the email application loads a first label and associated emails. For example, if the touch gesture is received again, the email application then loads a second label and associated emails. This process continues until there are so more associated labels.
In some cases, the user can select one or more specific labels when selecting an operation of how the mobile device should respond to the touch gesture. The user can specify which labels to show when the touch gesture is performed and which ones not to show. For example, if the user selects the labels “priority inbox,” “work,” “Betty,” and “news,” and there are a total of seven other labels, when the touch gestures is received within the email application, the first time the touch gesture is received the emails associated with the label “priority inbox” are displayed. If within this screen the touch gesture is received again, then the emails associated with “Betty” are displayed. Finally if the touch gesture is received again, the emails associated with the label “news” are displayed.
As shown in
In some cases, the horizontal swipe 306 is from left to right across the screen of the mobile device. The computing device 130 receives the horizontal swipe 306 from left to right and can also determine that this touch gesture is not associated with an operation. The computing device 130 can provide the menu of operations 308 in the same manner as described above.
The menu 308 shown in
In this example, suppose the user of the device 302 selected the operation 310 to switch between different labels associated with the current email application. Therefore, emails that are associated with particular labels will be shown to the user the next time the user performs the touch gesture of the horizontal swipe 306 right to left on the device 302. Emails that are associated with particular labels the user has already viewed will be shown to the user the next time the user performs the touch gesture of the horizontal swipe left to right (now shown) on the device 302.
The touch gesture in this example, the horizontal swipe 306 from right to left, can be mapped to a function to switch between the labels in the email application 304.
In one embodiment, the computing device 130 can determine an opposing gesture to a gesture that has already been associated with an operation. For example, an opposing gesture to a right to left swipe is a right to left swipe. The computing device 130 can then associate with the opposing gesture, an opposing operation associated with the selected gesture. For example, an opposing operation to switch between labels and to go to a next label would be to switch to a previous label.
For example, a horizontal swipe from left to right (not shown), can be mapped to a function to switch between labels as well in the email application 304, however, the left to right swipe can be associated with a function to switch to a previous label, while the horizontal swipe from right to left can be associated with a function to switch to the next label. Based on the description herein, persons skilled in the relevant art will recognize that other operations of the software map application, as well as other software applications, can be mapped to the touch gesture of method 200.
As shown in
Each time the horizontal swipe 306 from right to left is performed, emails associated with a new label can be displayed. The horizontal swipe from left to right can be associated with a function to display emails associated with a previous label. For example, if a user performs a horizontal swipe from right to left to go to the label “priority inbox,” then again to go to a second label, for example, “mom,” then if the user at this point performs a horizontal swipe from left to right, the emails associated with the first label “priority inbox” can again be displayed.
In one embodiment, the computing device 130 can receive a indication to disassociate the touch gesture from the selected operation. The user may be able to make this disassociation within a menu provided on the mobile device. The user can indicate that he/she no longer wants a particular gesture associated with an operation. The computing device 130 can then disassociate the touch gesture with the selected operation. The user can then select a new operation to associate with the touch gesture. The computing device 130 can receive a selection of a new operation, and then associate the touch gesture with the selected new operation.
Various aspects of the embodiments described herein may be implemented in software, firmware, hardware, or a combination thereof.
Computer system 400 includes one or more processors, such as processor 404. Processor 404 may be a special purpose or a general-purpose processor. Processor 404 is connected to a communication infrastructure 406 (e.g., a bus or network).
Computer system 400 also includes a main memory 408, random access memory (RAM), and may also include a secondary memory 410. Secondary memory 410 can include, for example, a hard disk drive 412, a removable storage drive 414, and/or a memory stick. Removable storage drive 414 can comprise a floppy disk drive, a magnetic tape drive, an optical disk drive, a flash memory, or the like. The removable storage drive 414 reads from and/or writes to a removable storage unit 418 in a well-known manner. Removable storage unit 418 can include a floppy disk, magnetic tape, optical disk, etc. which is read by and written to by removable storage drive 414. As will be appreciated by persons skilled in the relevant art, removable storage unit 418 includes a computer-usable storage medium having stored therein computer software and/or data.
Computer system 400 (optionally) includes a display interface 402 (which can include input and output devices such as keyboards, mice, etc.) that forwards graphics, text, and other data from communication infrastructure 406 (or from a frame buffer not shown) for display on display unit 430.
In alternative implementations, secondary memory 410 can include other similar devices for allowing computer programs or other instructions to be loaded into computer system 400. Such devices can include, for example, a removable storage unit 422 and an interface 420. Examples of such devices can include a program cartridge and cartridge interface (such as those found in video game devices), a removable memory chip (e.g., EPROM or PROM) and associated socket, and other removable storage units 422 and interfaces 420 which allow software and data to be transferred from the removable storage unit 422 to computer system 400.
Computer system 400 can also include a communications interface 424. Communications interface 424 allows software and data to be transferred between computer system 400 and external devices. Communications interface 424 can include a modem, a network interface (such as an Ethernet card), a communications port, a PCMCIA slot and card, or the like. Software and data transferred via communications interface 424 are in the form of signals, which may be electronic, electromagnetic, optical, or other signals capable of being received by communications interface 424. These signals are provided 428 to communications interface 424 via a communications path 426. Communications path 426 carries signals and may be implemented using wire or cable, fiber optics, a phone line, a cellular phone link, a RF link or other communications channels.
In this document, the terms “computer program medium” and “computer-usable medium” are used to generally refer to media such as removable storage unit 418, removable storage unit 422, and a hard disk installed in hard disk drive 412. Computer program medium and computer-usable medium can also refer to memories, such as main memory 408 and secondary memory 410, which can be memory semiconductors (e.g., DRAMs, etc.). These computer program products provide software to computer system 400.
Computer programs (also called computer control logic) are stored in main memory 408 and/or secondary memory 410. Computer programs may also be received via communications interface 424. Such computer programs, when executed, enable computer system 400 to implement embodiments described herein. In particular, the computer programs, when executed, enable processor 404 to implement processes described herein, such as the steps in the methods illustrated by flowchart 200 of FIG. 2, discussed above. Accordingly, such computer programs represent controllers of the computer system 400. Where embodiments are implemented using software, the software can be stored in a computer program product and loaded into computer system 400 using removable storage drive 414, interface 420, hard drive 412 or communications interface 424.
Based on the description herein, a person skilled in the relevant art will recognize that the computer programs, when executed, can enable one or more processors to implement processes described above, such as the steps in the method illustrated by flowchart 200 of
Based on the description herein, a person skilled in the relevant art will recognize that the computer programs, when executed, can enable multiple processors to implement processes described above, such as the steps in the method illustrated by flowchart 200 of
Embodiments are also directed to computer program products including software stored on any computer-usable medium. Such software, when executed in one or more data processing device, causes a data processing device(s) to operate as described herein. Embodiments employ any computer-usable or -readable medium, known now or in the future. Examples of computer-usable mediums include, but are not limited to, primary storage devices (e.g., any type of random access memory), secondary storage devices (e.g., hard drives, floppy disks, CD ROMS, ZIP disks, tapes, magnetic storage devices, optical storage devices, MEMS, nanotechnological storage devices, etc.), and communication mediums (e.g., wired and wireless communications networks, local area networks, wide area networks, intranets, etc.).
While various embodiments have been described above, it should be understood that they have been presented by way of example only, and not limitation. It will be understood by those skilled in the relevant art that various changes in form and details can be made therein without departing from the spirit and scope of the embodiments described herein. It should be understood that this description is not limited to these examples. This description is applicable to any elements operating as described herein. Accordingly, the breadth and scope of this description should not be limited by any of the above-described exemplary embodiments, but should be defined only in accordance with the following claims and their equivalents.
| Number | Name | Date | Kind |
|---|---|---|---|
| 6249606 | Kiraly et al. | Jun 2001 | B1 |
| 20070177803 | Elias et al. | Aug 2007 | A1 |
| 20090058823 | Kocienda | Mar 2009 | A1 |
| 20090228807 | Lemay | Sep 2009 | A1 |
| 20100205563 | Haapsaari et al. | Aug 2010 | A1 |
| 20110113384 | Gotcher et al. | May 2011 | A1 |
