The present disclosure is related generally to selecting information displayed on a display screen and, more particularly, to selecting information using a single continuous stepwise gesture on a touch-sensitive display screen.
One of the challenges that continues to face designers of devices having user-engageable display screens, such as touch-sensitive display screens, pertains to providing enhanced functionality for users through gestures that can be employed with the devices. This is so, not only with devices having larger or multiple screens, but also in the context of devices having a smaller footprint, such as tablet PCs, hand-held devices, smaller multi-screen devices, etc.
One challenge with gesture-based input is that of providing secondary actions. For example, in touch-sensitive or touch interfaces today, it is common to tap on an item to launch the item. This makes it difficult to provide secondary functionality such as an ability to select items. Further, certain challenges exist with so-call pannable surfaces, e.g., surfaces that can be panned and have their content moved. For example, a pannable surface typically reacts to a finger drag and moves the content in the direction of the user's finger. If the surface contains objects that a user might want to re-arrange, it is difficult to tell whether the user wants to pan the surface or to re-arrange the content.
While the appended claims set forth the features of the present techniques with particularity, these techniques, together with their objects and advantages, may be best understood from the following detailed description taken in conjunction with the accompanying drawings of which:
Turning to the drawings, wherein like reference numerals refer to like elements, techniques of the present disclosure are illustrated as being implemented in a suitable environment. The following description is based on embodiments of the claims and should not be taken as limiting the claims with regard to alternative embodiments that are not explicitly described herein.
Current information forums such as chat rooms and chat sessions provide a format with all participants having full access to each other. However, the ease of sharing among participants information such as emails, photos, and documents and being able to filter out “classified” content in a simple set of actions or gestures can be cumbersome, often requiring multi-key/command protocols with changes in screens.
As described herein, there is an opportunity to facilitate information exchange using a simple set of “selecting” and “assembling” actions to ease the interactive experience for the participants. In addition to forums such as chat rooms, the present methods and devices may be used anywhere that assembling data bundles in a direct and simplified manner is desired.
As used herein, a data bundle includes data such as emails, video, music, raw data (charts, text, numerics), etc. The present methods and devices provide a gesture-enabled tool that enables a user to assemble a data bundle using a single continuous gesture to select the items for the data bundle from a plurality of menus or lists and to deliver the data bundle to a recipient as part of the single continuous gesture. As used herein, a single continuous gesture is defined as a sequence of selections in a stepwise continuous gesture action.
Computer-readable media 106 include a gesture manager 112 and one or more applications, features, or capabilities 114 of the computing device 102. Applications 114 include social-media platforms such as chat rooms, hangouts, twitter, etc.
Computing device 102 is shown as a smart phone having a gesture-sensitive display 108, which acts as both a display 116 and a gesture-sensitive input mechanism 118. Gesture-sensitive input mechanism 118 is capable of receiving gesture inputs, such as human-touch or stylus-touch gestures, as well as motion gestures not having a touch element, Gesture-sensitive input mechanism 118 may include a motion-sensitive array, a micro-electro-mechanical systems inertial sensor, an accelerometer, and the like. Another type of gesture-sensitive input mechanism is an infrared sensor or video camera for detecting gestures (e.g., hand gestures) made in the near-vicinity of the computing device 102.
Non-gesture input mechanisms 110 can include keyboard buttons, a track ball, volume control buttons, a camera button, a power/standby button, voice commands, and the like. While not required, non-gesture inputs may be received and responded to by the techniques described herein.
Furthermore, various types of computing devices, displays, and input mechanisms may also or instead be used, such as a personal computer having a monitor, keyboard, and mouse, a laptop with an integrated display and keyboard with touchpad, a cellular phone with a small integrated display and a telephone keypad plus navigation keys, or a tablet computer with an integrated touch-sensitive display (e.g., a touch screen or other touch-sensitive sensors capable of receiving gestures made proximal to the display). In some of these cases, a gesture is not made directly over a display but is instead received over a display, such as a gesture received through a mouse or touch pad and shown on the display. Thus, a received gesture may be a mouse movement where the mouse pointer makes the motion over a label on the display. This may still be considered a gesture-sensitive display.
Environment 100 also illustrates an example home-screen interface 120 with various labels for applications 114.
Device 102 can be implemented in a fixed or mobile electronic device being one or a combination of a media device, computing device, television set-top box, video processing or rendering device, appliance device (e.g., a closed-and-sealed computing resource, such as some digital video recorders or global-positioning-satellite devices), gaming device, electronic device, in-vehicle computing platform, or workstation.
Device 102 can be integrated with electronic circuitry, a microprocessor, memory, input-output (“I/O”) logic control, communication interfaces, and components, other hardware, firmware, or software needed to run an entire device. Example device 102 can also include an integrated data bus (not shown) that couples the various components of the computing device for data communication among the components.
Device 102 includes various components such as an I/O logic control 202 (e.g., to include electronic circuitry) and microprocessors 204 (e.g., microcontroller or digital signal processor). Device 102 also includes a memory 206, which can be any type of random-access memory, a low-latency nonvolatile memory (e.g., flash memory), read-only memory, or other suitable electronic data storage.
Device 102 can also include various firmware and software, such as an operating system 208, gesture manager 112, and applications 114, which can be computer-executable instructions maintained in memory 206 and executed by microprocessor 204. Device 102 can also include other various communication interfaces and components, wired or wireless local-area network or private-area network components, cellular transceivers, other hardware, firmware, and software.
Referring back to
Contact manager 320 generally includes a directory of people/company/group/organization contact information which could include name, address, telephone number, etc. Filter manager 330 generally includes a configurable list of filters, which could include text-based and document-type filters. File manager 340 generally includes a filtered or unfiltered list of items, e.g. files to share, such as documents, calendar events, contact cards, etc.
List windows 310 facilitate the selection and assembly of accessible information. While shown as three primary lists in
In some embodiments, a user may add to or modify the lists in list windows 310. For example, the user may add a text-based or Boolean search field to Filter manager 330 or add contacts to the Contact manager 320. In some embodiments, the user may add a field such as “delete name” to Filter manager 330 to prevent a conversation to or from a particular contact in, for example, an email before bundling and sending to a recipient.
In some embodiments, gesture manager 112 assembles lists based on the ability of the data or content to be manipulated by gestures. For example, gesture manager 112 may assemble all applications 114 and related data configured to be gesture-enabled and provide these applications 114 as lists in list windows 310.
As used herein, a gesture is a motion by the user to signal the desire for an action to be taken. Consequently, gesture-enablement is the ability of an application to understand and react to the intent of the user through a motion. Thus, a fade, slide in, slide out, swipe, scroll, throw, flick, shake, are all gestures that may be used to select and bundle data. In addition, a camera may be used to detect gestures by eye tracking or monitoring hand gestures.
Still referring to
In an example shown in
While shown in the order 320, 330, 340, the order of selection within list window managers 320, 330, 340 can be in any combination. This provides flexibility to facilitate choice based on context. Furthermore, in some embodiments, the creation of data bundles may be performed using a single, continuous gesture such as a single swipe that the user moves from one list manager to another to select and then to send the data bundles to the desired recipients.
As another example, a user selects a contact (“contact#1) from the Contact manager 320 and then slides to the Filter manager 330 and selects a filter (“email”). Gesture manager 112 automatically searches through available emails with the contact#1 name in them and displays or presents these emails in File manager 340. On producing these emails with the contact#1 name, the gesture manager 112 may determine that there are additional related contacts (“contact#2” and “contract #3”) within the user's Contact manager 320: They may be related because they are recipients to the emails from contact#1. In some embodiments, the gesture manager 112 would filter out and only display these related contacts in Contact manager 320. The user then has the opportunity to further filter within Contact manager 320 for contact#1, contact#2, and contact#3 if desired, then bundle the files and send to a recipient.
In addition to list windows 300, gesture manager 112 also provides a plurality of lists which comprise one or more interactive recipient windows on interface 120.
Recipient windows 410 facilitate the selection of where to deliver data bundle 350. While shown as three primary lists in
In order for the user 560 to send the data bundle 550 to one or more participants, 562, 564, 566, and 568, the user 560 may simply drag the data bundle 550 to each participant 562, 564, 566, and 568 to whom the data bundle 550 is to be sent. If all participants 562, 564, 566, and 568 are intended recipients, then the user 560 can simply drag the data bundle 550 into the chat room window 580.
In some embodiments, one or more of the participants 562, 564, 566, and 568 can view the user's list window 510. In some embodiments, the participants 562, 564, 566, and 568 can request data bundles 550 of interest and accessible to the participants 562, 564, 566, and 568. Such requests can be made to user 560 by a participant 562, 564, 566, 568 similarly assembling a data bundle 550 from the user's list window 510 and waiting for the user to drag the data bundle 550 to the intended recipient or to approve the formed data bundle 550. For example, participant 562 could create a request by sliding over a filter, e.g. music, then over name, e.g. Dido, and place that request over user 560. The system supporting conference window 580 could then assemble a data bundle of all Dido music resident on user 560's computer and place it on participant 562, with a send question, which 560 could approve. Here user 560 is aware that a request is made, which he could deny if desired.
In some embodiments, the user 560 may be prompted to enter a password or provide another means for authentication before sending data bundle 550 to its intended recipients. Such a password or authentication may be invoked whenever, e.g., a chat session has been dormant or inactive for a while or if the user 560 has not been actively engaged in the chat. Alternatively, in some embodiments, data bundle 550 may be queued to be sent to a particular recipient, but the data bundle 550 may sit for a predetermined time period before actually being sent, in case the user 560 desires to cancel the data bundle 550 to the recipient for any reason, including user error.
In a first step 1110, a user selects a first data item from a list in the list window by gesturing over the first item. The user then determines whether or not the data bundle is complete at step 1120. If the user decides that the data bundle is not complete, then the user then selects a second item from a list in the list window by gesturing over the second item (step 1130). The user once again determines whether or not the data bundle is complete at step 1140. If not, then steps 1130 and 1140 may be repeated until the user decides that the data bundle is complete. Once the user decides the data bundle is complete, at step 1150, the user selects a recipient from a list in the recipient window by gesturing over the recipient. While not shown explicitly, the user may select more than one recipient by repeating step 1150.
An example of applying
Once the data collection and filters are assembled in a data bundle or a collection, they can then be released or delivered to a destination or recipient at step 1150. For example, the recipient could be a chat room, a folder, an attach-list to an email, etc.
In a first aspect, a method for sharing data on an electronic device having a display is disclosed including: providing a list window for selecting the data bundle; providing a recipient window for receiving the data bundle; enabling a user through a sequence of selections to a collect data bundle from the list window using a single continuous gesture such that the data bundle is delivered to the recipient window as part of the single continuous gesture. In an embodiment of the first aspect, the list window includes an element selected from the group consisting of: contact list, filter list, and files list. In an embodiment of the first aspect, the contact list includes a list of contacts available to the user. In an embodiment of the first aspect, the filter list includes a list of filters available to the user. In an embodiment of the first aspect, the filters include an element selected from the group consisting of: electronic mail, calendar dates, attachments, text, photos, and music. In an embodiment of the first aspect, the user is allowed to create a filter by entering a filter term or dragging a filter item into the filter list. In an embodiment of the first aspect, the files list includes a list of data files available to the user. In an embodiment of the first aspect, the recipient window includes a destination for sending the data bundle. In an embodiment of the first aspect, the recipient window includes an element selected from the group consisting of: a folder, a forum, a recipient, and an email. In an embodiment of the first aspect, the user selects a data bundle by identifying an item from the list window using a gesture that selects the item after a predetermined amount of time passes. In an embodiment of the first aspect, the user selects a data bundle by identifying at least two items from different lists. In an embodiment of the first aspect, when a user selects a data bundle, metadata associated with the data bundle are dynamically changed to reflect the data bundle selection. In an embodiment of the first aspect, a data bundle includes an item selected from the list window. In an embodiment of the first aspect, a single gesture includes an element selected from the group consisting of: a swipe, slide, scroll, throw, or flick by the user. In an embodiment of the first aspect, the list window is visible to the recipient window. In an embodiment of the first aspect, a recipient can request a data bundle from the user.
In a second aspect, an electronic device is disclosed including: a display configured to provide a user with a gesture-enabled selection tool; a processor; and a program stored in memory and configured to be executed by the processor, the program including instructions for: providing a list window for selecting the data bundle; providing a recipient window for receiving the data bundle; and enabling a user through a sequence of selections to collect a data bundle from the list window using a single continuous gesture such that the data bundle is delivered to the recipient window as part of the single continuous gesture, wherein the recipient window and list window together compose the gesture-enabled selection tool. In an embodiment of the second aspect, the electronic device includes an element selected from the group consisting of: a mobile phone, a tablet, a laptop, a desktop computer, a personal digital assistant, a global positioning system, and a video gaming device.
In view of the many possible embodiments to which the principles of the present discussion may be applied, it should be recognized that the embodiments described herein with respect to the drawing figures are meant to be illustrative only and should not be taken as limiting the scope of the claims. Therefore, the techniques as described herein contemplate all such embodiments as may come within the scope of the following claims and equivalents thereof.
Number | Name | Date | Kind |
---|---|---|---|
6317739 | Hirata | Nov 2001 | B1 |
8510677 | van Os | Aug 2013 | B2 |
20050216524 | Gomes | Sep 2005 | A1 |
20070157101 | Indiran | Jul 2007 | A1 |
20090030971 | Trivedi | Jan 2009 | A1 |
20090183088 | Saka | Jul 2009 | A1 |
20110167369 | van Os | Jul 2011 | A1 |
20120182244 | Arthur | Jul 2012 | A1 |
20130132883 | Vayrynen | May 2013 | A1 |
20130139092 | Hang | May 2013 | A1 |
20140237378 | Gonen | Aug 2014 | A1 |
Entry |
---|
Google Operating System, Unofficial news and tips about Google, Jul. 27, 2006, Google Talk Adds Voicemail and File Transfer, googlesystem.blogspot.com/2006/07/google-talk-adds-voicemail-and-file.html, all pages. |
Number | Date | Country | |
---|---|---|---|
20150169147 A1 | Jun 2015 | US |