Patent Application
20140168077
This disclosure relates to electronic display devices, and more particularly, to user interface techniques for interacting with touch sensitive devices.
Electronic display devices such as tablets, eReaders, mobile phones, smart phones, personal digital assistants (PDAs), and other such touch screen electronic display devices are commonly used for displaying consumable content. The content may be, for example, an eBook, an online article or blog, images, a movie or video, a map, just to name a few types. Such display devices are also useful for displaying a user interface that allows a user to interact with an application running on the device. The user interface may include, for example, one or more touch screen controls and/or one or more displayed labels that correspond to nearby hardware buttons. The touch screen display may be backlit or not, and may be implemented for instance with an LED screen or an electrophoretic display. Such devices may also include other touch sensitive surfaces, such as a track pad (e.g., capacitive or resistive touch sensor) or touch sensitive housing (e.g., acoustic sensor).
a-b illustrate an example electronic touch sensitive device having a navigation mode configured in accordance with an embodiment of the present invention.
c-d illustrate example configuration screen shots of the user interface of the electronic touch sensitive device shown in
a illustrates a block diagram of an electronic touch sensitive device configured in accordance with an embodiment of the present invention.
b illustrates a block diagram of a communication system including the electronic touch sensitive device of
a-j each illustrates an example multi-touch navigation mode of an electronic touch sensitive device, in accordance with an embodiment of the present invention.
Techniques are disclosed for providing a navigation mode in electronic touch sensitive devices. The navigation mode can be used, for example, to advance forward and backward through displayed pages of content on a page-by-page or multi-page basis, such as pages of an eBook, photos, lists such as search results and files, or other consumable content that can be readily displayed in a page-like fashion. Likewise, the navigation mode can also be used, for example, to navigate from book to book, album to album, etc. The user can engage the navigation mode with a particular gesture that includes a combination of contact points that uniquely and/or globally identify that the navigation mode is desired. The combination may include, for example, a press-and-hold activation contact point by one hand of the user, and one or more additional moving contact points that indicate the desired navigation using the other hand of the user. Horizontal and vertical paging speeds correspond to the number of moving contact points, which can be effected with swiping or circular gestures, for instance. Given the uniqueness and possibly global nature of the engagement mechanism, the mode can be similarly invoked within multiple diverse applications (e.g., eBook, browser, picture viewer, etc) and without conflicting with other global gestures that might also be used by the device's operating system.
General Overview
As previously explained, electronic display devices such as tablets, eReaders, and smart phones are commonly used for displaying user interfaces and consumable content. The user of such devices can typically page through the displayed content with relative ease. In some instances, however, the user might prefer a more customized navigation scheme that can be uniquely activated on a global level to enhance the consumption experience. While available navigation techniques such as page turning are commonly provided within a given application, those same techniques cannot be used outside that application (e.g., the techniques only work when an eBook is being read). Likewise, user interface commands relevant to a given application cannot conflict with global commands. In this sense, the user is required to remember various application-based navigation techniques, and must know which technique to use depending on the given application. Such complexity can effectively diminish the user's consumption experience, or may simply inhibit wide spread adoption or otherwise leave the available techniques underutilized.
Thus, and in accordance with an embodiment of the present invention, techniques are disclosed for providing a navigation mode in electronic touch sensitive devices, such as touch screen and track pad devices. The navigation mode can be used, for example, to advance forward and backward through displayed pages of content on a page-by-page or multi-page basis, such as the pages of an eBook, lists such as search results and files, or other consumable content that can be readily displayed to a user in a page-like fashion (e.g., advancing through photos on a photo-by-photo or multi-photo basis). The navigation mode can also be used, for example, to advance at a more coarse level. For instance, in addition to navigating through pages of a book, or pictures of a photo album, or songs or an album, the user can also navigate from book to book within a virtual library, or picture album to picture album, or song album to song album. The user can engage the navigation mode, for instance, with a particular touch screen/pad gesture that includes a combination of contact points that globally and/or otherwise uniquely identify that the navigation mode is desired.
In one example embodiment, the combination of contact points includes an activation contact point applied by one hand of the user and one or more additional moving contact points applied by the user's other hand that indicate the desired navigation. For instance, the right hand of a left-handed user, or the left hand of a right-handed user, can provide the activation contact point, in some example cases. Horizontal and vertical paging can be executed, and at speeds that correspond to the number of moving contact points used. For instance, in one example case, one moving contact point corresponds to a 1-page advancement, two moving contact points corresponds to 2-page advancement, . . . and five moving contact points corresponds to 5-page advancement. The navigation gesture associated with the moving contact points may be, for instance, a horizontal or vertical swipe to navigate in those respective directions either forward or backward. Other gestures, such as diagonal swipe or circular, may also be used. In some cases, the user can specify a right or left hand preference, and may also apply a page advancement multiplier to the number of moving contact points. For instance, a multiplier set to 5 and 2 moving contact points corresponds to 10-page advancement per gesture. The multiplier can be automatically applied, for instance, to a particular type of gesture, such as a diagonal swipe or a circular gesture.
As previously indicated, the user can engage the navigation mode with a particular combination of contacts/gestures that uniquely indicate a desired intent to engage the mode, such as a press-and-hold at the edge of the device touch screen or track pad, or on the device home button (or other such physical feature), or a tap or sequence of taps on a housing configured with acoustics sensors. Such a touch is generally referred to herein as an activation point. This, used in combination with one or more moving contact points on the same (or different) touch sensitive surface, causes real-time engagement of the navigation mode, in accordance with an embodiment of the present invention. In a more general sense, any uniquely identifiable set of contact points on a touch sensitive surface(s) by the user can be used to engage the navigation mode. The uniqueness of the touch may be based, for example, on the particular location of the touch (e.g., edge of display or track pad for activation point and over displayed content for gesture/moving point(s), etc) and/or the nature of the touch (e.g., press-and-hold for a predetermined duration, the number of simultaneously applied contact points, the sequence of taps, drags, swipes, circular or elliptical gestures, etc).
Once the navigation mode is engaged, the user may continue to maintain the activation point (or points) while the page advancement is provided in unison with the user directed page turning based on the moving point (or points). To exit the navigation mode, the user can release the activation point(s), for example. In other embodiments, once activated, the activation point can be released, so that only the moving point(s) are needed. In one such example case, a navigation mode icon may appear in the status bar or other display area of the device, once the mode is engaged. This icon can be used to effectively indicate to the user that navigation mode is engaged and that the activation point has effectively been internalized, and the desired navigation gestures supported by that mode can be used. To exit the mode, the user can touch or tap the icon, for example.
The techniques can be implemented in an intuitive manner, so that the user can seamlessly and selectively engage, pause, and/or disengage the navigation mode without disrupting the reading experience, in accordance with some embodiments. For instance, in one specific such embodiment, a thumb press-and-hold gesture along the border region of the display screen can be used in combination with one or more swiping/circular gestures to automatically advance an appropriate number of pages. Alternatively, a stylus could be used in combination with one or more fingers. For instance, for a right-handed user, the left thumb could be placed at the left-side boarder of the display and the stylus tip could be generally placed and swiped or flicked over the content area to turn pages. In any such cases, the use of two (or more) contact points can be used to uniquely identify the user's desire to engage the navigation mode. Numerous uniquely identifiable engagement schemes that exploit a touch sensitive surface can be used as will be appreciated in light of this disclosure. Further note that any touch sensitive device (e.g., track pad, touch screen, or other touch sensitive surface, whether capacitive, resistive, acoustic or other touch detecting technology) may be used to detect the user contact, and the claimed invention is not intended to be limited to any particular type of touch sensitive technology, unless expressly stated.
Architecture
a-b illustrate an example electronic touch sensitive device having a navigation mode configured in accordance with an embodiment of the present invention. The device could be, for example, a tablet such as the NOOK® Tablet by Barnes & Noble. In a more general sense, the device may be any electronic device having a touch sensitive user interface and capability for displaying content to a user, such as a mobile phone or mobile computing device such as a tablet or laptop, a desktop computing system, a television, a smart display screen, or any other device having a touch screen display or a non-touch display screen that can be used in conjunction with a touch sensitive surface. As will be appreciated, the claimed invention is not intended to be limited to any particular kind or type of electronic device.
As can be seen with this example configuration, the device comprises a housing that includes a number of hardware features such as a power button and a press-button (sometimes called a home button herein). A touch screen based user interface is also provided, which in this example embodiment includes a quick navigation menu having six main categories to choose from (Home, Library, Shop, Search, Light, and Settings) and a status bar that includes a number of icons (a night-light icon, a wireless network icon, and a book icon), a battery indicator, and a clock. Other embodiments may have fewer or additional such UI touch screen controls and features, or different UI touch screen controls and features altogether, depending on the target application of the device. Any such general UI controls and features can be implemented using any suitable conventional or custom technology, as will be appreciated.
The power button can be used to turn the device on and off, and may be used in conjunction with a touch-based UI control feature that allows the user to confirm a given power transition action request (e.g., such as a slide bar or tap point graphic to turn power off). In this example configuration, the home button is a physical press-button that can be used as follows: when the device is awake and in use, tapping the button will display the quick navigation menu, which is a toolbar that provides quick access to various features of the device. The home button may also be configured to cease an active function that is currently executing on the device, such as a navigation mode as described herein. The button may further control other functionality if, for example, the user presses and holds the home button. For instance, an example such push-and-hold function could engage a power conservation routine where the device is put to sleep or an otherwise lower power consumption mode. So, a user could grab the device by the button, press and keep holding as the device was stowed into a bag or purse. One physical gesture that would safely put the device to sleep. Thus, in such an example embodiment, the home button may be associated with and control different and unrelated actions: 1) show the quick navigation menu; 2) exit the navigation mode, but keep the page being read or otherwise consumed displayed (e.g., so that another mode can be entered, if so desired); and 3) put the device to sleep. Numerous other configurations and variations will be apparent in light of this disclosure, and the claimed invention is not intended to be limited to any particular set of hardware buttons or features, or device form factor.
As can be further seen, the status bar may also include a book icon (upper left corner). In some such cases, the user can access a sub-menu that provides access to a navigation mode configuration sub-menu by tapping the book icon of the status bar. For example, upon receiving an indication that the user has touched the book icon, the device can then display the multi-touch navigation mode configuration sub-menu shown in
As will be appreciated, the various UI control features and sub-menus displayed to the user are implemented as UI touch screen controls in this example embodiment. Such UI touch screen controls can be programmed or otherwise configured using any number of conventional or custom technologies. In general, the touch screen translates the user touch in a given location into an electrical signal which is then received and processed by the underlying operating system (OS) and circuitry (processor, etc). Additional example details of the underlying OS and circuitry in accordance with some embodiments will be discussed in turn with reference to
As previously explained, and with further reference to
As can be further seen with reference to the example embodiment of
With further reference to the example embodiment of
Also configurable via the UI screen example of
a illustrates a block diagram of an electronic touch screen device configured in accordance with an embodiment of the present invention. As can be seen, this example device includes a processor, random access memory (RAM), additional storage/memory, a communications module, a touch screen, and an audio module. A communications bus and interconnect is also provided to allow inter-device communication. Other typical componentry and functionality not reflected in the block diagram will be apparent (e.g., battery, co-processor, etc). Further note that although a touch screen display is provided, other embodiments may include a non-touch screen and a touch sensitive surface such as a track pad, or a touch sensitive housing configured with one or more acoustic sensors, etc. In any such cases, the touch sensitive surface is generally capable of translating a user's physical contact with the surface into an electronic signal that can be manipulated or otherwise used to trigger a specific user interface action, such as those provided herein. The principles provided herein equally apply to any such touch sensitive devices. For ease of description, examples are provided with touch screen technology.
In this example embodiment, the RAM includes a number of modules stored therein that can be accessed and executed by the processor (and/or a co-processor). The modules include an operating system (OS), a user interface (UI), and a power conservation routine (Power). The modules can be implemented, for example, in any suitable programming language (e.g., C, C++, objective C, JavaScript, custom or proprietary instruction sets, etc), and encoded on a machine readable medium, that when executed by the processor (and/or co-processors), carries out the functionality of the device including a UI having a navigation mode as described herein. Other embodiments can be implemented, for instance, with gate-level logic or an application-specific integrated circuit (ASIC) or chip set or other such purpose built logic, or a microcontroller having input/output capability (e.g., inputs for receiving user inputs and outputs for directing other components) and a number of embedded routines for carrying out the device functionality. In short, the functional modules can be implemented in hardware, software, firmware, or a combination thereof.
The processor can be any suitable processor (e.g., 800 MHz Texas Instruments OMAP3621 applications processor), and may include one or more co-processors or controllers to assist in device control. In this example case, the processor receives input from the user, including input from or otherwise derived from the power button and the home button. The processor can also have a direct connection to a battery so that it can perform base level tasks even during sleep or low power modes. The RAM can be any suitable type of memory and size (e.g., 256 or 512 Mbytes SDRAM), and in other embodiments may be implemented with non-volatile memory or a combination of non-volatile and volatile memory technologies. The storage can also be implemented with any suitable memory and size (e.g., 2 GBytes of flash memory). The display can be implemented, for example, with a 6-inch E-ink Pearl 800×600 pixel screen with Neonode® zForce® touch screen, or any other suitable display and touch screen interface technology. The communications module can be, for instance, any suitable 802.11b/g/n WLAN chip or chip set, which allows for connection to a local network so that content can be downloaded to the device from a remote location (e.g., content provider, etc, depending on the application of the display device). In some specific example embodiments, the device housing that contains all the various componentry measures about 6.5″ high by about 5″ wide by about 0.5″ thick, and weighs about 6.9 ounces. Any number of suitable form factors can be used, depending on the target application (e.g., laptop, desktop, mobile phone, etc). The device may be smaller, for example, for smartphone and tablet applications and larger for smart computer monitor and laptop applications.
The operating system (OS) module can be implemented with any suitable OS, but in some example embodiments is implemented with Google Android OS or Linux OS or Microsoft OS or Apple OS. As will be appreciated in light of this disclosure, the techniques provided herein can be implemented on any such platforms. The power management (Power) module can be configured as typically done, such as to automatically transition the device to a low power consumption or sleep mode after a period of non-use. A wake-up from that sleep mode can be achieved, for example, by a physical button press and/or a touch screen swipe or other action. The user interface (UI) module can be, for example, based on touch screen technology and the various example screen shots shown in
Client-Server System
b illustrates a block diagram of a communication system including the electronic touch sensitive device of
Multi-Touch Navigation Examples
a-j each illustrates an example multi-touch navigation mode of an electronic touch sensitive device, in accordance with an embodiment of the present invention. As can be seen, the device includes a touch sensitive surface, which may be, for example, a touch screen display, a track pad, or any other touch sensitive surface for receiving a multi-touch point user input.
In the example engagement mode shown in
As can be seen in this example scenario of
In the example engagement mode shown in
In the example engagement mode shown in
Methodology
As can be seen, the method includes an activation phase and a navigation phase. Each phase includes sensing a user's input by a touch sensitive surface, and the phases may overlap in time (at least partially) or may be completely sequential in nature, as will be appreciated in light of this disclosure. In general, any touch sensitive device may be used to detect contact with it by one or more fingers and/or styluses. As soon as the user begins to drag or otherwise move the contact points, the UI code (and/or hardware) can assume a drag gesture has been engaged and track the path of each contact point with respect to any fixed point within the touch surface until the user stops engaging the touch sensitive surface. The release point can also be captured by the UI as it may be used to commit the action started when the user pressed on the touch sensitive surface. In a similar fashion, if the user releases hold without moving the contact point, a press or press-and-hold command may be assumed depending on the amount of time the user was continually pressing on the touch sensitive surface. These main detections can be used in various ways to implement UI functionality, including a navigation mode as variously described herein.
In this example case, the activation phase of the method includes detecting 401 multiple user contact points at the touch sensitive interface. In general, the touch monitoring is effectively continuous. The method continues with determining 403 if at least one of the contact points is in the navigation mode activation zone. As previously indicated, one example activation zone is the edge or perimeter of the touch sensitive surface. Other embodiments may have the activation zone anywhere on the touch sensitive surface that is specified by the user via a configuration menu. In a more general sense, the navigation mode activation zone can be pre-established in any specific location on the touch sensitive surface of the device.
In any case, if the contact is not in the navigation mode activation zone, then the method may continue with reviewing 404 the contact for some other UI request (e.g., select a file, send an email, etc). On the other hand, if the contact is in the navigation mode activation zone, the method continues with determining 405 if one or more other contact points are moving (e.g., being dragged in a horizontal, vertical, diagonal, or circular motion). If the one or more other contact points are not moving, then the method may continue with reviewing 404 the contact for some other UI request. On the other hand, if the one or more other contact points are moving, then the method continues with activating 407 the navigation mode, or maintaining that mode if already activated.
In the navigation phase, the method continues with determining 409 if the moving contact points are swiping left or right. If swiping left then the UI code assumes the user is actively paging forward in the horizontal direction and the method continues with navigating 411 forward X pages, where X is the number of moving/swiping contact points. If swiping right then the UI code assumes the user is actively paging backward in the horizontal direction and the method continues with navigating 414 backward X pages. If the moving contact points are not swiping left or right, the method continues with determining 415 if the moving contact points are swiping up or down. If swiping down then the UI code assumes the user is actively paging upward and the method continues with navigating 417 upward X pages, where X is the number of moving/swiping contact points. If swiping up then the UI code assumes the user is actively paging downward and the method continues with navigating 419 downward X pages. As will be appreciated in light of this disclosure, whether a particular gesture causes forward or backward navigation, or upward or downward navigation, can be programmed or otherwise configured to comply with a given convention as desired, and the claimed invention is not intended to be limited to any particular convention.
If the moving contact points are not swiping up or down, the method continues with determining 421 if the moving contact points are swiping diagonally up or down. If swiping diagonally down (and to the left, for instance) then the UI code assumes the user is actively paging forward in the horizontal direction and the method continues with navigating 423 forward X*Y pages, where X is the number of diagonally moving contact points and Y is a multiplier configured by the user or otherwise pre-established. If swiping diagonally up (and to the right, for instance) then the UI code assumes the user is actively paging backward in the horizontal direction and the method continues with navigating 425 backward X*Y pages. Numerous variations will be apparent in light of this disclosure. For instance, if swiping diagonally down (and to the right, for instance) then the UI code assumes the user is actively paging backward in the vertical direction and the method continues with navigating backward X*Y pages. If swiping diagonally up (and to the left, for instance) then the UI code assumes the user is actively paging forward in the vertical direction and the method continues with navigating 425 forward X*Y pages.
If the moving contact points are not swiping diagonally up or down, the method of this example embodiment continues with determining 427 if the moving contact points are moving in a circular-like fashion. If moving counter-clockwise then the UI code assumes the user is actively paging forward in the horizontal direction and the method continues with navigating 429 forward X, where X is the number of circularly moving contact points. If moving clockwise then the UI code assumes the user is actively paging backward in the horizontal direction and the method continues with navigating 425 backward X pages. Just as previously explained, an optional multiplier may be associated with circular gestures, if so desired. Likewise, circular gestures may also be used to navigate in the vertical (up/down) direction, if so desired. While a number of user-configurable features are provided in some example embodiments (e.g., such as shown in
The method may continue in the touch monitoring mode indefinitely or as otherwise desired, so that any multi-touch contact provided by the user can be evaluated and used as a navigation command. As previously indicated, the navigation mode can be exited by, for example, the user removing the activation contact point or pressing a release mode UI feature such as the home button or a touch screen feature.
Numerous variations and embodiments will be apparent in light of this disclosure. For instance, different navigating functions can be assigned to horizontal and vertical gestures. For example, horizontal gestures can be used to advance from page to page within a book, picture to picture within a picture album, song to song within a music album, etc, while vertical gestures can be used to advance from book to book within a library, picture album to picture album, music album to music album, etc.
One embodiment of the present invention provides a device including a display for displaying content to a user, and a touch sensitive surface for allowing user input. The device further includes a user interface including a multi-touch navigation mode that is configured to be activated in response to user contact via the touch sensitive interface, the user contact including a fixed activation point and one or more moving gesture points, the one or more moving gesture points defining a navigation gesture. In some cases, the display is a touch screen display that includes the touch sensitive surface. In some cases, the touch sensitive surface is a track pad. In some cases, the quantity of the one or more moving gesture points defines how many pages to advance displayed content per navigation gesture. In some cases, the navigation gesture is user-configurable. In some cases, direction of the one or more moving gesture points dictates direction of page advancement of displayed content, such that swipes to the right page backward, swipes to the left page forward. In some cases, the fixed activation point is a press-and-hold contact on the touch sensitive surface, and the navigation mode remains enabled until the press-and-hold contact is released. In other cases, the fixed activation point is a press-and-release contact on the touch sensitive surface, and the navigation mode remains enabled after release of the press-and-release contact and until the navigation mode is affirmatively terminated. In some cases, the fixed activation point has a location that is user-configurable. In some cases, the fixed activation point is received from a first hand of the user and the one or more moving gesture points are received from another hand of the user.
Another embodiment of the present invention provides a device including a display having a touch screen interface and for displaying content to a user, and a user interface including a multi-touch navigation mode that is configured to be activated in response to user contact via the touch sensitive interface, the user contact including a fixed activation point and one or more moving gesture points, the one or more moving gesture points defining a navigation gesture. The quantity of the one or more moving gesture points defines how many pages to advance displayed content per navigation gesture, and the fixed activation point is received from a first hand of the user and the one or more moving gesture points are received from another hand of the user. In some cases, the fixed activation point has a location and at least one of the location and/or the navigation gesture is user-configurable. In some cases, the fixed activation point is a press-and-hold contact on the touch screen interface, and the navigation mode remains enabled until the press-and-hold contact is released. In other cases, the fixed activation point is a press-and-release contact on the touch screen interface, and the navigation mode remains enabled after release of the press-and-release contact and until the navigation mode is affirmatively terminated. In some cases, the device is an eReader device or a tablet computer or a smartphone.
Another embodiment of the present invention provides a computer readable medium encoded with instructions that when executed by one or more processors, cause a content navigation process to be carried out. The process includes, in response to user contact via a touch sensitive interface of a device capable of displaying content, activating a multi-touch navigation mode in the device, the user contact including a fixed activation point and one or more moving gesture points, the one or more moving gesture points defining a navigation gesture, and advancing displayed content based on the navigation gesture. In some cases, the quantity of the one or more moving gesture points defines how many pages to advance displayed content per navigation gesture. In some cases, the fixed activation point has a location, and at least one of the location and/or the navigation gesture is user-configurable. In some cases, the fixed activation point is a press-and-hold contact on the touch sensitive surface, and the navigation mode remains enabled until the press-and-hold contact is released. In other cases, the fixed activation point is a press-and-release contact on the touch sensitive surface, and the navigation mode remains enabled after release of the press-and-release contact and until the navigation mode is affirmatively terminated.
The foregoing description of the embodiments of the invention has been presented for the purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form disclosed. Many modifications and variations are possible in light of this disclosure. It is intended that the scope of the invention be limited not by this detailed description, but rather by the claims appended hereto.
