When interacting with a user interface rendered on a device, a user can access an input component of the device, such as a keyboard and/or a mouse. The user can reposition the mouse from one location to another to navigate the user interface and to access visual content rendered on the user interface. In another example, the user can utilize shortcut keys on the keyboard to navigate and to access visual content on the user interface.
Various features and advantages of the disclosed embodiments will be apparent from the detailed description which follows, taken in conjunction with the accompanying drawings, which together illustrate, by way of example, features of the disclosed embodiments.
A device includes a sensor to detect information of a hand gesture from a user for the device to detect an initial location and an end location of the hand gesture. The initial location corresponds to where the hand gesture begins and the end location corresponds to where the hand gesture ends. The sensor can be a touchpad or a touch surface to detect the user touching a surface of the sensor to make one or more hand gestures. In response to detecting the initial location and the end location of the hand gesture, the device can identify an input mode for the device. An input mode for the device corresponds to how the device interprets and processes a hand gesture as an input command for the device.
In one embodiment, an input mode can include a swipe mode for the user to navigate between content displayed on a user interface. The content can include an application, file, media, menu, setting, and/or wallpaper of the device. In another embodiment, an input mode can include a pointer mode for the user to access and navigate content which is presently rendered for display on the user interface. If either the initial location or the end location of the hand gesture are within proximity of an edge of the sensor, the device will identify the input mode for the device to be a swipe mode. In another embodiment, if neither the initial location nor the end location of the hand gesture are within proximity of any edge of the sensor, the device will identify the input mode to be a pointer mode.
In response to identifying an input mode, the device can identify an input command to execute on the device corresponding to the identified input mode and information of the touch gesture from the user. For example, if the identified mode is a swipe mode, the input command can be to navigate between content and/or to bring a menu of the device into view on the user interface. In another example, if the identified input is a pointer mode, the input command can be to navigate the presently rendered content by repositioning a cursor or a pointer over an area of the presently rendered content. As a result, the device can accurately identify one or more input commands on the device for a user to access and navigate a user interface with one or more hand gestures.
For the purposes of this application, an input mode 140 of the device 100 corresponds to how the controller 120 and/or the input application interpret a hand gesture to identify an input command 145 of the device 100. In one embodiment, an input mode 140 includes a swipe mode. If the device 100 is in a swipe mode, a hand gesture from a user can be interpreted as an input command 145 to navigate between content displayed on a user interface of the device 100. The user interface includes visual content such as files, documents, media, applications, and/or wallpaper. In another example, the visual content can include a menu and/or settings of a file, an application, and/or an operating system of the device 100. In other embodiments, an input mode 140 can include a pointer mode of the device 100. If the device 100 is a pointer mode, a hand gesture from the user can be interpreted as an input command 145 to access content presently rendered for display on the user interface. Additionally, the pointer mode can be used to navigate the content rendered on the user interface.
When determining which input mode 140 to use for the device 100, a sensor 130 of the device 100 can initially detect for a hand gesture from a user of the device 100. The user can include any person which can access the device 100 by making one or more hand gestures. A hand gesture can include one or more fingers and/or hand of the user coming within proximity of the sensor 130. In another embodiment, a hand gesture can include the user making a motion with at least one finger and/or a hand within proximity of the sensor 130. In other embodiments, the hand gesture can be a touch gesture where a hand or a finger of the user touches and/or maintains contact with a surface of the sensor 130. For the purposes of this application, the sensor 130 is a hardware component of the device 100 which can detect a hand or finger of the user as the user is making one or more hand gestures. In one embodiment, the sensor 130 can be a touchpad and/or a touch surface of the device 100.
When detecting the hand gesture, the sensor 130 can detect information of the hand gesture. The information can include one or more coordinates corresponding to accessed locations of the sensor 130. One or more coordinates can include an initial location and an end location of the hand gesture. The initial location corresponds to a location where the hand gesture is detected by the sensor 130 to begin. The end location corresponds to a location where the hand gesture is detected by the sensor 130 to end. In another embodiment, the information can identify a number of fingers used in the hand gesture. In other embodiments, the information can include whether the hand gesture includes a motion and a direction of the motions.
For example, if the user makes a hand gesture by touching a top-center location of the sensor 130 and moving to a bottom-center location of the sensor 130, the initial location of the hand gesture is identified by the controller 120 and/or the input application to be top-center edge and the end location of the hand gesture is identified to be bottom-center. Additionally, the hand gesture includes a motion which moves downward from the top to the bottom. In another example, if the user makes a hand gesture by touching the center location of the sensor 130 and releasing the center location of the sensor 130, the controller 120 and/or the input application determine that the initial location and the end location of the hand gesture are the center of the sensor 130. Additionally, the hand gesture does not include any motions.
In response to detecting a hand gesture, the sensor 130 can pass information of the hand gesture to the controller 120 and/or the input application. The controller 120 and/or the input application can use the detected information to identify an input mode 140 for the device 100 by determining whether the first location and/or the end location of the hand gesture include a location within proximity of an edge of the sensor 130. The edge can include a top edge, a bottom edge, a left edge, and/or a right edge of the sensor 130. In one embodiment, the edge of the sensor 130 includes a perimeter of a touchpad or touch surface. The controller 120 and/or the input application can compare a coordinate of the initial location and/or a coordinate of the end location of the hand gesture to coordinates of the perimeter of the sensor 130.
If the coordinate of the initial location and/or the end location match a coordinate of the perimeter, the controller 120 and/or the input application determine that the input mode 140 for the device 100 is a swipe mode. In another embodiment, if neither the coordinate of the initial location and the coordinate of the end location do not match any of the coordinates of the perimeter, the controller 120 and/or the input application determine that the input mode 140 for the device 100 is a pointer mode. In response to identifying the input mode 140 for the device 100, the controller 120 and/or the input application identify an input command 145 of the device 100 corresponding to the input mode 140 and the hand gesture. For the purposes of this application, an input command 145 includes an input instruction to access and/or navigate the user interface.
In one embodiment, if the input mode 140 is a swipe mode, the hand gesture can be used to navigate between content on the user interface. In another embodiment, if the input mode 140 is a pointer mode, the hand gesture can be used to access and navigate a presently rendered content on the user interface. When identifying an input command 145, the controller 120 and/or the input application can compare the information of the hand gesture to predefined information of input commands 145 corresponding to the identified input mode 140. In response to identifying the input command 145, the controller 120 and/or the input application can execute the input command 145 on the device 100.
The user 205 can access and/or interact with the user interface 265 by making one or more hand gestures for a sensor 230 to detect. The hand gesture can be made with at least one finger and/or hand of the user 205. Additionally, the hand gesture can include the user 205 touching the sensor 230 and/or making one or more motions while touching the sensor 230. As noted above, the sensor 230 is a hardware component of the device 200 which can detect one or more hand gestures from the user 205. The sensor 230 can include a touchpad, a touch surface, and/or any additional hardware component which can detect a hand and/or finger of the user 205. In one embodiment, the sensor 230 can be integrated as part of the device 200. In another embodiment, the sensor 230 can be a peripheral component coupled an interface port of the device 200.
As shown in
When detecting a hand gesture, the sensor 230 can detect information of the hand gesture from the user 205. The information can include a number of fingers used in the hand gesture. In another embodiment, the information can include an initial location of the hand gesture and an end location of the hand gesture. As noted above, the initial location corresponds to where the hand gesture is detected by the sensor 230 to begin. For example, the initial location can be a coordinate of where the user initially touches a surface of the touchpad or touch surface. The end location corresponds to where the hand gesture is detected by the sensor 230 to end. For example, the end location can be a coordinate of where the user last touches a surface of the touchpad or touch surface. In other embodiments, the information can include whether the hand gesture includes any motions and/or a direction of any of the motions.
In response to detecting information of the hand gesture, a controller and/or an input application of the device 200 identify an input mode for the device 200 based on the initial location and/or the end location of the hand gesture. In another embodiment, as illustrated in
The controller 320 and/or the input application 310 can instruct the sensor 330 to detect information of the hand gesture. In one embodiment, the controller 320 and/or the input application 310 can additionally increase a sensitivity of the sensor 330 in response to the sensor 330 detecting one or more fingers from the user. Increasing the sensitivity of the sensor 330 can include increasing an amount of power supplied to the sensor 330. In another embodiment, the controller 320 and/or the input application 310 can increase a sensitivity of the edges of the sensor 330 without increasing a sensitivity of other areas or portions of the sensor 330.
As shown in
In response to receiving the information of the hand gesture, the controller 320 and/or the input application 310 can identify an input mode of the device based on the initial location and/or the end location of the hand gesture. In one embodiment, when identifying the input mode, the controller 320 and/or the input application 310 access a list, table, and/or database of input modes for the device. The list, table, and/or database of input modes can be locally stored on the device or remotely accessed from another device. As shown in the present embodiment, the device includes a swipe mode and a pointer mode. The swipe mode is used to navigate between content of the user interface and the pointer mode is used to access and/or navigate a presently rendered content of the user interface. In other embodiments, the device can include additional input modes in addition to and/or in lieu of those noted above and illustrated in
If the controller 320 and/or the input application 310 determine that the initial location and/or the end location of the hand gesture are within proximity of an edge of the sensor 330, the input mode for the device will be identified to be the swipe mode. The hand gesture is within proximity of the edge if at least one finger touches a location on a surface of the sensor 330 corresponding to an edge of the sensor 330. As noted above, the surface of the sensor 330 can include visible markings which show where on the sensor 330, an edge is located. In another embodiment, the hand gesture is within proximity of the edge if at least one finger touches a location of the sensor 330 within a predefined distance from the edge.
In one embodiment, the controller 320 and/or the input application 310 can additionally determine if more than one finger is detected to be touching the sensor 330 before identifying the input mode to be the swipe mode. In another embodiment, the controller 320 and/or the input application further determine if a first finger of the hand gesture is within proximity of an edge of the sensor 330 and if a second finger of the hand gesture is within proximity of the center of the sensor 330 before identifying the input mode to be the swipe mode. If the controller 320 and/or the input application 310 determine that neither the initial location nor the end location are within proximity of an edge of the sensor 330, the input mode for the device will be identified to be the pointer mode.
In response to identifying the input mode of the device, the controller 320 and/or the input application 310 proceed to identify an input command on the device corresponding to the input mode and the hand gesture. The input command includes an executable input instruction to access and/or navigate the user interface. As shown in
The controller 320 and/or the input application 310 compare information of the hand gesture detected by the sensor 330 to predefined information corresponding to an input command to determine which input command to execute. In one embodiment, if the input mode was previously identified to be the swipe mode and the information of the hand gesture specified that it included a horizontal motion, the controller 320 and/or the input application 310 identify the input command to be an instruction to navigate between content on the user interface. The controller 320 and/or the input application 310 can execute the input command on the device. Additionally, the controller 320 and/or the input application 310 modify the user interface of the display component 360 to display switching between content. Switching between content of the user interface can include switching from one open application or file to another.
In another embodiment, if the input mode is identified to be the swipe mode and the information of the hand gesture specified a vertical motion, the controller 320 and/or the input application 310 identify the input command to switch between content by sliding a menu bar into view on the user interface. As noted above, the menu bar can be a menu or settings of the presently rendered content, such as a file, application, and/or for an operating system of the device.
In other embodiments, if the input mode was previously identified to be a pointer mode and the information of the hand gesture specified that it included a horizontal motion, the controller 320 and/or the input application 310 identify the input command to be an instruction to navigate the presently rendered content by repositioning a pointer or cursor horizontally across the content. Additionally, the controller 320 and/or the input application 310 can modify the user interface of the display component 360 to display a pointer or cursor repositioning horizontally over the presently rendered content. In other embodiments, the controller 320 and/or the input application 310 can identify additional input commands for the device based on an input mode and information of a hand gesture in addition to and/or in lieu of those noted above.
The controller and/or the input application use the information detected from the sensor to identify the initial location and the end location of the hand gesture. As noted above, the initial location corresponds to where the hand gesture begins and the end location corresponds to where the hand gesture ends. Based on the initial location and/or the end location of the hand gesture, the controller and/or the input application can identify an input mode for the device at 410. An input mode corresponds to how the controller and/or the input application interpret the hand gesture as an input command for the device. If the controller and/or the input application determine that the initial location and/or the end location of the hand gesture are within proximity of an edge of the sensor, the input mode of the device can be identified as a swipe mode for the user to navigate between content of the user interface. In another embodiment, if the controller and/or the input application determine that neither the initial location nor the end location of the hand gesture are within proximity of an edge of the sensor, the input mode of the device can be identified as a pointer mode for the user to access and navigate a presently rendered content of the user interface.
In response to identifying the input mode for the device, the controller and/or the input application identify and execute an input command corresponding to the input mode and the hand gesture from the user at 420. As noted above, the controller and/or the input application can access a list, table, and/or database of input modes and each input mode can list input commands corresponding to the input mode and a hand gesture. The controller and/or the input application can compare the detected information of the hand gesture to predefined information of input commands listed under the identified input mode of the device. If a match is found under the identified input mode, the input command for the device is identified. The controller and/or the input application can then execute the input command on the device. The method is then complete. In other embodiments, the method of
If a hand gesture is detected, the sensor can detect information of the hand gesture for the controller and/or the input application to identify the initial location and the end location of the hand gesture at 520. In one embodiment, the sensor can detect a coordinate of the initial touch location and a coordinate of the end touch location and share the coordinates with the controller and/or the input application. The sensor can additionally detect if the hand gesture includes a motion and/or a direction of the motion. The controller and/or the input application then determine if the initial location and/or the end location of the hand gesture are within proximity of an edge of the sensor at 530. As noted above, the edge includes a top edge, a bottom edge, a left edge, and/or a right edge of the surface of the sensor. The controller and/or the input application compare the coordinate of the initial location and the coordinate of the end location to coordinates of the edge to determine if the initial location and/or the end location of the hand gesture are within proximity of the edge of the sensor.
If neither the initial location nor the end location are within proximity of an edge of the sensor, the controller and/or the input application identify the input mode of the device to be a pointer mode for the user to access and navigate a presently rendered content on a user interface with the hand gesture at 540. In another embodiment, if either the initial location and/or the end location are within proximity of the edge of the sensor, the controller and/or the input application identify the input mode of the device to be a swipe mode for the user to navigate between content of the user interface with the hand gesture at 550.
In response to identifying the input mode for the device, the controller and/or the input application identify and execute an input command on the device corresponding to the identified input mode and the hand gesture from the user at 560. As noted above, the controller and/or the input application can access a table, list, and/or database of input modes which list input commands corresponding to an input mode. The controller and/or the input application can compare the detected information of the hand gesture to predefined information of input commands corresponding to the identified input mode. If a match is found, the input command is identified and the controller and/or the input application proceed to execute the input command on the device.
As the input command is executed, the controller and/or the input application can modify the user interface based on the input command at 570. If the input mode is a swipe mode, the controller and/or the input application can modify the user interface to display the user navigating between content.
Navigating between content can include switching from one application to another or bringing a menu into view on the user interface. In another embodiment, if the input mode is a pointer mode, the controller and/or the input application modify the user interface to display the user navigating the presently rendered content. Navigating the presently rendered content includes rendering a cursor or pointer to reposition over the presently rendered content. The method is then complete. In other embodiments, the method of
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/US2011/062573 | 11/30/2011 | WO | 00 | 4/22/2014 |