Today's electronic devices are typically multi-functional. For example, a smart phone can include a telephone, a music player, an email reader, a camera, and other functions. A user may access these functions using various buttons, keypads, keyboards, sliders, or other control elements.
This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.
In certain electronic devices, a user may access certain functions even when an electronic device is in a locked mode. For example, a user may start, stop, forward, rewind, or pause a media player on an electronic device by pressing certain soft buttons without unlocking the electronic device. However, the user may need to look at the electronic device to operate these soft buttons; otherwise, the media player may not respond correctly. Thus, the operation may be cumbersome or even unsafe, for example, when the user is driving.
Several embodiments of the present technology can address at least some of the foregoing drawbacks by detecting gestures in a detection zone on an electronic device and perform control functions according to the detected gestures. The detected gestures can be independent from any soft buttons, sliders, and/or other controls on the electronic device. For example, the electronic device may accept a swipe left, a swipe right, a tap, and/or other gestures to any locations in the detection zone (e.g., top half of a touchscreen). The electronic device may then control a media player, a calendar application, a social media application, a news application, an email application, a text message application, and/or other types of application based on the detected gestures. Thus, control inputs to the electronic device are not limited to only certain small input areas of the electronic device. As a result, a user may not need to look at the electronic device to control functions of the electronic device. Consequently, safety and user friendliness of the electronic device may be improved over conventional devices.
Certain embodiments of systems, devices, components, modules, routines, and processes for gesture-based control of electronic devices are described below. In the following description, example software codes, values, and other specific details are included to provide a thorough understanding of certain embodiments of the present technology. A person skilled in the relevant art will also understand that the technology may have additional embodiments. The technology may also be practiced without several of the details of the embodiments described below with reference to
Also used herein, the term “gesture” generally refers to a form of non-verbal communication utilizing bodily actions including, for example, movements of a hand, head, finger, or another part of a user's body. An electronic device may detect gestures using, for example, one or more touchscreens, motion sensors, cameras, material deformation sensors, and/or other suitable detectors. Example gestures can include a swipe left, a swipe right, a pull down, a touch, a double touch, and/or another suitable bodily action.
Also used herein, the term a “locked mode” generally refers to an operational mode under which access to one or more functionalities of an electronic device is restricted. Examples of restricted functionalities can include one or more of application access, system configuration, data entry, system update, and/or other suitable functionalities. A user may be required to perform one or more certain actions in order to receive access to the restricted functionalities. For example, a user may be required to enter a password, use a certain combination of buttons, provide a thumb print, trace a certain pattern, complete a certain gesture, or perform other suitable actions. A user interface displayed when the electronic device is in the locked mode may be generally referred to as a “locked screen.” Example locked screens may display interface elements for a time, date, email notification, alarm, and/or other suitable information.
As described above, certain electronic devices may display locked screens with soft buttons, sliders, or other control elements for forward, rewind, play, pause, or stop of a media player or other applications. As used herein, the term a “control element” generally refers to an interface element configured to accept control inputs to electronic devices. Example control elements can include soft buttons, selectors, sliders, etc. However, to operate such control elements, a user may need to look at the electronic device because input areas associated with the control elements may be limited. For example, a soft button may only have an input area of a small circle. Thus, a cumbersome or even unsafe operating environment may result in many situations, for example, when the user is driving a vehicle.
Several embodiments of the present technology can address at least some of the foregoing drawbacks by defining a detection zone on a locked screen of an electronic device. The detection zone can be associated with a target application (e.g., a media player) and configured to detect gestures for controlling the application. The detected gestures can be independent from any soft buttons, sliders, and/or other control elements on the electronic device. For example, the electronic device may detect a swipe left, a swipe right, a tap, a hover, and/or other gestures to any locations of the detection zone (e.g., top half of the screen) at the locked screen. The electronic device may then control certain functions of the media player based on the detected gestures. As a result, the user may not need to look at the electronic device to control operations of the electronic device, and thus resulting in improved usability and safety.
In operation, the electronic device 100 can accept user inputs via the input/output device 105 and/or the button 107 to perform certain functions when the electronic device 100 is in a locked mode. For example, in one embodiment, a user can activate control for a media player on the electronic device 100 by single or double pressing the button 107. The electronic device 100 can then define a detection zone 109 configured to detect gestures of the user's finger 101. The electronic device 100 can forward, rewind, pause, stop, or otherwise control operations for the media player based on detected gestures. In other embodiments, the user can also activate control to detect gestures for a calendar application, a social media application, a news application, an email application, a text message application, and/or other types of application on the electronic device 100 instead of or in addition to the media player. As discussed in more detail below with reference to
As show in
The processor 122 can be configured to execute instructions of software components stored in the memory 123. For example, as shown in
In operation, the input component 132 can accept user inputs 154, for example, via the input/output device 105 and/or the button 107 (
The sensing module 160 can be configured to receive the user inputs 154 to a detection zone and convert the user inputs 154 into input parameters of suitable engineering units. For example, the sensing module 160 may convert the user inputs 154 into at least one of a travel distance (i.e., a length of persistent touch), a duration of persistent touch, and/or a direction of movement of the user's finger 101 (
The calculation module 166 may include routines configured to perform certain types of calculations to facilitate operations of other modules. In one example, the calculation module 166 can include a counter that accumulates a number of user inputs 154 that are outside of the detection zone 109 (
The analysis module 162 can be configured to analyze the sensed and/or calculated user inputs 154 to determine one or more corresponding gestures. For example, in one embodiment, the analysis module 162 can compare a travel distance of one of the user inputs 154 to a predetermined threshold. If the travel distance is greater than the predetermined threshold, the analysis module 162 may indicate that the one of the user inputs 154 corresponds to one of a left swipe, a right swipe, a pull down, or another gesture. In further examples, the analysis module 162 may also determine that the user inputs 154 corresponds to a touch, a click, a double click, and/or other suitable types of gesture.
In certain embodiments, the analysis module 162 can also be configured to analyze data input 150 to determine if an application is currently running on the electronic device 100 (
In other embodiments, the analysis module 162 may be configured to analyze the data input 150 to determine if a notification is currently displayed via the input/output device 105 (
In certain embodiments, the control module 164 may be configured to define a detection zone on the input/output device 105 based on analysis results from the analysis module 162. For example, the control module 164 can define a first detection zone that is one third, one half, two thirds, or other proportions of an input area of the input/output device 105 for the determined application (e.g., a media player). In one embodiment, the control module 164 can also define one or more additional detection zones based on the determined one or more notifications. For example, in response to a determination that an incoming email notification is currently displayed, the control module 164 can define a second detection zone that is spaced apart from, abutting, or partially overlapping with the first detection zone. In another embodiment, the control module 164 may also adjust the first detection zone to accommodate the second detection zone. In further embodiments, the control module 164 may also define a third, fourth, or any other number of additional detection zones.
In certain embodiments, the control module 164 may re-position, re-shape, or otherwise manipulate the defined detection zone (or additional detection zones) in response to the number of user inputs 154 being outside of the defined detection zone. For example, the control module 164 may move the detection zone up, down, left, or right on the input/output device 105. In another example, the control module 164 may enlarge the detection zone to encompass locations associated with the previous user inputs 154. In further examples, the control module 164 may adjust both the position and the size of the detection zone to encompass locations associated with the previous user inputs 154. In other embodiments, the control module 164 may maintain the position and/or size of all the detection zones.
In certain embodiments, the control module 164 may also be configured to control operation of the electronic device 100 based on the analysis results from the analysis module 162. For example, in one embodiment, the control module 164 can perform at least one of a forward, rewind, pause, or stop to a media player on the electronic device 100 based on the detected gestures to the first detection zone. In other embodiments, the control module 164 can dismiss, read, reply, scroll, pan, acknowledge, or otherwise respond to a notification based on gestures to additional detection zones. For example, a user may stop an alarm notification by a persistent touch. In another example, the user may dismiss an email notification by a double tap in the detection zone.
In certain embodiments, if a detected gesture traverses more than one detection zone, the control module 164 may be configured to determine which detection zone the detected gesture is related to based on certain characteristic of the detected gesture. For example, in one embodiment, if the detected gesture has a beginning portion in a first detection zone and an ending portion is a second detection zone, the control module 164 may determine that the gesture is related to the first detection zone, and vice versa. In another embodiment, if the detected gesture has a longer duration of persistent touch in the first detection zone than in a second detection zone, the control module may determine that the gesture is related to the first detection zone, and vice versa. In further embodiments, the control module 164 may perform the determination based on a trajectory length, a direction, and/or other suitable characteristics of the detected gesture. Certain operations of the sensing, calculation, control, and analysis modules 160, 162, 164, and 166 are described in more detail below with reference to
As shown in
At stage 204, if the target application is not running, the process reverts to stage 202. In response to a determination that the target application is currently running, the process 200 proceeds to defining a detection zone without requiring unlocking the electronic device 100 at stage 206. The detection zone may be defined on, for example, the input/output device 105 (
The process 200 can then include detecting user inputs to the detection zone when the electronic device 100 is in a locked mode at stage 208. In one embodiment, detecting user inputs can include detecting swipes, pull downs, or other gestures of the user's finger 101 (
Based on the detected user inputs, the process 200 can include determining a control signal associated with the application at stage 210. In one embodiment, determining the control signal can include determining gestures corresponding to the user inputs and correlating the gestures to the control signal based on, for example, the control signal records 142 in the memory 123 (
The process 200 can then include controlling the application based on the determined control signal at stage 212. For example, in response to a swipe right, a media player may be forwarded to skip a track. In another example, in response to a swipe left, a media player may rewind to a previous track. In yet another example, in response to a pull down, a media player may pause or stop. In further examples, in response to other gestures, a media player or other suitable applications may be otherwise suitably controlled.
Optionally, the process 206 can also include modifying existing detection zone at stage 226. For example, the electronic device 100 (
At stage 232, if the number of user inputs outside of the detection zone does not exceed a threshold, the process reverts to stage 230. In response to the number of user inputs exceeds the threshold, the process proceeds to modifying the existing detection zone at stage 234. In one embodiment, the existing detection zone may be re-positioned to be proximate at least some of the locations associated with the user inputs. In other embodiments, the existing detection zone may be enlarged to encompass all the locations associated with the user inputs. In further embodiments, the existing detection zone may be enlarged, for example, to encompass the entire screen of the input/output device 105. In further embodiments, the existing detection zone may be resized, reshaped, and/or otherwise adjusted.
The electronic device 100 can then detect user inputs to any locations in the detection zone 405, not being limited to small input areas of the electronic device 100. For example, as shown in
In certain embodiments, as shown in
Specific embodiments of the technology have been described above for purposes of illustration. However, various modifications may be made without deviating from the foregoing disclosure. In addition, many of the elements of one embodiment may be combined with other embodiments in addition to or in lieu of the elements of the other embodiments. Accordingly, the technology is not limited except as by the appended claims.