Patent Application
20140204126
The present disclosure relates to electronic devices, and more particularly to electronic devices that display an electronic-ink line that corresponds to the movement of a stylus.
Some electronic devices have displays particularly configured to work with a corresponding stylus. Generally speaking, a stylus is typically a hand-held writing utensil that often (but not exclusively) has a pencil-like elongated form factor and that includes at least one pointed end configured to interact with a stylus-scribing surface. Using a stylus as an input mechanism with a display offers a variety of advantages over a fingertip including the opportunity for increased precision as well as an expression modality that accords with the user's own past experience with a pencil or pen.
In some cases the stylus comprises an active device that transmits a signal. This signal serves, for example, as a location beacon that the display device utilizes, for example, to confirm the proximity of the stylus and/or to facilitate accurate tracking of the stylus's movement with respect to the display. To conserve power, the stylus typically only transmits such a signal on an intermittent basis.
Unfortunately, the intermittent nature of location-beacon signal transmissions (and/or other signal sampling and processing delays) can lead to unwanted and inconsistent latency with respect to displaying the movement of the stylus across the display. Such latency can occur, for example, when the intermittent location-beacon signal arrives just after the display device refreshes the display presentation. In such a case, the representation of a line on the display that flows like ink in response to movement of the stylus across the display can lag the actual location of the stylus tip by a noticeable amount. This latency, in turn, can feel unnatural to the user and can defeat or at least impair the user's effective use of the stylus as an input mechanism.
It is known to attempt to overcome such latency by predicting the likely path of the stylus tip. By displaying a successfully predicted path the displayed result can remain closer to the stylus tip and hence yield a more natural experience for the user. Unfortunately, known prediction algorithms cannot yet always successfully predict where a user might next direct the stylus tip. Typical prior art approaches tend to display a predicted line until an error is detected. The depicted electronic ink line is then suddenly and abruptly corrected. While technically preserving an accurate rendering insofar as possible, this abrupt correction can be disconcerting and distracting to at least some users.
The following describes an apparatus and method pertaining to the display of a stylus path that includes both a validated portion and a predicted portion. Upon determining an error between subsequent stylus movement and that predicted portion, these teachings provide for morphing a display of the predicted portion to accord with the subsequent stylus movement over time rather than abruptly switching the display to a fully-corrected representation.
These teachings are highly flexible in practice and will accommodate, for example, use in conjunction with a predicted portion that represents predicted movement of the stylus over some predetermined number of sampling frames. As another example, these teachings will accommodate optionally determining a user-selected morphing state and then morphing (or even not morphing) the aforementioned display as a function, at least in part, of that user-selectable morphing state. By one approach, for example, a user-selectable morphing can comprise a selection of a particular morphing speed (i.e., a speed at which the displayed electronic ink line moves from a known erroneous location to a known corrected location).
So configured, a corresponding electronic device can utilize a predicted-path algorithm (or algorithms) of choice. When and if a given displayed predicted line of electronic ink proves inaccurate, these teachings permit the line to more gradually change from the displayed prediction to the known correct path. This gradual change, in turn, helps to avoid the potentially jarring and sometimes disconcerting effect of the sudden snap-to-correction effect employed so often in the prior art.
These teachings are highly scalable and will accommodate as small or wide a range of morphing speeds and/or types as may be appropriate to suit the needs of a given application setting. These teachings are also readily employed in conjunction with existing fielded platforms and component architectures and hence can serve to leverage those platforms in favor of continued utility and viability.
For simplicity and clarity of illustration, reference numerals may be repeated among the figures to indicate corresponding or analogous elements. Numerous details are set forth to provide an understanding of the embodiments described herein. The embodiments may be practiced without these details. In other instances, well-known methods, procedures, and components have not been described in detail to avoid obscuring the embodiments described. The description is not to be considered as limited to the scope of the embodiments described herein.
Prior to providing more details regarding the present teachings it may be helpful to first review in more detail a particular practice as tends to characterize the prior art.
As illustrated in
Such a control circuit 401 can comprise a fixed-purpose hard-wired platform or can comprise a partially or wholly programmable platform. These architectural options are well known and understood in the art and require no further description here. This control circuit 401 is configured (for example, by using corresponding programming as will be well understood by those skilled in the art) to carry out one or more of the steps, actions, and/or functions described herein.
By one optional approach this control circuit 401 operably couples to a memory 402. The memory 402 may be integral to the control circuit 401 or can be physically discrete (in whole or in part) from the control circuit 401 as desired. This memory 402 can serve, for example, to non-transitorily store the computer instructions that, when executed by the control circuit 401, cause the control circuit 401 to behave as described herein. (As used herein, this reference to “non-transitorily” will be understood to refer to a non-ephemeral state for the stored contents (and hence excludes when the stored contents merely constitute signals or waves) rather than volatility of the storage media itself and hence includes both non-volatile memory (such as read-only memory (ROM) as well as volatile memory (such as an erasable programmable read-only memory (EPROM).)
In this illustrative example the control circuit 401 also operably couples to a display 403 that also shares its form factor with a stylus-scribing surface 404 such that the display 403 and the stylus-scribing surface 404 comprise an integrated component. A stylus tracker 405 in turn operably couples to the control circuit 401 and to the stylus-scribing surface 404 and serves to track the position and movement of a stylus 101 (such as a scribing tip thereof) with respect to the stylus-scribing surface 404. Various stylus tracking techniques and approaches are known in the art. As the present teachings are not overly sensitive regarding any particular selections in these regards, for the sake of brevity this description will not be burdened with further details about such stylus tracking techniques.
So configured, scribing interactions between the stylus 101 and the stylus-scribing surface 404 are tracked 405 and the control circuit 401 in turn uses that tracking information to cause a corresponding presentation of electronic ink on the display 403. In a typical modern application setting there is often latency between a present location of the stylus 101 and the display of electronic ink that corresponds to the stylus's location. It is therefore presumed for the purposes of this illustrative example that the control circuit 401 employs one or more prediction algorithms to predict near-term movement of the stylus 101 to thereby permit displaying electronic ink ahead of actually knowing the precise location of the stylus 101. Again, there are various prediction approaches known in the art and hence further description regarding such approaches is not provided here.
As mentioned above these teachings serve to morph a display of a predicted portion of a rendered line of electronic ink to accord with actual movement of a corresponding stylus. Referring to
By another approach, in lieu of the foregoing or in combination therewith, the user-selectable morphing state can comprise a choice amongst candidate states that include at least two morphing speeds. As illustrated by way of example in
The present teachings are highly flexible in practice. Accordingly, it will be understood that the foregoing examples of particular user-selectable morphing states are intended to serve an illustrative purpose and are not intended to suggest any limitations in these regards.
Referring now to
At 303 the control circuit 401 detects that a corresponding presentation error has occurred and at 304 the control circuit 401 determines the error between subsequent stylus 101 movement and the predicted portion 104. By one approach, this error can be represented, for example, by the display coordinates for the actual positions of the stylus 101 given the benefit of now-available hindsight.
At 305 the control circuit 401 then morphs the display of the predicted portion to accord with the subsequent actual movement of the stylus 101 over time. Specifically, this morphing comprises gradually reshaping the display of the predicted portion over time until the displayed electronic ink accords with the actual movement of the stylus 101.
As mentioned earlier, this process 300 will accommodate using one or more user-selectable morphing states 306. For example, when the user has selected a particular morphing speed, the aforementioned movement of the predicted portion of the rendered line can occur at the selected speed. For example, the aforementioned morphing could happen at a speed of, say, 0.05 seconds, 0.1 seconds, 0.25 seconds, or at essentially any other speed of choice.
The implementing electronic device can comprise any of a wide variety of electronic devices. For example, the portable electronic device can comprise a portable communications device as illustrated in
The wireless network 950 may be any type of wireless network, including, but not limited to, a wireless data networks, a wireless voice network, or a network that supports both voice and data communications. The control circuit 401 may also operably couple to a short-range communication subsystem 932 (such as an 802.11 or 802.16-compatible transceiver and/or a Bluetooth™-compatible transceiver). To identify a subscriber for network access, the portable electronic device may utilize a Subscriber Identity Module or a Removable User Identity Module (SIM/RUIM) card 938 for communication with a network, such as the wireless network 950. Alternatively, user identification information may be programmed into the aforementioned memory 402.
A power source 942, such as one or more rechargeable batteries or a port to an external power supply, powers the electronic device. The control circuit 401 may interact with an accelerometer 936 that may be utilized to detect direction of gravitational forces or gravity-induced reaction forces. The control circuit 401 may also interact with a variety of other components, such as a Random Access Memory (RAM) 908, an auxiliary input/output (I/O) subsystem 924, a data port 926, a speaker 928, a microphone 930, and other device subsystems 934 of choice.
The aforementioned display 403 can be disposed in conjunction with a touch-sensitive overlay 914 that operably couples to an electronic controller 916. Together these components can comprise a touch-sensitive display 918 that serves as a graphical-user interface. Information, such as text, characters, symbols, images, icons, and other items may be displayed on the touch-sensitive display 918 via the control circuit 401. By one approach this touch-sensitive overlay 914 may suffice to track the location and movement of the stylus 101. By another approach, if desired, the aforementioned stylus tracker 405 can comprise a separate component.
The portable electronic device can include an operating system 946 and software programs, applications, or components 948 that are executed by the control circuit 401 and that are stored, for example, in the above-mentioned memory 402. Additional applications or programs may be loaded onto the portable electronic device through the wireless network 950, the auxiliary I/O subsystem 924, the data port 926, the short-range communications subsystem 932, or any other suitable subsystem 934.
The approaches described herein permit the use of predication techniques to counteract latency concerns as regards the near real time display of electronic ink that corresponds to the movement of a corresponding stylus while also avoiding the potential distractions and cognitive disruptions of also displaying immediate one-step corrections when the prediction proves inaccurate. In particular, these teachings can utilize the detection of changes of speed with respect to the movement of a stylus to scale one or more prediction behaviors. For example, when a user accelerates stylus movement while moving the stylus in a relatively straight path the prediction algorithm can extend its “best guess” by up to, for example, four screen refreshes. An opposite response can occur, however, when the stylus decelerates. In this case the algorithm need not guess as many frames ahead of the current frame and can scale back, for example, to predictions that reach ahead only two frames or even only one frame.
In more extreme cases (when, for example, the stylus moves very slowly or the user's handwriting is extremely small), the described scaled metering of prediction behavior can be temporarily disabled due its lack of present usefulness. Generally speaking, the slower the movement of the stylus, the easier it is for prior art teachniques to keep up with the user's movement of the stylus in a visually non-disturbing manner.
The present teachings can be economically deployed and will accommodate placing a significant amount of morphing performance control in the hands of the user if desired. These teachings are also highly flexible in practice and will accommodate a wide variety of stylus-tracking methodologies as well as various stylus-movement prediction methodologies.
The present disclosure may be embodied in other specific forms without departing from its essential characteristics. The described embodiments are to be considered in all respects only as illustrative and not restrictive. The scope of the disclosure is, therefore, indicated by the appended claims rather than by the foregoing description. All changes that come within the meaning and range of equivalency of the claims are to be embraced within their scope.
