The present application is based on, and claims priority from, Taiwan Patent Application No. 101136015, filed Sep. 28, 2012, the disclosure of which is hereby incorporated by reference herein in its entirety.
The present disclosure relates generally to a smoothing method and apparatus for time data sequences.
Moving objects in tracked images often cause unstable object positioning due to change of color characteristics or shape of objects, for example, the distress caused by non-easy aligning with the target in applications of semi mouse's movement functions. In the past, smoothing technology of data points often uses complex smoothing algorithms and iterative techniques, for example, uses curve fitting and regression error analysis to modify the jitter curve, to immediately response the user's operation trajectory, and depict on the screen. This kind technique of smoothing data points need to solve simultaneous equations, thus computation amount and memory requirements are greater. This technique may achieve a good smoothing effect, but also induce the time delay.
The mouse cursor smoothing techniques such as one technology uses headset notations and controls the mouse cursor with a head facing direction. When the mouse cursor enters into a support position mode, this technology determines a new mouse cursor position based on a detection position and the average of the positions of a last point. Some tracking technologies for a mouse cursor controls the mouse cursor with the fingertips, and predicts a next cursor position according to the position and the speed of a current cursor, and performs an interpolation action at a low sampling frequency to maintain ease and smoothness of the cursor control. Some mouse cursor smoothing techniques use predicting cursor methods to alleviate timing jitter impact of network transmission for remote cursor control, and predict the next cursor position in accordance with the last cursor's position and speed, and the cursor's average acceleration.
Another technique of tracking a moving object improves the search strategy when tracking a moving target. As shown in
In the above mentioned curve smoothing technologies, some technologies achieve good smoothing effects, but do not immediately smooth data, which is unable to match the user expectation for the applications such as emphasizing real-time perception of gesture-like mouse trajectory. Some mouse cursor smoothing technology may be unable to overcome the problem of jitter due to more serious jitter of the data points, or to smoothly correct the trajectory when there is a gap between the cursor's true position and the predicted position. Some mouse cursor tracking technologies only predict the next cursor position with the current speed direction, and may cause a large error at a turning point. Some moving target tracking technologies predict an object target with a trend line, which may also cause a large error at a turning point. General curve generation technologies use the regression analysis to obtain only an orientation prediction, and may not directly provide the calculation of an absolute position.
Therefore, it is an important issue on how to design a trajectory smoothing mechanism with a balance between the global and the local trajectory trends, effective controlling the time delay within a small number of sampling points, and using simple trajectory smoothing techniques by simple algebra operations to achieve the effect of reducing the computation amount.
The exemplary embodiments of the disclosure may provide a smoothing method and apparatus for time data sequences.
One exemplary embodiment relates to a smoothing method for time data sequences. The method is executed by a hardware processor to perform: smoothing a plurality of original data points of a time data sequence, then from a plurality of smoothed data points, determining a plurality of reference points for a current global-trajectory trend and a current local-trajectory trend; calculating a global trajectory direction and a local trajectory direction of the time data sequence; according to the plurality of reference points; and adaptively calculating at least one new data point by integrating the global trajectory direction and the local trajectory direction.
Another exemplary embodiment relates to an apparatus for time data sequences. The smoothing apparatus comprises a hardware-implemented smoothing unit and a hardware-implemented prediction unit. The smoothing unit is configured to smooth a plurality of original data points of a time data sequence, and determine a plurality of reference points for a current global-trajectory trend and a current local-trajectory trend, from a plurality of smoothed data points. The prediction unit is configured to calculate a global trajectory direction and a local trajectory direction of the time data sequence according to the plurality of reference points; and adaptively calculates at least one new data point by integrating the global trajectory direction and the local trajectory direction.
Below, exemplary embodiments will be described in detail with reference to accompanying drawings so as to be easily realized by a person having ordinary knowledge in the art. The inventive concept may be embodied in various forms without being limited to the exemplary embodiments set forth herein. Descriptions of well-known parts are omitted for clarity, and like reference numerals refer to like elements throughout.
The exemplary embodiments in the disclosure provide a smoothing technique for a time data sequence. This technique uses a curve fitting method to smooth historical original data points of a time data sequence, then performs local sampling from the smoothed data points and determines reference points with a global trajectory trend and a local trajectory trend in the smoothed data points. This technique further calculates a proceed direction for global data and a proceed direction for a current data according to the reference points with obtained trends, and adaptively calculate new data point(s).
In other words, the disclosed exemplary embodiment of a smoothing method for a time data sequence is shown as in
Following the
Following the
It may be from
In other words, according to the exemplary embodiment, in the plurality of reference points of the trajectory trend, there are a first reference point, and a second and a third reference points. The first reference point is the tracked-back first smoothed data point from a current time, which may ensure immediate reaction of local movements, while the connection direction of the second and the third reference points is a representative direction for the current global-trajectory trend. The number of the reference points of aforementioned trajectory trends may not be limited to a fixed number.
After having obtained the plurality of reference points such as P1, P2 and P3, the smoothing technique may calculate such as the global trajectory direction and the local trajectory direction of the time data sequence 402, and may further adaptively calculate at least one new data point. The adaptive calculation for the at least one new data point may include such as defining the global trajectory direction and the local trajectory direction according to the plurality of reference points, and calculating a predicted length and determining a reference direction vector and a displacement point.
In
wherein the estimated length L is the projection amount of the vector {right arrow over (B)} on the vector {right arrow over (A)}, the estimated length L may be calculated by the inner product of the vector {right arrow over (B)} with the unit reference direction vector {right arrow over (V)}. The calculation formula for the new data point includes the implication of taking the projection amount of the local trajectory direction {right arrow over (B)} on the global trajectory direction {right arrow over (A)} as the predicted length increments (i.e., the estimated length L) of the new data point, and referring to the position of the displacement point {right arrow over (r)}. In the
In the above formula, the estimated length L is calculated by using the projection amount.
Accordingly,
As previously described in the exemplary embodiments of the disclosure, the plurality of original data points are a plurality of historical original data points by tracking back the time data sequence 1012 from a current time. The hardware-implemented smoothing unit 1010 may use smoothing mechanism such as interpolation, or regression, or curve fitting to smooth the historical original data points. The hardware-implemented smoothing unit 1010 may also use such as the aforementioned exemplary embodiments, to determine the reference point of the global-trajectory trend and the local-trajectory trend, which is not repeated here. The hardware-implemented prediction unit 1020 may use the aforementioned adaptive adjustment mechanism to calculate the new data point(s) including such as calculating the estimated length, and deciding the reference direction vector and the displacement point, which is not repeated here. The hardware-implemented smoothing unit 1010 may use a queue with a data storage structure of first-in first-out to maintain the number of the plurality of original data points equal to the number of smoothed data points 1014, which is not repeated here. When the original data points have a turning trend, under the unchanged global trajectory direction, this adaptive adjustment mechanism may shorten the estimated length of the at least one new data point 1030 to facilitate turning and maintaining the smoothing characteristics of the subsequent smoothed data points.
Following the above mentioned, the smoothing method and apparatus according to the disclosed exemplary embodiments is a prediction mechanism using the global and the local trajectory trends, and is a smoothing technology of using simple algebraic operations for time data sequences. This smoothing technology may apply to such as computer input devices, game consoles, home appliances manipulation, and interactive billboards.
In summary, the exemplary embodiments of the disclosure provide a smoothing method and apparatus for time data sequences. This technique uses prediction mechanism of global and local trajectory trends to effectively achieve the effect of real-time and smoothing trajectory trend, and uses representative specific sections of curve fitting to replace the existed steps of regress analysis for reducing the calculation amount. The technique uses only simple algebraic operations. Therefore, the required computation amount is low compared to the technology using simultaneous equation for solving and the technology using iterative optimization. In the exemplary embodiments of the smoothing method and apparatus, the time data sequence not only retains good smoothness, but also effectively controls time delay between each smoothed data point, and each original data point within 0 to 2 sampling points regardless the speed of the moving object.
It will be apparent to those skilled in the art that various modifications and variations can be made to the disclosed embodiments. It is intended that the specification and examples be considered as exemplary only, with a true scope of the disclosure being indicated by the following claims and their equivalents.
Number | Date | Country | Kind |
---|---|---|---|
101136015 A | Sep 2012 | TW | national |
Number | Name | Date | Kind |
---|---|---|---|
4158887 | Kosugi | Jun 1979 | A |
4561061 | Sakamoto et al. | Dec 1985 | A |
4686632 | Schrieber | Aug 1987 | A |
5121442 | Togawa et al. | Jun 1992 | A |
5214754 | Okamoto et al. | May 1993 | A |
5231697 | Yamada | Jul 1993 | A |
5261033 | Oka | Nov 1993 | A |
5267184 | Matsushiro et al. | Nov 1993 | A |
5269000 | Ohuchi | Dec 1993 | A |
5287441 | Nakamura | Feb 1994 | A |
5325477 | Klassen | Jun 1994 | A |
5363479 | Olynyk | Nov 1994 | A |
5367617 | Goossen et al. | Nov 1994 | A |
5410645 | Ooka et al. | Apr 1995 | A |
5416897 | Albers et al. | May 1995 | A |
5422990 | Siverbrook et al. | Jun 1995 | A |
5425109 | Saga et al. | Jun 1995 | A |
5473742 | Polyakov et al. | Dec 1995 | A |
5479590 | Lin | Dec 1995 | A |
5500927 | Sander-Cederlof et al. | Mar 1996 | A |
5594853 | Salesin et al. | Jan 1997 | A |
5613053 | Albers et al. | Mar 1997 | A |
5638503 | Hoel | Jun 1997 | A |
5694535 | Broekhuijsen | Dec 1997 | A |
5731820 | Broekhuijsen | Mar 1998 | A |
5737508 | Feigenbaum | Apr 1998 | A |
5818459 | Kurumida | Oct 1998 | A |
5877743 | Dzik | Mar 1999 | A |
5898439 | Takazawa | Apr 1999 | A |
6014148 | Tankelevich | Jan 2000 | A |
6044165 | Perona et al. | Mar 2000 | A |
6067094 | Schuster | May 2000 | A |
6111588 | Newell | Aug 2000 | A |
6195100 | Tibbett | Feb 2001 | B1 |
6204861 | Chen | Mar 2001 | B1 |
6298155 | Mitsunaga et al. | Oct 2001 | B1 |
6304677 | Sshuster | Oct 2001 | B1 |
6317651 | Gerstenberger et al. | Nov 2001 | B1 |
6441823 | Ananya | Aug 2002 | B1 |
6512847 | Gnutzmann | Jan 2003 | B1 |
7072812 | Corr | Jul 2006 | B2 |
7405733 | Helie et al. | Jul 2008 | B2 |
7463270 | Vale et al. | Dec 2008 | B2 |
7609278 | Dash | Oct 2009 | B1 |
7969440 | Polyakov et al. | Jun 2011 | B1 |
20030048277 | Maillot et al. | Mar 2003 | A1 |
20040001113 | Zipperer et al. | Jan 2004 | A1 |
20090027398 | Frisken | Jan 2009 | A1 |
20090099717 | Yabushita et al. | Apr 2009 | A1 |
Number | Date | Country |
---|---|---|
187439 | Jul 1992 | TW |
1257590 | Jul 2006 | TW |
200844870 | Nov 2008 | TW |
200910147 | Mar 2009 | TW |
201016020 | Apr 2010 | TW |
1328396 | Aug 2010 | TW |
201104513 | Feb 2011 | TW |
1341484 | May 2011 | TW |
1349888 | Oct 2011 | TW |
1355615 | Jan 2012 | TW |
201204054 | Jan 2012 | TW |
201218070 | May 2012 | TW |
Entry |
---|
Park et. al., “Efficient Fingertip Tracking and Mouse Pointer Control for a Human Mouse”, International Conference on Computer Vision Systems (ICVS 2003), pp. 88-97, Apr. 1, 2003. |
Javanovic et. al., “MarkerMouse: Mouse Cursor Control Using a Head-Mounted Marker”, International Conference on Computers Helping People With Special Needs ICCHP 2010, pp. 49-56, Jul. 14, 2010. |
Gutwin et. al., “Using Cursor Prediction to Smooth Telepointer Jitter”, International Conference on Supporting Group Work (ACM SIGGROUP 2003), pp. 294-301, Nov. 9, 2003. |
Zheng et. al., “A New Method for the Discerning of Point Moving Targets' Tracks”, International Congress on Image and Signal Processing (IEEE CISP 2009), pp. 1-5, Oct. 17, 2009. |
Mei et. al., “Curve fitting and optimal interpolation on CNC machines based on quadratic B-splines”, Science China (SC 2010), vol. 53, pp. 1-18, Jan. 2010. |
Taiwan Patent Office, Office Action, Patent Application Serial No. TW101136015, Sep. 18, 2014, Taiwan. |
Number | Date | Country | |
---|---|---|---|
20140093183 A1 | Apr 2014 | US |