Drift-compensation for servo, anti-hunt