During manipulator motion, sensor feedback to adapt model in memory