Wheels or drums supporting in exchangeable arrangement a layer of flexible abrasive material