Roll holder being able to pivote around an axis perpendicular to roller axis