Ornamental buckles or other ornaments for shoes, with fastening function