Insulating plug or plate inserted between normally closed contacts