Removable barriers with permanently installed base members