Removable valve with normally disabled supplemental check valve