Drop overlapping segments only if we have no active SAs on it