Don't unset IKE_SA on bus before we released virtual IPs and attributes