watcher: Rebuild fdset when select() fails