stream: Make sure no watcher callback is active while changing stream callbacks