Be more eager at stopping the fd watch thread for joysticks upon disconnection.