[osx] Fix possible corruption when joystick connects early