Fix race in tty_fasync() properly