tty: Move the leader test in disassociate