fb: avoid possible deadlock caused by fb_set_suspend