bfin_gpio: fix bf548-ezkit kernel fail to boot