RTC: Fix early irqs caused by calling rtc_set_alarm too early