Start idle timer only at the end of request or request like operation
such card detect, set_ios, probe, or resume. This will ensure the fclk is
disable quickly after the operation is done, but never too early.
Signed-off-by: Jarkko Lavinen <jarkko.lavinen@nokia.com>