genirq: Delegate irq affinity setting to the irq thread