Move gtod_cpu affinity check to verify callback