USB: octeon2-common: Don't reinitialize the clocks.