serial: don't optimise away baud rate changes when BOTHER is used