IPoIB: Fix oops if xmit is called when priv->broadcast is NULL