client: re-setup poll fd array in case a client disappears