[ARM] PXA ssp: unlock when ssp tries to close an invalid port