drm/panfrost: Make sure MMU context lifetime is not bound to panfrost_priv