drm/vmwgfx: Fix an issue with the device losing its irq line on module unload