gpio: zynq: Remove .owner field for driver