Techio,
I have a similar project to correct fisheye image to remove distortion, however I plan to use HDMI input and HDMI output.
I am using a WYZE v3 camera and mirroring it to a Rocku stick that has HDMI output that will be fed to the FPGA input channel.
Would you be interested in collaboration on this project?