I recently built an simpler kvm/ip using a few pi pico's and ms2130 chips. https://www.modularkvmip.com doesnt matter what server you use. Its not opensource but its just usb device passthrough at the core.