It sounds like you're trying to make a workstation from a server board.
Normal on server boards.
Every server board does this. They'll work with headless GPUs that don't have VGA out like Tesla cards.
Usually iKVM is there to manage the server. GPUs are providing services other than primary...