No, mixing sizes the way you intended is not a good idea. It might run, but you will definitely take a performance hit in addition to the memory only being 2133MT/s.
It works this way with 2 DIMMs per channel. But not with only one DIMM per channel, as you will have with 16 DIMMs total.
But honestly: you spent how much on the CPUs? 16x16GB DDR4-2933 RDIMM can be had for less than 1500$. DDR4-3200 is still a bit more expensive. Edit: nevermind, thought you had Epyc 7002.