If your main NIC is 10.0.1.x and you wish to use a separate subnet for 2nd NIC (for Ceph or whatever other purposes), with let's say 192.168.1.x as IP address, why not offload that at layer 3 with the first IP device upwards your 2nd NIC connection (router, firewall, layer 3 switch, whatever you have). Normally I'd recommend planting that on a separate VLAN - but if there's no such support, you can easily add an IP alias of 192.168.1.1/24 on your router on the same interface as 10.0.1.1 and that should solve your problem.
Please keep in mind this is a workaround towards your requirement - while it's functional, it is far from a correct implementation but it may have some speed benefits depending on your network topology.