Hi
I’m working in a proof of concept for a cloud project but I’m a completely new to infiniband so I’m not sure if I’m getting the right hardware for the job
For testing I have:
My setup will be like:
Each Pfsense Box will have a IB card (lan) and a 10GbE intel nic (wan/upstream Provider) and will act as firewall and proxy eth > IB and vice versa
Each Pfsense box will be connected to each 4036 through a dual 40 Gbps card (one port to each 4036 switch)
Each server will be connected to each 4036 switch (bounded)
The dual 40 Gbps network will be used for IP traffic and SAN (Gluster and ScaleIO or CEPH)
One Juniper switch for ipKVM traffic only (out the band)
I know the cards are able to talk IB/Eth but I’m not sure about the 4036 switches (SX6036 won’t be a problem with IB or Ethernet or even a mixed environment )
The goal is to set a high performance cloud (openstack) failover but simple and economical as possible
My question so far are:
What do you think about using pfsense as firewall AND gateway?
What are the the Mellanox equivalent to IBM 95Y3457 ? are they work with a 4036 and/or SX6036?
Any ideas/suggestions?
I know is better to keep SAN and Internet traffic apart but 2 x 40 Gbpswill be more than enough bandwidth for both and it requires a lot less cabling, and I want to keep it as simple as possible
I’m working in a proof of concept for a cloud project but I’m a completely new to infiniband so I’m not sure if I’m getting the right hardware for the job
For testing I have:
- 2 Mellanox/Voltaire 4036 (thinking to go with SX6036 for production)
- 8 Supermicro servers
- 2 Pfsense Firewall/Gateway
- 10 IBM/Mellanox 95Y3457 Dual 40 Gbps (not sure what Mellanox nic is but I’m guessing is from ConnectX3 family and maybe a EN card (they are on the way)
- 1 Juniper Ex-4200
- Bunch of QSFP cables
My setup will be like:
Each Pfsense Box will have a IB card (lan) and a 10GbE intel nic (wan/upstream Provider) and will act as firewall and proxy eth > IB and vice versa
Each Pfsense box will be connected to each 4036 through a dual 40 Gbps card (one port to each 4036 switch)
Each server will be connected to each 4036 switch (bounded)
The dual 40 Gbps network will be used for IP traffic and SAN (Gluster and ScaleIO or CEPH)
One Juniper switch for ipKVM traffic only (out the band)
I know the cards are able to talk IB/Eth but I’m not sure about the 4036 switches (SX6036 won’t be a problem with IB or Ethernet or even a mixed environment )
The goal is to set a high performance cloud (openstack) failover but simple and economical as possible
My question so far are:
What do you think about using pfsense as firewall AND gateway?
What are the the Mellanox equivalent to IBM 95Y3457 ? are they work with a 4036 and/or SX6036?
Any ideas/suggestions?
I know is better to keep SAN and Internet traffic apart but 2 x 40 Gbpswill be more than enough bandwidth for both and it requires a lot less cabling, and I want to keep it as simple as possible
