To be fair you did find the unicorn switch (two really) in a sea of ludicrously expensive enterprise licensed kit. We'd have a lot more options if the other $200-500 switches didn't also require 5-10x their purchase cost in fees to actually use them.yeah, this thread really impacted ebay prices. Before I created this thread I bought 3 6450's, 2 non-poe and 1 PoE. Didn't pay more than 90 dollars for any of them.
In the future, if I ever found another neat switch that fits STH needs, I would be sure to buy up all of them before mentioning it, cough https://i.imgur.com/RkqI0UR.jpg
I purchased these Dell 40G QSFP breakout cables and now my 10G ports on the back of my ICX6610 is now working with stacking enable. Finally some success.
Thanks, good to know. I was looking for something with smaller power footprint, and per specs VDX uses <130W vs 185W on icx6610-48 for example. But the rest of those issues like access to fw make it a non-starter.not good. They draw more power than the ICX6610 with WAY less 10gbe ports, they run NOS which is nothing like fastiron (I do not like it), they're now owned by Extreme which has no public firmware updates, the VDX series has almost no L3 features, they are extremely vendor locked (non-brocade optics will not even link up).
The VDX product philosophy has always been the total opposite of the fastiron stuff. Fastiron heritage is a lot of engineers from Foundry etc, while VDX has always been a totally separate group that shares more heritage with Brocade's fibrechannel product lines than it does with Foundry's ethernet stuff
any reason why you don't just pick up an icx6610?
Huh, I suppose I'll have to try it and see how it performs then. It would be nice to have some numbers from someone else with a supported setup to compare to though, that's for sure.RoCE "technically" requires switches to support PFC (priority flow control) to run over them, and the ICX line does not support pfc as they are the "campus" product line. For RoCE feature support you'd need the data center line, which is the VDX series (which I really don't like).
PFC support on the switch ensures the Ethernet transport layer is lossless - eg no dropped frames, which is how RoCE guaruntees it's speed/very low latency. That said, RoCE has its own error correction and retransmission faculties, it will run just fine over a "lossy" network (eg a switch without PFC support), it won't corrupt your data or anything malicious like that. It will just impact performance.
On a non-oversubbed switch with only a few clients, how often will you get dropped frames and therefore how much will it kill RoCE performance? I haven't the slightest clue, I've been wondering that myself. I've seen tests showing plain RoCE (eg the type intended for lossless networks only) working plenty fast without PFC in smaller networks, but I've also heard from engineers "don't ever do that, it'll be slower than non-rdma protocols" so I really have no clue.
Maybe someone here with an existing pfc-enabled switch and RoCE clients and some spare time can run a quick benchmark, then disable PFC on the switch and run it again. I honestly can't even begin to guess the performance impact, I would assume the biggest impact would be to latency, and you might get dropped frames that need to be recovered (costly time wise) just from one nic outpacing the switch or vice versa. What I do know is many people will tell you "just don't do it without PFC support"
Members are saying to avoid the:To break out those 2x breakout ports, you have many options:
** Avoid** You can use a DAC breakout cable: 2M Cisco QSFP-4SFP10G-CU2M Compatible QSFP+ to 4SFP+ Breakout Cable 889028000663 | eBay
Or you can use a 40gbE optic to give you an MPO fiber connector: Brocade XBR-000232 QSFP 57-1000267-01 4*16Gb SWL 100m for DCX8510 EMC | eBay
And then connect an MPO to LC breakout cable to that optic: MPO Fan-out Patch Cable, Multimode Fiber, MPO to LC Uniboot, 3-meter 10FT 603149398665 | eBay
Or you can get fancy, and using an optic like above, use MPO fiber like this: 5m 50/125 Standard MTP Multimode Fiber Optic Patch Cable Key-up to Key-down | eBay
To go to an MPO breakout panel like this: Systimax SCS InstaPATCH 24-Port Fiber Patch Panel Module 642337970740 | eBay
Mine is 6450-24P simply as FYI: 2 10GB ports being used, 12 1GB ports used, no PoE; Kill-a-watt was reporting 30-32 watts.Could anyone with a 6450-48 measure the actual power consumption with ~10 ports connected?
I currently use a T1700G-28TQ which uses <20W with that many connections. I want to try the routing features on the 6450, but I can't find a reasonable deal on the 24 port version here in the UK.
I will get the -48 if it uses less power than the 30-51W in the datasheet with fewer ports connected.
Thanks. For the P version, this is not bad at all.Mine is 6450-24P simply as FYI: 2 10GB ports being used, 12 1GB ports used, no PoE; Kill-a-watt was reporting 30-32 watts.
Off Topic: the 19" Rack PDU's I see used on ebay for about $100; which offer watt metering via a LAN browser, do they only meter the wattage going through the entire PDU - or are there any PDU which can report wattage of each outlet independently ?the P version power draw with no PoE devices is identical to the non-P version, the 54v rail doesn't even turn on. With PoE devices, just add 2 or 3 watts per PoE device