Drag to reposition cover

Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)

Dreece

Active Member
Jan 22, 2019
506
154
43
Talking of direct-attach cables... to be extra sure, can I use the Brocade 58-0000033-01 QSFP cable to connect the 6610 to a Mellanox X3 card for 40g?

Supposed to work, just wanting verification from someone using this cable right now with a Mellanox X3 :)
 
Last edited:

KFJ

New Member
Mar 11, 2019
9
5
3
OOF! I bought a used ICX-6610 from eBay but it turns out the PoE board was shot (had a hole in an IC and a blown transistor on the PoE board). I was able to update the firmware and image and PoE firmware but the error persisted and of course the error blocked the output of commands like 'show chassis'.

The switch was just saying:
Code:
PoE Error: Device 0 failed to start on PoE module.
PoE Error: Device 1 failed to start on PoE module.
Resetting module in slot 1 again to recover from dev fault
The seller graciously sent another used PoE board which I installed about 40 minutes ago. Now the switch powers on and I can get a console, but the console doesn't load past "Enter 'b' to stop at boot monitor" regardless if I press b per usual or not. The switch never fully boots. Tell me I don't have a $400 brick. Just got my fiber kit today :)o_O

Any tips or tricks to reflash or reset the switch? I still have the old PoE board - at least that let me boot the switch, but I'd kinda like to have the PoE working, but it is optional (I'll have to get another PoE switch).
 

Churchill

Admiral
Jan 6, 2016
799
191
43
Ok after minutes of deliberation I went ahead and bought the following to complete my 40GBE network:

QTY 1: Brocade ICX6650 - $250
QTY 3: HP 659281-B21 10/40GB Adapter - $30/card
QT3: NatAPP SAS QSFP/QSFP Cables - $10/card

So for under $400 I will soon have a 40GB network ready to roll

Now I need some quality 1/10GBE gbics and I can get rid of my other switch.

PS. I love and hate you all....
 
  • Like
Reactions: wsuff and Dreece

tjk

Active Member
Mar 3, 2013
285
50
28
www.servercentral.com
Ok after minutes of deliberation I went ahead and bought the following to complete my 40GBE network:

QTY 1: Brocade ICX6650 - $250
QTY 3: HP 659281-B21 10/40GB Adapter - $30/card
QT3: NatAPP SAS QSFP/QSFP Cables - $10/card

So for under $400 I will soon have a 40GB network ready to roll

Now I need some quality 1/10GBE gbics and I can get rid of my other switch.

PS. I love and hate you all....
What seller did you get your 6650 from? I bought 5 off ebay, 2 of the 5 came damaged and had broken ports.

3 of them were packed nice, 2 of them were packed pretty crappy, makes me scratch my head.
 

Dreece

Active Member
Jan 22, 2019
506
154
43
A wise man never ignores a real bargain starring right in his face, well done Churchill! :D
 

Churchill

Admiral
Jan 6, 2016
799
191
43
What seller did you get your 6650 from? I bought 5 off ebay, 2 of the 5 came damaged and had broken ports.

3 of them were packed nice, 2 of them were packed pretty crappy, makes me scratch my head.

G-Electronic: Brocade ICX6650 56-Port 10/40 Gigabit Ethernet Top-of-Rack Switch 42111395699 | eBay

Took $250 in make an offer. Whom did you buy yours from?


EDIT: Depends on the broken part I'm OK with a few things being busticated. As long as the QSFP's are working I'm happy. If 10 of the SFP ports are working I'm happy.

Anything beyond that I'm gonna be ticked.
 
Last edited:

Churchill

Admiral
Jan 6, 2016
799
191
43
A wise man never ignores a real bargain starring right in his face, well done Churchill! :D

I've been going round and round on this all weekend trying to figure out if this is feasable. For the total price it was totally worth it to upgrade from my 10GBE network to 40GBE and consolidate
 

Dreece

Active Member
Jan 22, 2019
506
154
43
I bought from them as well...hopefully they pack yours better then they did mine.
That is the nightmare with ebay... I always do my best to keep my bridges solid across the board, I tend to source more important items directly from businesses... fleabay is great for nics and cables though.

Out of interest, did they offer to compensate/replace or has it become a postal service argument?
 

Churchill

Admiral
Jan 6, 2016
799
191
43
I'm willing to take the hit through ebay for this. Seller will take the item back if things go south. I'm OK with that, there's risks here with anything. If worse comes to worse I don't NEED the switch as I can connect the servers directly to each other via the SAS cables.

This will limit the amount of systems I have connected but I'll survive.
 

Lambdariver

New Member
Mar 24, 2019
20
14
3
That's what you call no pain no gain, some may say it cant be resold, personally I think it has gone up in value :D
I almost posted a picture of my bleeding finger, but thought better of it :)

Got it for 175 shipped as a bunch of ports were crushed and the ears were missing, but nothing a pair of pliers couldn't fix. I wonder what the ebay seller would say if I tried to return it now hehe
 

Lambdariver

New Member
Mar 24, 2019
20
14
3
@Lambdariver are those 10GBT gbics? IF so which ones and how good are they working? Did you get any 1GB gbics as well? Same question
They're only 1gbit SFPs and haven't had a chance to test them yet, but they are recognized on the switch and don't throw the ports into an error state.
Brocade 57-1000042-02 ~$3.50/ea
CDW Proline 855-933-3223 ~$2.30/ea

I'm not sure of the long-term quality of copper SFPs as I don't run any in production. We use Cisco FEX for 1gbit copper, with multimode fiber & twinax handling 10gbit duties.
 

Dreece

Active Member
Jan 22, 2019
506
154
43
I've ordered some bits to do my mod on the 6610, though I've taken the non-invasive approach... hopefully get onto it coming weekend.
 

Churchill

Admiral
Jan 6, 2016
799
191
43
I'm on the hunt for solid 10GBT SFP+'s that will work with the 6650's. Anyone have any ideas?

Good lord these are 60-80 on ebay....
 

Dreece

Active Member
Jan 22, 2019
506
154
43
The 10GB converter transceivers are definitely going to come at a premium, considering they are rarely used by enterprise, hardly surprising. I don't believe we will see any hitting the used scene at sensible prices anytime soon or even at all, not enough out there in public circulation from what I've gathered.
 

Churchill

Admiral
Jan 6, 2016
799
191
43
I have too much infrastructure already built to swap out to all mellanox. Will have to bite the bullet and buy one to see if those cables work.

Bought a dozen Brocade 57-1000042-02 just to get me going.
 
Last edited: