Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)
- Thread starter fohdeesha
- Start date
Since we're reading together (I love group activities), you'll note the part where he's talking about mellanox switches, and infiniband - you have neither. You left out the part where even he himself said:
I'll help you out: you're using a card, and ethernet. We have a match!
Other than the chances of you no longer getting any help in this thread after you've blamed everyone for your purchase of unknown vendor origin cards lmao
That's a nice chip on your shoulder that you spend your spare time debugging NICs. I prefer spending time with loved ones, but to each their own.
You've literally ducked all my points from earlier, but whatever man. I guess you just want to hide behind memes and call it a day. Have a good life dawg. Hope those NICs keep you warm at night.
Since you've all confirmed that the issue you are debugging is unrelated to any Brocade ICX product, can you move this discussion to a different thread?
Sorry hall monitor, didn't know I needed my hall pass around here. Will update my other thread and dip. Enjoy STH!
Last edited:
Look legit? I don't know how to spot fakes.
I was hoping to see something like hpe typcal product numbers eg "123456-B85". But the numbers look like "vanilla" mellanox nics which is confusing becuase the sellers says that the psid was changed (which usually is done to be able to flash stock mellanox firmware over oem firmware)
Another idea or possible cause: revision a1 + "made in Israel" could be an earlier version (or engineering sample). All the connectx-4 nics that I have are a2 or newer and the hpe branded models are all "made in China", the vanilla cx-4 are all "made in Israel"
Another idea or possible cause: revision a1 + "made in Israel" could be an earlier version (or engineering sample). All the connectx-4 nics that I have are a2 or newer and the hpe branded models are all "made in China", the vanilla cx-4 are all "made in Israel"
I agree. I was fully expecting HP flashed NICs when I bought these and got these instead.
Thank you very very much for the insight and references. I would never have known this. I appreciate your help. I've flopped between it being the cards, the fiber, the transceivers and the switch about 100 times, but something is definitely up here that doesn't seem to be software related. I have some ConnectX-3's coming in along with a few other cables / transcievers and will update my post over here if I ever get to the bottom of this.
BTW, I have just ordered a bunch of transceivers from the USA, including the recommended XQX2502 because I really want to see how they behave.
after reading through all of "that" - I find myself using the ignore member function for the first time. 
XDDDDD LAWL ROFLCOPTER don't worry I'll let you get back to your beloved men's support forum.after reading through all of "that" - I find myself using the ignore member function for the first time.
Mod edited for crimes against vision.
Last edited by a moderator:
Just had my first real weirdness with my 6610. I had a unifi access point go offline. Weird. I power cycled the POE port on my 6610, and while the port has 2 lights on, the cli says the port is down. I try the port next to it (19)...same issue. I grab a new spare out of the box, same issue. I test the RJ45 cable with a tester (all pairs good). I replace the cable anyway, same issue.
I reload the POE stack member these are attached into and everything is perfect again. ARGHH
I reload the POE stack member these are attached into and everything is perfect again. ARGHH
the spare you grabbed and tested, was it a spare AP, or a space ICX? if you had the problem even on a separate newly booted ICX, that def sounds like the unifi device was having issues. if it was a spare AP, and the same icx with the prob was still having the issue on the different AP, then yeah it sounds like a strange icx bug. what OS and PoE fw version are you on?
Sorry for the confusion. I tried spare ap, cable & port in the same stack member. I have a 2 stack setup using the 40G QSFP connectors on back. I don't have another ICX6610 that has POE, so as a last resort I kicked just the POE stackmember which has my access points (only) in it.
I did everything according to the guide you setup (much thanks btw!).
SSH@BCORE#sh ver | i Version
SW: Version 08.0.30uT7f3
SW: Version 08.0.30uT7f3
Boot-Monitor Image size = 370695, Version:10.1.00T7f5 (grz10100)
Not sure offhand how to get the poe firmware version, but I remember upgrading it as per your guide.
I kinda wish I had waited for a deal, as I found the 48 port POE model with 2 PS for about $150 shipped on eBay which I thought was superb.
For my first one, non-poe, 48 port, It was $90 but only with one power supply.
To be fair I use Cisco all day at my day job and have had, at one time, 3 Cisco TAC Teams working for 24 hours straight on a multicast over GRE over ipsec issue that was not solvable by them. I found a workaround as I was on a tight time schedule & we eventually ended up removing that equipment as it was older (although still supported). I"m kinda famous @ work for finding issues
There is an HP G6 or G7 BIOS out there that has a bios memory setting bug I found. HP Later released an updated bios and the only fix was the bug I found. So maybe it's just me & not the equpment
Last edited:
@fohdeesha The Infallible, confirmed fallible - ConnectX-4 Lx DO NOT work with KAIAM modules:
Proof that Mellanox programmed transceivers work:
Proof that KAIAM transceivers work properly with ConnectX-3 cards:
Code:
01:00.0 Ethernet controller [0200]: Mellanox Technologies MT27710 Family [ConnectX-4 Lx] [15b3:1015]
Kernel driver in use: mlx5_core
Kernel modules: mlx5_core
Code:
show media ethernet 1/3/1
Port 1/3/1: Type : 40GE-LR4 2km (QSFP+ LC)
Vendor: KAIAM CORP Version: 1A
Part# : XQX2502 Serial#: KD60315209
Code:
Settings for enp1s0np0:
Speed: Unknown!
Duplex: Unknown! (255)
Auto-negotiation: on
Port: FIBRE
PHYAD: 0
Transceiver: internal
Supports Wake-on: d
Wake-on: d
Current message level: 0x00000004 (4)
link
Link detected: no
Code:
show media ethernet 1/4/1
Port 1/4/1: Type : 40GBASE-Passive Copper 2m (QSFP+)
Vendor: Mellanox Version: A3
Part# : MC2207130-002 Serial#: MT1433VS02614
Code:
Settings for enp1s0np0:
Speed: 40000Mb/s
Duplex: Full
Auto-negotiation: on
Port: Direct Attach Copper
PHYAD: 0
Transceiver: internal
Supports Wake-on: d
Wake-on: d
Current message level: 0x00000004 (4)
link
Link detected: yes
Code:
02:00.0 Network controller [0280]: Mellanox Technologies MT27500 Family [ConnectX-3] [15b3:1003]
Kernel driver in use: mlx4_core
Kernel modules: mlx4_core
Code:
show media ethernet 1/3/1
Port 1/3/1: Type : 40GE-LR4 2km (QSFP+ LC)
Vendor: KAIAM CORP Version: 1A
Part# : XQX2502 Serial#: KD60315209
Code:
Settings for enp2s0:
Speed: 40000Mb/s
Duplex: Full
Auto-negotiation: off
Port: FIBRE
PHYAD: 0
Transceiver: internal
Supports Wake-on: d
Wake-on: d
Current message level: 0x00000014 (20)
link ifdown
Link detected: yessame here...after reading through all of "that" - I find myself using the ignore member function for the first time.