So, those $13 Bidi 40gbE transceivers work with zero issues on the 6610. Also, he's accepting best offers of $8 - absolute steal. 40gb over regular cheap duplex singlemode fiber, thanks to
@jasonwc for the find. auction -
XQX2502 KAIAM QSFP+40G-LR4 Lite OPTICAL MODULE NEW PULLS | eBay (if link dies, search around for KAIAM XQX2502)
Code:
ICX6610-24P Router#show stack con
Probing the topology. Please wait ...
ICX6610-24P Router#
standby active
+---+ +---+
2/6| 2 |2/1==2/1| 1 |2/6
+---+ +---+
trunk probe results: 1 links
Link 1: u1 -- u2, num=1
1: 1/2/1 (T0) <---> 2/2/1 (T0)
Code:
ICX6610-24P Router#show media e 1/2/1
Port 1/2/1:Type : 40G QSFP Module
Vendor Name: KAIAM CORP Serial Num: KD60630129 Revision: 1A
ICX6610-24P Router#show media e 2/2/1
Port 2/2/1: Type : 40G QSFP Module
Vendor: KAIAM CORP Version: 1A
Part# : Serial#: KD60628356
Code:
ICX6610-24P Router#ICX6610-24P Router#show int e 1/2/1
40GigabitEthernet1/2/1 is up, line protocol is up
Port up for 10 minute(s) 31 second(s)
Hardware is 40GigabitEthernet, address is cc4e.243d.3eff (bia cc4e.243d.3eff)
Interface type is 40Gig Fiber
Configured speed 40Gbit, actual 40Gbit, configured duplex fdx, actual fdx
Tested in all 4 ports as I recall talk of one port being higher power for ZR factory optics, and these work in all 4 slots including the 4x10gbE slots:
Code:
ICX6610-24P Router#show stack con
Probing the topology. Please wait ...
ICX6610-24P Router#
active
+---+ +---+
2/6| 2 |2/1==2/1| 1 |2/6
+---+ +---+
trunk probe results: 1 links
Link 1: u1 -- u2, num=4
1: 1/2/2 (T0) <---> 2/2/2 (T0)
2: 1/2/3 (T0) <---> 2/2/3 (T0)
3: 1/2/4 (T0) <---> 2/2/4 (T0)
4: 1/2/5 (T0) <---> 2/2/5 (T0)
CPU to CPU packets are fine between 2 units.
These transceivers are an insane value! Not only do they work perfectly in both the ICX6610 AND the Mellanox ConnectX-3 but you also get digital optical monitoring data from ethtool. Moreover, It appears that the transceiver uses a maximum of 2.5W, which is about 1W less than the typical 10km 40G-LR4 modules I've seen. For example, Fiber Store's generic module reports ~3.5W of as maximum power consumption.
Code:
root@storage-server:~# ethtool -m enp2s0
Identifier : 0x0d (QSFP+)
Extended identifier : 0x80
Extended identifier description : 2.5W max. Power consumption
Extended identifier description : No CDR in TX, No CDR in RX
Extended identifier description : High Power Class (> 3.5 W) not enabled
Connector : 0x07 (LC)
Transceiver codes : 0x02 0x00 0x00 0x00 0x00 0x00 0x00 0x00
Transceiver type : 40G Ethernet: 40G Base-LR4
Encoding : 0x00 (unspecified)
BR, Nominal : 10300Mbps
Rate identifier : 0x00
Length (SMF,km) : 2km
Length (OM3 50um) : 0m
Length (OM2 50um) : 0m
Length (OM1 62.5um) : 0m
Length (Copper or Active cable) : 0m
Transmitter technology : 0x40 (1310 nm DFB)
Laser wavelength : 1310.000nm
Laser wavelength tolerance : 6.500nm
Vendor name : KAIAM CORP
Vendor OUI : 14:ed:e4
Vendor PN : XQX2502
Vendor rev : 1A
Vendor SN : KD60629247
Date code : 16062900
Revision Compliance : SFF-8636 Rev 1.5
Module temperature : 39.52 degrees C / 103.13 degrees F
Module voltage : 3.2447 V
Alarm/warning flags implemented : No
Laser tx bias current (Channel 1) : 45.030 mA
Laser tx bias current (Channel 2) : 38.174 mA
Laser tx bias current (Channel 3) : 40.436 mA
Laser tx bias current (Channel 4) : 39.490 mA
Transmit avg optical power (Channel 1) : 1.4921 mW / 1.74 dBm
Transmit avg optical power (Channel 2) : 1.5180 mW / 1.81 dBm
Transmit avg optical power (Channel 3) : 1.4837 mW / 1.71 dBm
Transmit avg optical power (Channel 4) : 1.4863 mW / 1.72 dBm
Rcvr signal avg optical power(Channel 1) : 0.8646 mW / -0.63 dBm
Rcvr signal avg optical power(Channel 2) : 0.7799 mW / -1.08 dBm
Rcvr signal avg optical power(Channel 3) : 0.6020 mW / -2.20 dBm
Rcvr signal avg optical power(Channel 4) : 0.5647 mW / -2.48 dBm
It's pretty crazy how cheap 40G ethernet has gotten. I picked up a HP 649281-B21 Mellanox ConnectX-3 for $30 on Ebay and flashed it to the FCBT variant using your guide (also removed the crappy PXE ROM). In contrast, a single-port 10G Mellanox ConnectX-3 is about $25 and lacks DOM (ethtool -m provides no output even with Mellanox optics). I paid $10 each for the 40G-LR Lite transceivers and around $10 for a 20M OS2 duplex cable.
Thus far, the ICX6610 and ConnectX-3 cards have accepted every transceiver I've used.
Macroreer for Brocade 10G-SFPP-LR SFP+ ($7 on Ebay): Works with DOM
Curvature SFP-10G-LR-CURV 10GB 1310nm 10GBASE-LR: ($5 on Ebay in a lot of 4): Works but no DOM
ProLabs for Cisco SFP-10G-LR ($6 on Ebay): Works but no DOM
Brocade Genuine 10G-SFPP-LR 57-0000076-01 SFP+ LR ($5 ea. for a lot of 4) - As expected, works with DOM
Brocade Genuine 10G-SFPP-SR 57-0000075-01 10GB 10GBASE-SR ($5ea for a lot of 4) - As expected, works with DOM
Given that you can get 10G-LR SFP+ modules for $5 and these KAIAM 40G-LR4 Lite QSFP transceivers dramatically reduce the cost of 40G fiber connections, I''ll probably use SMF for all my runs moving forward. It's just more future-proof. For my 150ft runs from my network closet to my upstairs bedrooms, FS OS2 duplex cables are $15 and MTP OM3 cables with 8 fibers are $184.
EDIT: There's also a seller offering genuine Brocade 57-10000263-01 40G-LR4 10km optics for $27 each if you buy 3. Presumably this would provide DOM and it's validated to work on the ICX6610.
