Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)

Discussion in 'Networking' started by fohdeesha, Jul 12, 2018.

  1. Churchill

    Churchill Admiral

    Joined:
    Jan 6, 2016
    Messages:
    767
    Likes Received:
    171
    all my qsfp are disabled in an err-disabled stated. Something about licensing? I used the firmware from the beginning of this thread. Am I missing something?

    1/2/1 ERR-DIS None None None None No 1 0 cc4e.2417.69bb
    1/2/2 ERR-DIS None None None None No 1 0 cc4e.2417.69bc
    1/2/3 ERR-DIS None None None None No 1 0 cc4e.2417.69bd
    1/2/4 ERR-DIS None None None None No 1 0 cc4e.2417.69be
    1/3/1 ERR-DIS None None None None No 1 0 cc4e.2417.69bf
    1/3/2 ERR-DIS None None None None No 1 0 cc4e.2417.69c0
    1/3/3 ERR-DIS None None None None No 1 0 cc4e.2417.69c1
    1/3/4 ERR-DIS None None None None No 1 0 cc4e.2417.69c2
    1/3/5 ERR-DIS None None None None No 1 0 cc4e.2417.69c3
    1/3/6 ERR-DIS None None None None No 1 0 cc4e.2417.69c4
    1/3/7 ERR-DIS None None None None No 1 0 cc4e.2417.69c5
    1/3/8 ERR-DIS None None None None No 1 0 cc4e.2417.69c6



    40GigabitEthernet1/2/1 is ERR-DISABLED (invalid license), line protocol is down
    Port down for 5 days 23 hours 24 minutes 25 seconds
    Hardware is 40GigabitEthernet, address is cc4e.2417.69bb (bia cc4e.2417.69bb)
    Interface type is unknown
    Configured speed 40Gbit, actual unknown, configured duplex fdx, actual unknown
    Configured mdi mode AUTO, actual unknown
    Member of L2 VLAN ID 1, port is untagged, port state is DISABLED
    BPDU guard is Disabled, ROOT protect is Disabled, Designated protect is Disabled


    ICX6650-64 Router(config-if-e40000-1/2/1)#show license
    Index License Name Lid License Type Status License Period License Capacity
    Stack unit 1:
    1 ICX6650-40G-LIC-POD ensHKJFlFeg Normal Active Unlimited 8
    2 ICX6650-10G-LIC-POD ensHKJFlFeg Normal Active Unlimited 24
    ICX6650-64 Router(config-if-e40000-1/2/1)#
     
    #2201
  2. am45931472

    am45931472 Member

    Joined:
    Feb 26, 2019
    Messages:
    43
    Likes Received:
    8
    So I've read the thread thoroughly, damn its long. Is this the longest thread on STH?

    Anyway i'm still looking for a way, anyway, to quiet down the ICX 6610-48P I got. Have done the full software upgrade thanks to the OP who has been amazing on this thread. I currently have this installed with the single 1000w Power supply. I've read many times on here that adding a second power supply can reduce the noise of these switches but I wanted to make sure that that was true of the POE models of these 6610s, not just the non poe models before i go out and get a second one of these 1000w PSUs. The psu my 6610 came with was a revision B.

    Also wanted to know if you can run Poe off these switches with the 250w PSUs instead. would 2x 250w psus be quieter than a single 1000 while also allowing for POE? my poe budget is very low, just a few APs

    Just for kicks, I removed the top plate of this switch and put a 20' box fan on top of it to cooler it down to see if reducing the temps a ton would spool down the fans more but it doesnt with cpu temp around 45C. other senor temps are between 29-35C

    I have a startech openrack, no space limitations. willing to get creative to get this quieter. Home lab
     
    #2202
  3. fohdeesha

    fohdeesha Kaini Industries

    Joined:
    Nov 20, 2016
    Messages:
    1,389
    Likes Received:
    1,117

    you need licenses to unlock the 40gb ports on the 6650. You have them, but you still need to tell the ports to unlock themselves:

    conf t
    fpod-40g-enable group 1
    fpod-40g-enable group 2
    fpod-40g-enable group 3
    write mem
     
    #2203
    capn13 and Churchill like this.
  4. Churchill

    Churchill Admiral

    Joined:
    Jan 6, 2016
    Messages:
    767
    Likes Received:
    171
    After you enable them with the "fpod" command you need to enable the interfaces manually. I had to go into port 1/2/1 and type "enable" and VOILA! 40gb!
     
    #2204
  5. fohdeesha

    fohdeesha Kaini Industries

    Joined:
    Nov 20, 2016
    Messages:
    1,389
    Likes Received:
    1,117
    I think you should only have to enable them if you don't reboot, I think I forgot a reboot instruction after the fpod crap. there's a whole paragraph on it in the licensing manual included in the firmware zip
     
    #2205
  6. BobTB

    BobTB New Member

    Joined:
    Jul 19, 2019
    Messages:
    16
    Likes Received:
    3
    Is there a way to see the total running hours of these switches in their lifetime, not just the uptime?
     
    #2206
  7. fohdeesha

    fohdeesha Kaini Industries

    Joined:
    Nov 20, 2016
    Messages:
    1,389
    Likes Received:
    1,117
    nope
     
    #2207
  8. Skippy96

    Skippy96 New Member

    Joined:
    May 14, 2019
    Messages:
    14
    Likes Received:
    5
    So unfortunately I'm going to have to sell both my ICX6610-24P switches :( they work great but my pregnant wife cant yell at me from upstairs for me to hear her in my office. they are fully updated but will not have any licenses on them (you can reach out to
    fohdeesha for that :) will sell with 2 fans and 2 power supplies (switch is POE but power supplies are not but they are brand new a version C witch is the most quiet) for $250 and with 1 power supply for 200. Local is NY/NJ/CT or shipping at buyers expense. will also post on ebay next week and in the for sale area.

    if im only running 3-4 10GB lines and the rest being 1gb, would the 6450 work for me?

     
    #2208
    fohdeesha likes this.
  9. Wolfstar

    Wolfstar Member

    Joined:
    Nov 28, 2015
    Messages:
    60
    Likes Received:
    28
    I mean, my 6450-24P is fine noise-wise, but I don't recall the 6610 when I had it being THAT much louder. If you're not using PoE it may well be even quieter, but you may want to seriously consider a fanless switch from somewhere.

    That said, yeah, 3-4 10G and the rest gigabit will be fine, as long as you can activate the second pair of 10G ports. I suspect you know how to do that though. :)

    I'd be interested in one of them, possibly. Need to figure out how much I can afford. Sadly I'm not local (Maine) so that won't work out and I'd need to figure shipping.
     
    #2209
    Skippy96 likes this.
  10. Skippy96

    Skippy96 New Member

    Joined:
    May 14, 2019
    Messages:
    14
    Likes Received:
    5
    Less the true loudness of the switches, more the layout of my house. The switches sit in between my desk and the door in my office, so any sound coming inside my office has to pass through them to get to me.

    Hoping I can either put quieter fans or turn off the fans all together on the 6450, I was trying to do that on the 6610 but decided against cutting and splicing on the PSUs.

    My question on the 6450 was more bandwidth wise. I run a SAN and multiple containers with Plex, home assistant, openVPN, etc. If I'm doing 1-2 lager 25-300gb copies on 10gbt andmeone is watching a netflix movie on 4k HDR will they stutter? Also, am I losing any layer options going to the lower switch.

    Thanks
     
    #2210
  11. Wolfstar

    Wolfstar Member

    Joined:
    Nov 28, 2015
    Messages:
    60
    Likes Received:
    28
    No, I've not experienced throughput issues at all with them and I really wouldn't expect to - switches haven't really had blocking issues in a long time. I've got a NAS and a couple of ESXi hosts connected on 10g, with the NAS feeding both hosts for a datastore as well as general and media file sharing and had no issues.

    You WILL lose some functionality at layer 3; no BGP, no ability to handle dynamic IPv6 assignments and some other IPv6 limitations, but the advanced license does get you OSPF v2/v3 at least. But static routing for both IP types is included in base package and I think RIP for both is as well.
     
    #2211
    Skippy96 likes this.
  12. raab

    raab New Member

    Joined:
    Aug 24, 2019
    Messages:
    12
    Likes Received:
    3
    I managed to go through all 111 pages on and off over a week

    Glad @PGlover finally for his sonos stuff working after all that
     
    #2212
    fohdeesha and Octopuss like this.
  13. hemmy

    hemmy New Member

    Joined:
    Aug 15, 2019
    Messages:
    3
    Likes Received:
    1
    I went through most of the pages on this thread and ending up picking up a couple 6610s off eBay.

    The PoE one I picked up only has one exhaust fan. Does anyone have one they can sell me?
     
    #2213
  14. fohdeesha

    fohdeesha Kaini Industries

    Joined:
    Nov 20, 2016
    Messages:
    1,389
    Likes Received:
    1,117
    1 fan tray is how 90% of them were sold and operated (already redundant with the PSU fans)
     
    #2214
  15. hemmy

    hemmy New Member

    Joined:
    Aug 15, 2019
    Messages:
    3
    Likes Received:
    1
    Ah perfect, thanks!
     
    #2215
  16. fohdeesha

    fohdeesha Kaini Industries

    Joined:
    Nov 20, 2016
    Messages:
    1,389
    Likes Received:
    1,117
    selling my ICX6650 (2x PSUs 2x fan trays, normal front to back airflow), $520 free shipping (cheapest on ebay right now seems to be $750). posting here for a day or two before throwing it on ebay
     
    #2216
  17. raab

    raab New Member

    Joined:
    Aug 24, 2019
    Messages:
    12
    Likes Received:
    3
    My 6450-24P's arrived today, very well packaged by the ebay seller and there's no obvious signs of shipping damage. Considering they came from America -> New Zealand that's a bonus!

    One of the rack ears is a bit bent on the bottom of the ear (top switch in picture), otherwise just scuff marks and scratches on the casing. Not sure how they get so bad as you're not exactly ripping switches in and out of racks often (unless you run lan parties!)

    Imgur

    Now I just get to look at them because I'm still waiting for my usb/rj45 serial cable to arrive from amazon
     
    #2217
  18. fohdeesha

    fohdeesha Kaini Industries

    Joined:
    Nov 20, 2016
    Messages:
    1,389
    Likes Received:
    1,117
    icx6650 sold
     
    #2218
  19. raab

    raab New Member

    Joined:
    Aug 24, 2019
    Messages:
    12
    Likes Received:
    3
    So I got this serial cable https://www.amazon.com/Asunflower-Serial-Console-Rollover-Routers/dp/B00KMRVGFO

    But nothing seems to happen when I try use putty, also tried screen.. pressing enter (or any other key) doesn't bring anything up etc. Plugged into the ethernet port 1 on both switches, same thing

    Any idea? I felt I read someone else had a problem with the asunflower cable but can't recall now
     
    #2219
  20. fohdeesha

    fohdeesha Kaini Industries

    Joined:
    Nov 20, 2016
    Messages:
    1,389
    Likes Received:
    1,117
    plugged it into the ETHERNET port?
     
    #2220
Similar Threads: Brocade Series
Forum Title Date
Networking [SOLVED] Help Needed - Brocade ICX 6450 + Ruckus R720 Nov 25, 2019
Networking Brocade ICX 6610 - what does dhcp-client enable do? Nov 19, 2019
Networking MikroTik CSS326-24G-2S+RM vs Brocade ICX6450-24 Nov 1, 2019
Networking Brocade ICX6450-24P vs Aruba S2500-24P for Homelab Sep 22, 2019
Networking Brocade VDX 6720 - what do I need to know? Sep 16, 2019

Share This Page