Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)

Discussion in 'Networking' started by fohdeesha, Jul 12, 2018.

  1. BackupProphet

    BackupProphet Well-Known Member

    Joined:
    Jul 2, 2014
    Messages:
    783
    Likes Received:
    278
    I am testing my units tonight, received 4 units of the 6450. The 6610 is a lot louder, but the 6450 makes a vibrating sound. I think I need to replace the fan, then it should be super quiet.
     
    #501
  2. BackupProphet

    BackupProphet Well-Known Member

    Joined:
    Jul 2, 2014
    Messages:
    783
    Likes Received:
    278
    Damn, tried a Delta fan, with similar specs, but the fan wouldn't start. The wires are green and yellow, which is unusal. I guess the middle pin is what should be supplying power?
     
    #502
  3. tommybackeast

    tommybackeast Active Member

    Joined:
    Jun 10, 2018
    Messages:
    126
    Likes Received:
    30
    I cannot comment to that at all, merely as FYI, my own 6450-24p which frankly was in mint shape inside and out when i got it (not even rack rash); running 2 10GB ports, 14 1GB, and no PoE is silly quiet. When I opened it up expecting to need to clean out some dust bunnies; it was spotless.
     
    #503
  4. BackupProphet

    BackupProphet Well-Known Member

    Joined:
    Jul 2, 2014
    Messages:
    783
    Likes Received:
    278
    Well I went ahead and tried with power in the middle pin, and then it worked :)
    Now it is super silent! I do get fan failed though
     
    #504
  5. fohdeesha

    fohdeesha Kaini Industries

    Joined:
    Nov 20, 2016
    Messages:
    1,228
    Likes Received:
    987
    they have the standard 3 pin cpu/case fan pinout, that delta must have had a weird non-standard pinout
     
    #505
  6. BackupProphet

    BackupProphet Well-Known Member

    Joined:
    Jul 2, 2014
    Messages:
    783
    Likes Received:
    278
    It's not standard, I compared with my other "standard" fans, I had to reverse the order. The Delta belonged to another switch I had that died, which had another non standard order. No big deal deal, but it is annoying.
     
    #506
  7. Myth

    Myth Member

    Joined:
    Feb 27, 2018
    Messages:
    141
    Likes Received:
    7
    Oh wow of course LACP across multiple switches, amazing! That's going to take some research on how to set that up.

    We have three servers, each with 2x ports 40GigE. So how would it work to connect each server via 2x 40GigE ports. I guess one 40GigE line per switch. Would I then connect the two switches together using a 1GigE line?
     
    #507
  8. kapone

    kapone Active Member

    Joined:
    May 23, 2015
    Messages:
    612
    Likes Received:
    241
    No.

    You connect each switch to your router on a different interface. That way each switch is its own LAN segment (with potential VLANs downstream). Your servers now have two paths to get to the router, if one of them fails, there's still one path available (The LACP link will still be up).

    Edit: Actually, there's many ways to do this. This may or may not be the right/optimal way to do it, depending on what you're trying to achieve.
     
    #508
  9. fohdeesha

    fohdeesha Kaini Industries

    Joined:
    Nov 20, 2016
    Messages:
    1,228
    Likes Received:
    987
    No I mean literally stack the switches (use the stacking commands/code to make them become one logical switch), then each server/host would have a LACP connection of two links, one landing on each switch chassis. Then you can rip the power cord out of a switch, and thanks to the hitless stacking failover, the remaining switch will take over, that LACP link will become the one left active, and servers will not notice even a temporary traffic drop, it's hitless.

    This is what I do at home and in colo, every important link (transit uplink, virt hosts, storage etc) lands on 2 switches in a stack, so I'm not tied to one switch. Keep in mind @Myth that the ICX6610 only has 2x 40gbE ports, and if you stack them, you should use at least one of the 40gbE ports per switch to do it, so you'll be left with 2x free 40gbE ports in a stack. That's enough to LACP to a storage host or something, but the rest of the hosts etc will have to use 10gbE ports as you've ran out of 40gbE. If you need high density 40gbE Arista 7050qx is the way to go
     
    #509
    Matt G likes this.
  10. jmacsob

    jmacsob New Member

    Joined:
    Mar 18, 2017
    Messages:
    5
    Likes Received:
    0
    So I was poking around inside my switch and I accidentally shorted something out and now my 6450-24 appears to be dead, it's unable to see the ethernet ports or any of the hardware it seems.
    Code:
     I2C Dev 0x24, Register 03 Initial Fail
    FAIL!
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Read hw monitor register value fail
    Unable to configure hw monitor
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Read hw monitor register value fail
    Unable to configure hw monitor
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Read hw monitor register value fail
    Unable to configure hw monitor
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Read hw monitor register value fail
    Unable to configure hw monitor
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Read hw monitor register value fail
    Unable to configure hw monitor
    Unable to select to bank 0 of HWM
    mvEgigaEnvMacGet: Wrong MAC (<NULL>).
    mvEgigaLoad: mvEgigaEnvMacGet failed.
    mv_eth_init: mvEgigaLoad() failed.
    No ethernet found.
    Enter 'b' to stop at boot monitor:  1
    
    Bootloader Version: 10.1.05T310 (Mar 19 2015 - 16:39:59)
    
    Bootloader Version: 10.1.05T310 (Mar 19 2015 - 16:39:59)TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Unable to read IO Expander 27 Register 1
    ioexp_read fail
    Error while reading Base MAC from EEPROM
    
    
    
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Unable to read CPLD revision
    Model ID: 1.0.0.0.0.1
    assembly error, wrong PoE card installed
    
     I2C Dev 0x20, Register 06 Initial FailTWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    
     I2C Dev 0x20, Register 07 Initial Fail
     I2C Dev 0x24, Register 06 Initial FailTWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    
     I2C Dev 0x24, Register 07 Initial Fail
     I2C Dev 0x20, Register 02 Initial FailTWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    
     I2C Dev 0x20, Register 03 Initial Fail
     I2C Dev 0x24, Register 02 Initial FailTWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    
     I2C Dev 0x24, Register 03 Initial Fail
    FAIL!
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Read hw monitor register value fail
    Unable to configure hw monitor
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Read hw monitor register value fail
    Unable to configure hw monitor
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Read hw monitor register value fail
    Unable to configure hw monitor
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Read hw monitor register value fail
    Unable to configure hw monitor
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Read hw monitor register value fail
    Unable to configure hw monitor
    Unable to select to bank 0 of HWM
    mvEgigaEnvMacGet: Wrong MAC (<NULL>).
    mvEgigaLoad: mvEgigaEnvMacGet failed.
    mv_eth_init: mvEgigaLoad() failed.
    No ethernet found.
    Enter 'b' to stop at boot monitor:  0
    bootdelay: ===
    Booting image from Primary
    ## Booting image at 00007fc0 ...
       Created:      2015-04-22  22:31:19 UTC
       Data Size:    8393876 Bytes =  8 MB
       Load Address: 00008000
       Entry Point:  00008000
       Verifying Checksum ... OK
    OK
    
    Starting kernel in BE mode ...
    Uncompressing Image................................................................................................................................................................................................................................................................................................................................................................. done, booting the kernel.
    
    
    Bootloader Version: 10.1.05T310 (Mar 19 2015 - 16:39:59)TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Unable to read IO Expander 27 Register 1
    ioexp_read fail
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Error while reading Base MAC from EEPROM
    
    
    
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Unable to read CPLD revision
    Model ID: 1.0.0.0.0.1
    assembly error, wrong PoE card installed
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    
     I2C Dev 0x20, Register 06 Initial FailTWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    
     I2C Dev 0x20, Register 07 Initial FailTWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    
     I2C Dev 0x24, Register 06 Initial FailTWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    
     I2C Dev 0x24, Register 07 Initial FailTWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    
     I2C Dev 0x20, Register 02 Initial FailTWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    
     I2C Dev 0x20, Register 03 Initial FailTWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    
     I2C Dev 0x24, Register 02 Initial FailTWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    
     I2C Dev 0x24, Register 03 Initial Fail
    FAIL!
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Read hw monitor register value fail
    Unable to configure hw monitor
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Read hw monitor register value fail
    Unable to configure hw monitor
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Read hw monitor register value fail
    Unable to configure hw monitor
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Read hw monitor register value fail
    Unable to configure hw monitor
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Read hw monitor register value fail
    Unable to configure hw monitor
    Unable to select to bank 0 of HWM
    mvEgigaEnvMacGet: Wrong MAC (<NULL>).
    mvEgigaLoad: mvEgigaEnvMacGet failed.
    mv_eth_init: mvEgigaLoad() failed.
    No ethernet found.
    Enter 'b' to stop at boot monitor:  0
    bootdelay: ===
    Booting image from Primary
    ## Booting image at 00007fc0 ...
       Created:      2015-04-22  22:31:19 UTC
       Data Size:    8393876 Bytes =  8 MB
       Load Address: 00008000
       Entry Point:  00008000
       Verifying Checksum ... OK
    OK
    
    Starting kernel in BE mode ...
    Uncompressing Image................................................................................................................................................................................................................................................................................................................................................................. done, booting the kernel.
    Config partition mounted.
    Creating TUN device
    Starting the FastIron.
    Error: I2C access failed for device 0x27, command -1071879421, I2C code = 0x1, SIM Code = 14, TWSI Sts = 0xf8
    Retrying read of extended board-id, retry count: 1
    Error: I2C access failed for device 0x27, command -1071879421, I2C code = 0x1, SIM Code = 14, TWSI Sts = 0xf8
    Retrying read of extended board-id, retry count: 2
    Error: I2C access failed for device 0x27, command -1071879421, I2C code = 0x1, SIM Code = 14, TWSI Sts = 0xf8
    Retrying read of extended board-id, retry count: 3
    Error: I2C access failed for device 0x27, command -1071879421, I2C code = 0x1, SIM Code = 14, TWSI Sts = 0xf8
    Retrying read of extended board-id, retry count: 4
    Error: I2C access failed for device 0x27, command -1071879421, I2C code = 0x1, SIM Code = 14, TWSI Sts = 0xf8
    Retrying read of extended board-id, retry count: 5
    Error: I2C access failed for device 0x27, command -1071879421, I2C code = 0x1, SIM Code = 14, TWSI Sts = 0xf8
    Retrying read of extended board-id, retry count: 6
    Error: I2C access failed for device 0x27, command -1071879421, I2C code = 0x1, SIM Code = 14, TWSI Sts = 0xf8
    Failed to read ext id from CPLD!
    
    I2C Bus Error !!
    Please remove ALL faulty SFPs and power cycle if the switch doesn't recover.
    
    Sent SIGTERM to all processes
    Sent SIGKILL to all processes
    Requesting system reboot
    Restarting system.
    
    
    Bootloader Version: 10.1.05T310 (Mar 19 2015 - 16:39:59)TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Unable to read IO Expander 27 Register 1
    ioexp_read fail
    Error while reading Base MAC from EEPROM
    
    
    
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Unable to read CPLD revision
    Model ID: 1.0.0.0.0.1
    assembly error, wrong PoE card installed
    
     I2C Dev 0x20, Register 06 Initial FailTWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    
     I2C Dev 0x20, Register 07 Initial Fail
     I2C Dev 0x24, Register 06 Initial FailTWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    
     I2C Dev 0x24, Register 07 Initial Fail
     I2C Dev 0x20, Register 02 Initial FailTWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    
     I2C Dev 0x20, Register 03 Initial Fail
     I2C Dev 0x24, Register 02 Initial FailTWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    
     I2C Dev 0x24, Register 03 Initial Fail
    FAIL!
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Read hw monitor register value fail
    Unable to configure hw monitor
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Read hw monitor register value fail
    Unable to configure hw monitor
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Read hw monitor register value fail
    Unable to configure hw monitor
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Read hw monitor register value fail
    Unable to configure hw monitor
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Read hw monitor register value fail
    Unable to configure hw monitor
    Unable to select to bank 0 of HWM
    mvEgigaEnvMacGet: Wrong MAC (<NULL>).
    mvEgigaLoad: mvEgigaEnvMacGet failed.
    mv_eth_init: mvEgigaLoad() failed.
    No ethernet found.
    Enter 'b' to stop at boot monitor:  0
    bootdelay: ===
    Booting image from Primary
    ## Booting image at 00007fc0 ...
       Created:      2015-04-22  22:31:19 UTC
       Data Size:    8393876 Bytes =  8 MB
       Load Address: 00008000
       Entry Point:  00008000
       Verifying Checksum ... OK
    OK
    
    Starting kernel in BE mode ...
    Uncompressing Image................................................................................................................................................................................................................................................................................................................................................................. done, booting the kernel.
    Config partition mounted.
    Creating TUN device
    Starting the FastIron.
    Error: I2C access failed for device 0x27, command -1071879421, I2C code = 0x1, SIM Code = 14, TWSI Sts = 0xf8
    Retrying read of extended board-id, retry count: 1
    Error: I2C access failed for device 0x27, command -1071879421, I2C code = 0x1, SIM Code = 14, TWSI Sts = 0xf8
    Retrying read of extended board-id, retry count: 2
    Error: I2C access failed for device 0x27, command -1071879421, I2C code = 0x1, SIM Code = 14, TWSI Sts = 0xf8
    Retrying read of extended board-id, retry count: 3
    Error: I2C access failed for device 0x27, command -1071879421, I2C code = 0x1, SIM Code = 14, TWSI Sts = 0xf8
    Retrying read of extended board-id, retry count: 4
    Error: I2C access failed for device 0x27, command -1071879421, I2C code = 0x1, SIM Code = 14, TWSI Sts = 0xf8
    Retrying read of extended board-id, retry count: 5
    Error: I2C access failed for device 0x27, command -1071879421, I2C code = 0x1, SIM Code = 14, TWSI Sts = 0xf8
    Retrying read of extended board-id, retry count: 6
    Error: I2C access failed for device 0x27, command -1071879421, I2C code = 0x1, SIM Code = 14, TWSI Sts = 0xf8
    Failed to read ext id from CPLD!
    
    I2C Bus Error !!
    Please remove ALL faulty SFPs and power cycle if the switch doesn't recover.
    
    Sent SIGTERM to all processes
    Sent SIGKILL to all processes
    Requesting system reboot
    Restarting system.
    
    
    Bootloader Version: 10.1.05T310 (Mar 19 2015 - 16:39:59)TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Unable to read IO Expander 27 Register 1
    ioexp_read fail
    Error while reading Base MAC from EEPROM
    
    
    
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Unable to read CPLD revision
    Model ID: 1.0.0.0.1.1
    
     I2C Dev 0x20, Register 06 Initial FailTWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    
     I2C Dev 0x20, Register 07 Initial Fail
     I2C Dev 0x24, Register 06 Initial FailTWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    
     I2C Dev 0x24, Register 07 Initial Fail
     I2C Dev 0x20, Register 02 Initial FailTWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    
     I2C Dev 0x20, Register 03 Initial Fail
     I2C Dev 0x24, Register 02 Initial FailTWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    
     I2C Dev 0x24, Register 03 Initial Fail
    FAIL!
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Read hw monitor register value fail
    Unable to configure hw monitor
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Read hw monitor register value fail
    Unable to configure hw monitor
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Read hw monitor register value fail
    Unable to configure hw monitor
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Read hw monitor register value fail
    Unable to configure hw monitor
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Read hw monitor register value fail
    Unable to configure hw monitor
    Unable to select to bank 0 of HWM
    mvEgigaEnvMacGet: Wrong MAC (<NULL>).
    mvEgigaLoad: mvEgigaEnvMacGet failed.
    mv_eth_init: mvEgigaLoad() failed.
    No ethernet found.
    Enter 'b' to stop at boot monitor:  0
    bootdelay: ===
    Booting image from Primary
    ## Booting image at 00007fc0 ...
       Created:      2015-04-22  22:31:19 UTC
       Data Size:    8393876 Bytes =  8 MB
       Load Address: 00008000
       Entry Point:  00008000
       Verifying Checksum ... OK
    OK
    
    Starting kernel in BE mode ...
    Uncompressing Image................................................................................................................................................................................................................................................................................................................................................................. done, booting the kernel.
    Config partition mounted.
    Creating TUN device
    Starting the FastIron.
    Error: I2C access failed for device 0x27, command -1071879421, I2C code = 0x1, SIM Code = 14, TWSI Sts = 0xf8
    Retrying read of extended board-id, retry count: 1
    Error: I2C access failed for device 0x27, command -1071879421, I2C code = 0x1, SIM Code = 14, TWSI Sts = 0xf8
    Retrying read of extended board-id, retry count: 2
    Error: I2C access failed for device 0x27, command -1071879421, I2C code = 0x1, SIM Code = 14, TWSI Sts = 0xf8
    Retrying read of extended board-id, retry count: 3
    Error: I2C access failed for device 0x27, command -1071879421, I2C code = 0x1, SIM Code = 14, TWSI Sts = 0xf8
    Retrying read of extended board-id, retry count: 4
    Error: I2C access failed for device 0x27, command -1071879421, I2C code = 0x1, SIM Code = 14, TWSI Sts = 0xf8
    Retrying read of extended board-id, retry count: 5
    Error: I2C access failed for device 0x27, command -1071879421, I2C code = 0x1, SIM Code = 14, TWSI Sts = 0xf8
    Retrying read of extended board-id, retry count: 6
    Error: I2C access failed for device 0x27, command -1071879421, I2C code = 0x1, SIM Code = 14, TWSI Sts = 0xf8
    Failed to read ext id from CPLD!
    
    I2C Bus Error !!
    Please remove ALL faulty SFPs and power cycle if the switch doesn't recover.
    
    Sent SIGTERM to all processes
    Sent SIGKILL to all processes
    Requesting system reboot
    Restarting system.
    
    
    Bootloader Version: 10.1.05T310 (Mar 19 2015 - 16:39:59)TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Unable to read IO Expander 27 Register 1
    ioexp_read fail
    Error while reading Base MAC from EEPROM
    
    
    
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Unable to read CPLD revision
    Model ID: 1.0.0.1.1.1
    
     I2C Dev 0x20, Register 06 Initial FailTWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    
     I2C Dev 0x20, Register 07 Initial Fail
     I2C Dev 0x24, Register 06 Initial FailTWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    
     I2C Dev 0x24, Register 07 Initial Fail
     I2C Dev 0x20, Register 02 Initial FailTWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    
     I2C Dev 0x20, Register 03 Initial Fail
     I2C Dev 0x24, Register 02 Initial FailTWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    
     I2C Dev 0x24, Register 03 Initial Fail
    FAIL!
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Read hw monitor register value fail
    Unable to configure hw monitor
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Read hw monitor register value fail
    Unable to configure hw monitor
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Read hw monitor register value fail
    Unable to configure hw monitor
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Read hw monitor register value fail
    Unable to configure hw monitor
    TWSI: mvTwsiRead: 940: mvTwsiStopBitSet fail
    Read hw monitor register value fail
    Unable to configure hw monitor
    Unable to select to bank 0 of HWM
    mvEgigaEnvMacGet: Wrong MAC (<NULL>).
    mvEgigaLoad: mvEgigaEnvMacGet failed.
    mv_eth_init: mvEgigaLoad() failed.
    No ethernet found.
    Enter 'b' to stop at boot monitor:  0
    bootdelay: ===
    Booting image from Primary
    ## Booting image at 00007fc0 ...
       Created:      2015-04-22  22:31:19 UTC
       Data Size:    8393876 Bytes =  8 MB
       Load Address: 00008000
       Entry Point:  00008000
       Verifying Checksum ... OK
    OK
    
    Starting kernel in BE mode ...
    Uncompressing Image................................................................................................................................................................................................................................................................................................................................................................. done, booting the kernel.
    Config partition mounted.
    Creating TUN device
    Starting the FastIron.
    Error: I2C access failed for device 0x27, command -1071879421, I2C code = 0x1, SIM Code = 14, TWSI Sts = 0xf8
    Retrying read of extended board-id, retry count: 1
    Error: I2C access failed for device 0x27, command -1071879421, I2C code = 0x1, SIM Code = 14, TWSI Sts = 0xf8
    Retrying read of extended board-id, retry count: 2
    Error: I2C access failed for device 0x27, command -1071879421, I2C code = 0x1, SIM Code = 14, TWSI Sts = 0xf8
    Retrying read of extended board-id, retry count: 3
    Error: I2C access failed for device 0x27, command -1071879421, I2C code = 0x1, SIM Code = 14, TWSI Sts = 0xf8
    Retrying read of extended board-id, retry count: 4
    Error: I2C access failed for device 0x27, command -1071879421, I2C code = 0x1, SIM Code = 14, TWSI Sts = 0xf8
    Retrying read of extended board-id, retry count: 5
    
    I'm unable to interrupt the boot process and not sure if there is anything else I can try before writing this one off. Anyone seen this before?
     
    #510
  11. fohdeesha

    fohdeesha Kaini Industries

    Joined:
    Nov 20, 2016
    Messages:
    1,228
    Likes Received:
    987
    looks like you fried something on the i2c bus and it took the whole bus out, pretty much a write off

    There's a 1% chance it's a short or damage on the LED/reset daughterboard (it has a couple i2c multiplexers), you can try unplugging it from the mainboard and booting again. this board: https://i.imgur.com/W31ceGX.jpg

    I really doubt that's where the damage is (unless that's where you were poking around), but worth a try before throwing it away
     
    #511
  12. jmacsob

    jmacsob New Member

    Joined:
    Mar 18, 2017
    Messages:
    5
    Likes Received:
    0
    Thanks, yeah I wasn't anywhere near the daughterboard. I thought I had shorted the fan pins on the empty fan header but, it's possible I may have accidentally touched something else.
     
    #512
  13. BackupProphet

    BackupProphet Well-Known Member

    Joined:
    Jul 2, 2014
    Messages:
    783
    Likes Received:
    278
    Is it possible to update the SSH server? It is using an old algorithm so I have to connect with ssh -oKexAlgorithms=+diffie-hellman-group1-sha1
     
    #513
  14. Dawg10

    Dawg10 Associate

    Joined:
    Dec 24, 2016
    Messages:
    195
    Likes Received:
    90
    Thankyou guru @fohdeesha . The 6610 and 6450 are fully functional and ready to add to the rack.


    ICXa.jpg
     
    #514
    fohdeesha likes this.
  15. arglebargle

    arglebargle H̸̖̅ȩ̸̐l̷̦͋l̴̰̈ỏ̶̱ ̸̢͋W̵͖̌ò̴͚r̴͇̀l̵̼͗d̷͕̈

    Joined:
    Jul 15, 2018
    Messages:
    634
    Likes Received:
    203
    Kind of an off the wall question here: Can the icx6xxx series handle per-vlan MTU without any major disruption? I don't actually need it but I'd like the option to chuck storage packets around at 9k MTU and traditional traffic at 1500. I think I googled this last week and the answer wasn't completely clear.

    I'm going to play around with my switches today and I'll probably have a chance to test this out but if anyone can confirm for me that'd be great too.
     
    #515
  16. BackupProphet

    BackupProphet Well-Known Member

    Joined:
    Jul 2, 2014
    Messages:
    783
    Likes Received:
    278
    I would just keep MTU at 1500, you get lower latency which is much more important than throughput.
     
    #516
  17. arglebargle

    arglebargle H̸̖̅ȩ̸̐l̷̦͋l̴̰̈ỏ̶̱ ̸̢͋W̵͖̌ò̴͚r̴͇̀l̵̼͗d̷͕̈

    Joined:
    Jul 15, 2018
    Messages:
    634
    Likes Received:
    203
    Yeah, I've actually run tests with MTU set at 9000 vs 1500 and iperf/smb throughput was about 3x faster at the non-Jumbo size. I'm more curious if it's possible than anything else.
     
    #517
  18. fohdeesha

    fohdeesha Kaini Industries

    Joined:
    Nov 20, 2016
    Messages:
    1,228
    Likes Received:
    987

    yup no problem, however obviously if something from the storage network needs to get routed to another vlan with default MTU, and the devices don't properly support PMTU discovery (which is surprisingly a lot of stuff) it's going to have to be fragmented, which is bad news

    look on page 46 of fastiron-08030mb-l3guide.pdf for details. You would just run the MTU command on the VE interface for each vlan instead of the physical port. If the storage vlan doesn't have a VE (eg no routing) just run it on the ports for storage stuff

    fragmentation is disabled by default (it will drop packets that would otherwise require fragmentation, because it's so slow). If you want it to fragment packets between VLAN's when the host doesn't support PMTUD and is trying to send 9k packets to a 1.5k vlan, you need to run "mtu-exceed forward global"
     
    #518
    Last edited: Sep 2, 2018
    arglebargle likes this.
  19. arglebargle

    arglebargle H̸̖̅ȩ̸̐l̷̦͋l̴̰̈ỏ̶̱ ̸̢͋W̵͖̌ò̴͚r̴͇̀l̵̼͗d̷͕̈

    Joined:
    Jul 15, 2018
    Messages:
    634
    Likes Received:
    203
    Awesome, that was exactly what I was looking for. Thanks!
     
    #519
    Emanuele and fohdeesha like this.
  20. miked1

    miked1 New Member

    Joined:
    Mar 15, 2017
    Messages:
    5
    Likes Received:
    0
    Do the ears of a 6450-48P (or a -24P) allow for vertically wall mounting the switch?
     
    #520
Similar Threads: Brocade Series
Forum Title Date
Networking Guest VLAN on Brocade 6450 Jul 18, 2019
Networking Has anyone got a Mellanox ConnectX-5 100G card connected to a Brocade ICX 40G QSFP to QSFP? Apr 5, 2019
Networking [Solved] Brocade ICX6610-48P PoE Errors Apr 2, 2019
Networking Anyone done a Brocade 6610 fan mod? Apr 1, 2019
Networking Brocade 6650 Mar 9, 2019

Share This Page