Quanta LB6M (10GbE) -- Discussion

djbon2112

New Member
Nov 24, 2013
28
10
3
34
Burlington, ON, CANADA
www.boniface.me
Has anyone figured out how/if PVLAN is supported on the LB6M? Going through the LB4M manual there doesn't seem to be anything obvious, though knowing this switch I'm sure it's there just under some weird name.

Edit: And I check and the manual has been found! You guys rock! Hopefully there's something useful in there.
 

cypher526

New Member
Mar 1, 2017
2
1
3
41
Has anyone had issues with ports not reconnecting after the LB6M and/or servers lose power? It's only happened a few times but when I lose power it seems I have to reboot the switch then either reboot attached machines or disable/re-enable the NICs to get them to reconnect. I'm using Mellanox ConnectX-2 NICs and running Windows 10 on desktop and Debian 8.9 on servers. Also running jumbo packets.

Any ideas?
 
Last edited:

hien

New Member
Sep 23, 2017
8
0
1
42
Has anyone tried inter-vlan routing on LB6M? The vlan interface always stuck at 10M Half that make inter-vlan traffic only 10Mbps.
I can not find anywhere in CLI that can change interface vlan speed. Any help?

Code:
# show port all

                  Admin    Physical   Physical   Link   Link    LACP   Actor
 Intf      Type   Mode     Mode       Status     Status Trap    Mode   Timeout
--------- ------ --------- ---------- ---------- ------ ------- ------ --------
1/63             Enable                          Down   Disable N/A    N/A
1/64             Enable                          Down   Disable N/A    N/A
2/1              Enable    10 Half    10 Half    Up     Enable  Enable N/A
2/2              Enable    10 Half    10 Half    Up     Enable  Enable N/A
2/3              Enable    10 Half    10 Half    Up     Enable  Enable N/A
2/4              Enable    10 Half    10 Half    Up     Enable  Enable N/A
2/5              Enable    10 Half    10 Half    Up     Enable  Enable N/A



----


(FASTPATH Routing) #show ip interface 2/4

Routing Interface Status....................... Down
Method......................................... None
Routing Mode................................... Enable
Administrative Mode............................ Enable
Forward Net Directed Broadcasts................ Disable
Proxy ARP...................................... Enable
Local Proxy ARP................................ Disable
Active State................................... Active
Link Speed Data Rate........................... 10 Half
MAC address.................................... 08:9E:01:72:EC:EF
Encapsulation Type............................. Ethernet
IP MTU......................................... 9198
Bandwidth...................................... 10000 kbps
Destination Unreachables....................... Enabled
ICMP Redirects................................. Enabled
 

Marek J

New Member
Nov 24, 2016
16
2
3
49
Hello guys,

Have you got the successful cooperation of the LB6M to get working in with the Hyper-V vmSwitch VLANs please?
My config and the initial test:
Two servers (I name them from now S1 and S2).
Two quantas (from now, I name them Q1 and Q2) connected by LCAP (it works with VLANs by 4 SFP+ without hassle, at least this is OK).
The ports of Quantas, I will name lie Q1P1, Q1P2 etc.
Each server has 4 adapters, (I will name them from now S1L1, S2L2 etc)
Adapter are connected as bellow:
S1L1 to Q1P1,
S1L2 to Q1P2
S1L3 to Q2P1
S1L4 to Q2P2

S2L1 to Q1P7
S2L2 to Q1P8
S2L3 to Q2P7
S3L4 to Q2P8
That means, if one of Qantas shutdown, still servers can talk each other.

For the test purposes, I forget about Quanta Q2 and shutdown the switch.
I don't create any teaming on L1-L4 adapters.
I disable all ports except Q1P1 and Q1P7.
Then servers can talk each other on single ports S1L1 on Q1P1 to S2L1 on Q1P7.

I create simple external vmswitch on each server and name it S1VMS1 basis on single adapter S1L1.
The same S2VMS2 from S2L1. All in managementOS.
Then create virtual ethernet adapters. S1VL1 attached to S1VMS1.
S2VL1 attached to S2VMS1.
All in manaegementOS.

Set IP address on S1VL1 =10.0.0.99/24
S2VL2 10.0.0.199/24
Until now, everything works. I can ping each other IPs from S1 and S2.
Then I want VLAN=99.

The short comment. I can say, if I take a simple S1L1 and simple S2L1, just allocate VLAN=99 on them - no hassle, I can ping both interfaces from S1 and S2 Hyper-Vs with VLAN configuration on Q1P1 and Q1P7.
This is fine. But I need those unlucky VMswitches :)

Then I set VLAN on vethernets S1VL1 and S2VL2 let's say VLAN=99.

From now, I have stairs with VMSwitches.
I try -access -vlanid 99 on S1VL1 and S2VL1.
Then -trunk -allowlist 99 -native 99 - I just simplify commands.

On Q1P1 and Q1P7 I am not sure what I need to do then.
I have been trying to addport 1/1 (I will name it Q1A1/1) to both of them, then I have been trying to addport 1/1 to Q1P1 then addport 1/2 (it is Q1A1/2) to O1P7.
Of course to have a port-channel : no port-channel static, vlan participation include 99, vlan pvid 99.
I have been trying all combinations with vlan acceptframes.
I have been trying to add vlan participation to Q1P1 and Q1P7 as well. And without it as well.

OK. Then the question. How is the proper way to get it work please?

Questions:
do I have to do separate trunks on each ports even it is on the same Quanta?
Or shall I group it in one addport?
Shall I allocate VLAN on the phisical adapters (this is not recommended, if I have to use vethernet as I remember)?

My target is: to get teaming on S1L and S2L adapters (probably LCAP?, don't know yet, which one), connect teams to vmswitch, create vethernet with vlans, I guess in trunk.
I don't touch RDMA/iWarp :) etc. yet. But I want to do it. Chelsio are on the way ;) .

Sorry for questions, but it drives me nuts a little bit :)
I became the powershell guru just typing bunch of commands from left to right and right to left, which it's good probably :D but a little bit frustrating. Anyway, from now, I will never use GUI in HyperV to be happy from powershell.

Any help appreciated and welcome.

Cheers,
Marek
 

Marek J

New Member
Nov 24, 2016
16
2
3
49
I can answer myself for above :) (this is just first step passed).
The vEthernet on the vSwitch has to be setup as trunk.
And simple commands on Quanta:
vlan database
vlan 99

configure interface 0/1,0/7 vlan participation include 99, vlan tagging 99 and... bang!!! everything starts :)
 

LegenardaryStoner

New Member
Feb 25, 2017
7
0
1
Earth
50 pages worth of data in this thread. I have read through a lot of them so I apologize if this is been asked or addressed. In regards to the fan swaps that have been done or even using a fan controller. I was curious. On the stop fans is it documented what the db rating and cfm ratings are on those fans.
 

LegenardaryStoner

New Member
Feb 25, 2017
7
0
1
Earth
So I swapped out the 3 fans today.

Original fan specs
size 40x40x28
voltage 12
operating dc at 7v - 13.2
13000 rpm
cfm 23.8
45db
dual ball bearing


New Fans
Sunon 40x40x20mm 3 pin fan #KDE1204PKVX
Maglev technology
Air Flow: 10.2 CFM / Noise Level: 27 dBA.
Speed: 8,200 RPM
Power Input: 12V DC, 3pin with RPM Sensor
Link from Amazon
https://smile.amazon.com/gp/product/B006ODM76C/ref=oh_aui_detailpage_o02_s01?ie=UTF8&psc=1


It appears as either i disconnected a sensors some where or not having 4pin fans dont play to nice. Below is output showing nothing for anything basically

(FASTPATH Routing) #show environment

Temp (Celsius)................................. 0
Fan Speed, RPM................................. 2147483647
Fan Duty Level................................. 0%
Temperature traps range: 0 to 45 degrees (Celsius)

Temperature Sensors:
Unit Sensor Description Temp (Celsius) State
---- ------ ---------------- -------------- --------------
1 1 0 Normal

Fans:
Unit Fan Type Speed Duty level State
---- ------ ---------- -------- ---------- --------------
1 1 Fixed 2147483647 0% Operational
1 2 Fixed 2147483647 0% Operational
1 3 Fixed 2147483647 0% Operational

Power supplies:
Unit Power supply Type State
---- ------------ ---------- --------------
1 1 Removable Failed
1 2 Removable Failed


(FASTPATH Routing) #show environment

Temp (Celsius)................................. 0
Fan Speed, RPM................................. 2147483647
Fan Duty Level................................. 0%
Temperature traps range: 0 to 45 degrees (Celsius)

Temperature Sensors:
Unit Sensor Description Temp (Celsius) State
---- ------ ---------------- -------------- --------------
1 1 0 Normal

Fans:
Unit Fan Type Speed Duty level State
---- ------ ---------- -------- ---------- --------------
1 1 Fixed 2147483647 0% Operational
1 2 Fixed 2147483647 0% Operational
1 3 Fixed 2147483647 0% Operational

Power supplies:
Unit Power supply Type State
---- ------------ ---------- --------------
1 1 Removable Failed
1 2 Removable Failed
 

cyberjock

New Member
Jul 15, 2017
1
0
1
42
Hello everyone. I did some basic setup of my LB6M, but then got busy and it's been sitting plugged in with nothing attached to it for months. Today I hooked up my serial cable to it and found it is constantly rebooting itself. Here's what it says:

Select startup mode. If no selection is made within 5 seconds,
the FASTPATH Application will start automatically...

FASTPATH Startup -- Main Menu

1 - Start FASTPATH Application
2 - Display Utility Menu
Select (1, 2):
Extracting FASTPATH from .....warning: invalid STK header, assuming uimage
error: invalid uimage header
done
Loading FASTPATH .....tar: switchdrvr.tgz: No such file or directory
grep: /mnt/application/fastpath.vpd: No such file or directory
/mnt/application
done
/etc/rc.d/rc.fastpath: /etc/rc.d/rc.fastpath: 1410: /mnt/application/switchdrvr: not found
Starting pid 709, console /dev/ttyS0: '/etc/rc.d/rc.reboot'
syncing filesystems....This may take a few moments
umount: forced umount of /mnt/fastpath failed!
Rebooting system!
The system is going down NOW !!
Sending SIGTERM to all processes.
Terminated
/etc/rc.d/rc.fastpath: /etc/rc.d/rc.fastpath: 1: 1: not found
/mnt/application
FASTPATH not executed!
Press <ENTER> to continue...
Please stand by while rebooting the system.
Restarting system.


It'll boot up, and this will happen all over, over and over. I tried erasing the config file, but that didn't fix it. I'm really not sure where to proceed with this, so I'm hoping for some advice.

When I bought this months ago, it had the oldest version on it, then I upgraded it to the newest version, and had done several power cycles of the machine without issue. I never got the 10Gb ports to work, but I hadn't tried to use them either. It was one of the projects that was a low priority and "i'll get back to it next week" and then 5 months later I'm finally trying to get it setup.

Edit: I noticed this at the beginning of the boot sequence:

Please stand by while rebooting the system.
Restarting system.


U-Boot 2009.06 (Jun 23 2010 - 16:22:08)

CPU: 8541, Version: 1.1, (0x80720011)
Core: E500, Version: 2.0, (0x80200020)
Clock Configuration:
CPU0:825 MHz,
CCB:330 MHz,
DDR:165 MHz (330 MT/s data rate), LBC:41.250 MHz
CPM: 330 MHz
L1: D-cache 32 kB enabled
I-cache 32 kB enabled
I2C: ready
DRAM: Initializing
DDR: 512 MB
FLASH: 32 MB
L2: 256 KB enabled
*** Warning - bad CRC, using default environment

So I'm thinking I need to reload the u-boot environment as well as the 1.2.0.18 firmware. Anyone have any instructions on reloading both? I'm currently trying to do a boot from serial, and the file is uploading via xmodem. After that I can overwrite the firmware on image1 and image2. But I can't find anyone who has the steps for reloading the u-boot environment.
 
Last edited:

naga bonar

New Member
Nov 22, 2017
1
0
1
32
hy all, can anyone have try Quanta LB6M 24-10G with Cumulus OS ?
or this type of switch do not support Cumulus ??
 

SamCN2

New Member
Dec 4, 2017
2
0
1
60
Hi, and thanks for maintaining info in this thread. It's been very helpful!

So, has anyone tried to set the ports as a trunk to auto-participate in all VLANS?
With my 1G switches, they just pass the VLAN tags, and my ESXi hosts just do the right thing.

So, I tried that with the LB6M, and of course, no joy.
So I tried:

(FASTPATH Routing) #show run
!Current Configuration:
!
!System Description "Quanta LB6M, 1.2.0.14, Linux 2.6.21.7"
!System Software Version "1.2.0.14"
!System Up Time "3 days 14 hrs 10 mins 44 secs"
!Additional Packages FASTPATH QOS
!Current SNTP Synchronized Time: Not Synchronized
!
set gvrp adminmode
vlan database
exit
configure
spanning-tree configuration name "08-9E-01-70-CA-5A"
interface 0/20
no auto-negotiate
addport 1/1
exit
interface 0/21
no auto-negotiate
addport 1/1
exit
interface 0/22
no auto-negotiate
addport 1/1
exit
!
interface 0/1
set gvrp interfacemode
exit
interface 0/2
set gvrp interfacemode
exit
... on through 0/26
!
interface 1/1
set gvrp interfacemode
mtu 9000
vlan participation auto 1
exit
interface 1/2
set gvrp interfacemode
exit

... on through 1/64


I'd really like this switch to replace a SFP+ - SFP+ cable.

Cheers!
-sam
 

BLinux

cat lover server enthusiast
Jul 7, 2016
2,605
1,053
113
artofserver.com
hello LB6M owners...

i know earlier in this 50-page thread, there's mention that idle power consumption was around 120-130W. has anyone measured the power consumption after swapping out fans? just wondering how much of the 130W is from the 3x 9000RPM + 4x PSU fans?

also, for those who swapped out the fans for something quieter/less airflow, do you have any feedback after several months of running with less airflow? would you recommend going back to stock or trying to find higher CFM fans?
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,587
2,776
113
31
fohdeesha.com
I believe I've found a way to significantly upgrade the LB6M, but I may need a couple guinea pigs. As mentioned several pages back the Brocade TurboIron 24x is the same reference design. Brocade's documentation is top notch and super thorough, and they have firmware builds for that model as recent as last year. I have access to the firmware and will PM it to anyone who messages me and is willing to give it a go.

after a *lot* of googling I even found a post by someone on a russian forum saying they have been running their LB6M with brocade firmware and it works great, including enabling the broadcom chipsets pre-existing support for 1gbe SFP's on all ports, just as it does on the BigIron 24x.

here's a link to the datasheet, you can see some of the new stuff we'd get at the bottom: http://www.suntekpc.com/image/network-switch-xxx-brocade-turboiron-ti-24x-ac-data-sheet.pdf

highlights:
1gbe SFP support
well documented huge commandset with no limitations
BGP
properly working stp/rstp/mstp
QoS, traffic shaping/limiting/ACL etc
Q-in-Q tagging
tons of multicast features
SFlow with a config that doesn't disappear on reboot
huge and well documented/supported snmp MIB

It would almost be like getting a new switch. I'm 90% sure it's possible (especially after finding someone saying they've been running one), I think the big question is just whether it will require flashing the brocade bootloader via JTAG or not. EDIT: it does, the brocade FW is encrypted and requires the matching bootloader. The good news is brocade ships it as a separate file and with the right equipment can easily be flashed via JTAG. Will be doing this around new years unless something else pops up
 
Last edited:
  • Like
Reactions: fvanlint

fohdeesha

Kaini Industries
Nov 20, 2016
2,587
2,776
113
31
fohdeesha.com
here's some initial binwalk output: http://fohdeesha.com/data/other/binwalk.txt

I forgot that brocade seemingly encrypts most of their firmware, and there's no uImage header to be found, so it seems the brocade boot image definitely needs to be flashed. I'll be talking to a firmware engineer friend with JTAG equipment in the next few days to go further.

Is it possible to flash a new boot image from within the quanta OS? I know the brocade OS lets you do this. I'm not so much worried if it's possible to get this going via JTAG (I'm sure it is), but whether we can figure out an easy process for the rest of you to load it as well

My offer of providing the FW and bootloader still stands to anyone who wants to poke around
 
Last edited:
  • Like
Reactions: fvanlint

fohdeesha

Kaini Industries
Nov 20, 2016
2,587
2,776
113
31
fohdeesha.com
It seems the LB6M u-boot bootloader might have support to flash a new bootloader image from within it. Can someone verify the "copy -b" command exists in the bootloader? (not the OS) my LB6M is currently buried in a closet.

if that command exists, it may be as simple as
copy -b tftp://192.168.2.10/brocade_boot.bin

will provide the bootloader and fw to anyone brave enough to try it, if not I'll have to wait till i have a JTAG interface standing by to unbrick mine then I'll give it a go
 
  • Like
Reactions: fvanlint
No, doesn't look like "copy -b" exists. There exists a 'dd' command on the internal LVL7 debug, so it may be possible to just copy it to the flash device using 'dd if=xxx.img of=/dev/mtd0' or similar.

The flash looks like this:

Code:
LVL7 Systems, Inc.
# cat /proc/mtd
dev:    size   erasesize  name
mtd0: 01f80000 00020000 "jffs2"
mtd1: 00080000 00020000 "u-boot"
mtd2: 00020000 00020000 "u-boot-env"
# ls /mnt/fastpath/
debug_config         mfg-diags.tar.gz     slog2.txt
debug_config.md5sum  mfg_diags_log.bin    ssh_host_dsa_key
dh1024.pem           olog0.txt            ssh_host_key
dh512.pem            olog1.txt            ssh_host_rsa_key
fastpath.cfg         olog2.txt            sshd.pid
image1               slog0.txt            sslt.rnd
log2.bin             slog1.txt            startup-config
# mount
proc on /proc type proc (rw)
none on /sys type sysfs (rw)
/dev/mtdblock0 on /mnt/fastpath type jffs2 (rw)
tmpfs on /mnt/application type tmpfs (rw)
I'm not willing to flash mine, however. It is probably not reversible without a JTAG and serious Quanta LB6M internals knowledge.

It seems the LB6M u-boot bootloader might have support to flash a new bootloader image from within it. Can someone verify the "copy -b" command exists in the bootloader? (not the OS) my LB6M is currently buried in a closet.

if that command exists, it may be as simple as
copy -b tftp://192.168.2.10/brocade_boot.bin

will provide the bootloader and fw to anyone brave enough to try it, if not I'll have to wait till i have a JTAG interface standing by to unbrick mine then I'll give it a go
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,587
2,776
113
31
fohdeesha.com
in discord working on it with a couple firmware guys this minute, we're getting close. It's certainly possible using just bootloader commands. We're able to write the brocade bootloader to an arbitrary flash location of our choosing, now we're just sifting through the flash contents using md and disassembling it to find the proper first stage bootloader location. then it's as simple as writing the brocade bootloader to that location.

It should be roughly as easy once it's brocade to get it back to quanta by using the same commands and substituting the quanta boot image, although I have no clue why you'd want to when you'd have brand new full featured firmware
 
Last edited:
It looks like the first stage would be at 0x1f80000 after mtd0, if the sizes are related to flash offsets.

Notice the sizes of the partitions (the block size is in units of 512b):

Code:
mtd0: 01f80000 00020000 "jffs2"
mtd1: 00080000 00020000 "u-boot"
mtd2: 00020000 00020000 "u-boot-env"

# cat /sys/block/mtdblock*/size
64512
1024
256
The LB8 has a similar structure. The same image size, even though it is a different OS and the image partitions are formatted differently.

Code:
# cat /proc/mtd
dev:    size   erasesize  name
mtd0: 01f80000 00020000 "system image"
mtd1: 00020000 00020000 "uboot-env"
mtd2: 00060000 00020000 "uboot"
mtd3: 01c00000 00020000 "/var"
mtd4: 00400000 00020000 "/mnt/persist"

# cat /sys/block/mtdblock*/size
64512
256
768
57344
8192
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,587
2,776
113
31
fohdeesha.com
LOOOOOOOOOOOOOOL. docu to come soon. I can't believe it. everything works, all of it. all done from bootloader
ya'll just got one of these for free: http://www.suntekpc.com/image/network-switch-xxx-brocade-turboiron-ti-24x-ac-data-sheet.pdf

Code:
TX24 Router#show ver
  SW: Version 07.4.00pT203 Copyright (c) 1996-2012 Brocade Communications Systems, Inc. All rights reserved.
      Compiled on Mar 22 2016 at 03:35:33 labeled as TIR07400p
      (6850809 bytes) from Tftp TIR07400p.bin
      Compressed Boot-Monitor Image size = 369366, Version:07.3.00T205 (trz07300)
  HW: Stackable TurboIron-X24
==========================================================================
      Serial  #: ??LB6M
      P-ASIC  0: type B820, rev 11  subrev 00
==========================================================================
  825 MHz Power PC processor MPC8541E (version 8020/0020) 330 MHz bus
  512 KB boot flash memory
31744 KB code flash memory
  512 MB DRAM
The system uptime is 2 minutes 5 seconds
The system : started=cold start

TX24 Router#
 
Last edited: