Quanta LB6M (10GbE) -- Discussion
- Thread starter T_Minus
- Start date
Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.
Appreciate the advice, Aero, including a confirmation that the wall plate isn't right.
Thanks @qamaro! I should have done a comprehensive review of this thread first. FWIW I scanned through all 105 pages of the E5-2670 thread last weekend - I learned a lot but I also haven't quite recovered from the brain overload that resulted. I should be able to read full threads again soon
I don't need a router for the Gigabit internet connection from my power utility company I have. They drop fiber up to the electric board and from there its CAT6 to the closet. All my server equipment resides there. To all other nook and corner of the house its wireless or wireless ac (> 1 Gbps) bridge if the bandwidth is really required like to my htpc.
Below you can find a snippet of a lb6m running Indigo on 2.6.25-bcm-ntsw
I had tried all the ports and they seem to work but as you can seem there are som inconsistencies as port 1 is port 49 and port 9 is port 2, port 10 is port 3 ....
for those playing at home: (you need to have u-boot, if you don't update to it)
I uploaded the file here:
File-Upload.net - 00_firmware.zip
as it's too big to upload to the forum
I had tried all the ports and they seem to work but as you can seem there are som inconsistencies as port 1 is port 49 and port 9 is port 2, port 10 is port 3 ....
for those playing at home: (you need to have u-boot, if you don't update to it)
Code:
1.) stop uboot
2.)
setenv netmask switch_netmask
setenv ipaddr switch_ip
tftpboot 0x8000000 tftp_server:00_firmware
bootm 0x8000000File-Upload.net - 00_firmware.zip
as it's too big to upload to the forum
Code:
U-Boot 2009.06 (Apr 19 2011 - 15:57:06)
CPU: 8541, Version: 1.1, (0x80720011)
Core: E500, Version: 2.0, (0x80200020)
Clock Configuration:
CPU0:825 MHz,
CCB:330 MHz,
DDR:165 MHz (330 MT/s data rate), LBC:41.250 MHz
CPM: 330 MHz
L1: D-cache 32 kB enabled
I-cache 32 kB enabled
I2C: ready
DRAM: Initializing
Warning: some of the installed DIMMs can not operate this slowly.
DDR: 512 MB
FLASH: 32 MB
L2: 256 KB already enabled
Service port MAC address: C8:0A:A9:03:B6:6F
In: serial
Out: serial
Err: serial
Net: TSEC0: No support for PHY id bcb1; assuming generic
TSEC1: PHY is Broadcom BCM5482 (143bcb1)
TSEC0, TSEC1
Hit any key to stop autoboot: 0
=>
=>
=>
=> setenv netmask 255.255.255.0
=> setenv ipaddr 10.1.10.22
=> tftpboot 0x8000000 10.1.10.1:00_firmware
Speed: 1000, full duplex
Using TSEC0 device
TFTP from server 10.1.10.1; our IP address is 10.1.10.22
Filename '00_firmware'.
Load address: 0x8000000
Loading: #################################################################
#################################################################
#################################################################
#################################################################
#################################################################
#################################################################
#################################################################
#################################################################
#################################################################
#################################################################
#################################################################
#################################################################
#################################################################
#################################################################
#################################################################
#######################################################
done
Bytes transferred = 15115245 (e6a3ed hex)
=> bootm 0x8000000
## Booting kernel from Legacy Image at 08000000 ...
Image Name: FASTPATH System for lb4m
Image Type: PowerPC Linux Multi-File Image (gzip compressed)
Data Size: 15115181 Bytes = 14.4 MB
Load Address: 00000000
Entry Point: 00000000
Contents:
Image 0: 1382344 Bytes = 1.3 MB
Image 1: 13732825 Bytes = 13.1 MB
Verifying Checksum ... OK
## Loading init Ramdisk from multi component Legacy Image at 08000000 ...
Uncompressing Multi-File Image ... OK
Loading Ramdisk to 1ee4e000, end 1fb66bd9 ... OK
Loading Device Tree to 007fc000, end 007ffb63 ... OK
Using BCM98548XMC machine description
Memory CAM mapping: CAM0=256Mb, CAM1=256Mb, CAM2=0Mb residual: 0Mb
Linux version 2.6.25-bcm-ntsw (dtalayco@its1) (gcc version 4.2.2) #1 Sun Dec 4 23:31:02 PST 2011
Found initrd at 0xdee4e000:0xdfb66bd9
Found FSL PCI host bridge at 0x00000000e0008000. Firmware bus number: 0->0
Zone PFN ranges:
DMA 0 -> 131072
Normal 131072 -> 131072
Movable zone start PFN for each node
early_node_map[1] active PFN ranges
0: 0 -> 131072
Built 1 zonelists in Zone order, mobility grouping on. Total pages: 130048
Kernel command line: root=/dev/ram rw mtdparts=physmap-flash.0:32256k(jffs2),512k(u-boot),128k@32512k(u-boot-env)
mpic: Setting up MPIC " OpenPIC " version 1.2 at e0040000, max 1 CPUs
mpic: ISU size: 4, shift: 2, mask: 3
mpic: Initializing for 60 sources
PID hash table entries: 2048 (order: 11, 8192 bytes)
clocksource: timebase mult[60f83e1] shift[22] registered
Dentry cache hash table entries: 65536 (order: 6, 262144 bytes)
Inode-cache hash table entries: 32768 (order: 5, 131072 bytes)
Memory: 502912k/524288k available (2700k kernel code, 20848k reserved, 100k data, 93k bss, 144k init)
SLUB: Genslabs=12, HWalign=32, Order=0-1, MinObjects=4, CPUs=1, Nodes=1
Mount-cache hash table entries: 512
net_namespace: 152 bytes
NET: Registered protocol family 16
rstcr compatible register does not exist!
PCI: Probing PCI hardware
NET: Registered protocol family 2
IP route cache hash table entries: 16384 (order: 4, 65536 bytes)
TCP established hash table entries: 65536 (order: 7, 524288 bytes)
TCP bind hash table entries: 65536 (order: 6, 262144 bytes)
TCP: Hash tables configured (established 65536 bind 65536)
TCP reno registered
checking if image is initramfs... it is
Freeing initrd memory: 13410k freed
io scheduler noop registered
io scheduler anticipatory registered (default)
io scheduler deadline registered
io scheduler cfq registered
Generic RTC Driver v1.07
Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing enabled
serial8250.0: ttyS0 at MMIO 0xe0004500 (irq = 26) is a 16550A
console [ttyS0] enabled
serial8250.0: ttyS1 at MMIO 0xe0004600 (irq = 26) is a 16550A
brd: module loaded
loop: module loaded
Gianfar MII Bus: probed
eth0: Gianfar Ethernet Controller Version 1.2, c8:0a:a9:03:b6:6f
eth0: Running with NAPI enabled
eth0: 256/256 RX/TX BD ring size
eth1: Gianfar Ethernet Controller Version 1.2, 00:e0:0c:00:01:fd
eth1: Running with NAPI enabled
eth1: 256/256 RX/TX BD ring size
tun: Universal TUN/TAP device driver, 1.6
tun: (C) 1999-2004 Max Krasnyansky <maxk@qualcomm.com>
MPC98548XMC Boot flash (128 MiB at f8000000)
MPC98548XMC PLCC boot flash (128 MiB at f0000000)
TCP cubic registered
Initializing XFRM netlink socket
NET: Registered protocol family 1
NET: Registered protocol family 17
RPC: Registered udp transport module.
RPC: Registered tcp transport module.
drivers/rtc/hctosys.c: unable to open rtc device (rtc0)
Freeing unused kernel memory: 144k init
Running rc.sh
Bringing up local devices
Platform: LB6M. Vendor: Quanta
Running /etc/system_init
Installing user-linux_kernel_bde: module license 'Proprietary' taints kernel.
kernel communication drivers
Welcome to Indigo
2012.03.19-iods: User mode. T2-ref.
indigo-unknown# device tap0 entered promiscuous mode
indigo-unknown# uname -a
Linux indigo-unknown 2.6.25-bcm-ntsw #1 Sun Dec 4 23:31:02 PST 2011 ppc GNU/LinuxSeems there is a forum limit for 10000 letters/post so here is my second post ( as it did not fit in the first). As you can see there is ssh and web access for it and it works. This is just temporary as it does not modify any file on your switch, but don't come after me if all hell breaks loose and you break your switch. So you had been warned. When you reboot your switch it will go to your old fastpath application.
At this moment I don't plan to make an uploadable image, but if the request is high I might do that as well.
Now if anyone understands openflow's rc.soc please let me know as I think we might fix the port issues but I am not in a hurry to understand rc.soc. I have tried the one inside switchdrvr but it seems switchdrvr does more that just using this file to boot up it's internal (or infernal) openflow. For now just have fun with this.
At this moment I don't plan to make an uploadable image, but if the request is high I might do that as well.
Now if anyone understands openflow's rc.soc please let me know as I think we might fix the port issues but I am not in a hurry to understand rc.soc. I have tried the one inside switchdrvr but it seems switchdrvr does more that just using this file to boot up it's internal (or infernal) openflow. For now just have fun with this.
Code:
indigo-unknown# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 16436 qdisc noqueue
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
2: eth0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop qlen 1000
link/ether c8:0a:a9:03:b6:6f brd ff:ff:ff:ff:ff:ff
3: eth1: <BROADCAST,MULTICAST> mtu 1500 qdisc noop qlen 1000
link/ether 00:e0:0c:00:01:fd brd ff:ff:ff:ff:ff:ff
4: tap0: <BROADCAST,MULTICAST,UP,LOWER_UP100> mtu 1500 qdisc pfifo_fast qlen 500
link/ether 00:26:e1:e8:86:00 brd ff:ff:ff:ff:ff:ff
indigo-unknown# cli
Welcome to the Switch CLI
Firmware version:
2012.03.19-iods: User mode. T2-ref.
SwitchCLI# ps
Port Show. * = Link up; D = Disabled
Port Link Speed MTU TXPause RXPause Dplx
ERROR: Status nil, operation did not complete.
No port entries returned for 1
ERROR: Status nil, operation did not complete.
No port entries returned for 2
ERROR: Status nil, operation did not complete.
No port entries returned for 3
ERROR: Status nil, operation did not complete.
No port entries returned for 4
ERROR: Status nil, operation did not complete.
No port entries returned for 5
ERROR: Status nil, operation did not complete.
No port entries returned for 6
ERROR: Status nil, operation did not complete.
No port entries returned for 7
ERROR: Status nil, operation did not complete.
No port entries returned for 8
9 * 10000 16356 1 1 1
10 10000 16356 1 1 1
11 10000 16356 1 1 1
12 10000 16356 1 1 1
13 10000 16356 1 1 1
14 10000 16356 1 1 1
15 10000 16356 1 1 1
16 10000 16356 1 1 1
ERROR: Status nil, operation did not complete.
No port entries returned for 17
ERROR: Status nil, operation did not complete.
No port entries returned for 18
ERROR: Status nil, operation did not complete.
No port entries returned for 19
ERROR: Status nil, operation did not complete.
No port entries returned for 20
21 10000 16356 1 1 1
22 10000 16356 1 1 1
23 10000 16356 1 1 1
24 10000 16356 1 1 1
25 10000 16356 1 1 1
26 10000 16356 1 1 1
27 10000 16356 1 1 1
28 10000 16356 1 1 1
ERROR: Status nil, operation did not complete.
No port entries returned for 29
ERROR: Status nil, operation did not complete.
No port entries returned for 30
ERROR: Status nil, operation did not complete.
No port entries returned for 31
ERROR: Status nil, operation did not complete.
No port entries returned for 32
33 * 10000 16356 1 1 1
34 10000 16356 1 1 1
35 10000 16356 1 1 1
36 10000 16356 1 1 1
37 10000 16356 1 1 1
38 10000 16356 1 1 1
39 10000 16356 1 1 1
40 1000 1518 1 1 1
ERROR: Status nil, operation did not complete.
No port entries returned for 41
ERROR: Status nil, operation did not complete.
No port entries returned for 42
ERROR: Status nil, operation did not complete.
No port entries returned for 43
ERROR: Status nil, operation did not complete.
No port entries returned for 44
ERROR: Status nil, operation did not complete.
No port entries returned for 45
ERROR: Status nil, operation did not complete.
No port entries returned for 46
ERROR: Status nil, operation did not complete.
No port entries returned for 47
ERROR: Status nil, operation did not complete.
No port entries returned for 48
49 10000 16356 1 1 1
50 1000 1518 1 1 1
51 1000 1518 1 1 1
52 1000 1518 1 1 1
ERROR: Status nil, operation did not complete.
No port entries returned for 53
SwitchCLI# quit
Bye
indigo-unknown# cat /proc/partitions
major minor #blocks name
1 0 32768 ram0
1 1 32768 ram1
1 2 32768 ram2
1 3 32768 ram3
1 4 32768 ram4
1 5 32768 ram5
1 6 32768 ram6
1 7 32768 ram7
1 8 32768 ram8
1 9 32768 ram9
1 10 32768 ram10
1 11 32768 ram11
1 12 32768 ram12
1 13 32768 ram13
1 14 32768 ram14
1 15 32768 ram15
indigo-unknown# mount
rootfs on / type rootfs (rw)
proc on /proc type proc (rw)
devpts on /dev/pts type devpts (rw,mode=600)
indigo-unknown# df -h
Filesystem Size Used Available Use% Mounted on
indigo-unknown# netstat -tan
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address Foreign Address State
tcp 0 0 0.0.0.0:6633 0.0.0.0:* LISTEN
tcp 0 0 0.0.0.0:80 0.0.0.0:* LISTEN
tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN
tcp 0 0 0.0.0.0:23 0.0.0.0:* LISTEN
tcp 0 0 0.0.0.0:8088 0.0.0.0:* LISTEN
netstat: /proc/net/tcp6: No such file or directory
indigo-unknown# ls -la /proc/config.gz
-r--r--r-- 1 root root 6391 Jan 1 00:04 /proc/config.gz
indigo-unknown# ifconfig eth0 10.1.10.22 netmask 255.255.255.0
indigo-unknown# ping 10.1.10.1
PING 10.1.10.1 (10.1.10.1): 56 data bytes
PHY: e0024520:01 - Link is Up - 1000/Full
64 bytes from 10.1.10.1: seq=4 ttl=64 time=2.051 ms
64 bytes from 10.1.10.1: seq=5 ttl=64 time=0.392 ms
64 bytes from 10.1.10.1: seq=6 ttl=64 time=0.382 ms
64 bytes from 10.1.10.1: seq=7 ttl=64 time=0.430 ms
Last edited:
Here is a good deal on this switch a NATEX.us....
Quanta LB6M 10GB 24-Port SFP+ Switch with 2 x SFP+ transceiver modules
The LB6M is priced at $298 .... I am really considering this as I currently need a minimal of eight spf+ ports in a switch. I suspect this is the best deal available. However, I am concerned about the CLI only as I sometimes struggle with my EdgeRouter. Any advice? I would only need to place a few ports into a different VLAN as I am setting up a 4 node ceph cluster.
Thanks!
Quanta LB6M 10GB 24-Port SFP+ Switch with 2 x SFP+ transceiver modules
The LB6M is priced at $298 .... I am really considering this as I currently need a minimal of eight spf+ ports in a switch. I suspect this is the best deal available. However, I am concerned about the CLI only as I sometimes struggle with my EdgeRouter. Any advice? I would only need to place a few ports into a different VLAN as I am setting up a 4 node ceph cluster.
Thanks!
Thank you for the encouraging response! I put in my order...
Now I just have to wait for it to arrive, woot!
ya win some, lose some.
I did score another Dell Perc H310 today. Seller accepted $40.00 with free shipping. Best deal I've gotten on one of these.
DELL 3P0R3 RAID CONTROLLER PERC H310 6GB/S RAID CONTROLLER ADAPTER
I did score another Dell Perc H310 today. Seller accepted $40.00 with free shipping. Best deal I've gotten on one of these.
DELL 3P0R3 RAID CONTROLLER PERC H310 6GB/S RAID CONTROLLER ADAPTER
Has anyone had any luck with 1G copper SFPs in the SFP+ slots? I have tried Finisar FCLF-8521-3, eNet GLC-T-ENC, and Mikrotik S-RJ01, but none of them are working.
Admin Physical Physical Link Link LACP Actor
Intf Type Mode Mode Status Status Trap Mode Timeout
--------- ------ --------- ---------- ---------- ------ ------- ------ --------
0/8 Enable 10G Full Down Enable Enable long
Interestingly I never see any Phy mode other than 10G Full. And the usual Brocade "speed-duplex 1000-full" command is not allowed in interface.
"interface speed" only lists 10 and 100, and those are not valid modes for the 10G ports.
I have some 10G DAC cables that are working fine. But I have some older gear as well I'd like to connect at 1G.
Edit: Went back and re-read the entire thread. Looks like nobody else has gotten this working either.
Admin Physical Physical Link Link LACP Actor
Intf Type Mode Mode Status Status Trap Mode Timeout
--------- ------ --------- ---------- ---------- ------ ------- ------ --------
0/8 Enable 10G Full Down Enable Enable long
Interestingly I never see any Phy mode other than 10G Full. And the usual Brocade "speed-duplex 1000-full" command is not allowed in interface.
"interface speed" only lists 10 and 100, and those are not valid modes for the 10G ports.
I have some 10G DAC cables that are working fine. But I have some older gear as well I'd like to connect at 1G.
Edit: Went back and re-read the entire thread. Looks like nobody else has gotten this working either.
Yeah pretty much if you have more than 4x 1Gbe connections you need a second switch.
I've used it with all 4 1Gbe ports LACP to a 24 port 1Gbe switch and I have used a mikrotik CRS226-24g-2s+RM connected via a 0.5m DAC.
Yup. dwright1542 has said multiple times that they have an optical SFP transceiver working but has yet to verify the P/N. Another person thought they had one working but recanted. Everyone else who has tried one or several has reported failure.
And in my experience trying to get a 10GbE transceiver to link with a 1GbE transceiver on the other end doesn't work either, tho I've misplaced the 1GbE transceiver now and can't say what the P/N was.
I'd have liked to use some 1GbE RJ-45 SPFs to eliminate wasting an LB4M for IPMI traffic... but I think I'm just going to swap the LB4M for an old Netgear L2 switch that only draws 15W and call it a day.