Quanta LB6M (10GbE) -- Discussion

[StammesOpfer]

So any prizes for having the oldest boot image? Just got mine up and running ver. 1.0.0.10. Has anyone figured out or looked into what the differences are between versions? If someone is interested in it here is the link to what I have pulled together and mine. LB6M

(FASTPATH Routing) #show bootvar

Image Descriptions

image1 : default image
image2 :


Images currently available on Flash

--------------------------------------------------------------------
unit      image1      image2     current-active        next-active
--------------------------------------------------------------------

    1    1.0.0.10      <none>             image1             image1

(FASTPATH Routing) #show sysinfo

System Description............................. Quanta LB6M, 1.0.0.10, Linux
                                                2.6.21.7
System Name....................................
System Location................................
System Contact.................................
System Object ID............................... 1.3.6.1.4.1.4413
System Up Time................................. 0 days 0 hrs 12 mins 32 secs
Current SNTP Synchronized Time................. Not Synchronized

 

[Sleyk]

Hello All,

Great info here.

I picked up one of these monsters on ebay for about $400. I was reading through the thread and I was able to follow the simple commands to set a static address to the switch through the regular gigabit network ports. I do have a Direct attached cable coming from my pc to the switch from a mellanox card too. I read the manual, but it seems alot of the commands are not compatible with the LB6M?

I have a great working knowledge of computers from reading alot, but I am completely new to the forum and CLI as well, I actually need alittle help, but I thought I would make my first post adding a bit of info i gathered in the thread (thanks to most of you guy's knowledge and posts) in an attempt to be a little helpful first to anyone needing a little help coming after me, this is of course not for experienced ones. I wanted to post this at least, before I start begging for you guy's help! ;.)

These are some of the commands pulled from the thread and the manual that seems to work. Perhaps better minds and more knowledgeable people can make a document or something with a complete shortlist of working commands that they know of that work for this beast.
Experienced ones: Please feel free to correct and edit. I am, for all intents and purposes, a brand spanking, shiny ass, green under the collar, noob.

For a simple setup to connect by ssh:

use a simple cisco console cable and connect on the serial port (I use a console cable rj45 to serial, then attach the serial end of the cable to a serial to usb adapter, then plug into my usb port in my pc, works great) - use a terminal program like termite 3.2 (Its simple and works well)

Settings for the terminal program are: 9600, 8, 1, N, N, or something to that effect. Most of the settings are not important, but make sure you set the baud rate to 9600, or i think it won't connect.

once switch is on and booted press any key, the user prompt pops up.

type: admin

then switch asks for password, leave blank, press enter.

a prompt that says "fastpath routing" pops up.

type: enable (this simple command, allows you to start to config items in the switch, if you don't enter this here, you can't access the lower level settings)

it will ask for password again. leave blank, press enter

then type: show network

it will then show the network parameters for the management of the switch. most of them should be blank or a set of zeros. here is where we wanna set the ip address for the switch so it can connect through ssh.

ok, so type: network protocol none (i believe this turns off dhcp, so the switch can take a static ip address)

then type: network parms followed by a space and then each of the following items followed by a space (static ip address you wanna set) (subnet mask, usually 255.255.255.0) (default gateway of your network, usually in the order of 192.168.x.0 or 192.168.x.1)

(example: network parms 192.168.0.10 255.255.255.0 192.168.0.1)

then type: show network

you should then see your newly added static ip settings.

now type: ip ssh server enable (this i believe activates the ssh server)

then type: no ip telnet server enable (this i think, allows telnet to be on if no ip address is set?)

then to save, type: write memory

it will ask you if you wanna save the config file, type "Y" i believe. then it will save your config. This new config i believe now boots to the switch everytime you bootup.

Finally, open up putty, or your favorite ssh terminal in windows (i like Winscp as well) and type in your static ip address and leave the port set at 22. it should then prompt you for the username. type admin and leave password blank. You should then see the "fastpath routing" prompt!

I like ssh over serial terminal because ssh windows/sessions are easier to scroll through for me, also, it allows me to just connect to the switch to configure things without needing a console cable. (ironic, since the console cable was needed at first)

Also, if you wanna reset all config settings, and start over, djflow195's 4 steps work great:

1) Hook up a serial cable to the RJ45 console port (Cisco console cable works)
2) Open a serial console 9600-8N1 no flow control
2) Power cycle the switch
3) When prompted, go into the boot menu (not the UBoot menu)
4) Restore factory defaults (which erases the config files)

Alternatively, I personally found out that you can clear the configuration and set to factory defaults by typing: "clear" after you type the enable prompt:

1) Login (SSH or Telnet)
2) Type: enable
3) If you set a password, enter it, if not, leave blank, press enter
4) Type: clear
5) Prompt will ask if you wanna clear settings to defaults or something similar, type "y" press enter.
6) Switch will clear config and your off to the races.
7) Logout/Quit/Exit your ssh/telnet session.

Also, here is itguy82's steps to change the admin password (I added a little bit to it to make it alittle easier to understand):

1) Login (SSH or Telnet)
2) Type: enable (press enter, when ask for password if one is set, enter it, if not set, leave blank, press enter)
3) Type: configure (I think typing "config" also works) (press enter, if ask for password if one is set, enter it, if not, leave blank, press enter)
4) Type: username admin password [type desired password here, no brackets]
5) Press enter. New password should be entered.
6) Type: exit
7) Type: write memory (Always remember to do this, if not upon reboot, you will lose all unsaved settings)
7) Type "Y" then save is complete.
8)Logout/Quit/Exit your ssh/telnet session.

This is just to save/change the password for the admin account. This is not be confused with the "Enable" password access. That password is changed elsewhere, but i kinda recommend leaving the "Enable" access password blank for now.

(NOTE: Always remember to type "write memory" after all config changes to save settings)

Added/Updated: 03/30/16:

Piglover posted the commands to enable Jumbo Frames across all interfaces a little further down the thread. Saw it fit to post it here as well, and I spiced it up abit! Thanks for the help guys!

Enable Jumbo Frames across all Interfaces:

1) Login (SSH or Telnet)
2) Type: enable (press enter, when ask for password if one is set, enter it, if not set, leave blank, press enter)
3) Type: configure (I think typing "config" also works) (press enter, if ask for password if one is set, enter it, if not, leave blank, press enter)
4) Type: interface 0/1-0/28
5) Type: mtu 9216 (This is the maximum amount you can put on an interface I believe. This particular number is used, so that even if varying jumbo frame numbers are set across different interfaces in different pc's/servers, (ex. 9000, 9014, 9028, etc...)the interface will be able to handle it as 9216 is obviously higher.
6) Type: exit
7)Type exit (yes, again)
8) Finally Type: copy system:running-config nvram:startup-config (I believe this command is the same as "write memory", but i think this might be more of a complete configuration save? Use whatever you like I suppose.
9) Type: exit
10) Logout/Quit/Exit your ssh/telnet session.

Also, a great help for me, when i am looking to see what commands are compatible, I type "?" (no quotations) and it pops up a list of commands compatible with the switch.

Credit to all you smart people who helped contribute to this info. To all I say Thanks!
Will keep updating and editing this post with added info i find whenever i can.

Lets continue to share the knowledge.

 

[Fritz]

Pardon my ignorance but why is SSH preferred over telnet?

 

[T_Minus]

Telnet is plain text / not secure while SSH is encrypted.

SSH aka "Secure Shell"

 

[Sleyk]

Hey Fritz,

well its not that SSH is universally preferred over telnet of course, but I think it is abit simpler and safer. For me, I guess I am a bit more used to SSH than Telnet? I use SSH to connect to my server, to configure pfsense, and just about most of my networking needs. Telnet sure does have its use though. It saved my butt on one occasion long ago when i was screwing around with DDWRT on my old netgear WNDR3700. I was able to restore the firmware I bricked up.

Tminus, you make an excellent point about SSH being more secure too!

 

[Sleyk]

Ok, so I got as far as setting up SSH on the switch. Now, I begin the pleas for help...

So I connect a ethernet cable to one of the switched 1gigabit network ports (port 25)this cable is coming straight from my pfsense box. I made sure to disable the 1gigabit ethernet port on my pc. I then connected a DAC to the switch in port 24 going to my pc. Its a mellanox connectx-2 10gb single port card. (windows 8.1 seems to have a decent driver for it) and i am able to see the internet on my pc! This means the internet signal coming from the pfsense box to the gigabit ports is passing over to the 10gb sfp+ ports. This is good.

However, I put another mellanox card in my server, I connect it to port 23 on the switch and bootup my server (nas4free) and the drivers load. Upon bootup, I can configure the ip address in the server and all is well, i can even ping the server from my pc and my server can ping my pc as well, but when i try to login to the server through web management or through windows smb/cifs networking, i cant access my server.

I know the internet signal passes through quite well from the 1gigabit ports on the switch to the 10gb ports on the switch. I can see my internet connection through the 10gb card in my pc, as i can browse the internet just fine, but basically, when i try to go from pc to server, or 10gb port to 10gb port on the switch, it is blocked?

Is there perhaps some sort of setting that enables the switch to allow all the ports to see each other? I am stumped, as I thought this was the purpose of the switch, and that it should just plug and play like a dumb 1gigabit 5 or 8 port switch. My server sees the internet, my workstation pc sees the internet, my personal pc sees the internet, all are connected through DAC cables to ports 24, 23 and 22, but it seems like the 10gb ports are not talking to each other? I even performed an iperf3 test, and to my dismay, there is no data transfer between the server and pc.

Experienced/Knowledgeable ones, does this have anything to do with vlans? I was reading through the thread again and I thought someone mentioned that all ports have to be configured into vlans to work? Or am I thinking the wrong thing here? I thought the sfp+ ports would just see all the other ports automatically. I got my ssd download drive prepped and ready to transfer at 10gigabit speeds to my server, but I cant "see" the server connected to the switch.

Help out a noob in training....

 

[dwright1542]

If you login, enable, and do a "show run" I can help.

 

[Fritz]

For my purposes, security is a non issue so would I gain anything functionality wise by switching to SSH?

 

[Sleyk]

Hey Fritz, well since SSH allows you to have a password set so no one can log in beside you, you are pretty much ok with out SSH if security is not a concern per se. The shell is also very much encrypted as per what Tminus mentioned. The functionality to the best of my knowledge is centered around the "secure" aspect of it. I guess SSH is more widely used? I could be wrong though. Functionality-wise, both Telnet and SSH offer similar level access depending on the hardware i believe. I think SSH is more cool though Fritz! Come on... jump on the SSH wagon with us.

dwright1542, will do a show run and post right away.

 

[Sleyk]

Ok, here you go dwright, any and all help is greatly appreciated...



(FASTPATH Routing) #show run
!Current Configuration:
!
!System Description "Quanta LB6M, 1.2.0.14, Linux 2.6.21.7"
!System Software Version "1.2.0.14"
!System Up Time "1 days 4 hrs 15 mins 14 secs"
!Additional Packages FASTPATH QOS
!Current SNTP Synchronized Time: Not Synchronized
!
network protocol none
network parms 192.168.0.5 255.255.255.0 192.168.0.1
vlan database
exit
ip ssh server enable
no ip telnet server enable
configure
ip routing
username "admin" password cda5d072920fca940b3710a175f0fe3a25fe83f3e9ad17ceca72ca27966aa7f012067fbfe8877e9e7df30b7b92725bede2969f8e93846d3787cf4c1f86c3aa04 level 15 encrypted
aaa authentication enable "enableList" enable
line console
exit
line telnet
exit
line ssh
exit

--More-- or (q)uit

spanning-tree configuration name "04-7D-7B-87-01-8A"
!
router rip
exit
router ospf
exit
exit

Here's also a show version of the switch for added info:

(FASTPATH Routing) #show version

Switch: 1

System Description............................. Quanta LB6M, 1.2.0.14, Linux
2.6.21.7
Machine Type................................... Quanta LB6M
Machine Model.................................. LB6M
Serial Number.................................. QTFCRW2150165
FRU Number..................................... 1LB6BZZ0STJ
Part Number.................................... BCM56820
Maintenance Level.............................. A
Manufacturer................................... 0xbc00
Burned In MAC Address.......................... 04:7D:7B:87:01:8A
Software Version............................... 1.2.0.14
Operating System............................... Linux 2.6.21.7
Network Processing Device...................... BCM56820_B0

--More-- or (q)uit


Additional Packages............................ FASTPATH QOS

 

[Fritz]

OK, you talked me into it. It's on my todo list for tomorrow.

 

[Sleyk]

Great Fritz!

 

[dwright1542]

show me the config for the ports in question: do a show run, and then hit <space> at the --More-- or (q)uit

Also...if you connect the 2 Windows machines together with a DAC, can you ping?

 

[Sleyk]

Hey dwright, thanks so much for wanting to help me. Yeah, when i direct connect the server with my windows pc, it works great. I assign a different subnet and i can ping nicely between the two. Iperf3 gives me speeds close to 10gbits (9.8gbits). The funny thing is, after doing more testing, i am able to login wirelessly to the server with my access point connected to one of the gigabit ports. Mind you, the server is only connected to the switch by DAC cable through the 10gb sfp+ port. The server even comes up on my tablet which is wirelessly connected to the access point, just unable to access anything else through/on the 10gbit ports. This leads me to believe that my problem must lie somewhere on the 10gb sfp+ interfaces/ports. Will do a new show run right away.

 

[Sleyk]

Ok, so i did another show run as requested, seems like the same info though:


(FASTPATH Routing) #showrun
^
% Invalid input detected at '^' marker.

(FASTPATH Routing) #show run
!Current Configuration:
!
!System Description "Quanta LB6M, 1.2.0.14, Linux 2.6.21.7"
!System Software Version "1.2.0.14"
!System Up Time "1 days 6 hrs 41 mins 4 secs"
!Additional Packages FASTPATH QOS
!Current SNTP Synchronized Time: Not Synchronized
!
network protocol none
network parms 192.168.0.5 255.255.255.0 192.168.0.1
vlan database
exit
ip ssh server enable
no ip telnet server enable
configure
ip routing
username "admin" password cda5d072920fca940b3710a175f0fe3a25fe83f3e9ad17ceca72ca27966aa7f012067fbfe8877e9e7df30b7b92725bede2969f8e93846d3787cf4c1f86c3aa04 level 15 encrypted
aaa authentication enable "enableList" enable
line console
exit
line telnet
exit
line ssh
exit

--More-- or (q)uit (I pressed the space bar here, gave the same info as before, not sure if i was supposed to hit something else?)

spanning-tree configuration name "04-7D-7B-87-01-8A"
!
router rip
exit
router ospf
exit
exit

(FASTPATH Routing) #

Not sure how to show config for individual ports though. Will try to see if i can find the command in the manual.

 

[dwright1542]

HMMMMMMMM. Looks like you're not showing any interfaces at all. Which is VERY odd, since you said you can see traffic passing between some interfaces.

ok let start with a

show interface 0/1

see anything?

 

[Sleyk]

Ok, did a show interface 0/1:

(FASTPATH Routing) #show interface 0/1


Packets Received Without Error................. 0
Packets Received With Error.................... 0
Broadcast Packets Received..................... 0
Packets Transmitted Without Errors............. 0
Transmit Packet Errors......................... 0
Collision Frames............................... 0
Time Since Counters Last Cleared............... 1 day 13 hr 46 min 9 sec

(FASTPATH Routing) #

Not sure why i get 0 packets. I am logged into the server wirelessly through my tablet. Also, laptop sees server on network just fine. This means the connection is fine from 1gigabit ethernet to 10gb sfp+ ports, but no connection from sfp+ ports to each other. I can certainly ping each other, but besides that, the pc and the server wont talk to each other through the sfp+ ports. Both are connected through DAC to ports 24 and 23. Mighty odd. I hope i havent recieved a bad switch. Everything else works though. Thank you for all your help and suggestions. I will await your further instructions, and I will keep testing as well.

 

[Sleyk]

Ok, did a show interface on 0/24 and 0/23. Still nothing:

FASTPATH Routing) #show interface 0/24


Packets Received Without Error................. 0
Packets Received With Error.................... 0
Broadcast Packets Received..................... 0
Packets Transmitted Without Errors............. 0
Transmit Packet Errors......................... 0
Collision Frames............................... 0
Time Since Counters Last Cleared............... 1 day 15 hr 35 min 40 sec

(FASTPATH Routing) #show interface 0/23


Packets Received Without Error................. 0
Packets Received With Error.................... 0
Broadcast Packets Received..................... 0
Packets Transmitted Without Errors............. 0
Transmit Packet Errors......................... 0
Collision Frames............................... 0
Time Since Counters Last Cleared............... 1 day 15 hr 36 min 14 sec

(FASTPATH Routing) #

Also, I am able to SSH into the server just fine through 10gbit dac to the switch from my pc. You mentioned me not showing any interfaces at all through the show run command. I'm thinking perhaps they are off or disabled? Not sure if they're disabled, because i can see the internet through the sfp+ports, but maybe inter-port routing is off? Is there perhaps a direct command to see if my sfp+ ports are enabled for this? Maybe a test command to verify? I just know that I'm missing something fundamentally simple here.

 

[djflow195]

@Sleyk: do "show port all" and post the output

 

[Sleyk]

Ok sure, show port all:

(FASTPATH Routing) #show port all

Admin Physical Physical Link Link LACP Actor
Intf Type Mode Mode Status Status Trap Mode Timeout
--------- ------ --------- ---------- ---------- ------ ------- ------ --------
0/1 Enable 10G Full Down Enable Enable long
0/2 Enable 10G Full Down Enable Enable long
0/3 Enable 10G Full Down Enable Enable long
0/4 Enable 10G Full Down Enable Enable long
0/5 Enable 10G Full Down Enable Enable long
0/6 Enable 10G Full Down Enable Enable long
0/7 Enable 10G Full Down Enable Enable long
0/8 Enable 10G Full Down Enable Enable long
0/9 Enable 10G Full Down Enable Enable long
0/10 Enable 10G Full Down Enable Enable long
0/11 Enable 10G Full Down Enable Enable long
0/12 Enable 10G Full Down Enable Enable long
0/13 Enable 10G Full Down Enable Enable long
0/14 Enable 10G Full Down Enable Enable long
0/15 Enable 10G Full Down Enable Enable long
0/16 Enable 10G Full Down Enable Enable long
0/17 Enable 10G Full Down Enable Enable long
0/18 Enable 10G Full Down Enable Enable long

--More-- or (q)uit


Admin Physical Physical Link Link LACP Actor
Intf Type Mode Mode Status Status Trap Mode Timeout
--------- ------ --------- ---------- ---------- ------ ------- ------ --------
0/19 Enable 10G Full Down Enable Enable long
0/20 Enable 10G Full Down Enable Enable long
0/21 Enable 10G Full 10G Full Up Enable Enable long
0/22 Enable 10G Full 10G Full Up Enable Enable long
0/23 Enable 10G Full Down Enable Enable long
0/24 Enable 10G Full Down Enable Enable long
0/25 Enable Auto 1000 Full Up Enable Enable long
0/26 Enable Auto 1000 Full Up Enable Enable long
0/27 Enable Auto 1000 Full Up Enable Enable long
0/28 Enable Auto 1000 Full Up Enable Enable long
1/1 Enable Down Disable N/A N/A
1/2 Enable Down Disable N/A N/A
1/3 Enable Down Disable N/A N/A
1/4 Enable Down Disable N/A N/A
1/5 Enable Down Disable N/A N/A
1/6 Enable Down Disable N/A N/A
1/7 Enable Down Disable N/A N/A
1/8 Enable Down Disable N/A N/A

--More-- or (q)uit


Admin Physical Physical Link Link LACP Actor
Intf Type Mode Mode Status Status Trap Mode Timeout
--------- ------ --------- ---------- ---------- ------ ------- ------ --------
1/9 Enable Down Disable N/A N/A
1/10 Enable Down Disable N/A N/A
1/11 Enable Down Disable N/A N/A
1/12 Enable Down Disable N/A N/A
1/13 Enable Down Disable N/A N/A
1/14 Enable Down Disable N/A N/A
1/15 Enable Down Disable N/A N/A
1/16 Enable Down Disable N/A N/A
1/17 Enable Down Disable N/A N/A
1/18 Enable Down Disable N/A N/A
1/19 Enable Down Disable N/A N/A
1/20 Enable Down Disable N/A N/A
1/21 Enable Down Disable N/A N/A
1/22 Enable Down Disable N/A N/A
1/23 Enable Down Disable N/A N/A
1/24 Enable Down Disable N/A N/A
1/25 Enable Down Disable N/A N/A
1/26 Enable Down Disable N/A N/A

--More-- or (q)uit


Admin Physical Physical Link Link LACP Actor
Intf Type Mode Mode Status Status Trap Mode Timeout
--------- ------ --------- ---------- ---------- ------ ------- ------ --------
1/27 Enable Down Disable N/A N/A
1/28 Enable Down Disable N/A N/A
1/29 Enable Down Disable N/A N/A
1/30 Enable Down Disable N/A N/A
1/31 Enable Down Disable N/A N/A
1/32 Enable Down Disable N/A N/A
1/33 Enable Down Disable N/A N/A
1/34 Enable Down Disable N/A N/A
1/35 Enable Down Disable N/A N/A
1/36 Enable Down Disable N/A N/A
1/37 Enable Down Disable N/A N/A
1/38 Enable Down Disable N/A N/A
1/39 Enable Down Disable N/A N/A
1/40 Enable Down Disable N/A N/A
1/41 Enable Down Disable N/A N/A
1/42 Enable Down Disable N/A N/A
1/43 Enable Down Disable N/A N/A
1/44 Enable Down Disable N/A N/A

--More-- or (q)uit


Admin Physical Physical Link Link LACP Actor
Intf Type Mode Mode Status Status Trap Mode Timeout
--------- ------ --------- ---------- ---------- ------ ------- ------ --------
1/45 Enable Down Disable N/A N/A
1/46 Enable Down Disable N/A N/A
1/47 Enable Down Disable N/A N/A
1/48 Enable Down Disable N/A N/A
1/49 Enable Down Disable N/A N/A
1/50 Enable Down Disable N/A N/A
1/51 Enable Down Disable N/A N/A
1/52 Enable Down Disable N/A N/A
1/53 Enable Down Disable N/A N/A
1/54 Enable Down Disable N/A N/A
1/55 Enable Down Disable N/A N/A
1/56 Enable Down Disable N/A N/A
1/57 Enable Down Disable N/A N/A
1/58 Enable Down Disable N/A N/A
1/59 Enable Down Disable N/A N/A
1/60 Enable Down Disable N/A N/A
1/61 Enable Down Disable N/A N/A
1/62 Enable Down Disable N/A N/A

--More-- or (q)uit


Admin Physical Physical Link Link LACP Actor
Intf Type Mode Mode Status Status Trap Mode Timeout
--------- ------ --------- ---------- ---------- ------ ------- ------ --------
1/63 Enable Down Disable N/A N/A
1/64 Enable Down Disable N/A N/A

(FASTPATH Routing) #

Seems like the ports are enabled? What do you think? Most likely your trained eye spotted something...
As of now, all tests done from ethernet to 10gbit sfp+ ports work, sfp+ports remain unable to be reached. I even attempted putting a 10gbit single port card into the pfsense router to plug it into one of the ports to see if i could pass the internet signal from 10gbit port to another 10gbit port, but i was stopped short since pfsense doesnt seem to have support for 10gbit sfp+ cards yet, at least it didnt recognize the card for me. Thanks to all for helping me out here. I am truly stumped here.