12 sfp+ + 4 10gbe rj45 - Ubiquiti Edgeswitch 16xg

Discussion in 'Networking' started by Jannis Jacobsen, Aug 3, 2016.

  1. Terry Kennedy

    Terry Kennedy Well-Known Member

    Joined:
    Jun 25, 2015
    Messages:
    1,039
    Likes Received:
    489
    Generally, the router / switch manufacturers that don't force you to use vendor-locked pluggables say something like "We don't specifically exclude any parts, but we have only tested with the following parts: ..."

    That's pretty reasonable, but not much of a condolence when you're trying to get something working. Incompatibilities can arise from:
    • Interactions with vendor proprietary "magic footprints". These are generally computed based on some of the SEEPROM fields and stored in one of the reserved areas, so this should not be a problem if the part accurately describes itself (I've seen all sorts of screwball problems, including DWDM parts that report the wrong channel and so on).
    • Parts that aren't compatible regardless of branding. For example, Dell has a dual-speed 1/10GbE SFP+ part that is used in one product line. It isn't recognized anywhere else, even by other Dell products. This part requires some hardware support that isn't present in most routers / switches. That's also one of the issues with copper SFPs - some of them do speed conversion internally and always talk to the router / switch innards at GigE speed, while others expect the router / switch to handle 10/100/1000 speeds itself.
    • Parts that aren't one of the types the hardware / firmware knows about. For example, a lot of the lower-end products only know about short or long range optics or passive direct attach cables. If you plug in something like a BiDi part (bidirectional on a single fiber), the device will probably go "I don't know what this is, so I can't use it". Likewise if you plug a SONET part into a switch that is only expecting Ethernet.
    • Parts that are not listed in any relevant standard. It is possible for a switch / router manufacturer to come up with something non-standard that will work in their equipment but nowhere else. I haven't seen much of this, and most of it has been oddball variants of direct attach for things like active / standby failover.
     
    #101
    ignx likes this.
  2. Terry Kennedy

    Terry Kennedy Well-Known Member

    Joined:
    Jun 25, 2015
    Messages:
    1,039
    Likes Received:
    489
    Pretty much all 10GbE hardware should be capable of "wire speed", given reasonable hardware with a decent networking stack. This is /dev/zero to /dev/null between a pair of Xeon E5620 boxes, using X540-T1 cards and a Dell 8024 switch:
    Code:
    (0:1) srchost:~terry# bbcp -P 2 -s 8 /dev/zero desthost:/dev/null
    bbcp: Creating /dev/null/zero
    bbcp: 160620 06:06:45  0% done; 1.2 GB/s
    bbcp: 160620 06:06:47  0% done; 1.2 GB/s
    bbcp: 160620 06:06:49  0% done; 1.2 GB/s
    bbcp: 160620 06:06:51  0% done; 1.2 GB/s
    bbcp: 160620 06:06:53  0% done; 1.2 GB/s
    ^C
    Sending real data is also pretty fast - this is a ZFS send / receive in a zrep wrapper with bbcp as the transport (same hardware as above). Spinning rust (no SSDs) on either end:
    Code:
    (0:2) srchost:/sysprog/terry# zrep init storage/data desthost storage/data
    Setting properties on storage/data
    Creating snapshot storage/data@zrep_000000
    Sending initial replication stream to desthost:storage/data
    bbcp: Creating zfs
    bbcp: 160619 22:26:28  not done; 748.5 MB/s
    bbcp: 160619 22:26:58  not done; 727.1 MB/s
    bbcp: 160619 22:27:28  not done; 738.4 MB/s
    bbcp: 160619 22:27:58  not done; 739.2 MB/s
    bbcp: 160619 22:28:28  not done; 738.8 MB/s
    bbcp: 160619 22:28:58  not done; 739.7 MB/s
    bbcp: 160619 22:29:28  not done; 739.6 MB/s
    bbcp: 160619 22:29:58  not done; 739.3 MB/s
    bbcp: 160619 22:30:28  not done; 736.9 MB/s
    ...
     
    #102
  3. BackupProphet

    BackupProphet Well-Known Member

    Joined:
    Jul 2, 2014
    Messages:
    790
    Likes Received:
    279
    Never heard about bbcp before, works great on Linux, not so great on FreeBSD
     
    #103
  4. ignx

    ignx New Member

    Joined:
    Aug 10, 2016
    Messages:
    9
    Likes Received:
    13
    I just put together a pc from spare parts on a testbench ( msi x99 gaming motherboard with a xeon) so I could with flash firmware to all nics with ease before starting anything else . I realise that dragging large files between windows isn`t a good way to demonstrate anything beside the fact that both ends can communicate with speed higher than 1G and that was the purpose of my post. I should have replied directly to IamSpartacus .With some nice deals around , I mean vendor branded 10G nics there can be some problems but there is always that urge to get some cheap while the stock lasts.I found myself in that situation (I guess I am not the only one) when I bought few nics with dacs and transceivers bundled together so plugging a transceiver that I got with a nic costed me 10s ,less than hours of research on a product than doesnt have many reviews yet (if any) and will have few firmware updates. But that`s what you get when you buy first batch of hardware with stock firmware.
     
    #104
    Patrick likes this.
  5. Patrick

    Patrick Administrator
    Staff Member

    Joined:
    Dec 21, 2010
    Messages:
    11,627
    Likes Received:
    4,584
    Enabling SSHD and HTTPS on v1.6.0 firmware:
     
    #105
    niekbergboer and ultradense like this.
  6. Patrick

    Patrick Administrator
    Staff Member

    Joined:
    Dec 21, 2010
    Messages:
    11,627
    Likes Received:
    4,584
  7. GCM

    GCM Active Member

    Joined:
    Aug 24, 2015
    Messages:
    137
    Likes Received:
    43
    #107
    Patrick and ignx like this.
  8. Terry Kennedy

    Terry Kennedy Well-Known Member

    Joined:
    Jun 25, 2015
    Messages:
    1,039
    Likes Received:
    489
    It works fine on FreeBSD as long as you use the 20120520 version. Newer versions have all sorts of bizarre problems which seem to boil down to there not being an assigned maintainer who also uses the port. Thus, some patches got in which (at a minimum) do all sorts of strange things with the IPv6 stack.

    I go into this in some more detail in my RAIDzilla II upgrade article.

    The sample outputs from my earlier post are from FreeBSD, by the way.
     
    #108
    BackupProphet likes this.
  9. BackupProphet

    BackupProphet Well-Known Member

    Joined:
    Jul 2, 2014
    Messages:
    790
    Likes Received:
    279
    Thanks! That worked great! :D
    It is also nice to see other people using FreeBSD too.
     
    #109
  10. himynameisdaniel

    Joined:
    Aug 17, 2016
    Messages:
    32
    Likes Received:
    1
    very interested in the fan model numbers and specs. also power consumption running at all SFP+ interfaces at max loads\speeds.
    but that initial reading for idle power consumption is very good. there does not seem to be much love with Finisar transceivers from what i have gathered.

    is this something that could be corrected with future firmware updates from Ubiquiti?
     
    #110
  11. BLinux

    BLinux cat lover server enthusiast

    Joined:
    Jul 7, 2016
    Messages:
    2,371
    Likes Received:
    842
    I'm very interested in the answers to the above too....
     
    #111
  12. GCM

    GCM Active Member

    Joined:
    Aug 24, 2015
    Messages:
    137
    Likes Received:
    43
    I doubt they'll adopt them, finisar transceivers have been historically bad with Ubiquiti in terms of support.
     
    #112
  13. IamSpartacus

    IamSpartacus Well-Known Member

    Joined:
    Mar 14, 2016
    Messages:
    2,011
    Likes Received:
    446
    Just found these being sold on eBay for anyone interested since it seems the compatible DACs are quite limited right now and these are confirmed working. Buyer accepted BO of $25 per when I bought 8. Listing only has 7 left but the description says quantity of 100 available and it's a new listing so might have more not being listed.
     
    #113
    GCM and Patrick like this.
  14. himynameisdaniel

    Joined:
    Aug 17, 2016
    Messages:
    32
    Likes Received:
    1
    Just got mine today.
    No issues with build quality. even got the rubber boots for unused SFP+ ports
    Quality Check date of 06/17/16
    Fans are quiet but still emit a muffled whine . nothing that closing a door does not fix for near total silence. (x1 1G RJ45 port active only so far)
    UPS says that device is only drawing <10 watts currently. device seems very power optimized. which is very good to see.
     
    #114
  15. Jeff Robertson

    Jeff Robertson Active Member

    Joined:
    Oct 18, 2016
    Messages:
    399
    Likes Received:
    103
    Has anyone tried replacing the internal fans with the 40mm noctuas? I'm hoping to get this switch but I'm going to be sitting about 8' from it so silence is a must.
     
    #115
  16. himynameisdaniel

    Joined:
    Aug 17, 2016
    Messages:
    32
    Likes Received:
    1
    they look like standard 3 pin fans. you should have no issues replacing them. mine are acceptable noise as they are locked in another room.
    just remember the 10G base T ports will suck a lot of power per port and will create more heat vs SFP+.
     
    #116
  17. pyro_

    pyro_ Active Member

    Joined:
    Oct 4, 2013
    Messages:
    726
    Likes Received:
    161
    #117
  18. Netwerkz101

    Netwerkz101 Active Member

    Joined:
    Dec 27, 2015
    Messages:
    237
    Likes Received:
    57
    #118
  19. BLinux

    BLinux cat lover server enthusiast

    Joined:
    Jul 7, 2016
    Messages:
    2,371
    Likes Received:
    842
    when you go to the site, it still shows $599?
     
    #119
  20. Jeff Robertson

    Jeff Robertson Active Member

    Joined:
    Oct 18, 2016
    Messages:
    399
    Likes Received:
    103
    Just verified it's still an active deal. You have to have an account then sign up for their beta account (free, takes about two seconds). This is what I see when I log in:

    Capture.JPG

    I ordered one last night just in case they took it down quickly. For that price it's worth it to have some cable headaches.
     
    #120
Similar Threads: sfp+ 10gbe
Forum Title Date
Networking Help with home 10GbE network (10Gbase-T and SFP+) Nov 19, 2019
Networking Solarflare SFP+ 10Gbe cards May 7, 2019
Networking 10gbe SFP+ Intel/HELP! Dec 7, 2018
Networking Slow 10Gbe SFP+ on Chelsio T520-SO Jun 30, 2018
Networking Which SFP+ 10GBE cables are compatible? Apr 10, 2017

Share This Page