10-Gigabit Ethernet (10GbE) Networking - NICs, Switches, etc.
- Thread starter odditory
- Start date
Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.
No.
The core problem is that the spec for 10Gbase-T line levels requires more power than the spec for SFP+ can deliver. I don't think you'll ever see SFP+ based 10Gbase-T plugs.
SFP+ will remain limited to optical interfaces and short-distance direct-connect Twinax
The core problem is that the spec for 10Gbase-T line levels requires more power than the spec for SFP+ can deliver. I don't think you'll ever see SFP+ based 10Gbase-T plugs.
SFP+ will remain limited to optical interfaces and short-distance direct-connect Twinax
Has anyone used the IBM 49Y4250?
Thinking I might just go with three of them passive SFP+ to SFP+ for ESXi to OI and MM fiber OI to desktop. Would only be a little more than getting a AT2 dual port.
@PigLover how was your experience running terminated fiber through your house? I have a 40m run to make through 2 1/2 conduit.
Thinking I might just go with three of them passive SFP+ to SFP+ for ESXi to OI and MM fiber OI to desktop. Would only be a little more than getting a AT2 dual port.
@PigLover how was your experience running terminated fiber through your house? I have a 40m run to make through 2 1/2 conduit.
PigLover points out they are not Intel reference and are made by Emulex. Emulex OneConnect OCe10102-NX, are on the ESXi HCL through 5.0 and the Emulex doc says Oracle Solaris and Windows Server support. Also shows having TOE. On fleabay for $200 (11/15/11)
I am going to get my setup running with a 2Gb LAG to ESXi for now and may hold out for a lower price Intel dual port 10GBASE-T to come up.
@nitrobass24 have you been able to mess around with the 10GbE Dell switch?
I am going to get my setup running with a 2Gb LAG to ESXi for now and may hold out for a lower price Intel dual port 10GBASE-T to come up.
@nitrobass24 have you been able to mess around with the 10GbE Dell switch?
I only had to go about 25 feet with it, mostly exposed inside the garage, through the Furnace/Water Heater enclosure and directly through one wall to the termination plate on the other side. My experience was no problem at all (in fact, there are pictures of it posted here).
I don't think I'd want to run fiber without conduit. The cables are a bit fragile even with their plastic casing, nothing like pulling Cat5/6. Going 40m might be a challenge unless the conduit is already there.
Its all running fat, dumb and happy right now. Four machines on 10Gbe over a Juniper EX2500 switch. One using SFP+ SR fiber in the house, the three in the garage connected to the switch using SFP+ direct attach twinax cables (DAC). I am VERY satisfied.
Last edited:
Hi all,
I know this is a bit OT, but I've now got an SRP link working over 10Gig Infiniband from a Windows 7 Home Premium box to an Ubuntu box. Speeds up to 250mb/sec reads 200MB/sec writes, and that limit is down to the disk subsystem and software raid. If I got a decent RAID card, I'd expect that to go up to 500MB/sec or more.
Here's some links:
Infiniband SRP target on Ubuntu from Win7
Enabling Infiniband on Ububtu 10.10
Infiniband at Home (10Gb networking on the cheap)
Hope this helps someone!
Regards,
Dave.
I know this is a bit OT, but I've now got an SRP link working over 10Gig Infiniband from a Windows 7 Home Premium box to an Ubuntu box. Speeds up to 250mb/sec reads 200MB/sec writes, and that limit is down to the disk subsystem and software raid. If I got a decent RAID card, I'd expect that to go up to 500MB/sec or more.
Here's some links:
Infiniband SRP target on Ubuntu from Win7
Enabling Infiniband on Ububtu 10.10
Infiniband at Home (10Gb networking on the cheap)
Hope this helps someone!
Regards,
Dave.
Sweet Dave glad it worked out for you.
If you wanted to test your true speeds, you could create a RAMdisk on each box that way you are not limited by disk.
If you wanted to test your true speeds, you could create a RAMdisk on each box that way you are not limited by disk.
Just got my hands on a DELL PERC 5/i Raid controller. Abysmal speed. 5 disk RAID 5 Array giving me 200MB/sec reads and 50MB/sec writes. Each individual drive on it's own capable of 120MB/sec read/write. Controller in it's own PCIe8x slot. Still, at least I only spend €31 on it....Hi all,
I know this is a bit OT, but I've now got an SRP link working over 10Gig Infiniband from a Windows 7 Home Premium box to an Ubuntu box. Speeds up to 250mb/sec reads 200MB/sec writes, and that limit is down to the disk subsystem and software raid. If I got a decent RAID card, I'd expect that to go up to 500MB/sec or more.
Here's some links:
Infiniband SRP target on Ubuntu from Win7
Enabling Infiniband on Ububtu 10.10
Infiniband at Home (10Gb networking on the cheap)
Hope this helps someone!
Regards,
Dave.
Have a look here for a wealth of info, tweaks, and benchiesJust got my hands on a DELL PERC 5/i Raid controller. Abysmal speed. 5 disk RAID 5 Array giving me 200MB/sec reads and 50MB/sec writes. Each individual drive on it's own capable of 120MB/sec read/write. Controller in it's own PCIe8x slot. Still, at least I only spend €31 on it....
The Intel IOP333 is not a world beater, a bit like Intel GMA graphics vs nVidia/AMD
Flashing the cards firmware improved things, up to 200MB/sec read/write, but that's down to the motherboard being the bottleneck, as I found out. Stick this same array into an i7 gave me 500MB/sec reads and 350MB/sec writes. Gotta upgrade the linux box motherboard/cpu.
http://davidhunt.ie/wp/?p=2221
http://davidhunt.ie/wp/?p=2221
Thats probably the CPU assisting the RAID5 XORing ?
I think the IOP3xx are HW assisted SW RAID engines.
But get your self a nice LSI9260/9265 based card and RAID5 slow performance will be a thing of the past.
No matter how slow the CPU a 9260 will be able to pump out data with true HW XOR
Don't what ever you do get a 9240 based card for RAID5 its terrible at it, RAID0/1 no probs.
Same goes for RAID0/1 don't get a 9260, as the 9240/9211 does it so much better.
I think the IOP3xx are HW assisted SW RAID engines.
But get your self a nice LSI9260/9265 based card and RAID5 slow performance will be a thing of the past.
No matter how slow the CPU a 9260 will be able to pump out data with true HW XOR
Don't what ever you do get a 9240 based card for RAID5 its terrible at it, RAID0/1 no probs.
Same goes for RAID0/1 don't get a 9260, as the 9240/9211 does it so much better.
I just tried out a RAMdisk after eventually realising that one of the Infiniband cards PCI-E 8x) was in a 4x slot (Physically 16x, but only 4 lanes assigned).
Speed went up to about 900MB/sec across the fabric.
http://davidhunt.ie/wp/?p=2324
Not sure I want to spend $500 on a new RAID controller, though...
Speed went up to about 900MB/sec across the fabric.
http://davidhunt.ie/wp/?p=2324
Not sure I want to spend $500 on a new RAID controller, though...
So I've been following this for awhile - I picked up 2 of the XR997 cards awhile ago, and have been running them between my ZFS box and main PC. I've been wanting to hook up my HTPC on 10Gig as well (really just to see how high speed scrubbing performance was in XBMC) -- I saw a guy on ebay selling used 520-t2 dual port 10 gig nics for just under 300 each.
http://www.ebay.com/itm/Used-OEM-De...ltDomain_0&hash=item337106a0bd#ht_3581wt_1185
I picked up on, and so far (2 days now) it's been working like a champ. It runs much cooler than the XR997's, and the fan that comes with it is quiet (doesn't need to be replaced asap).
Anyway, just wanted to flag the current 300 bucks for a dual part 2nd gen 10Base-T card as pretty good.
http://www.ebay.com/itm/Used-OEM-De...ltDomain_0&hash=item337106a0bd#ht_3581wt_1185
I picked up on, and so far (2 days now) it's been working like a champ. It runs much cooler than the XR997's, and the fan that comes with it is quiet (doesn't need to be replaced asap).
Anyway, just wanted to flag the current 300 bucks for a dual part 2nd gen 10Base-T card as pretty good.
I saw those also. Not a bad deal at all if you need two 10GbE ports in the same machine.
I still have two XR997's that I will probably sell soon to make room for newer generation parts. Next week I'll probably do a quick write up on a six port 1GbE adapter I have been using. Too bad 10Gig switches are still expensive.
I still have two XR997's that I will probably sell soon to make room for newer generation parts. Next week I'll probably do a quick write up on a six port 1GbE adapter I have been using. Too bad 10Gig switches are still expensive.
Anyone seen this? http://communities.intel.com/commun...ith-intel-ethernet-controller-and-io-features
Looks like 10GBe will be coming to server boards in the not so distant future. Then it'll just be the switches.
Looks like 10GBe will be coming to server boards in the not so distant future. Then it'll just be the switches.