HP SL6500 4U 8-Node (16 CPU) Cloud Servers | 256 Threads | 2,048 GB RAM ~$2000

raileon

Active Member
Jun 22, 2016
150
38
28
And BTW It's my goal to get some idea about those hardware, IE what manf date, what version bios/fw, and the ILO as well. If anyone has ram/cpu and PSU already, I would think that a lot of people would be happy to see if you shared your details. As it does appear the ILO tags are on them, I wasn't sure if that was normal or not, but sadly it doesnt mention version.
I should be able to start posting this type of info by Tuesday night. Got extra cpus and ram. Plus my psus came in already. Just need the servers which are sitting at the airport a few miles from me...
 

Fredrik

New Member
Mar 28, 2016
5
1
3
And BTW It's my goal to get some idea about those hardware, IE what manf date, what version bios/fw, and the ILO as well. If anyone has ram/cpu and PSU already, I would think that a lot of people would be happy to see if you shared your details. As it does appear the ILO tags are on them, I wasn't sure if that was normal or not, but sadly it doesnt mention version.
I brought up 6 of 8 nodes last night. They came with iLO 1.22, advanced key pre-installed. I was able to upgrade to version 2.40 without issue.
BTW, one of my nodes arrived DOA - may be related to the screws I found floating around in the chassis. It wouldn't be a bad idea to check for loose screws before applying power. They appear to belong to the PCIe brackets, which arrived unsecured.
 

Zankza

Active Member
Feb 1, 2014
79
15
28
I brought up 6 of 8 nodes last night. They came with iLO 1.22, advanced key pre-installed. I was able to upgrade to version 2.40 without issue.
BTW, one of my nodes arrived DOA - may be related to the screws I found floating around in the chassis. It wouldn't be a bad idea to check for loose screws before applying power. They appear to belong to the PCIe brackets, which arrived unsecured.
Strange. None of my nodes have screws. It appears they rushed removing the raid card, and honestly I didn't care too. But Thanks for sharing your experience.

They came with iLO 1.22, advanced key pre-installed. I was able to upgrade to version 2.40 without issue.
Hell yes. I hope I get preinstalled keys as well !
 

cookiesowns

Active Member
Feb 12, 2016
194
72
28
25
Any ideas on what onboard SATA/SAS connectivity there is? Enough room to fit 6x SSD's with velcro and some creativity?

think I'm going to go in on these too.
 

Fredrik

New Member
Mar 28, 2016
5
1
3
Any ideas on what onboard SATA/SAS connectivity there is? Enough room to fit 6x SSD's with velcro and some creativity?
2x SFF-8087 (H220i) + 2 SATA. Physically, 8x SSD's will fit without issue. However, you'll need to be creative in sourcing power for the additional drives.
 

Zankza

Active Member
Feb 1, 2014
79
15
28
Any ideas on what onboard SATA/SAS connectivity there is? Enough room to fit 6x SSD's with velcro and some creativity?

think I'm going to go in on these too.
That was my first DIY plan, But after quick look, It seems very much more problematic with power. The cables seem to be custom, And I don't think there is any more power connectors, So that means you'd need to rig a custom cable with more tether. But the space is definitely vast, there is more than enough room to fit maybe 16 SSD if carefully designed.
 

Zankza

Active Member
Feb 1, 2014
79
15
28
As you can see I already can fit three SSD, and there is even room for fourth, fifth?! I hope those pictures show you why I think 16 SSD is very much possible reality, 20 would be pushing it.
 

cookiesowns

Active Member
Feb 12, 2016
194
72
28
25
Looks like HP is using traditional SATA power.. Definitely have room to add 1-2 of these: FrozenCPU ConnectRight DIY SATA EZ Crimp Connector - Black - 90° (M-SCA-16F-BK) - FrozenCPU.com

But will definitely need to be creative in re-arranging existing layout.

You can also go with SL250s, and get 4x 2.5" hotswap + 4x 2.5" Coldswap with an adapter kit.

Side note: Anyone have these in a cabinet yet? Still need to purchase some racks, so was wondering how these will fit in a normal depth rack, or if a "deep" style rack is necessary.
 
Last edited:

Zankza

Active Member
Feb 1, 2014
79
15
28
Looks like HP is using traditional SATA power.. Definitely have room to add 1-2 of these: FrozenCPU ConnectRight DIY SATA EZ Crimp Connector - Black - 90° (M-SCA-16F-BK) - FrozenCPU.com

But will definitely need to be creative in re-arranging existing layout.

You can also go with SL250s, and get 4x 2.5" hotswap + 4x 2.5" Coldswap with an adapter kit.
Of course that's possible but those things are HUGE. they need to be really a lot more smaller, Additionally it's 10x safer and space-wise if we somehow that small sata data/power bracket I think so at least.

Even something like this is by far better chance.

https://www.amazon.com/CableDeconn-SFF-8087-SFF-8482-Connectors-Power/dp/B010CMW6S4/

a "deep" style rack is necessary.
I think deep style might be not deep enough :\
 

cookiesowns

Active Member
Feb 12, 2016
194
72
28
25
Of course that's possible but those things are HUGE. they need to be really a lot more smaller, Additionally it's 10x safer and space-wise if we somehow that small sata data/power bracket I think so at least.

Even something like this is by far better chance.

Amazon.com: CableDeconn Mini SAS 36 SFF-8087 to (4) SFF-8482 Connectors With SATA Power 1m: Computers & Accessories


I think deep style might be not deep enough :\
Yeah that's what I was thinking.

As for the deep style rack... These things are about 900mm deep right? There are supermicro Chassis's that are about that deep. So I'm thinking 1200mm rack with rear rails pushed slightly back are a requirement?
 

Zankza

Active Member
Feb 1, 2014
79
15
28
Yeah that's what I was thinking.

As for the deep style rack... These things are about 900mm deep right? There are supermicro Chassis's that are about that deep. So I'm thinking 1200mm rack with rear rails pushed slightly back are a requirement?
Code:
The HP ProLiant s6500 Chassis is a modular server hardware system that is optimized for HP Rack 10000
Series and HP Intelligent Rack Series models that are at least 47.24 in (1200 mm) deep.
 

cookiesowns

Active Member
Feb 12, 2016
194
72
28
25

cookiesowns

Active Member
Feb 12, 2016
194
72
28
25

cookiesowns

Active Member
Feb 12, 2016
194
72
28
25
Hmm, the recommended HP Rack 10000 is of 1008mm deep, with the front to rear rackmount posts being at 742mm deep. Perhaps don't need 1200mm racks?

http://h18004.www1.hp.com/products/quickspecs/archives_division/10995_div_v19/10995_OV.gif
There's an extension KIT that you have to use for the HP RACK 10000 at least according to the documentation above that I linked..

Either way, I think 1100 or 1200mm rack should be sufficient, it's just a matter of if these racks can recess the Chassis... The Eaton RS I had planned doesn't seem to be able to do so... so that means one of the rack doors will need to be taken off unfortunately....

I guess I'll be the guinea pig in about a month or two, unless I find some good deals on C6220's, or other chassis setups
 

raileon

Active Member
Jun 22, 2016
150
38
28
I ordered my 2670s but no delivery of the servers today. UPS shows an odd set of time-stamps for today's tracking where I apparently delayed it.

For those of you that got your shipments already, did UPS call beforehand or was it like a regular delivery?
 

Layla

Game Engine Developer
Jun 21, 2016
63
25
18
36
IE I already found one caveat, the SAS onboard should require 90d but it appears the previous owner had some RAID card, so if you try to plug in the SAS cable, It's too tall and you would need to really bend it so hard to get 180 degree to able keep it inside within node.
What do you plan to do? Did you manage to bend the SAS cables for all 8 nodes? Do you plan to replace them with 90deg elbows? It appears that SFF-8087 female-female couplers are $50/ea, which would be around $400 in couplers alone, so that doesn't seem like a great option... :/
 

raileon

Active Member
Jun 22, 2016
150
38
28
The servers came in today. I visually inspected all nodes and they look to be in pretty good and mostly clean shape. I'll have to dig a bit of thermal gunk out of some places (cpu sockets...) but that's about it. I'll fire up a few tonight with all the extra E5 cpus I have and post some software details.

I ordered the listing that didn't mention rails. They came with rails. I now own 4 sets of rails. Don't order rails until after you see what you get.

The hard drive cages in the back are a scam. If you use SSDs those are begging to be modded. Plenty of extra power headers on the power distro board but I doubt you'd need them.

Why is there a pcie x16 slot above the ram for the rear cpu? I don't see that in the manual. GPU?

http://i.imgur.com/fuyGnXq.jpg

@Layla The sas cables can be bent enough to get the nodes in although it doesn't seem like the best way to handle it.
 

raileon

Active Member
Jun 22, 2016
150
38
28
I have three nodes up, that's all the cpus I have at the moment. No problems getting them to run.

Some quick notes:

iLo 4 Advanced on all three. The iLo IPs were set to static in the 172.24.0.0/24 subnet. Passwords were all default as written on the service tag of the nodes. Switching their IPs over to my subnet was pretty simple once I found their IP using nmap then just ssh in.

If you don't know iLO-speak (I didn't) then check out this quick run through of how to change the IP: Change ILO IP address via CLI on HP C7000 Blade Chassis - Systems Administration Problem Solvers

I basically ran two commands:
set /map1/enetport1/lanendpt1/ipendpt1 IPv4Address=<your new ilo static ip> SubnetMask=<subnet mask of your network>
*iLo reboots automatically here, ssh session freezes, fans attempt to liftoff
SSH into the new iLO IP and run:
set /map1/gateway1 AccessInfo=<your gateway ip>
* another auto-reboot

Give it a minute then just browse to your new iLO web gui.

If you screw-up any of the steps and can't get to your iLO through lan like I did then you can connect to it through the serial port. After you've connected with Putty or whatever hit "Esc + Shift + 9" and you get dropped to the iLO login where you can fix the network setup.

Nodes were at:
iLO FWs are 1.22 and 1.05
System ROM at P75 04/04/2012

Ran the SPP Version 2016.04.0 on each node, with no problems. It updated iLO, System ROM, some intel thing, not sure what else. I think I'm still missing some more updates like the integrated LSI but I'm not sure. I'm firmwared out for the night though.

Be sure to thank hightail.com for dumping these so cheap =)