Dedicated Crypto Mining Open Compute server build.

[Marsh]

@HellStew

Welcome to the asylum ...

I also mine xmr with 3 x 1U Intel dual E5-2450L server.
After some tweaking , disable unused core to save power.
Running Ubuntu 16.04 with xmr-stak-cpu miner

Here is my stat

bb4a , CPU dual E5-2450L v1 , L3 Cache 20M , 2 x 10 Threads , 5 active cores
CPU 638 H/s , 125w , 5.1 H/s per watt

 

[Klee]

hi @Klee

you have 4 x E2660 or 2 ?

Each server has 4 cpu's, two cpu's in each node and I have two open compute servers so I am running 8 E5-2660 cpu's.

 

[Klee]

Well I just ordered another open compute server to offset the increased difficulty , the E5-2660's are up in price about $20.00 each and into the 2665 price range.

The 2650's are still about $50.00 each, $25 less than the 2660's each, for about ~75 H/s less performance each.

The 2650L's are even cheaper and only 70w each but even less performance.

I'll think about the cpu's for a few days before I decide but hopefully i'll come across a deal.

I already have ram and hard drives so nothing spent there.

 

[Marsh]

E5-2650 are pretty ok for XMR mining.

Intel S2600JF 4 nodes with dual E5-2650 , L3 cache 20MB , 2 x 10 Threads , BIOS active 5 cores
each node is 760-765 H/s , total 760 x 4 = 3040 H/s , 640w - 664w , 4.67 H/s per watt

Intel S2600JF 4 nodes with dual E5-2660 , L3 cache 20MB , 2 x 10 Threads , BIOS active 5 cores
each node is 845-850 H/s , total 845 x 4 = 3360 H/s , 760w - 772w , 4.42 H/s per watt

E5-2650 is more efficient at XMR mining.

Let us know your decision, like you , I need to buy more E5-2660.
I have around 50 pieces E5-2670 , but used up all E5-2660 and E5-2650.

E5-2670 is power hungry for my use.

 

[JazzFaucet]

Did you purchase the OCP server from sonitekcomputer @Klee, or did you find a better deal elsewhere?

 

[Marsh]

I look up my Ebay purchase history, late last year, I was paying $28 to $32 each for E5-2650.

Why I didn't buy more E5-2650 CPU? Duh?????
I was too focus on buying E5-2670.

E5-2650 run so much cooler, the 1u fans do not bother me at all.

 

[Klee]

Did you purchase the OCP server from sonitekcomputer @Klee, or did you find a better deal elsewhere?

Yes them , I made a buy it now offer of $225.00

 

[Klee]

Made a offer for four E5-2650 V1 at $45.00 each.

Lowest I have found is $49.99 each from another seller with no make offer option.

 

[Klee]

Made a offer for four E5-2650 V1 at $45.00 each.

Lowest I have found is $49.99 each from another seller with no make offer option.

And he counter offered $60.00 from $63.99 so I declined it because I can do a buy it now for $49.99 each from another buyer.

 

[yuzmemak]

Dear Klee,

Your topic open a door for me. It is very interesting and usefull, thanks.

After reading your all steps, what I figure out that your component delivery prices are to much for my country. Also I have no experince on the server boards.

I found a second hand board with E5405 cpu. I google to find some comparision with your selected e2650 cpu. No result.

Do you have any idea that what could be result with e5450? Or any logic to compare these cpu's?

Thanks again.


Tapatalk kullanarak iPad aracılığıyla gönderildi

 

[Klee]

Just received my third Wiwynn server today, still need to decide on cpu's.

 

[Klee]

Well I went with 4 E5-2665 v1's.

They were a little less than $73.00 each, about what the cheapest E5-2660's are.

A little more power usage and a little more performance, ~ %90 of the performance of a 2670 at %70 of the cost.

Was really tempted by some E5-4640's at $62.00 each plus the 2650's at just under $50.00 each.

Supposed to be here Tuesday.

I am also going to try out a newer Monero Miner called xmrig, supposed to be a little faster than xmr-stak plus there is a Nvidia gpu version so maybe I can go back to mining in Linux with my main pc since xmr-nvidia seems to have issues with Ubuntu 17.04 and Cuda 8 and my GTX 1080Ti.



GitHub - xmrig/xmrig: Monero (XMR) CPU miner

 

[Klee]

I'm also using one 8 gig stick of DDR 3 ecc ram per cpu since I want to play around with compiling different miners on this server and the others running just one gig per cpu would error out when I tried to compile anything.

Shooting for ~970 H/s per node.

 

[Klee]

Dear Klee,

Your topic open a door for me. It is very interesting and usefull, thanks.

After reading your all steps, what I figure out that your component delivery prices are to much for my country. Also I have no experince on the server boards.

I found a second hand board with E5405 cpu. I google to find some comparision with your selected e2650 cpu. No result.

Do you have any idea that what could be result with e5450? Or any logic to compare these cpu's?

Thanks again.


Tapatalk kullanarak iPad aracılığıyla gönderildi

Sorry I have zero information on that cpu other than what I found on a Reddit post, 100 H/s.

So unless your electricity is free its probably only good to use as a learning tool.

 

[Klee]

In honor of one node dieing I am using the cpu's in the new server.

It lets me start on the new server with the two now available cpu's without waiting on the 2665's.

First I booted from a dedicated hard drive running Win 7 just to update the bios.

Next I installed Ubuntu 17.04 server and now its updating.

Edit: To fix the hang on reboot error.

Fix from the first big wiwynn thread.

echo "options mei-me disable_msi=1" | sudo tee /etc/modprobe.d/mei-me.conf

EDIT2:
Installing htop lmsensors and a few other programs.

Installed xmrig.

Had to enable huge pages to get rid the hugepages disabled message.

And it runs.

These E5-2620's seem to perform much better with xmrig compared to xmr-stak-cpu.

Oh and its much quieter than the nodes running the 2660's, fans are spinning alot slower.

 

[Klee]

Recieved my E5-2665 V1's in today and installed them into my third open compute server.

With xmr-stack I get ~910 H/s per node.
With xmrig I get ~896 H/s.

 

[Klee]

Running xmr-stak-cpu:

The 2665's run a bit hotter than the 2660's about 10c hotter.

Hottest 2660 is ~78c
Hottest 2665 is ~88c

Running xmrig the 2665's do ~895 H/s at ~85c.

 

[Artlimber]

What is your wattage use for the 2665's? I saw above you said 400W for the 2660's, 2665 is probably pretty close to that?

 

[Klee]

Finally all the 2660's and 2665's hashing.

 

[spfoo]

Running xmr-stak-cpu:

The 2665's run a bit hotter than the 2660's about 10c hotter.

Hottest 2660 is ~78c
Hottest 2665 is ~88c

Running xmrig the 2665's do ~895 H/s at ~85c.

Those temps seem very high. Have you measured the CPU temperature effect on power consumption? I've noticed that on AMD CPUs it has a significant effect. My only measures are from the watt usage that my UPS displays. Not sure how accurate these are.