Dedicated Crypto Mining Open Compute server build.

Klee

Well-Known Member
Jun 2, 2016
1,292
395
83
I'm running XMR-STAK-CPU on both Ubuntu 16.04 and 17.04 systems.

And I do not want to run the miner using the sudo command but if you do not run xmr-stak-cpu as sudo
you will get this error after every reboot:" Error: MEMORY ALLOC FAILED: mmap failed".

Unless you reenter this command "sudo sysctl -w vm.nr_hugepages=256" every time before you run xmr-stak-cpu.

To keep from having to reenter it every time after reboot do this:

Edit /etc/sysctl.conf

"sudo nano /etc/sysctl.conf"

Put this at the end of sysctl.conf

"vm.nr_hugepages = 256"

Reboot the system.

Check the page size .

"cat /proc/meminfo | grep Huge"

The output should be something like this:

"AnonHugePages: 4096 kB
HugePages_Total: 256
HugePages_Free: 256
HugePages_Rsvd: 0
HugePages_Surp: 0
Hugepagesize: 2048 kB

The page size is 2048 KB."

Then you should be able to run "bin/xmr-stak-cpu" without the error and without having to reenter "sudo sysctl -w vm.nr_hugepages=256".
 
Last edited:
  • Like
Reactions: Patrick

Klee

Well-Known Member
Jun 2, 2016
1,292
395
83
Just gonna run them for a few days before try one 1 gig stick per cpu.

Should run ok, since each node is running ~550 - ~ 650 mb's of ram.

550 for the headless node and 660 for the one that still has the video card.
 

Jetlag

New Member
Jun 7, 2016
17
4
3
41
How many cores are in the CPU on the right? The sensor only shows 8 cores per CPU but they're numbered strangely.
 

Klee

Well-Known Member
Jun 2, 2016
1,292
395
83
How many cores are in the CPU on the right? The sensor only shows 8 cores per CPU but they're numbered strangely.

The cpu's that show core's 0,2,3,5,8,10,12, and 14 ?

Those are E5-2667 V3 ES cpu's , they appear to be at least 15 core cpu's that intel deactivated all but 8 cores. Some programs show 8 cores others show what lm-sensors is showing.

They are a HCC die in size and have 35 MB L3 cache each so 70 mb for the pair so that means mining in monero I can mine on all the threads (32).
 
Last edited:

Klee

Well-Known Member
Jun 2, 2016
1,292
395
83
They have a littler higher "highest" speed.

914.3 H/s and 897.9 H/s.


 

Klee

Well-Known Member
Jun 2, 2016
1,292
395
83
The server has been running a whole week now and %100 solid.

I removed the 32 gigs of ram in node two and now have four 1 gig sticks per node, two 1 gig sticks per cpu.

I'll run them for a week then go to 1 gig stick per cpu.

Node one has been hashing a little faster than node 2, node one had four 8 gig sticks of Samsung DDR3 12800 and node two had eight 1 gig sticks of Hynix DDR3 8500.

Now both nodes have the DDR3 8500 and are configured identically except node one has a SSD and node 2 has a WD 1 gig hdd.


EDIT: The DDR 3 8500 ram does make a little bit of difference, about 10 H/s slower than the DDR3 12800.
 
Last edited:

Klee

Well-Known Member
Jun 2, 2016
1,292
395
83
Just wondering, will ram fillers help with the temps of the cpu's? With just one or two sticks of ram next the the cpu heat sink a lot of air seems to be bypassing the cpu cooler.
 

Klee

Well-Known Member
Jun 2, 2016
1,292
395
83
I just ordered four more E5-2660's, a pdu and I have figured out my 250v wiring needs.

The corner that has been my vintage pc and pc build area needs a complete reorganization, deciding to build a rack or maybe just use shelving rack.
 

Klee

Well-Known Member
Jun 2, 2016
1,292
395
83
Final prices and setup and performance.

2x Wiwynn open compute server $380.00 NEW*
4x E5-2660 V1 cpu’s $207.92 (best price found but the seller only had 4) USED
4x E5-2660 V1 cpu’s $230.80 USED
8 Gb of DDR 8500 8x1 Gb sticks $17.50 USED
4x used hard drives that I already had $00.00 USED
1x New HP PDU $10.00 NEW*
2x Power cords to reach unused 250V a/c outlet $20.00 NEW
*not including shipping

Total $866.22 gives 3480 H/s

I did not include the prices of the video card or pci-e usb card that were installed to install Ubuntu Server 17.04, the video card was an old Dell oem nvidia that came out of a free pc, the usb card was borrowed from my main pc.

To mine XMR that comes out to about $1000.00 less than a dedicated 5 GPU rig using RX580 4 gig card with slightly higher performance.

I went with new Wiwynn open compute servers, you could save another $100.00 buy going with two used Quanta open computer servers, I hate buying used motherboards and was willing to spend a little more.
 
Last edited:

JazzFaucet

New Member
May 19, 2017
29
4
3
Any word on power consumption @Klee? I see that several people asking in the thread, but no reply as yet. I would love to know so I can figure out what the return would be per open compute server given my local currency and electricity spot rate. Compared to using a 1080 Ti (0.4 h/s/$), Genesis Mining (0.9 h/s/$), or the 4-node Supermicro server I found on eBay (0.5 H/s/$), your open compute solution is by far and away the most efficient at 2.5 h/s/$. But that only accounts for the server output - how about the inputs?

Also, just out of curiosity, is the RAM you are using error correcting? I guess it does not really matter while mining, but might be a consideration if you intend to use the nodes for something else later.

Update: I see from the Wiwynn SV7210 datasheet that each node is rated at 300W max. That will do for back of the envelope calculations.
 
Last edited:

Klee

Well-Known Member
Jun 2, 2016
1,292
395
83
Any word on power consumption @Klee? I see that several people asking in the thread, but no reply as yet. I would love to know so I can figure out what the return would be per open compute server given my local currency and electricity spot rate. Compared to using a 1080 Ti (0.4 h/s/$), Genesis Mining (0.9 h/s/$), or the 4-node Supermicro server I found on eBay (0.5 H/s/$), your open compute solution is by far and away the most efficient at 2.5 h/s/$. But that only accounts for the server output - how about the inputs?

Also, just out of curiosity, is the RAM you are using error correcting? I guess it does not really matter while mining, but might be a consideration if you intend to use the nodes for something else later.

Update: I see from the Wiwynn SV7210 datasheet that each node is rated at 300W max. That will do for back of the envelope calculations.

I still do not have a way to measure the power, my kilowatt meter is 110v only. Any idea what I can use to read it that will work with 250v? The clamp on amp meters I have seen I just am not sure of their accuracy at lower amps.