Dedicated Crypto Mining Open Compute server build.

JazzFaucet

New Member
May 19, 2017
29
4
3
@Klee Did the Wiwynn servers come with a manual or any other form of documentation? All I have been able to find is a two-page data sheet that is light on detail. I am particularly interested in knowing the sort of memory they require. I know its 240 pin DDR3 for sure, but is it ECC? Registered? Having a look at Natex, I came across this and wonder if its compatible. Why do I want to know? Oh, no reason ;).
 

Klee

Well-Known Member
Jun 2, 2016
1,292
395
83
@Klee Did the Wiwynn servers come with a manual or any other form of documentation? All I have been able to find is a two-page data sheet that is light on detail. I am particularly interested in knowing the sort of memory they require. I know its 240 pin DDR3 for sure, but is it ECC? Registered? Having a look at Natex, I came across this and wonder if its compatible. Why do I want to know? Oh, no reason ;).

Nope no documentation at all, I have used Samsung EEC DDR3 12800r 8 gig sticks and Hynix EEC DDR3 8500 1 gig sticks and had no issues.

I'm guessing its not really particular about ram at all. If you want to use it any other wat than what I am doing fully load it up with ram, if you want to do what i'm doing, crypto-coin mining, get the cheapest 1 gig sticks you can find. I bought eight 1 gig sticks of the Hynix for under $18 and it runs fine for mining with one stick per cpu.

EDIT: The motherboard has a ton of information, some kind of cryptic, printed on the motherboard in tiny fonts.
 

Klee

Well-Known Member
Jun 2, 2016
1,292
395
83
Just received my 12 ft power cord to go from my 250v outlet to the PDU I have on order.

I have issues today with my main pc, I removed the RX480's and put the on ebay and plugged in a GTX 650 card so I went and did a fresh install of Windows 10 and the decided to go with Ubuntu 17.04 Desktop.

17.04 seems to be buggy and apps crash regularly. Going back to 16.04.02.
 

Klee

Well-Known Member
Jun 2, 2016
1,292
395
83
All the parts for the second server came in.

EDIT: I decided to use some fresh performance heat-sink compound and will compare to the OEM stuff. The OEM was not too soft unlike the first server which seemed to be fairly soft still. Will compare them to see if it makes a difference.

Now I'm running two 1 gig sticks of ram per node, one per cpu.

It runs!!! now I am updating the bios.

EDIT2: Installed Ubuntu 17.04 on both nodes in the second server. Now I need to update and install XMR-STAK-CPU.


EDIT3: I let Ubuntu installer "use the whole disk" automatically and it just made on big "/" partition with no swap. And with only two gigs I really would like to have at least a small swap space.

I going to reinstall and redo the partitions manually.

 
Last edited:

Klee

Well-Known Member
Jun 2, 2016
1,292
395
83
I ended up replacing the one SSD with a Hitachi 400 gig hard drive and configured all the bios's in all four nodes the same. I also reinstalled Ubuntu 17.04 on all 4 nodes to make them identical, partitions sizes types , mount points ect.

And I am writing a detailed how to as I do it with a few pics that I will post at a later time.
 
  • Like
Reactions: Marsh

Klee

Well-Known Member
Jun 2, 2016
1,292
395
83
Looks like the latest version of XMR-STAK-CPU is a little slower or something is configured differently.

About 840 H/s

EDIT: I am now using the older version and its back up to 868 H/s. Now install it on the other three nodes.
EDIT2: Node 2 is up and running at 868 H/s also.
EDIT3: All four nodes are up and hashing.:D
EDIT4: Took WAY too much time and energy to do four nodes at a time, maybe next time i'll go with a Docker image if there's one for mineXMR.com by then.
 
Last edited:

4004

Member
Feb 8, 2016
83
31
18

Marsh

Moderator
May 12, 2013
2,536
1,381
113
@4004

The Intel nodes each has its own set of 3 cooling fans. The fans of top 2 nodes turn faster than bottom 2 nodes.
IPMI shown power usage for bottom 2 nodes consume 190w each, top 2 consume 200w each.
Kill a watt meter shows 795 watt combined of 4 nodes.

Last 7days , we ( SF bayarea CA ) have mild and cool summer temperature ( day time high of around 70 F ).
I been mining with the Intel 4nodes space heater , using a table top fan to move hot air out of the room.
 

JazzFaucet

New Member
May 19, 2017
29
4
3
Are you able to share a link to where you downloaded the latest BIOS from @Klee? I had a look at the Wiwynn website and they do not list anything for the SV7210 server...
 

4004

Member
Feb 8, 2016
83
31
18
BIOS Version : EP_P09RG.02

Build Date : October 28, 2013
Thanks.


Can you or anyone verify the sv7210 will support 2600 v2s? I read here, but do not recall exact words saying something about v2s and the sv2710.

The release notes are specific about SB EP processor support, but no IB parts mentioned.


EP_P09RG.02 support notes quoted below for reference:

Processors supported:
SandyBridge EP Processor
Microcode update versions:
CPUID Version Status
0x206D2 0x8000020C Debug (SandyBridge EP B0)
0x206D3 0x80000304 Debug (SandyBridge EP B1)
0x206D5 0x00000513 Debug (SandyBridge EP C0)
0x206D6 0x00000619 Debug (SandyBridge EP C1)
0x206D7 0x0000070D Debug (SandyBridge EP C2)
 
Last edited:

Klee

Well-Known Member
Jun 2, 2016
1,292
395
83
Thanks.


Can you or anyone verify the sv7210 will support 2600 v2s? I read here, but do not recall exact words saying something about v2s and the sv2710.

The release notes are specific about SB EP processor support, but no IB parts mentioned.


EP_P09RG.02 support notes quoted below for reference:

Processors supported:
SandyBridge EP Processor
Microcode update versions:
CPUID Version Status
0x206D2 0x8000020C Debug (SandyBridge EP B0)
0x206D3 0x80000304 Debug (SandyBridge EP B1)
0x206D5 0x00000513 Debug (SandyBridge EP C0)
0x206D6 0x00000619 Debug (SandyBridge EP C1)
0x206D7 0x0000070D Debug (SandyBridge EP C2)
The V2 cpu's will not work with that bios, I have played around with the bios and created a modified bios to work with both ES cpu's and V2 cpu's a few weeks ago but I have not been brave enough yet to test it to see if it will actually boot with a V1 cpu. LOL

I need to get a chip programmer and a few spare bios chips first because I do not want to end up with a non booting node, been busy just getting the servers mining and the modded bios is not a priority right now since I have no ES or V2 cpu's.
 
Last edited:

Klee

Well-Known Member
Jun 2, 2016
1,292
395
83
I have been running the latest XMR-STAK-CPU-DEV on my dual E5-2667 V3 ES pc and it LOVES IT!! :D

It runs about the same H/s using only 16 cores, desktop is SUPER responsive its almost like its not even mining at all. :D

HASHRATE REPORT
| ID | 2.5s | 60s | 15m | ID | 2.5s | 60s | 15m |
| 0 | 69.0 | 67.6 | 68.1 | 1 | 60.3 | 66.0 | 66.1 |
| 2 | 72.2 | 73.4 | 73.5 | 3 | 71.5 | 70.0 | 70.5 |
| 4 | 72.8 | 70.8 | 71.4 | 5 | 72.7 | 71.0 | 71.9 |
| 6 | 61.4 | 57.4 | 56.8 | 7 | 61.4 | 61.5 | 61.3 |
| 8 | 70.3 | 66.2 | 63.9 | 9 | 71.1 | 67.5 | 63.1 |
| 10 | 75.7 | 72.5 | 69.5 | 11 | 75.8 | 69.1 | 67.7 |
| 12 | 76.5 | 69.0 | 67.0 | 13 | 77.5 | 72.5 | 70.3 |
| 14 | 66.7 | 62.0 | 60.5 | 15 | 65.9 | 63.5 | 60.9 |
-----------------------------------------------------
Totals: 1120.8 1079.9 1062.3 H/s
Highest: 1169.6 H/s






So I tried it on one of the open compute nodes, totally different story.

Ran it for the first time using the recommended settings it tells you to copy and paste to the config.txt file.

It ran at 204 H/s :(

After much fiddling with the "low_power_mode" : true, "no_prefetch" : true, in the config.txt the best was 304 H/s on the dev version vs 868 H/s on the older version of xmr-stak-cpu.

So I copied the "low_power_mode" : false, "no_prefetch" : false, from the older xmr config.txt and it gets about 835 H/s.

Then I changed it from "no_prefetch" : false to "no_prefetch" : true and it gets about 850 H/s.

Then I tried that on the older xmr-stak-cpu-master version and it went from 868 H/s to about 850 H/s

So on the open compute nodes I will stick to the older version for now.
 

Marsh

Moderator
May 12, 2013
2,536
1,381
113
I think Patrick is referring to post #68
Average Total Hash Rate: (24h) 3.22 KH/s

How many E5 CPU , GPU ? What models of CPU or GPU ?

I like to know too.
 

Klee

Well-Known Member
Jun 2, 2016
1,292
395
83
I think Patrick is referring to post #68
Average Total Hash Rate: (24h) 3.22 KH/s

How many E5 CPU , GPU ? What models of CPU or GPU ?

I like to know too.

8 x E5-2660
2 x E5-2620
2 x E5-2667 V3 es

No gpu's