Mining with Opteron Servers

TheYeti

New Member
Dec 3, 2017
4
0
1
42
Hey all. Looking for some pointers. Haven’t tested Linux yet although believe it may be the way to go.

Running DL385P G8’s
2 x 16 Core Opteron 6386’s 3.2Ghz ish
32Gb RAM (128 didn’t make any difference)
300Gb SAS

Managed to get running on 24 cores at 1200h but pretty sure these CPU’s should do a lot more. Any tips would be very appreciated.
 

Pooppoops

New Member
Dec 6, 2017
2
0
1
38
Hi Yeti,

I am running Supermicro H8DGU-F's with dual 6272's (also 16 core and same cache sizes) on Linux and achieve just a hair under 1KH/s. It may sometimes get you better performance if you use less threads than you have cores due to contention. I'd expect you to do quite a bit better than the 6272 as your chip is 2.8GHz w/o ocing vs. 2.1GHz for mine. These are outfitted with 4 dimms, the optimal config for 2 CPU according to the manual is 8 dimms. I tried that too, no real difference in hash rate between 4 and 8 dimms.

For example, to reach the max I reached I am running 28 cores on these - specifically I left core 0, 8, 16, and 24 out - and it had to be these ones. Each mem channel is on every run of 8, so you have to remove a core from each channel. Seems like 7 cores/channel is the max before contention happens... could be wrong though - someone let me know a trick please if I am!

I take it you are running Win7? I read somewhere else on these forums people getting like maybe 10%+ better perf out of xmr-stak-cpu on Win7 than Linux, but I haven't confirmed that on my own setup just yet.
 

Pooppoops

New Member
Dec 6, 2017
2
0
1
38
Yeti,

I also have a question for you, I am thinking of trying some builds now with DL385p boards - what's the bare minimum to get this board to POST? I have the HP power supply (just one) and the PCB connector thing it plugs into the board with. What else do I need?
 

cafcwest

Member
Feb 15, 2013
136
14
18
Richmond, VA
For example, to reach the max I reached I am running 28 cores on these - specifically I left core 0, 8, 16, and 24 out - and it had to be these ones. Each mem channel is on every run of 8, so you have to remove a core from each channel. Seems like 7 cores/channel is the max before contention happens... could be wrong though - someone let me know a trick please if I am!
An explanation, and a huge thank you sir.

Explanation: These chips have 16MB L2 + 12MB L3. Two processors, 56MB total /2 = 28 cores.

Thank you: I have a 4P system with Opteron 6200s, and had been running Wolfs on Ubuntu for the last 6+ months as no other miner in Windows could deliver similar performance. I tried the latest version of Stak earlier in the week, and had tried skipping cores (but dropping off the 8th core of each NUMA 'socket'), and a variety of other configurations with no effect. Based on what you said above, I reconfigured tonight and just picked up 150H/s. So once again, thank you sir!
 

virtualpimpin

New Member
Dec 22, 2017
3
2
3
38
Hi All,

Just wanted to keep the information flowing on this Opteron thread..

XMR-STACK-CPU under Ubuntu 17.04
Dell R815 x 2 ( 4 x 6380 Opteron ) 2190 H/s +/- 10 each
Dell R715 x 1 ( 2 x 6380 Opteron ) 1085 H/s +/- 10

Dell R815 x 2 ( 4 x 6176 Opteron ) 410 H/s +/- 10 each
Dell R715 x 1 ( 2 x 6176 Opteron ) 280 H/s +/- 10

Looking at scooping up some additional 6380's since they are fairly inexpensive on ebay right now.
 

NASU

New Member
Dec 31, 2017
1
0
1
20
Hi All,

Just wanted to keep the information flowing on this Opteron thread..

XMR-STACK-CPU under Ubuntu 17.04
Dell R815 x 2 ( 4 x 6380 Opteron ) 2190 H/s +/- 10 each
Dell R715 x 1 ( 2 x 6380 Opteron ) 1085 H/s +/- 10

Dell R815 x 2 ( 4 x 6176 Opteron ) 410 H/s +/- 10 each
Dell R715 x 1 ( 2 x 6176 Opteron ) 280 H/s +/- 10

Looking at scooping up some additional 6380's since they are fairly inexpensive on ebay right now.
So 6380 is up to 4-5 time better than 6176??? Fascinating! But, is that really correct? Maybe this is a result for 1 Opt 6176, note 4?
Why is there such a difference? They are quite similar (+4 cores)...
 

virtualpimpin

New Member
Dec 22, 2017
3
2
3
38
So 6380 is up to 4-5 time better than 6176??? Fascinating! But, is that really correct? Maybe this is a result for 1 Opt 6176, note 4?
Why is there such a difference? They are quite similar (+4 cores)...

Quite a big difference between the 6176 (12 core) and the 6380 (16 core) CPU's. The primary reason for the 4x increase is AES offload, which is found in the 62xx/63xx series but not in the 6176CPUS. AES encryption is a core function of hashing so the not being able to offload AES instructions makes the cpu's pretty much useless for mining. The additional L2/L3 cache also helps.
 
  • Like
Reactions: MiniKnight and NASU

TheYeti

New Member
Dec 3, 2017
4
0
1
42
Hi all,

Wow, I want expecting a flurry of replies.

I’m still maxing out at 4400hs for 4 servers with 2 x 6386 CPU’s, however pools register about 1000hs higher.

I haven’t managed to find a cpu config that works on all the servers the same but I will try the suggestions here. Thanks for such comprehensive feedback.

I’ll post more notes later and will test win 7 too.
 

virtualpimpin

New Member
Dec 22, 2017
3
2
3
38
Hi all,

Wow, I want expecting a flurry of replies.

I’m still maxing out at 4400hs for 4 servers with 2 x 6386 CPU’s, however pools register about 1000hs higher.

I haven’t managed to find a cpu config that works on all the servers the same but I will try the suggestions here. Thanks for such comprehensive feedback.

I’ll post more notes later and will test win 7 too.

I haven't been able to surpass 1100 hs on 2 x 6380's so your 4400 is right in line with what I've found running 25/26 threads. My config under ubuntu 17 seems to provide unified results across my Dell 715 stack. Now i simply deploy a saved disk image for any new servers. Trimming the power usage and lowering fan speed is now my main concern. How many watts are you burning per machine. I'm at 320W per unit.
 

TheYeti

New Member
Dec 3, 2017
4
0
1
42
I’m st 347w I haven’t tweaked power at all and my 6386’s eat a little more power I guess. I’m happy at that wattage.
 

online gravy

New Member
Jan 10, 2018
1
0
1
25
Hi All,

Just wanted to keep the information flowing on this Opteron thread..

XMR-STACK-CPU under Ubuntu 17.04
Dell R815 x 2 ( 4 x 6380 Opteron ) 2190 H/s +/- 10 each
Dell R715 x 1 ( 2 x 6380 Opteron ) 1085 H/s +/- 10

Dell R815 x 2 ( 4 x 6176 Opteron ) 410 H/s +/- 10 each
Dell R715 x 1 ( 2 x 6176 Opteron ) 280 H/s +/- 10

Looking at scooping up some additional 6380's since they are fairly inexpensive on ebay right now.
i have 2 x 6380s and i can only get them to run 53 Sol/s on zcash. How do you get such high rates from yours?
 

ryngach

New Member
Jan 5, 2018
1
0
1
32
Hi Yeti,

I am running Supermicro H8DGU-F's with dual 6272's (also 16 core and same cache sizes) on Linux and achieve just a hair under 1KH/s. It may sometimes get you better performance if you use less threads than you have cores due to contention. I'd expect you to do quite a bit better than the 6272 as your chip is 2.8GHz w/o ocing vs. 2.1GHz for mine. These are outfitted with 4 dimms, the optimal config for 2 CPU according to the manual is 8 dimms. I tried that too, no real difference in hash rate between 4 and 8 dimms.

For example, to reach the max I reached I am running 28 cores on these - specifically I left core 0, 8, 16, and 24 out - and it had to be these ones. Each mem channel is on every run of 8, so you have to remove a core from each channel. Seems like 7 cores/channel is the max before contention happens... could be wrong though - someone let me know a trick please if I am!

I take it you are running Win7? I read somewhere else on these forums people getting like maybe 10%+ better perf out of xmr-stak-cpu on Win7 than Linux, but I haven't confirmed that on my own setup just yet.
Hi, did you do some overclocking to get 1KH / s from this CPU's?
 

TheYeti

New Member
Dec 3, 2017
4
0
1
42
All done using xmr miner with manual configuration of threads. Started with every other thread 0,2,4,6, that sinply hit 1kh after that’s was just tweaking get a couple of extra stable threads