Monero Mining Performance

im10er

New Member
Feb 11, 2018
8
0
1
41
1x Intel Xeon E5-2630L V3 = 354H/s
monero.0.o3c2ts4e28qd@crypto-2 | [2018-02-11 11:58:33] speed 2.5s/60s/15m 37.5 37.5 37.4 H/s max: 38.0 H/s
monero.0.u43o90yv3qi0@crypto-1 | [2018-02-11 11:58:56] speed 2.5s/60s/15m 18.8 18.9 18.8 H/s max: 19.6 H/s

According to your benchmarks I should be getting 354H/s per node.. but only getting the above.. any advice on debugging?
 
Last edited:

Joel

Active Member
Jan 30, 2015
818
169
43
40
monero.0.o3c2ts4e28qd@crypto-2 | [2018-02-11 11:58:33] speed 2.5s/60s/15m 37.5 37.5 37.4 H/s max: 38.0 H/s
monero.0.u43o90yv3qi0@crypto-1 | [2018-02-11 11:58:56] speed 2.5s/60s/15m 18.8 18.9 18.8 H/s max: 19.6 H/s

According to your benchmarks I should be getting 354H/s per node.. but only getting the above.. any advice on debugging?
It looks like you're only running a single thread? Posting your config file would be helpful, if you want help...
 

im10er

New Member
Feb 11, 2018
8
0
1
41
monero.0.o3c2ts4e28qd@crypto-2 | [2018-02-11 11:58:33] speed 2.5s/60s/15m 37.5 37.5 37.4 H/s max: 38.0 H/s
monero.0.u43o90yv3qi0@crypto-1 | [2018-02-11 11:58:56] speed 2.5s/60s/15m 18.8 18.9 18.8 H/s max: 19.6 H/s

According to your benchmarks I should be getting 354H/s per node.. but only getting the above.. any advice on debugging?

I just realized that crypto-1 is E5-2630 not E5-2630L I checked the logs and it says

monero.0.o3c2ts4e28qd@crypto-2 | * CPU: Intel(R) Xeon(R) CPU E5-2620 v4 @ 2.10GHz (1) x64 AES-NI
monero.0.f2o6eqhfcz79@crypto-3 | * CPU: Intel(R) Xeon(R) CPU E5-2620 v4 @ 2.10GHz (1) x64 AES-NI
monero.0.u43o90yv3qi0@crypto-1 | * CPU: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz (1) x64 -AES-NI

Based on specs, shouldn't the 2630 have AES-NI?
 

cellcore.systems

New Member
Jan 14, 2018
3
1
3
50
I just realized that crypto-1 is E5-2630 not E5-2630L I checked the logs and it says

monero.0.o3c2ts4e28qd@crypto-2 | * CPU: Intel(R) Xeon(R) CPU E5-2620 v4 @ 2.10GHz (1) x64 AES-NI
monero.0.f2o6eqhfcz79@crypto-3 | * CPU: Intel(R) Xeon(R) CPU E5-2620 v4 @ 2.10GHz (1) x64 AES-NI
monero.0.u43o90yv3qi0@crypto-1 | * CPU: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz (1) x64 -AES-NI

Based on specs, shouldn't the 2630 have AES-NI?
which OS are you running ?


Sent from my iPhone using Tapatalk
 

Patrick

Administrator
Staff member
Dec 21, 2010
12,204
5,290
113
That would be strange to have hardware AES-NI turned off in a BIOS.
 

DrStein99

If it does not exist ? I am probably building it.
Feb 3, 2018
105
4
18
47
New Jersey, USA
Hi. I'm new to this forum, I found while searching for help with my (4)x XEON E7 4850 rig. I figured I would post my depressing stats here.

(2) XEON E5-2670 20mb L3 cache, Windows 8.1. xmr-stak (modified by me): 981.2 h/s top (with nothing running) 920-950 h/s (using browser)
(4) XEON E7-4850 each: 24mb l3 cache, Ubuntu 16, xmr-stak (modified by me): 1410.0 h/s (high score), 1326 h/s (with nothing else running)

I was impressed with my first setup ( (2) Xeon E5-2670 ). When started the E7-4850 with 4 cpus at 24mb cache, I thought I was going to get over 200% more hash power. To my disappointment, I was wrong. I have spent the last 2 weeks trying to tune my system, but have not had success that made more than 50 h/s difference.
 

onsit

Member
Jan 5, 2018
98
26
18
30
Found some old Dell blades with Dual x5667 (quad cores with 12mb cache)

Dual x5667 @ 450H/s @ 200 watts

Not bad for a $12 processor
 

Patrick

Administrator
Staff member
Dec 21, 2010
12,204
5,290
113
@DrStein99 a few things to try:

1. Install docker on the E7 machine
2. Follow the guide here: https://forums.servethehome.com/index.php?threads/docker-xmrig-cryptonight-universal.18579/
3. When you follow the guide, make one docker container for each NUMA node and use --cpuset-cpus= to bind each container to physical cores. 12 threads per NUMA node
4. Remember to run sudo sysctl vm.nr_hugepages=128 before starting the docker containers

That has me much higher on E7 4- socket systems. Also using docker it is easy to deploy to hundreds or thousands more servers. It also gives you great logging, inspection, pause/ restart capabilities through docker.
 
  • Like
Reactions: DrStein99

DrStein99

If it does not exist ? I am probably building it.
Feb 3, 2018
105
4
18
47
New Jersey, USA
@DrStein99 a few things to try:

1. Install docker on the E7 machine
2. Follow the guide here: https://forums.servethehome.com/index.php?threads/docker-xmrig-cryptonight-universal.18579/
3. When you follow the guide, make one docker container for each NUMA node and use --cpuset-cpus= to bind each container to physical cores. 12 threads per NUMA node
4. Remember to run sudo sysctl vm.nr_hugepages=128 before starting the docker containers

That has me much higher on E7 4- socket systems. Also using docker it is easy to deploy to hundreds or thousands more servers. It also gives you great logging, inspection, pause/ restart capabilities through docker.
Ok thank you for the advice. Unfortunately I own enough servers to actually keep track in my head what they are all doing (or should be doing).

With 10-cores each on hyperthreading, was 80 threads total. The numbers were crazy when I tried to lay it out and organize since the core #'s are not assigned in human-friendly sequential order to each CPU. For me, I have found that turning the hyper-threading off, and dealing with only 10-threads for each (4) cpu's =40 total threads, was enough for me to play with without getting confused.

THEN I play fun games with the 6-10 deceptive bios settings that are PAINFULLY agonizing to set, since the Dell R810 wants to wait 2 minutes to "CONFIGURE MEMORY" every time reboot. Another 2 minutes for the stupid SAS controller with only 1 SSD (out of like 10 empty bays), giving me about 4-8 seconds to press "F2" at the exact right moment or be punished by resetting again. I really need to learn how to use the iDrac system management on that thing, if it's possible to re-do the bios settings remotely then I can finally install this in my freezing cold garage where it belongs.
 

Patrick

Administrator
Staff member
Dec 21, 2010
12,204
5,290
113
@DrStein99 Typically you use a launch script such as this:

Code:
#!/bin/bash

wally=<insertwallet>
thrperinst=12
pooldns=<pool address>
poolport=<pool port>


docker run -it -e pool=$pooldns -e startport=$poolport -e username=$wally -e pass=x -e numthreads=$thrperinst --cpuset-cpus="0-9,40,45" servethehome/universal_cryptonight:latest
docker run -it -e pool=$pooldns -e startport=$poolport -e username=$wally -e pass=x -e numthreads=$thrperinst --cpuset-cpus="10-19,50,55" servethehome/universal_cryptonight:latest
docker run -it -e pool=$pooldns -e startport=$poolport -e username=$wally -e pass=x -e numthreads=$thrperinst --cpuset-cpus="20-29,60,65" servethehome/universal_cryptonight:latest
docker run -it -e pool=$pooldns -e startport=$poolport -e username=$wally -e pass=x -e numthreads=$thrperinst --cpuset-cpus="30-39,70,75" servethehome/universal_cryptonight:latest
You can see the core layout using lscpu. If you are using a Dell, they have a different layout. They alternate so core0 on each chip alternates. So core0 on NUMA0 = 0, core0 on NUMA1 = 1, core0 on NUMA2 = 2 and so forth.

My tip there would be to enable HT, then use the script above as an outline. When you need to generate the --cpuset-cpus values, copy the output from the four NUMA lines in the lscpu output and everything below 40 on 10 core CPUs will be physical cores, everything above will be HT cores.

The benefit of scripting is that you will be able to easily kill a miner on an individual socket without having to restart the whole miner over on other CPUs. You can also experiment much faster, for example, with where to put the HT threads.
 

DrStein99

If it does not exist ? I am probably building it.
Feb 3, 2018
105
4
18
47
New Jersey, USA

pgh5278

Active Member
Oct 25, 2012
479
128
43
Australia
I went to the thread, it does not look like a guide. I need something for me to start off with, like how would I create a docker container for my version of xmr-stak, where do I begin. The link looks like it assumes I know how to use docker, and / or somehow download and use your docker container file images (whatever they are called).
Started in the same boat as You, a little leg work and self education is required to become familiar, google and persistence is your friend.
try here , if you search docker install on the home page you get presented with this....Good luck..
https://www.servethehome.com/monero-mining-on-linux-made-easy-with-docker/

Step 0: Install Docker (if it is not already)
If you want to install Docker you can either use your standard package manager or the company makes a one-liner install script that works on most platforms. Installing anything downloaded directly is dangerous so use this at your own risk:

wget -qO- https://get.docker.com/ | sh


and it installs, one line,, to learn about docker , type docker help on google, and read some basics, then it clicks..
 

DrStein99

If it does not exist ? I am probably building it.
Feb 3, 2018
105
4
18
47
New Jersey, USA
Oh, no I was not expecting someone to hold my hand and train me for free. I was just looking for possibly a better link / tutorial than what I could obviously find just by searching google. I only spent the last 2 hours wrestling with the screen trying to figure out the image creation (with no success... yet). I can figure this out.
 

Patrick

Administrator
Staff member
Dec 21, 2010
12,204
5,290
113

Joel

Active Member
Jan 30, 2015
818
169
43
40
@DrStein99 that is the point of making these images available. You can substitute the new universal image commands in something like https://forums.servethehome.com/index.php?resources/how-to-start-mining-monero-in-docker.34/

You can get started and relatively well-optimized mining experience without having to deal with all of that learning. While I like stak for Windows, xmrig is good in Linux, especially combined with Docker.
Big advantage for xmrig: hash rates are visible from Portainer logs instead of having to attach the container and type "h". :)
 

DrStein99

If it does not exist ? I am probably building it.
Feb 3, 2018
105
4
18
47
New Jersey, USA
You can get started and relatively well-optimized mining experience without having to deal with all of that learning. While I like stak for Windows, xmrig is good in Linux, especially combined with Docker.
xmrig is way better than xmr-stak for sure. I am trying to study how the mining software protocol works, and what goes on with the math processing. Tuning software only gets me so far, writing my own software I can than start breaking the limits and setting higher benchmarks.