[ebay BO] RMS-200/8G PCI-e NVRAM Accelerator 360$

Monoman

Active Member
Oct 16, 2013
335
96
28
FINALLY got mine installed on my proxmox host.

dual e5 2697v2
256gb ram
24x 200gb s3700 (off expander) to sas3 hba
RMS-200 8gb

Here's pveperf on just the drive.
Code:
root@pve1:/mnt# pveperf .

CPU BOGOMIPS:      259232.64
REGEX/SECOND:      1545679
HD SIZE:           7.80 GB (/dev/nvme0n1p1)
BUFFERED READS:    1723.78 MB/sec
AVERAGE SEEK TIME: 0.02 ms
FSYNCS/SECOND:     6827.35
DNS EXT:           43.92 ms
DNS INT:           57.11 ms (m0n0mana.local.lan)

Here's pve perv on my array with the RMS-200 with sync=standard
Code:
root@pve1:~# zfs set sync=standard s3700_pool
root@pve1:~# zfs get sync s3700_pool
NAME        PROPERTY  VALUE     SOURCE
s3700_pool  sync      standard  local
root@pve1:~# pveperf /s3700_pool/dir/
CPU BOGOMIPS:      259232.64
REGEX/SECOND:      1535681
HD SIZE:           2322.21 GB (s3700_pool)
FSYNCS/SECOND:     3805.59
DNS EXT:           42.72 ms
DNS INT:           58.03 ms (m0n0mana.local.lan)

Here's pve perv on my array with the RMS-200 with sync=always
Code:
root@pve1:~# zfs set sync=always s3700_pool
root@pve1:~# zfs get sync s3700_pool
NAME        PROPERTY  VALUE     SOURCE
s3700_pool  sync      always    local
root@pve1:~# pveperf /s3700_pool/dir/
CPU BOGOMIPS:      259232.64
REGEX/SECOND:      1555953
HD SIZE:           2322.21 GB (s3700_pool)
FSYNCS/SECOND:     2578.80
DNS EXT:           43.10 ms
DNS INT:           54.00 ms (m0n0mana.local.lan)
 
  • Like
Reactions: Patrick

Monoman

Active Member
Oct 16, 2013
335
96
28
P.S. It's quite a bit faster than when I used my optane (don't have the numbers off hand)
 
  • Like
Reactions: rshakin

i386

Well-Known Member
Mar 18, 2016
2,118
562
113
31
Germany
I got 3 of these devices for ~73£ each on ebay :D

Some windows diskspd numbers:
Code:
diskspd -b4K -c6G -d120 -L -o8 -r -Sh -t4 -w20 I:\testfile.dat
Code:
Input parameters:

   timespan:   1
   -------------
   duration: 120s
   warm up time: 5s
   cool down time: 0s
   measuring latency
   random seed: 0
   path: 'I:\testfile.dat'
       think time: 0ms
       burst size: 0
       software cache disabled
       hardware write cache disabled, writethrough on
       performing mix test (read/write ratio: 80/20)
       block size: 4096
       using random I/O (alignment: 4096)
       number of outstanding I/O operations: 8
       thread stride size: 0
       threads per file: 4
       using I/O Completion Ports
       IO priority: normal
Code:
CPU |  Usage |  User  |  Kernel |  Idle
-------------------------------------------
   0|  99.96%|  13.66%|   86.30%|   0.04%
   1| 100.00%|  10.25%|   89.75%|   0.00%
   2|  99.97%|   8.78%|   91.20%|   0.03%
   3|  99.96%|   9.10%|   90.86%|   0.04%
   4|  29.57%|  19.64%|    9.93%|  70.43%
   5|  29.66%|  21.95%|    7.71%|  70.34%
   6|  33.55%|  24.04%|    9.52%|  66.45%
   7|  30.63%|  22.43%|    8.19%|  69.38%
-------------------------------------------
avg.|  65.41%|  16.23%|   49.18%|  34.59%

Total IO
thread |       bytes     |     I/Os     |    MiB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |     25525678080 |      6231855 |     202.86 |   51932.12 |    0.134 |     0.237 | I:\testfile.dat (6144MiB)
     1 |     27306102784 |      6666529 |     217.01 |   55554.40 |    0.126 |     0.173 | I:\testfile.dat (6144MiB)
     2 |     30074277888 |      7342353 |     239.01 |   61186.27 |    0.114 |     0.153 | I:\testfile.dat (6144MiB)
     3 |     30585831424 |      7467244 |     243.07 |   62227.03 |    0.112 |     0.162 | I:\testfile.dat (6144MiB)
-----------------------------------------------------------------------------------------------------
total:      113491890176 |     27707981 |     901.95 |  230899.82 |    0.121 |     0.182

Read IO
thread |       bytes     |     I/Os     |    MiB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |     20423725056 |      4986261 |     162.31 |   41552.17 |    0.134 |     0.239 | I:\testfile.dat (6144MiB)
     1 |     21842378752 |      5332612 |     173.59 |   44438.43 |    0.125 |     0.171 | I:\testfile.dat (6144MiB)
     2 |     24058986496 |      5873776 |     191.20 |   48948.13 |    0.114 |     0.151 | I:\testfile.dat (6144MiB)
     3 |     24477962240 |      5976065 |     194.53 |   49800.54 |    0.112 |     0.158 | I:\testfile.dat (6144MiB)
-----------------------------------------------------------------------------------------------------
total:       90803052544 |     22168714 |     721.64 |  184739.27 |    0.121 |     0.181

Write IO
thread |       bytes     |     I/Os     |    MiB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |      5101953024 |      1245594 |      40.55 |   10379.95 |    0.135 |     0.229 | I:\testfile.dat (6144MiB)
     1 |      5463724032 |      1333917 |      43.42 |   11115.97 |    0.127 |     0.182 | I:\testfile.dat (6144MiB)
     2 |      6015291392 |      1468577 |      47.81 |   12238.14 |    0.115 |     0.163 | I:\testfile.dat (6144MiB)
     3 |      6107869184 |      1491179 |      48.54 |   12426.49 |    0.113 |     0.175 | I:\testfile.dat (6144MiB)
-----------------------------------------------------------------------------------------------------
total:       22688837632 |      5539267 |     180.31 |   46160.55 |    0.122 |     0.187



total:
  %-ile |  Read (ms) | Write (ms) | Total (ms)
----------------------------------------------
    min |      0.065 |      0.076 |      0.065
   25th |      0.104 |      0.105 |      0.104
   50th |      0.106 |      0.107 |      0.106
   75th |      0.112 |      0.113 |      0.112
   90th |      0.129 |      0.131 |      0.129
   95th |      0.158 |      0.160 |      0.159
   99th |      0.294 |      0.299 |      0.294
3-nines |      1.925 |      1.928 |      1.926
4-nines |      7.371 |      7.465 |      7.400
5-nines |     19.236 |     20.042 |     19.319
6-nines |     30.519 |     42.370 |     42.162
7-nines |     48.470 |     48.533 |     48.496
8-nines |     48.497 |     48.533 |     48.533
9-nines |     48.497 |     48.533 |     48.533
    max |     48.497 |     48.533 |     48.533
 
  • Like
Reactions: MiniKnight

Javik50k

Member
Oct 11, 2018
47
41
18
Does anybody know, can this be used for caching under windows? These are cheap, and have nice performance as a cache - 8GB and about 1m IOPS. Planning to get one, but i'm afraid this will be useless piece of hardware (will use it in my Windows NAS anyway, if it'll fail in workstation).
 
  • Like
Reactions: Samir

i386

Well-Known Member
Mar 18, 2016
2,118
562
113
31
Germany
These are "regular" nvme devices, you can use them as cache in storage spaces or other software raid implementations. Or as a small storage device for high performance (if your application needs less than 8gb space).
 
  • Like
Reactions: Samir

Javik50k

Member
Oct 11, 2018
47
41
18
These are "regular" nvme devices, you can use them as cache in storage spaces or other software raid implementations. Or as a small storage device for high performance (if your application needs less than 8gb space).
Thank you! That's exactly i want to do - cache my disk system. Maybe i should start new thread, but what about this card? PMC NVDRAM PCA-00364-03-C NVRAM Card TCA-00364-04-C | eBay

That is Microsemi NV-1616 really and it is NVMe compatible.
 
  • Like
Reactions: Samir

i386

Well-Known Member
Mar 18, 2016
2,118
562
113
31
Germany
You will need the additional flash Module for powerloss protection with the microsemi Card.
In nvme Mode IT should Work Like a normal Block device. The microsemi Card also Supports a dma Mode which allows Up to 10kk iops, but requires os and Application compatility.
 
  • Like
Reactions: Samir

Javik50k

Member
Oct 11, 2018
47
41
18
Seems i'll need only a supercap. This listing include flash memory module. Also where can i find specs for this? Microsemi wants login.
 
  • Like
Reactions: Samir

Javik50k

Member
Oct 11, 2018
47
41
18
Last edited:
  • Like
Reactions: Patrick and Samir

Javik50k

Member
Oct 11, 2018
47
41
18
Remember, i'm using prototype version. I don't know what differ my card from retail. Firmware may be incomplete and buggy. But i will try to reflash it to latest NV1616 firmware. If only i'll be able to get that firmware at all. Microsemi is very elusive.