Single NVME node Ceph Benchmarking OSD Tips

Discussion in 'Hard Drives and Solid State Drives' started by OBasel, May 22, 2017.

  1. OBasel

    OBasel Active Member

    Joined:
    Dec 28, 2010
    Messages:
    494
    Likes Received:
    62
    I'm trying to benchmark a single Ceph node and have 8 NVMe drives setup as OSD's but my speeds are 700MB / sec. Any tips on why I'm missing the speed of even one drive?
     
    #1
  2. vrod

    vrod Active Member

    Joined:
    Jan 18, 2015
    Messages:
    233
    Likes Received:
    33
    First of all I believe the point of ceph is to span a storage across several nodes and not just one. As far as i know though, ceph is really not that good in performance. Unless you are planning to expand to other nodes with ceph, go zfs or something similar.
     
    #2
  3. Patrick

    Patrick Administrator
    Staff Member

    Joined:
    Dec 21, 2010
    Messages:
    11,541
    Likes Received:
    4,464
    @OBasel sorry I missed this. The trick in these types of systems is multiple OSD per NVMe device. That is an extremely common practice for NVMe OSDs.
     
    #3
  4. Patriot

    Patriot Moderator

    Joined:
    Apr 18, 2011
    Messages:
    1,278
    Likes Received:
    658
    Ceph is not a performant solution and you have found the per OSD bottleneck.

    Just to clarify, this is a test lab solution to get performance, not a production solution.
     
    #4
Similar Threads: Single NVME
Forum Title Date
Hard Drives and Solid State Drives What to do with single NVMe drive? Oct 21, 2018
Hard Drives and Solid State Drives Sun Oracle F40 F80 Lsi Nytro Single Drives? Jul 1, 2018
Hard Drives and Solid State Drives Using ReFS for single drives Aug 18, 2016
Hard Drives and Solid State Drives Single Channel SAS? Apr 20, 2016
Hard Drives and Solid State Drives Need thoughts on using Skyhawk "NVMe" PCIe SSD 1.92TB Oct 27, 2019

Share This Page