Tesla V100 VS. P100 (deep learning speed testing)

Discussion in 'Machine Learning, Deep Learning, and AI' started by dhenzjhen, Oct 19, 2017.

  1. dhenzjhen

    dhenzjhen Member

    Joined:
    Sep 14, 2016
    Messages:
    38
    Likes Received:
    55
    This is only a speed training testing without any accuracy or tuning involved. I only want
    to test and compare the V100s and P100s in terms of crunching speed. In this testing, I used
    1281167 training images and 50000 validation images (ILSVRC2012) and NV-caffe for deep
    learning framework. On the networks, I used AlexNet, GoogleNET and CaffeNET with different
    batch sizes and 300,000 iterations runtime on all the tests.

    System: Supermicro SYS-4028GR-TXRT
    Motherboard: X10DG0-T
    CPU: E5 2699V4 x 2
    MEM: 32GB Micron x 12
    BIOS: 5/25/17
    GPU: Nvidia Tesla V100 SXM2 x 8 | P100 SXM2 x 8
    OS: Ubuntu 16.04 x64
    Driver: 384.81
    CUDA: version 9

    [​IMG]


    -dhenzjhen@SMCI
     
    #1
    Last edited: Oct 21, 2017
  2. William

    William Active Member

    Joined:
    May 7, 2015
    Messages:
    669
    Likes Received:
    216
    WOW man, pretty sweet !
     
    #2
    dhenzjhen likes this.
  3. dhenzjhen

    dhenzjhen Member

    Joined:
    Sep 14, 2016
    Messages:
    38
    Likes Received:
    55
    Thank u sir!
     
    #3
    William likes this.
  4. hifijames

    hifijames New Member

    Joined:
    Dec 26, 2017
    Messages:
    25
    Likes Received:
    7
    That's some serious horsepower you got there! Wish I could have that kind of toys to play with:)
    I am a total noob here, so please forgive my ignorance. How involved will it be to switch one framework to another, say from Caffe to Tensorflow?
     
    #4
  5. gigatexal

    gigatexal I'm here to learn

    Joined:
    Nov 25, 2012
    Messages:
    2,472
    Likes Received:
    437
    yeah yeah but can it run crysis? jk, that's pretty sweet.
     
    #5
  6. LukeP

    LukeP Member

    Joined:
    Feb 12, 2017
    Messages:
    107
    Likes Received:
    9
    Looks terrible. V100 should be 10 times faster
     
    #6
  7. LukeP

    LukeP Member

    Joined:
    Feb 12, 2017
    Messages:
    107
    Likes Received:
    9
    any followup why V100 with its 110Tflops is so slow? was that benchmark not tuned for V100?
     
    #7
  8. dhenzjhen

    dhenzjhen Member

    Joined:
    Sep 14, 2016
    Messages:
    38
    Likes Received:
    55
    Hi Luke,

    Sorry I don't have access to GPU servers anymore.
     
    #8
Similar Threads: Tesla V100
Forum Title Date
Machine Learning, Deep Learning, and AI Tesla V100 VS. P100 (images trained per second) Oct 23, 2017
Machine Learning, Deep Learning, and AI NEW OEM NVIDIA Tesla NVLink P100 SXM2 16GB CoWoS HBM2 Aug 31, 2018

Share This Page