Inspur AGX-5 and Our SC18 Discussion with the Company

Discussion in 'STH Main Site Posts' started by Patrick Kennedy, Nov 25, 2018.

  1. #1
  2. LukeP

    LukeP Member

    Joined:
    Feb 12, 2017
    Messages:
    137
    Likes Received:
    11
    why are all these servers 2u? why cant they just make them louder and halve them to 1u? there is nothing but fans and heatsinks in the top half.
    (please pay me 100k if you steal this idea)
     
    #2
  3. Patrick

    Patrick Administrator
    Staff Member

    Joined:
    Dec 21, 2010
    Messages:
    11,403
    Likes Received:
    4,351
    Cooling more than 8x V100's + 2 CPUs, 24 DIMMs, PCIe switches, and storage in a 2U chassis is not easy. Most with these configurations are 4U. Doing what the AGX-2 does in 2U is impressive. Cooling all of that in 1U is nearly impossible with air.
     
    #3
  4. LukeP

    LukeP Member

    Joined:
    Feb 12, 2017
    Messages:
    137
    Likes Received:
    11
    you can with smart heatsinks design. see recent cray designs what they do in 1u. it requires a bit of thought though. most of these 2u designs just throw in a row of fast fans and call it a day.

    depends how much you care about density.
     
    #4
  5. Patrick

    Patrick Administrator
    Staff Member

    Joined:
    Dec 21, 2010
    Messages:
    11,403
    Likes Received:
    4,351
    @LukeP sure https://www.servethehome.com/cray-shasta-cooling-by-coolit/

    8x Rome CPUs which have lower TDP than V100's. That is liquid cooled not air cooled.

    A complete system also will have 100Gb NICs CPUs RAM and NVMe

    4kW per U is not easy to cool. It is more efficient to do 4x1U in a 4U box than 1U servers because fans start having to spin so fast.


    I cannot talk about the specifics. One of the large server OEMs had a NDA booth at SC18 where they were trying to do 8x 350-400W parts in 2U. They had massive copper heatsinks in these machines.
     
    #5
    T_Minus likes this.
  6. LukeP

    LukeP Member

    Joined:
    Feb 12, 2017
    Messages:
    137
    Likes Received:
    11
    i know what youre saying. i just don't assume the past is necessarily the best achievable. every layout has been the same for ages. i just think they could do a re-think. it would require the vendor making bespoke all parts of the case. which on the downside would introduce much higher costs.
     
    #6
Similar Threads: Inspur AGX-5
Forum Title Date
STH Main Site Posts An Interview with Lillian Wang SVP and GM of Inspur CSP Business May 6, 2019
STH Main Site Posts Inspur Partner Forum 2019 Our Recap from IPF 2019 Apr 18, 2019
STH Main Site Posts Inspur Systems NF8260M5 4P Intel Xeon OCP Server Review Apr 15, 2019
STH Main Site Posts Inspur Compute and GPU Servers at OCP Summit and GTC 2019 Mar 20, 2019
STH Main Site Posts Inspur Systems NF5468M5 Review 4U 8x GPU Server Mar 5, 2019

Share This Page