44 cores 512gb X10DRG-Q 4-way SLI

Discussion in 'Processors and Motherboards' started by Venturi, May 12, 2016.

  1. Venturi

    Venturi Active Member

    Joined:
    Apr 22, 2016
    Messages:
    123
    Likes Received:
    165
    True
    But I've found if something can be sli-ed at all, that going to 4 way is simple

    In star citizen
    I found the inconsistencies even running in single gpu mode

    At 2560x1600 it's relatively within 20 frame spread in fps, at 4096 x 2160 the variation is huge


    So hopefully they will one day (might be years before its complete) they will optimize it ;)
     
    #81
  2. William

    William Active Member

    Joined:
    May 7, 2015
    Messages:
    762
    Likes Received:
    236
    With my older setup using 2x Titan Blacks @ 3840 x 2160 I had to lower screen res and details to get playable frame rates. Now with 1x 1080gtx I am at full screen res and max details getting 30 FPS solid.

    And yes the game is not optimized yet, they still have much work to do.

    And actually I believe Nvidia is moving away from SLI+ requirements. Did you have to get a special key from Nvidia for that setup ?
    I know if you go more than 2x 1080's you need a special key for that.
     
    #82
  3. Venturi

    Venturi Active Member

    Joined:
    Apr 22, 2016
    Messages:
    123
    Likes Received:
    165
    Nvidia offered no help, I had to reverse engineer it to get it to work.

    But until nvidia get a single card to run an 8k monitor at over 60fps with max eye candy, I think sli is going to be around a while
     
    #83
  4. William

    William Active Member

    Joined:
    May 7, 2015
    Messages:
    762
    Likes Received:
    236
    Yeah the new bridge also makes a huge dif from what I hear.
    Did you use the older 4 Way bridge ?

    Not sure if they even make a new 4 Way bridge.
     
    #84
  5. Venturi

    Venturi Active Member

    Joined:
    Apr 22, 2016
    Messages:
    123
    Likes Received:
    165
    you have to use no less than the metal clip v2 bridge or make / craft an 8 socket v3 bridge

    seriously
     
    #85
  6. William

    William Active Member

    Joined:
    May 7, 2015
    Messages:
    762
    Likes Received:
    236
    WOW !
     
    #86
  7. maxermaxer

    maxermaxer Active Member

    Joined:
    Oct 28, 2016
    Messages:
    220
    Likes Received:
    25
    Hello Venturi, I have started thinking to use the Supermicro X10DRG-Q to build a 4-GPU system before I saw your post. I have also purchased the motherboard. I was planning to use beQuiet! Darkbase Pro 900 to host this motherboard but I am not sure if it works. Then I see your post and notice this Core P5 massive case. Would you mind sharing with me what you have modified to this case? Can you show us some photos on the modded places?

    On the other hand, if you were to build this again would you still choose this chassis? Do you see other better choice? Thanks a lot in advance!
     
    #87
  8. Venturi

    Venturi Active Member

    Joined:
    Apr 22, 2016
    Messages:
    123
    Likes Received:
    165
    maxermaxer

    the Darkbase Pro 900 is quite a monster, and much bigger presence then the p5. With that said

    The original intent was quiet thermal management and fitting the board itself.

    on thermal:
    the p5 has an open design, noise is very little the only audible noise is the little fan on the chipset of the x10drg-q.
    The front has a glass cover or lean depending if you buy the tempered glass version of the p5.
    The front, top, back and bottom are open and allow full cooling. Check earlier parts of the post for temps on high usage that are less than 15F above room temp. I don't know ANYONE else with temps as low as me (also because of using the right tim, heatsinks, fans, setup etc)

    On fitment:
    The Darkbase pro 900 would have to be heavily modified to fit all the pcie slots. If you look at the back of the car you're going to have quite some work to make that happen and you will end up cutting off the whole back (everything) from the pro 900.

    The P5 is not much better as you'll have to fabricate a few pieces if you want all 7 slots, but if you want just the base 4 (8x spaces) you can use the included bracket with the p5.

    so there is some work to be done on the p5 to make it work. I used the sliding motherboard tray from a casuals workstation as the motherboard plate, drilled out the corresponding missing standoffs and mated that to the p5.

    I had no choice as I wanted ALL the pie slots to be available


    I'm on a trip right now, but when I get back I'll emceed pictures taken during the build

    if you can make the Darkbase Pro 900 work for you that would be great. I was catering to thermal, visual, and functionality when I used the p5.



    seriously, the only noise you hear is the damn chipset fan. I'm looking for a solution for that still
     
    #88
    gigatexal likes this.
  9. Jon Massey

    Jon Massey Active Member

    Joined:
    Nov 11, 2015
    Messages:
    340
    Likes Received:
    82
    Is it not just as simple as swapping it with a suitably-specified Noctua?
     
    #89
  10. RobertFontaine

    RobertFontaine Active Member

    Joined:
    Dec 17, 2015
    Messages:
    666
    Likes Received:
    148
    Make sure whatever enclosure you purchase has 11 expansion slots or more. I ended up using the lian li d8000. I have 2 noctuas on my board and the sound is home office acceptable even during a render.
     
    #90
  11. Venturi

    Venturi Active Member

    Joined:
    Apr 22, 2016
    Messages:
    123
    Likes Received:
    165
    unfortunately not

    Ive been unable to find a micro fan that is any quieter and that would fit in the same spot on the same heatsink
    It requires a heatsink fan combo on the motherboard chipset that can be flat enough to fit under the 4 video cards that come over it. I have 1 cm of room/height to play with for heatsink/fan height.

    A passive heatsink 1 cm tall would still need to route the cooling pipes out of the way as well

    so, no, its been a pretty tough

    BUT PLEASE GIVE ME SUGGESTIONS!!!
     
    #91
  12. Venturi

    Venturi Active Member

    Joined:
    Apr 22, 2016
    Messages:
    123
    Likes Received:
    165

    OMG the lian-li d8000 is a MONSTER

    Its HUGE, its BIG, it would be TOO DEEP, I don't think I could even fit that in.
    (everyone likes to have those problems)

    It wouldn't even fit under my desk much less my room! And its too deep to have it under the desk (if it would fit) without it hitting the back wall

    My hat's off to you, the lan-li would have it all so much easier for me, but I couldn't fit it

    The chassis would have been a dream to work with compared to the thermaltake P5 and it was on my list at the top, but I gave in to the Dremel instead

    The lianli would have turned two weeks of creative engineering into 3 hours of normal build.

    Believe me, there where moments where I was going to give up on the P5
     
    #92
  13. maxermaxer

    maxermaxer Active Member

    Joined:
    Oct 28, 2016
    Messages:
    220
    Likes Received:
    25
    Thanks for the prompt reply even when you are on the trip. Yes I think I have to do a lot of mod to the DarkBase Pro 900 to make it work. I hesitate to cut anything on that chassis since I feel it would make the back of the chassis look awkward.

    At the moment I am studying the 11X slots chassis of LianLi (聯力工業股份有限公司 Lian Li Industrial Co., Ltd. | PC-A76). It looks quite solid. Have you encountered any other chassis that you should have used, after building the system mentioned in this post?

    No hurry to reply since you are on the trip. Take your time!
     
    #93
  14. gigatexal

    gigatexal I'm here to learn

    Joined:
    Nov 25, 2012
    Messages:
    2,701
    Likes Received:
    502
    i regret getting rid of my li d8000 it was a beast and well built too
     
    #94
    Last edited: Nov 21, 2016
  15. TLN

    TLN Active Member

    Joined:
    Feb 26, 2016
    Messages:
    350
    Likes Received:
    38
    I'd look into caselabs at this point. Design is a bit too simple, and have some misaligned lines in my perfecionist opinion.

    ps. @Venturi, you're mentioned that want to install glass on top/front. Thermaltake recently released exactly that. P5 with glass panels. Check it out.
     
    #95
    Last edited: Nov 21, 2016
  16. maxermaxer

    maxermaxer Active Member

    Joined:
    Oct 28, 2016
    Messages:
    220
    Likes Received:
    25
    Hi TLN, would you mind sharing the link where you saw this? Can't find it on their site......


    Sent from my iPhone using Tapatalk
     
    #96
  17. TLN

    TLN Active Member

    Joined:
    Feb 26, 2016
    Messages:
    350
    Likes Received:
    38
    #97
  18. maxermaxer

    maxermaxer Active Member

    Joined:
    Oct 28, 2016
    Messages:
    220
    Likes Received:
    25
    #98
  19. maxermaxer

    maxermaxer Active Member

    Joined:
    Oct 28, 2016
    Messages:
    220
    Likes Received:
    25
    Hi Venturi, I am now building a similar rig as the one you built. The following is the spec:

    1. CPU: E5-2683 v3 X 2
    2. Motherboard: Supermicro X10DRG-q
    3. RAM: 128GB Samsung ECC Ram
    4. GPUs: 4 x GTX 1070
    5. PSU: Corsiar 1500W
    6. CHASSIS: Thermaltake Core P5 Temper glass Edition (Was trying to get Lian Li but it will take 1.5 month for the chassis arrive...)
    7. SSD: Plextor 256G PCIE SSD

    I have done heavy modding to the chassis. It's a difficult and also fun process. I will post some photos later.

    Now I actually have a few questions for you and appreciate if you can help answer:

    1. What exact model of CPU heat sink do you use? I know it is ILM format but I am not sure which model you use.

    2. Where did you get the little piece of extra 3-slot expansion slots supporting plate (not sure I make it clear what it is since I don't know the name of that little thing. Sorry for my English vocabulary)

    3. Why do you use Windows Server 2012 instead of Windows 10?





    Sent from my iPhone using Tapatalk
     
    #99
  20. Venturi

    Venturi Active Member

    Joined:
    Apr 22, 2016
    Messages:
    123
    Likes Received:
    165
    Absolutely no problem

    first- MAKE SURE YOU SET UP BIOS CORRECTLY
    then:

    1. For heatsink I use the narrow ILM

    Noctua NH-D9DX
    I did replace the fans with less ugly black similar performance 92mm, very very quiet

    2. I had to make that 3 slot expansion you referenced. I dremeled a 3 slot section from an old computer case, its all I could think to do at the time. About 5 minute effort and then shot it with a few strokes of flat black automotive spray paint (about 7 bucks from auto store)

    3. (takes deep breath all Ace Ventura about to give a list)

    In comparison to windows 10, Windows 2012r2

    Privacy
    Is faster with multi socket numa structures.
    I can decide my updates
    No telemitry
    Privacy
    Better privacy control
    no win10 forced updates
    no cortana
    *Privacy
    *
    faster Vulkan
    *faster array response
    *I use cache on die with my cores, win 10 has issues that would have to be fixed in registry
    *Full control over desktop
    *ALL my games work with server 2012r2, a handful will NEVER work on Win10
    *2012r2 is a better desktop experience than windows 10
    *Nvidia driver work better if you are doing VM, they are gimped in w2010
    *There are websites to convert 2008, 2012, and 2016 to a workstation, they are useful references AND converting 2012r2 to full desktop experience only takes a few minutes.

    Convert your Windows Server 2012 to a Workstation!
    *Privacy
    *Faster response across most aspects including it just 'feels' faster
    *When idle I have only 7 items/processes in all in task manager
    *Better memory handling
    *Better threading



    In comparison to windows 2012r2, Windows 2010
    *Dx12
    (but... I don't have single instance in any games was better than Vulcan or DX11.2)
    *Cortana... again.. lack of privacy
    *Lack of Privacy
    *telemitry -
    yes, you can turn it off, but not completely

    I'm working to convert server 2016 to desktop, but running into a few issues so far (but I'll get it figured out eventually)
    1. Update engine is NOT suitable to a server, not enough control on selecting/deselecting updates
    2. Telemitry - yes, you can turn it off, but not completely
    3. Multiple telemitry and recursive services including
    additional task scheduler services that re-enable telemetry even if they are deleted.



     
    #100
    SycoPath and gigatexal like this.
Similar Threads: cores 512gb
Forum Title Date
Processors and Motherboards Threadripper 3990X, 64 cores, 4 memory channels? Nov 25, 2019
Processors and Motherboards AMD Unveils 7nm EPYC Rome Processors, up to 64 Cores and 128 Threads for $6,950 Aug 7, 2019
Processors and Motherboards Atom C3000 / Proxmox VE / SOHO - 4 or 8 cores? Mar 15, 2018
Processors and Motherboards Asus X99 Deluxe II BIOS only showing 18 of 22 cores? Sep 28, 2017
Processors and Motherboards Intel’s Skylake Xeon E5 2699 v5 32 Cores Leaked Benchmark Mar 25, 2017

Share This Page