Proxmox VE 5.0 and Docker with a Web GUI

Discussion in 'Linux Admins, Storage and Virtualization' started by Patrick, Mar 22, 2017.

  1. Patrick

    Patrick Administrator
    Staff Member

    Joined:
    Dec 21, 2010
    Messages:
    11,197
    Likes Received:
    4,148
    Heading off to sleep, but I think I have a project tomorrow that people are going to be interested in. We have had threads on Proxmox v. Docker and periodic threads on why not Proxmox and Docker.

    For a home lab proof of concept I now bring you: Docker running on Proxmox bare metal with a web GUI.

    Storage server: FreeNAS Corral (Xeon D-1518 based) with bhyve virtualization and Docker support
    Virtualization server: Proxmox VE 5.0 Beta1 (Xeon D-1540 based) with KVM virtualization, LXC containers (Proxmox GUI), Docker CE version 17.03.0-ce, Portainer Docker Management

    Here is the hello world of this setup.
    upload_2017-3-22_22-7-12.png

    I believe this is now the ultimate virtualization lab setup.

    • The FreeNAS host has bhyve and Docker (docker in a VM) plus super ZFS storage
    • The Proxmox host has KVM, LXC, and Docker for running applications plus ZFS, Ceph Luminous, and Gluster. Key here is that this KVM should support running Hyper-V nested.
    The Proxmox team specifically states this is a bad idea since adding Docker on metal Proxmox introduces a slew of security challenges. For lab use, the Proxmox server now has just about everything you could possibly want.

    I will try to get instructions up tomorrow morning if anyone is interested.
     
    #1
    epicurean, rubylaser, Kybber and 2 others like this.
  2. gigatexal

    gigatexal I'm here to learn

    Joined:
    Nov 25, 2012
    Messages:
    2,502
    Likes Received:
    441
    Easy to run nested virtualization is a huge selling point for me. I might try this
     
    #2
  3. MiniKnight

    MiniKnight Well-Known Member

    Joined:
    Mar 30, 2012
    Messages:
    2,789
    Likes Received:
    787
    This. Made. My. Day.

    Get typing.
     
    #3
  4. T_Minus

    T_Minus Moderator

    Joined:
    Feb 15, 2015
    Messages:
    6,415
    Likes Received:
    1,320
    I am most def. going to try and play around with this!
     
    #4
  5. MiniKnight

    MiniKnight Well-Known Member

    Joined:
    Mar 30, 2012
    Messages:
    2,789
    Likes Received:
    787
    Still waiting.
     
    #5
  6. Patrick

    Patrick Administrator
    Staff Member

    Joined:
    Dec 21, 2010
    Messages:
    11,197
    Likes Received:
    4,148
    Busy day today.
     
    #6
  7. gigatexal

    gigatexal I'm here to learn

    Joined:
    Nov 25, 2012
    Messages:
    2,502
    Likes Received:
    441
    so on the FreeNAS side you'd run a storage container and then on the Proxmox side you'd start container(s) that point to the storage container on FreeNAS? I guess I am not sure how this all shakes out, I'll wait for the article though.
     
    #7
  8. Eric Faden

    Eric Faden Member

    Joined:
    Dec 5, 2016
    Messages:
    97
    Likes Received:
    6
    This looks awesome.... I just wish proxmox would build in docker... Can't wait for instructions. Totally doing this on my boxes.
     
    #8
    Last edited: Mar 25, 2017
  9. Eric Faden

    Eric Faden Member

    Joined:
    Dec 5, 2016
    Messages:
    97
    Likes Received:
    6
    #9
  10. Patrick

    Patrick Administrator
    Staff Member

    Joined:
    Dec 21, 2010
    Messages:
    11,197
    Likes Received:
    4,148
    Yes. That is very easy to do. Putting it into a VM also means you add another level of abstraction which is why I wanted bare metal.
     
    #10
  11. Eric Faden

    Eric Faden Member

    Joined:
    Dec 5, 2016
    Messages:
    97
    Likes Received:
    6
    Big question I have right now is how to organize my setup. I think Proxmox + LXC Docker makes the most sense to me. The big question is how/where to put my Plex setup given it's I/O needs. Right now I have a Debian VM with Docker that has a LSI card passed through for the drives. I'm considering changing it up... but I'm not sure which would be the best.... But I already made a thread for this question.
     
    #11
  12. Eric Faden

    Eric Faden Member

    Joined:
    Dec 5, 2016
    Messages:
    97
    Likes Received:
    6
    Did you ever post a guide for this? I tried to install 5 on my supermicro box using ipmi... The screen didn't detect right. The ok button was off the screen to the right. Tried resetting... Still.. nothing. Going to setup something similar.

    Sent from my Pixel XL using Tapatalk
     
    #12
  13. Patrick

    Patrick Administrator
    Staff Member

    Joined:
    Dec 21, 2010
    Messages:
    11,197
    Likes Received:
    4,148
    @Eric Faden not yet. Was sick this weekend. On the docket for this week though since I want it out before Ryzen 5.
     
    #13
  14. Eric Faden

    Eric Faden Member

    Joined:
    Dec 5, 2016
    Messages:
    97
    Likes Received:
    6
    Awesome.

    Sent from my Pixel XL using Tapatalk
     
    #14
  15. ecosse

    ecosse Active Member

    Joined:
    Jul 2, 2013
    Messages:
    293
    Likes Received:
    41
    As someone who is a hell of a lot clearer about a virtualisation platform around VMware, I'd be very interested if there is a comparison of how the above is so much better than a stack built on ESXi (sorry if its a dumb comment, I realise that I'd still be layering docker etc ontop of VMware in that path)
     
    #15
  16. Patrick

    Patrick Administrator
    Staff Member

    Joined:
    Dec 21, 2010
    Messages:
    11,197
    Likes Received:
    4,148
    Starting off, ESXi (free) is fairly basic/ limited at this point right? Most features you want are an upgrade.

    Proxmox has the GUI for KVM but also has features like ZFS, Gluster, Ceph, LXC containers and the HA clustering side built in. The HCL is also larger for Proxmox than VMware out of the box (e.g. Realtek NICs) It is also "free".

    Big stack with a larger budget (or free licenses), VMware has a lot of awesome tools and a great ecosystem.

    If you are doing more cost sensitive work, Proxmox works very well. If you just need a basic hypervisor, VMware is great.
     
    #16
  17. _alex

    _alex Active Member

    Joined:
    Jan 28, 2016
    Messages:
    857
    Likes Received:
    92
    ESXi / VMware will
    - cost you a fortune if you want advanced features above a single node
    - bind you to a HCL
    - make you dependent on software/drivers/kernel modules available (i.e IB / Ofed) where you are free as a bird with proxmox as it's based on Debian / GNU Linux. Just get what you need and install from binary or compile.
    - not offer HC / the Storage options proxmox has built-in without VSan (=expensive, high requirements).
    - Not allow you to apply changes / work on features of the Host as it's not open. On proxmox you can add Kernel modules via dkms, Build custom Storage Plugins, replace the Kernel - whatever you want/need ...

    so, as long as you don't need Horizon/VDI or any other Feature not available in Proxmox (i.e. workload-based scaling of the Cluster by bringing hosts up/down) it's maybe the better, easier and also cheaper way to go. (correct me if i'm wrong)
     
    #17
  18. Patrick

    Patrick Administrator
    Staff Member

    Joined:
    Dec 21, 2010
    Messages:
    11,197
    Likes Received:
    4,148
    @_alex the obvious major pro for VMware is that there is a large company for support which is a major pro. Likewise, there is a giant community.
     
    #18
  19. _alex

    _alex Active Member

    Joined:
    Jan 28, 2016
    Messages:
    857
    Likes Received:
    92
    yes, i know ..
    but question was why proxmox would be better ;)

    Don't know how good proxmox support is as i barely need support on this type of product, especially not as long it's sort of open..
    but would guess proxmox paid support also is quite good, and also the community is active.
     
    #19
  20. ecosse

    ecosse Active Member

    Joined:
    Jul 2, 2013
    Messages:
    293
    Likes Received:
    41
    Thanks for the thoughts. I run VMware in my lab using the evalexperience. I can see the time when VMware are potentially cut out of the market (but of course through Proton, AWS hookups etc they are trying to stay relevant). Whilst I understand the attractions of opensource, I'm not a coder at heart - I just want the thing to work and be reliable (otherwise I get it in the neck from the wife always up in my computer room!) I've a few spare servers to test drive, I look forward to the write-up.
     
    #20
Similar Threads: Proxmox Docker
Forum Title Date
Linux Admins, Storage and Virtualization Ideal Plex Setup with Proxmox/LXC/Docker/KVM? Mar 26, 2017
Linux Admins, Storage and Virtualization ProxMox vs OMV vs UnRaid vs Debian/Centos w/ Docker + KVM vs Rancher Dec 29, 2016
Linux Admins, Storage and Virtualization Proxmox 5.3 released Dec 4, 2018
Linux Admins, Storage and Virtualization Proxmox configuration suggestions Nov 25, 2018
Linux Admins, Storage and Virtualization Proxmox NVIDIA GPU passthrough Nov 14, 2018

Share This Page