Proxmox VE 5.0 and Docker with a Web GUI

Discussion in 'Linux Admins, Storage and Virtualization' started by Patrick, Mar 22, 2017.

  1. Patrick

    Patrick Administrator
    Staff Member

    Joined:
    Dec 21, 2010
    Messages:
    11,559
    Likes Received:
    4,489
    I have Proxmox servers running ZFS mirrors as storage that have 300+ days of uptime right now. The only reason they go down is when I want to upgrade them.

    STH hosting is now on Proxmox as well.

    No coding required. All GUI based. Stay tuned.
     
    #21
    vv111y and _alex like this.
  2. _alex

    _alex Active Member

    Joined:
    Jan 28, 2016
    Messages:
    874
    Likes Received:
    94
    - so, you have some experience / smth. running on it

    - and obviously don't need much more than a reliable Host

    This are some very good reasons for you to stay with VMware, no learning, no new setup, no licensing required besides VMUG.

    Edit:
    Like Patrick said, it's really not necessary to do coding / extensive configurations of the Host-OS on the CLI to get a reliable proxmox setup up and running. What i meant was that this can be done if desired.
     
    #22
  3. Eric Faden

    Eric Faden Member

    Joined:
    Dec 5, 2016
    Messages:
    97
    Likes Received:
    6
    Another upside with proxmox is that it's Debian under the hood. So theoretically you can install anything on it. Eg snapraid, mergerfs, etc.

    Sent from my Pixel XL using Tapatalk
     
    #23
  4. Patrick

    Patrick Administrator
    Staff Member

    Joined:
    Dec 21, 2010
    Messages:
    11,559
    Likes Received:
    4,489
    Good news/ bad news. Bad news of my 2 projects yesterday, one failed miserably (needed to go to the data center to flip a switch) and the other did not happen. Today getting some VERY cool hardware (more on this later.)

    Looks like rain is forecasted in the next day or two here so hopefully that means time to do the Docker + Proxmox tutorial. I am going to re-install from scratch.
     
    #24
    Nnyan, Albert, BakerT and 2 others like this.
  5. ecosse

    ecosse Active Member

    Joined:
    Jul 2, 2013
    Messages:
    354
    Likes Received:
    59
    Thanks, this is more about learning and preparing for the future I guess. I dont mind a bit of CLI but unless I use something a lot I simply forget. :)
     
    #25
  6. PigLover

    PigLover Moderator

    Joined:
    Jan 26, 2011
    Messages:
    2,775
    Likes Received:
    1,116
    Bump...with the death of Corral this project actually gets much more interesting. Would love to see your setup guide for Proxmox+Docker.
     
    #26
    Patrick likes this.
  7. RobertFontaine

    RobertFontaine Active Member

    Joined:
    Dec 17, 2015
    Messages:
    666
    Likes Received:
    148
    Hmm, I've been dancing around the VMware evalexperience fire.

    This smells interesting
     
    #27
  8. Eric Faden

    Eric Faden Member

    Joined:
    Dec 5, 2016
    Messages:
    97
    Likes Received:
    6
    I actually just made a Debian 8.0 LXC and tried to install Docker into it.

    I basically used the default settings. Ran apt-get update, apt-get upgrade and then installed docker. The install went fine, but I get

    docker: failed to register layer: ApplyLayer exit status 1 stdout: stderr: permission denied.

    When I try to docker run anything.... I'm assuming there is a permission issue due to the LXC. Thoughts?
     
    #28
  9. ttabbal

    ttabbal Active Member

    Joined:
    Mar 10, 2016
    Messages:
    723
    Likes Received:
    193
    I suspect it's not going to be happy in a container. You will probably need to install in a VM or on the host.
     
    #29
  10. Patrick

    Patrick Administrator
    Staff Member

    Joined:
    Dec 21, 2010
    Messages:
    11,559
    Likes Received:
    4,489
    @PigLover - re-doing the setup tomorrow and plan on taking detailed notes.

    The first beta Proxmox VE 5 was having issues with some of my VMs starting. That seems to be fixed with the new update so I think it is an okay time to publish the project.

    Between the VM start issues and the FreeNAS Corral bit, needed to wait for things to settle down.
     
    #30
  11. Eric Faden

    Eric Faden Member

    Joined:
    Dec 5, 2016
    Messages:
    97
    Likes Received:
    6
    I gave up with the container.... for anyone curious I decided to use RancherOS in a VM for my setup. Here are the steps I used...

    1) Download RancherOS ISO
    2) Setup a VM with RancherOS ISO as CD.
    3) Boot
    4) From Console
    - sudo /bin/bash
    - password rancher
    5) SSH to rancher@<host>
    - vi cloud-config.yml

    Code:
    hostname: <hostname>
     
    rancher:
      network:
        interfaces:
          eth*:
           dhcp: false
          eth0:
           dhcp: true
          eth1:
           address: 10.0.254.140/24
           gateway: 10.0.254.1
        dns:
         nameservers:
          - 10.0.0.1
     
    ssh_authorized_keys:
      - ssh-rsa <your SSH id_pub.rsa)
    
    Of note... eth0 is bridged to vmbr0 on Proxmox which is my main 1G network. Eth1 is bridged to vmbr1 on Proxmox which is my 10G network between my proxmox servers and my QNAP. Eventually I'm planning to merge that half of the network and only use the SFP+ cards once I have a switch... (on my list).

    - Run
    sudo ros install -c cloud-config.yml -d /dev/sda

    - Remove CD Image from VM, and then reboot.

    6) SSH back into RancherOS (rancher@<IP>)

    7) Install Whatever.... I'm using Rancher and Portainer... so I ran
    sudo docker run -d --name rancher --privileged -v /var/run/docker.sock:/var/run/docker.sock --restart=unless-stopped -p 8080:8080 rancher/server

    sudo docker run -d --name portainer --privileged -v /var/run/docker.sock:/var/run/docker.sock --restart=unless-stopped -p 9000:9000 portainer/portainer


    Seems like it's working well... Next step is maybe TLS/SWARM....

    Swarm vs Kubernetes ...

    Then I'll have a proxmox cluster with RancherOS inside of a VM running a Docker Cluster....

    -Eric
     
    #31
    Last edited: Apr 18, 2017
    Cadal and Marsh like this.
  12. Patrick

    Patrick Administrator
    Staff Member

    Joined:
    Dec 21, 2010
    Messages:
    11,559
    Likes Received:
    4,489
    Jotted down notes:

    Create a Proxmox VE 5.0 All-in-One with Docker

    Seems like the latest beta updates fixed issues.
     
    #32
  13. mad1993max

    mad1993max New Member

    Joined:
    Jan 27, 2016
    Messages:
    17
    Likes Received:
    0
    I am trying to figure out how to replace the default docker bridge with an existing ovs-switch from proxmox sofare not luck, because i need vlan and I couldnt get vlan to work with docker-ovs
    hase someone an idea on how to implement
    Code:
    ovs-docker add-port vmbr1 container1 --ipaddress=192.168.0.88/24
    with vlan ?
     
    #33
  14. TangoWhiskey9

    TangoWhiskey9 Active Member

    Joined:
    Jun 28, 2013
    Messages:
    402
    Likes Received:
    59
    That'd be better to just make its own thread with this. There's an old thread Proxmox VE Open vSwitch (OVS) Discussion

    but just make your own. That's an old one.
     
    #34
  15. voxadam

    voxadam Member

    Joined:
    Apr 21, 2016
    Messages:
    107
    Likes Received:
    14
    Has anyone given rkt a shot on Proxmox?
     
    #35
  16. cliffr

    cliffr Member

    Joined:
    Apr 2, 2017
    Messages:
    77
    Likes Received:
    31
    I have seen it but I haven't tried it. I love the concept of rkt and CoreOS but it seems smaller. After the clusterhq fiasco I'm trying to stick to larger distributions. IMO should look at kubernetes over swarm
     
    #36
  17. yeah

    yeah New Member

    Joined:
    Jul 29, 2017
    Messages:
    3
    Likes Received:
    1
    Great. I've managed to install docker on a builder LXC CT from Proxmox and install there Portainer. Then, I installed Docker Swarm directly on Proxmox nodes and communicate from Portainer to to them -using TLS- through manager swarm node TCP port. Finally, my Gluster as a multi-access bind-volume for services. Lots of fun!

    Now, looking at Docker Services for replicated/scaled containers. Then, use my CEPH as a Docker Volumes provisioner (still don't know how... OCFS? LVM? ZFS?).
     
    #37
    gigatexal likes this.
  18. gigatexal

    gigatexal I'm here to learn

    Joined:
    Nov 25, 2012
    Messages:
    2,697
    Likes Received:
    499
    Sounds like a great front page article @Patrick
     
    #38
  19. yeah

    yeah New Member

    Joined:
    Jul 29, 2017
    Messages:
    3
    Likes Received:
    1
    #39
  20. yeah

    yeah New Member

    Joined:
    Jul 29, 2017
    Messages:
    3
    Likes Received:
    1
    Where would you publish this hypothetical article?
     
    #40
Similar Threads: Proxmox Docker
Forum Title Date
Linux Admins, Storage and Virtualization Ideal Plex Setup with Proxmox/LXC/Docker/KVM? Mar 26, 2017
Linux Admins, Storage and Virtualization ProxMox vs OMV vs UnRaid vs Debian/Centos w/ Docker + KVM vs Rancher Dec 29, 2016
Linux Admins, Storage and Virtualization Networking Services don’t auto-start on boot up - Dell R720 w/ proxmox (Warning: Beginner User) Friday at 12:17 PM
Linux Admins, Storage and Virtualization Proxmox environment feedback Nov 4, 2019
Linux Admins, Storage and Virtualization Selecting a Proxmox Master Node for Cluster Oct 3, 2019

Share This Page