Cockpit ZFS Manager [0.1.1.158 Now Available]

Discussion in 'Linux Admins, Storage and Virtualization' started by optimans, Aug 31, 2019.

  1. optimans

    optimans Member

    Joined:
    Feb 20, 2015
    Messages:
    33
    Likes Received:
    27
    Thought I'd better give another quick update: am behind schedule (think i'm starting to sound like a broken record :eek:). Been sick last couple of weeks and having drives fail due to firmware bugs (link), but with that all over, now getting back on track!

    Apologies for the delays, bear with me, it will be ready in November!

    One question I do have, those who are using ZFS as root, are you using it for / and /boot only? Have configuration options to hide/display boot and root pools from list (display default); would like to know if need to include other system directories as part of filter. Thanks.

    P.S.: Few more things added:
    • Added ability to configure pool features
    • Can choose whether ZFS manager manages Samba shares or not
    • Can unlock all file systems from the one place - handy if you use the same passphrase for more than 1
    • Working well on Ubuntu 19.10 and CentOS 8 so far
    upload_2019-10-26_23-13-21.png
     
    #21
    T_Minus, Patrick, rootpeer and 4 others like this.
  2. Marshalleq

    Marshalleq New Member

    Joined:
    Nov 13, 2019
    Messages:
    1
    Likes Received:
    1
    This is amazing work! Hopefully we find a way to get it onto unraid at some point. It will be fun to try to make that happen! Thanks.
     
    #22
    optimans likes this.
  3. Patrick

    Patrick Administrator
    Staff Member

    Joined:
    Dec 21, 2010
    Messages:
    11,575
    Likes Received:
    4,520
    Personal opinion here: I think there will be those who put two 1TB SSDs in a system and ZFS mirror root + keep data on there. It may not be ideal, but it will happen.
     
    #23
    optimans and T_Minus like this.
  4. T_Minus

    T_Minus Moderator

    Joined:
    Feb 15, 2015
    Messages:
    6,838
    Likes Received:
    1,491
    My thoughts too
     
    #24
  5. RageBone

    RageBone Active Member

    Joined:
    Jul 11, 2017
    Messages:
    267
    Likes Received:
    72
    i totally agree, mainly because i did that, and a friend does it currently on Freenas.
    He doesn't want to waste any space on the 250GB drive he's using for it.
    It was the "best" thing he had around. He would have used a 16GB Optane but his board didn't have drivers for it.

    i stopped doing it because the 16GB optane is a bit small for more then two VMs on top.
    And jails and stuff can't be put onto it.
     
    #25
    T_Minus likes this.
  6. rootpeer

    rootpeer New Member

    Joined:
    Oct 19, 2019
    Messages:
    9
    Likes Received:
    2
    #26
  7. optimans

    optimans Member

    Joined:
    Feb 20, 2015
    Messages:
    33
    Likes Received:
    27
    Hello @rootpeer,

    Yes, will be ready on November 29th.
    Thanks for your patience.

    Currently finishing up work on snapshot roll back.
    This will be the last feature for first release.
    Try to let user know what datasets will be impacted for critical tasks:

    upload_2019-11-26_8-38-39.png
     
    #27
    panzer, rootpeer and RageBone like this.
  8. optimans

    optimans Member

    Joined:
    Feb 20, 2015
    Messages:
    33
    Likes Received:
    27
    Ready...Steady...Go!

    Thanks for your patience! Info is in first post. Install should be pretty easy, hopefully works well for your system.
     
    #28
    EluRex likes this.
  9. EluRex

    EluRex Active Member

    Joined:
    Apr 28, 2015
    Messages:
    209
    Likes Received:
    70
    I have install Cockpit 202 (via buster-backport stable) and Cockpit ZFS manager on Proxmox VE 6.0 (which is Debian Buster),

    1575018365353.jpg

    However I am getting following error

    2019-11-29_17-09-03.jpg

    I have zfs module install and loaded into kernel, please check

    Code:
    root@pve-nextcloud:~# modinfo zfs
    filename:       /lib/modules/5.0.21-5-pve/zfs/zfs.ko
    version:        0.8.2-pve2
    license:        CDDL
    author:         OpenZFS on Linux
    description:    ZFS
    alias:          devname:zfs
    alias:          char-major-10-249
    srcversion:     7974A38E326E18F22E88682
    depends:        spl,znvpair,icp,zlua,zunicode,zcommon,zavl
    retpoline:      Y
    name:           zfs
    
    root@pve-nextcloud:~# cat /sys/module/zfs/version
    0.8.2-pve2
    
    I guess it is because PVE version adds -pve2 at the suffix
     
    #29
    Last edited: Nov 29, 2019
  10. optimans

    optimans Member

    Joined:
    Feb 20, 2015
    Messages:
    33
    Likes Received:
    27
    Hi EluRex,

    Are you able to send me a screenshot. Also what information do you have in the console logging? Any errors? What browser are you using?

    with Debian 10 you need to uninstall cockpit and then install cockpit via the testing or unstable repos to get above 188. Unstable has the latest 208 which was what I was testing last night.
     
    #30
  11. EluRex

    EluRex Active Member

    Joined:
    Apr 28, 2015
    Messages:
    209
    Likes Received:
    70
    I have provided all info in above post and here is the screenshot of the console

    2019-11-29_17-32-09.jpg

    And I found out that zfs.js calls
    • /usr/bin/cat
    • /usr/bin/grep
    • /usr/bin/echo
    but Proxmox bin directory is at
    • /bin/cat
    • /bin/grep
    • /bin/echo
    so I made ln -s to make then works

    I have not test all the functionality like create destroy or snapshot... but the Status of the Pool failed to display
    2019-11-29_17-57-08.jpg

    I am assuming it should display something like following (which is from proxmox web gui interface)
    2019-11-29_18-00-54.jpg
    2019-11-29_18-01-08.jpg
     
    #31
    Last edited: Nov 29, 2019
  12. optimans

    optimans Member

    Joined:
    Feb 20, 2015
    Messages:
    33
    Likes Received:
    27
    Thanks for this. Didn’t know the version could have letters in them. Will need to add regex to strip letters before comparing the version numbers.
     
    #32
  13. optimans

    optimans Member

    Joined:
    Feb 20, 2015
    Messages:
    33
    Likes Received:
    27
    I will need to setup a copy of Proxmox for myself and do some testing. The status function uses lsblk to get information about the disks. Layout should be very similar to the zpool status command. I wonder if the bin folder issue is also here too. The console log should hopefully provide where the error is at.

    I have a check for operating system at script load so that it makes changes to samba path depending on os. Can make adjustments to detect proxmox and change the bin path for commands too.
     
    #33
  14. optimans

    optimans Member

    Joined:
    Feb 20, 2015
    Messages:
    33
    Likes Received:
    27
    @EluRex I have created both issue tickets on GitHub. Am currently away for the weekend, but will get onto this next week. If you find anything else, please raise a issue ticket. Thanks for your help!
     
    #34
  15. EluRex

    EluRex Active Member

    Joined:
    Apr 28, 2015
    Messages:
    209
    Likes Received:
    70
    Optimans, I solved the status page issue by
    • ln -s /bin/lsblk /usr/bin/lsblk
    please note my current Proxmox 6.0 (buster) is upgraded from Proxmox 5.X (stretch), thus I have those path issue.

    Complete PVE 6.0 installation for cockpit and zfs manager as follow
    Code:
    echo "deb http://deb.debian.org/debian buster-backports main" > /etc/apt/sources.list.d/buster-backport.list;
    apt update;
    apt-get -t buster-backports install cockpit;
    git clone https://github.com/cockpit-project/cockpit;
    cp -r cockpit/zfs /usr/share/cockpit;
    
    systemctl enable cockpit.service;
    systemctl start cockpit.service;
    
    #for pve5to6
    ln -s /bin/cat /usr/bin/cat;
    ln -s /bin/grep /usr/bin/grep;
    ln -s /bin/echo /usr/bin/echo;
    ln -s /bin/lsblk /usr/bin/lsblk;
     
    #35
    Last edited: Dec 1, 2019
  16. optimans

    optimans Member

    Joined:
    Feb 20, 2015
    Messages:
    33
    Likes Received:
    27
    Hi EluRex,

    I have made changes to the absolute paths for shell commands, and symbolic links should no longer be required. Have tested on Ubuntu 18.04 LTS which had the same issue as you did with the PVE 5 -> 6 upgrade.

    Was very surprised how easy Promox 6.0 was to setup Cockpit and get up and running.

    Thanks for your help.
     
    #36
  17. optimans

    optimans Member

    Joined:
    Feb 20, 2015
    Messages:
    33
    Likes Received:
    27
    #37
Similar Threads: Cockpit Manager
Forum Title Date
Linux Admins, Storage and Virtualization MegaRAID Storage Manager in x64 DEB distros Oct 1, 2012

Share This Page