Cockpit ZFS Manager

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

optimans

Member
Feb 20, 2015
61
77
18
I appreciate the reply - I just thought that each disk would populate with the read/write/checksum information, instead of showing 0's. It is not a deal breaker in any way shape or form, I just wanted to make sure that I didn't misconfigure anything.
No problem. I see what you mean now. The 0's are a good sign. The read/write/checksum counts are error counts. If you have any errors, as the numbers grow, the color of the number will change. They are also reset when manually clearing errors, system restarted or zfs service is restarted. Apologies if you already know this.

Were you looking for zpool iostat to display live disk information?
 

Morgan Simmons

Active Member
Feb 18, 2015
134
25
28
44
No problem. I see what you mean now. The 0's are a good sign. The read/write/checksum counts are error counts. If you have any errors, as the numbers grow, the color of the number will change. They are also reset when manually clearing errors, system restarted or zfs service is restarted. Apologies if you already know this.

Were you looking for zpool iostat to display live disk information?

That is exactly what I thought it was. Thanks for the explanation!
 

optimans

Member
Feb 20, 2015
61
77
18
Thought I'd better give an update on what's coming next.

A little while ago, I teased about new features coming in 0.4; this will now not be released.

I have started working on 1.0 which is written in React. This update is going to take quite a while as I'm doing a complete re-write of the whole application.

Here is a list of what's happening so far:
  • jQuery/Bootstrap -> React
  • PF3/PF4 hybrid to complete PF4 (May also allow to run on older versions of Cockpit as well)
  • Sector size for Add Virtual Device, Attach Disk and Disk Replace modals
  • Alt Root, Key Location, and Mountpoints will have path selection as you type
  • Key File encryption support for File System
  • Filtering/Search for tables
  • Column management; choose what you want displayed, with saving to config file for persistence
  • NFS/Samba to be moved to Configure Sharing modal
  • Manage Samba shares will be changed to Basic Sharing (Property value, managed via ZFS) or Enhanced Sharing (Share managed by CZM)
  • #9 Progress bar and tags for file systems
  • #8 Allow CZM to run when Samba is not installed whilst CZM is managing shares. Will display an inline alert instead of critical error
  • #13 Automatic snapshots
  • RPM & DEB packages
Here are some screenshots of new layout. Mostly the same. Not final:

1.jpg2.jpg3.jpg4.jpg5.jpg6.jpg7.jpg8.jpg9.jpg10.jpg

If all goes well, 0.3 will be last jQuery/Bootstrap version with only bug fixes until 1.0 is released.

Stay tuned!
 

bmensah8directgroup

New Member
Oct 7, 2020
2
0
1
Cockpit ZFS Manager
An interactive ZFS on Linux admin package for Cockpit.

WARNING!

Cockpit ZFS Manager is currently pre-release software. Use at your own risk!

Requirements

  • Cockpit: 201+
  • NFS (Optional)
  • Samba: 4+ (Optional)
  • ZFS: 0.8+
  • Arch Linux
  • CentOS Linux 8
  • Debian 10
  • Fedora 31
  • Oracle Linux Server 8
  • Proxmox VE 6
  • Red Hat Enterprise Linux 8
  • Ubuntu 18.04 LTS
  • Ubuntu 19.10

0.3.3.404 Now Available (09-08-2020)

github.com/optimans/cockpit-zfs-manager

Screenshots

View attachment 13755 View attachment 13756 View attachment 13757 View attachment 13758 View attachment 13759 View attachment 13760 View attachment 13761 View attachment 13762 View attachment 13763 View attachment 13764 View attachment 13765 View attachment 13766 View attachment 13767 View attachment 13768 View attachment 13769 View attachment 13770 View attachment 13771 View attachment 13772 View attachment 13773 View attachment 13774 View attachment 13775 View attachment 13776 View attachment 13777 View attachment 13778 View attachment 13779 View attachment 13780 View attachment 13781 View attachment 13782 View attachment 13783 View attachment 13784

Screenshots using Cockpit 217 on Oracle Linux 8.1 with UEK R6


Screenshots continued: Post #3
looks fantastic, been looking for a solution to replace freenas/truenas. can you please confirm what features you have been able to implement comparing apples to apples and of course where is your donation link to keep this going.
 

optimans

Member
Feb 20, 2015
61
77
18
Hi @bmensah8directgroup,

Have you looked at all the screenshots? All features are displayed there. Here is a summary (not limited to) of what is provided so far.

Note, certain features / configurable options are only available depending on storage pool version and feature flags enabled. For example: LZ4 compression, Device removal, Deduplication, Skein, EdonR, Special Virtual Device.

There are also some caveats, which are listed on GitHub page.

More features and changes are coming with version 1.0, which is still in progress.

There is no donation link at this stage; project is still active.

Configurable options for Cockpit ZFS Manager
  • Log Level
  • Remove cockpit packages that cause problems for ZFS
  • Manage Samba shares (Basic or Enhanced)
Storage Pools
  • Create Storage Pool
    • Initial virtual device - Disk / Mirror / RaidZ1 / RaidZ2 / RaidZ3 (Additional virtual devices are added after creation)
    • Configure Disks Identifier - Block Device / Disk / Hardware Path / WWN / Virtual Device Mapping
    • Sector size
    • Record size
    • Deduplication
    • Refreservation
    • LZ4 compression
    • Automatically expand storage pool when larger devices are added
    • Automatically replace devices
    • Automatic TRIM
    • SELinux contexts for Samba
    • Forcefully create storage pool
    • Additional options are configured later
  • Import Storage Pool
    • Active & Destroyed
    • Rename storage pool on import
    • Configure Alternate Root path (Temporary)
    • Read Only on import (Temporary)
    • Configure Disks Identifier on import - Block Device / Disk / Hardware Path / WWN / Virtual Device Mapping
    • Import without mounting file systems
    • Recovery mode
    • Forcefully import storage pool
  • Notification if storage pool upgrade is available in storage pools list and status tab
Storage Pool
  • Configure Storage Pool
    • Comment
    • Default sector size for new virtual devices (Does not change for existing)
    • Automatically expand storage pool when larger devices are added
    • Automatically replace devices
    • Automatic TRIM
    • Multi host - Random / Lib C if Host ID does not exist
  • Configure Storage Pool Features (Feature Flags)
  • Export Storage Pool
    • Forcefully unmount all file systems
  • Destroy Storage Pool
    • Forcefully unmount all file systems
    • Clear the label information on the disks
File Systems
  • Create File System (With display of properties that are inherited)
    • Encryption
      • Passphrase
      • Cipher - AES 128 / 192 / 256 CCM / GCM
    • Access Time
    • Case Sensitivity
    • Compression
    • Deduplication
    • DNode Size
    • Extended Attributes
    • NFS Share
    • Quota
    • Record Size
    • Special Small Blocks
    • SELinux contexts for Samba
    • Enable Samba Share
    • Read only
File System
  • Configure File System
    • Read Only
    • ACL Inheritance
    • ACL Type
    • Access Time
    • Can Mount
    • Checksum
    • Compression
    • Deduplication
    • DNode Size
    • Extended Attributes
    • Mountpoint
    • NFS Share
    • Quota
    • Record Size
    • Special Small Blocks
    • Refreservation
    • SELinux contexts for Samba
    • Enable Samba Share (Basic Sharing Only)
  • Rename / Move File System
    • Forcefully unmount file system
    • Create non-existent parent file systems
  • Promote Clone File System
  • Mount File System
    • Forcefully mount file system if directory is not empty
    • Enable Samba share
  • Unmount File System
    • Forcefully unmount file system
    • Disable Samba share
  • Unlock File System
    • Mount file system
    • Forcefully mount file system if directory is not empty
    • Enable Samba share
  • Lock File System
  • Change Passphrase
  • Destroy File System
    • Forcefully unmount file system
    • Destroy all child file systems and snapshots
    • Destroy all child: file systems, cloned file systems and snapshots
  • Enable / Configure / Disable NFS Sharing (Via Configure File System)
  • Enable / Configure / Disable Samba Sharing (Enhanced Sharing)
    • Basic Sharing - managed by ZFS: Enable / Disable only (Via Configure File System)
    • Enhanced Sharing - managed by Cockpit ZFS Manager: Complete management of the share
  • Create Snapshot
    • Auto Name / Custom naming
    • Create snapshots of child file systems
Snapshots
  • Create Snapshot
    • Auto Name / Custom naming
    • Create snapshots of child file systems
Snapshot
  • Clone Snapshot
    • Create non-existent parent file systems
  • Rename Snapshot
    • Rename snapshots of child file systems with this name
  • Roll Back Snapshot
    • Destroy all newer snapshots of file system
    • Destroy all newer: snapshots, cloned file systems and file systems
  • Destroy Snapshot
    • Destroy snapshots of child file systems with this name
    • Destroy all child: snapshots, cloned file systems and file systems
Status
  • Storage Pool
    • Clear Storage Pool Errors
    • Resilver Storage Pool
    • Start / Resume / Pause / Stop Storage Pool Scrub
    • Start / Resume / Suspend / Cancel Storage Pool TRIM (Storage pool must contain a TRIM capable device)
      • Secure TRIM (Disk must be secure capable, for example: Enterprise SSD)
    • Upgrade Storage Pool
    • Regenerate storage pool GUID
    • Add Virtual Device
      • Cache / Dedup / Disk / Log / Mirror / RaidZ1 / RaidZ2 / RaidZ3 / Spare / Special
      • Configure Disks Identifier - Block Device / Disk / Hardware Path / WWN / Virtual Device Mapping
      • Forcefully add virtual device
  • Virtual Device
    • Remove Virtual Device
      • Clear the label information on the disk
    • Clear Virtual Device Errors
    • Attach Disk (Disk or Mirror)
      • Configure Disks Identifier - Block Device / Disk / Hardware Path / WWN / Virtual Device Mapping
      • Forcefully attach disk
    • Detach Disk (Disk or Mirror)
      • Clear the label information on the disk
  • Disk
    • Clear Disk Errors
    • Detach Disk (Mirror)
      • Clear the label information on the disk
    • Offline Disk
      • Forcefully offline the disk
      • Temporarily offline the disk until next reboot
    • Online Disk
      • Expand the device to use all available space
      • Scrub the storage pool after disk is set online
    • Replace Disk
      • Configure Disks Identifier - Block Device / Disk / Hardware Path / WWN / Virtual Device Mapping
      • Forcefully replace disk
    • Start / Resume / Suspend / Cancel Disk TRIM (Disk must be TRIM capable)
      • Secure TRIM (Disk must be secure capable, for example: Enterprise SSD)
 
Last edited:

Ixian

Member
Oct 26, 2018
88
16
8
This addon is great! I am also running a test Debian ZFS server in VirtualBox for some other projects I am working on, let us know when you are close to a beta version and I'll be happy to test in a non-production environment. 1.0 looks really good.
 
  • Like
Reactions: optimans and gb00s

optimans

Member
Feb 20, 2015
61
77
18
This addon is great! I am also running a test Debian ZFS server in VirtualBox for some other projects I am working on, let us know when you are close to a beta version and I'll be happy to test in a non-production environment. 1.0 looks really good.
Hi @Ixian, thanks for the offer. Still got a lot of work to do, but making progress :). Will let you know when ready.
 

bleomycin

Member
Nov 22, 2014
54
6
8
37
I also just wanted to chime in and say I recently discovered your work and couldn't be happier, it's truly wonderful thank you so much for building this and sharing it with the community!
 
  • Love
Reactions: optimans

robert.gurde

New Member
Nov 13, 2020
2
0
1
Great work. I like what you did :)

Would it be possible to:
- when creating an account also create/delete a samba user?
- when changing account password, would it be possible to also change samba user password?
- basically sync unix/samba accounts
 

optimans

Member
Feb 20, 2015
61
77
18
Great work. I like what you did :)

Would it be possible to:
- when creating an account also create/delete a samba user?
- when changing account password, would it be possible to also change samba user password?
- basically sync unix/samba accounts
Hi Robert,

When creating an account, are you creating in Cockpit? Cockpit ZFS Manager only manages individual shares for Samba, not the global configuration.

If you are looking to sync your accounts, you will need to enable unix password sync in Samba configuration:

Code:
$ sudo nano /etc/samba/smb.conf
Append/Change to [global] section
Code:
pam password change = Yes
passwd program = /usr/bin/passwd %u
passwd chat = *Enter\snew\s*\spassword:* %n\n *Retype\snew\s*\spassword:* %n\n *password\supdated\ssuccessfully* .
unix password sync = Yes
Restart Samba service
Code:
$ sudo service smb restart
Change the passwords for your accounts and they should now sync up.

References:
 

robert.gurde

New Member
Nov 13, 2020
2
0
1
Thanks for the reply, I have to try your suggestion.

I have another suggestion. When creating filesystem allow setting owner or permissions, for whatever reason if not owner when mounting can't write to share. Same for edit.
 

optimans

Member
Feb 20, 2015
61
77
18
Hey All, new patch update available: 0.3.4.514
  • Fix: jQuery was missing due to spec change for Cockpit 233

If you are running an earlier version of Cockpit, this update is optional.
 
  • Like
Reactions: gb00s and Tinkerer

Tinkerer

Member
Sep 5, 2020
83
28
18
Thanks!

Just installed on Fedora 33 Server with ZFS 2.0 kernel 5.9.11-200. Seems to work fine so far but haven't tested extensively.
 
  • Like
Reactions: gb00s

TheDarkCorner

New Member
Jan 22, 2021
5
1
3
Just came to say that you are hero! Without your work, i would not have dared to go all in on ZFS for my home servers!
I now use Ubuntu + Virt-Manager + Cockpit + Docker/Podman; With this easy setup even someone like me can combine storage + VMs + Docker + Samba all on one single host!
Been using CZM since many months, all stable without a single problem! And now i saw your plans for more features, polish and a rewrite i am even more hyped!
Thank you so much!
 
  • Love
Reactions: optimans

elkhound

New Member
Jan 25, 2021
1
1
1
Let me add some praise here as well. I started dipping my toe into the Linux (Ubuntu for now) waters late last year and spent a good amount of time tinkering with solutions for my home server. I finally settled on zfs - first via FreeNAS to experiment and now with (properly backed up) real data via Ubuntu. It was a bit daunting for a novice such as myself, but your GUI interface really gives me peace of mind with keeping it monitored.

I know it's my rotted out Windows brain that says I need a GUI but I just didn't feel "safe" until I installed this into Cockpit and can see it in a webpage at any time. Great GREAT job. Thank you very much!!
 
  • Love
Reactions: optimans

optimans

Member
Feb 20, 2015
61
77
18
Hey All,

I know it's been a while; thought I'd better give a quick little update. Getting closer for release of next version. Still bit more work to do, but should be good to go sometime in April.

Few things to note (not limited to):
  • PatternFly 4 layout
  • ZFS 2.0 support
  • Encryption with Create Storage Pool - will no longer need to be a dataset
  • Key File based encryption - hexadecimal and raw key file support - generate or use existing keys
  • Path selection dropdown for encryption key path, mount point, alternative root
  • Compression ratio selection for GZIP, ZSTD, ZSTD-FAST modes
  • Column selection for Storage Pools, File Systems, Snapshots & Status - you choose what you want to see - saves to config file if an administrator
  • Snapshot file system rows that are expanded will stay open on refresh (configurable option)
  • Sector size selection for Add Virtual Device, Attach Disk, Replace Disk
  • Offline disk and sequential reconstruction during resilver options for Replace Disk
  • Configure File System Sharing - NFS and SMB in its own section.
  • Deferred deletion of snapshots
Stay tuned!

1.jpg2.jpg3.jpg4.jpg5.jpg6.jpg7.jpg8.jpg9.jpg10.jpg11.jpg12.jpg13.jpg14.jpg15.jpg16.jpg17.jpg