zfs

  1. L

    ZOL - recover lacked MBR after physical problem

    We had a physical problem in our backup server (we suppose an electrical shock due to the thunderstorm). The system is Linux Debian on a disk and the storage in on a two 4 TB disks RAID-1 ZFS (ZFS On Linux) pool. The first symptom we discovered was a frozen system. After we had multiple erratic...
  2. R

    TUTORIAL: Beauty by simplicity, OR one ZFS Snapshot used by 5 Layers of Applications

    This is about ZFS Filesystem and the (not) need to stack multiple layers of ZFS and snapshots, but made to utilize all the functionality from ZFS napshots on the proxmox host. to achieve this fabulous glory of software-engineering i utilized this projects: cv4pve-autosnap and Zamba Fileserver...
  3. P

    Poolsman - ZFS Web GUI for Linux based on Cockpit

    Hello, we are working on new ZFS GUI called Poolsman (www.poolsman.com) and would like to invite you to join our Early Access Program (EAP). Poolsman is intended to give an easy, graphical way for managing ZFS on commonly used Linux systems (including Debian, Ubuntu, RHEL, Rocky, OpenSUSE...
  4. E

    Need help with vdev/pool configuration.

    Good day to all. I am trying to setup a new trunas system. I'm running an r720 server 96g ram. Hba card (sorry forget off hand which one) and 5 netapp ds4243's. Each netapp shelf is populated with 24 600gb 15k sas drives, and OM3 controllers. My plan is to power up only the shelves I need for...
  5. L

    Analysis paralysis: Help me pick out my first enterprise-grade drives for my homelab hypervisor

    I currently run Proxmox on a DeskMini H470 with an i5-10400 and 64GB DDR4 (non-ECC). I have about a dozen VMs/CTs running, with one of the VMs running about 25 Docker containers. The Proxmox box hovers around 5% CPU usage and 60% RAM usage. Proxmox is installed on a Samsung 970 Pro 512GB NVMe...
  6. W

    How important is QAT for distributed storage?

    Specifically, I'm looking at Ceph (via Rook) and TrueNAS Scale (so OpenZFS) between CPUs like Xeon D 1500/AMD Epyc 3000 vs Atom C3000/Xeon D 1700. I can't seem to find anything about using QAT with Ceph/ZFS besides the fact that it's available to use. There is an older thread here about QAT on...
  7. L

    Synology vs DIY NAS for home?

    I'd like to get a NAS to use at home as an additional backup destination for several home PCs, besides two cloud backup services I already use. No VMs, no media server, just a another place to archive my data (and Windows OS drives), ideally with snapshotting and ease of replicating (eventually)...
  8. N

    Is it possible to swap ZIL vdevs on a ZFS pool?

    tl;dr I just got an Optane drive. I'm currently running 2 SSDs in mirror as ZIL, I want to remove them and use only the Optane drive as ZIL. How can I do this? My current setup is as follows: Xeon D-1541 8c/16t 64GB DDR4 ECC Registered 6x12TB drives in RAIDZ2 (72TB raw, 48TB usable) 1x512GB...
  9. M

    Best 300TB storage for $100K challenge

    Hi, I work for a research hospital. I would appreciate any comments or advice for file system and hardware design for a high-end storage solution. We have a few microscopes (running windows 10), each can produce 3-4GB/s of image data that needs to written to the shared storage and to be...
  10. S

    'httm' is my take on a CLI ZFS Time Machine

    Don't call it a h-- t-- time machine httm prints the size, date and corresponding locations of available unique versions (deduplicated by modify time and size) of files residing on ZFS snapshots, but can also be used to the interactively view and restore such files. 'httm' might change the way...
  11. G

    Symlinking pools is a bad idea (or is it?). But why?

    So to preface. I'm not going to do this. I'm not running zfs even (maybe yet , maybe ever). I was going trough the basics and I have questions my regular hangout couldn't answer in a way that wasn't "that's just dumb" . So you're supposed to size your pools and vdevs according to your loss...
  12. E

    Proxmox 6.4-13 + zfs + oom

    tl;dr - I'm running Proxmox 6.4-13 on a system with 2x e5 Xeon procs, 128gb ECC ram, with a rust array of approximately 50tb. My issue is, proxmox continuously kills 2 of my containers for OOM conditions, and I can't for the life of me figure out how to solve this. Oddly, it almost seems like...
  13. K

    Whole pool degragated after replaceing one disk in pool

    Hello, Yesterday i had /dev/sdf disk in DEGRAGATED - too many errors state. After replaceing hdd ... What i done is: zpool offline tank /dev/sdf zpool clear tank /dev/sdf zpool status zpool online tank /dev/sdf zpool replace tank /dev/sdf after that sdf was resilvering after some time when I...
  14. E

    OminosCe r151038d smb file lock issues

    Hello @gea and everybody, I have migrated my old samba3 file share server(CentOs) to OminosCe r151038d with napp-it. Everything working fine,only having smb file lock issues sometimes. I know smb on Omnios working in-kernel and it is not same bits with samba project. You know there is...
  15. Z

    How to get the fastest possible write and read speeds on Linux?

    The work load consists of generating many files as fast as possible on very fast storage, (RAID 0 of nvme drives) and transferring that data to slow storage for long term storage while minimizing the bottleneck. I'm trying to minimize the time limit for the transfers to long term storage. When...
  16. N

    Ubuntu Server & L2ARC on Same Drives

    I'm looking for some advice on partitioning a new system with multiple disks for root on ZFS with Ubuntu Server 20.04. This is the hardware I have: 2 x Intel D3-S4610 256 GB SSD 4 x Seagate EXOS 7E8 8TB 32 GB ECC RAM (planning of expanding to 64 GB later) In brief, this is what I tentatively...
  17. N

    SLOG/L2ARC in Ubuntu w/Docker File-/Media Server

    Hello experts. I'm have recently built a server to be used as file-/media server for myself and a few family members. It will be running on Ubuntu Server with ZFS. I will be using Docker to run quite a few services for serving and streaming. Although I have already built the server I am not...
  18. M

    Prevent or reduce frequency of txg_sync

    I have a small server (Debian Buster) containing 2 WD RED hard disk which I have encrypted with LUKS and on which I set up a ZFS datapool with RAID 1. As the server is not used to frequently I have created a autoshutdown script which checks for services etc. and if the data drives are active...
  19. gb00s

    EU (SOLD) >> 3.2TB - Fusion ioMemory™ / Sandisk SX350 PCIe (very low usage)

    I'm selling a 3.2TB barely used Sandisk SX350. Current vsl-iomemory4 drivers are available from Snuf's GitHub repository. Got it running in Debian (Proxmox), Gentoo and even Arch Linux. The cards are traded on eBay for >500EUR even with high usage. Due to its very low usage, I'm asking for 399...
  20. D

    Zpool on sparse files

    Hi everyone! I have an NFS share, where I'm planning to store my backups. I created a raidz2 zpool on 7 sparse files on that NFS share and transferred snapshots using syncoid to that zpool. It seems to me that it's a working solution, but I haven't done that before and wanted to hear your...