ZFS Filesystem Awesome Collection
#HomeLab, #Self-Hosting
ZFS Explained
- The best two articles on the internet explaining what ZFS is: "ZFS 101—Understanding ZFS storage and performance" and "What is ZFS? Why are People Crazy About it?"
- Here is a worthy overview of ZFS on Proxmox wiki
ZFS Configuration
- The author of the thread has a number of disks of different types and sizes and is questioning about storage configuration options. The thread has worthy advice.
- The ZFS tuning cheat sheet page contains the ZFS configuration parameters explanation as well as the optimal values of choice.
- The post describes a useful example of ZFS pool naming and dataset hierarchy organization for replication and backup needs with thoughtful data prioritization.
ZFS: Snapshots, Backups and Replication
- Docs with all needed info about ZFS replication: Sending and Receiving ZFS Data
- Here is a worthy article describing ZFS replication in detail: How to use snapshots, clones, and replication in ZFS on Linux
- Folks are discussing caveats of replicating native ZFS encrypted pool here and here and there
ZFS: Encryption
-
ZFS native encryption kick-off article
-
OpenZFS on OS X encryption support
-
Tutorial on how to backup encrypted ZFS data on untrusted storage without the need of unlocking it.
-
"Secure External Backup with ZFS Native Encryption" - detailed tutorial of setting up ZFS backup
-
Discussion of ZFS Encryption options on reddit
-
How to install LUKS encrypted Server and enable remote unlocking tutorial
Comparison of different encryption options: EXT4 vs ZFS native encryption vs LUKS vs BTRFS and different combinations in video
Key takeaways: - ZFS native encryption is slow. - LUKS works nicely with any of BTRFS, ZFS, EXT4
ZFS: Cloud storage for offsite backup
There are caveats of using ZFS with offsite backup storage.
All magic of incremental backup features of ZFS are working on a filesystem level. It means that if you want to make incremental backups to an offsite storage that storage should also be ZFS.
However, if it's not ZFS, you can still back up with something like rclone just like with a usual filesystem, but it makes using ZFS a bit purposeless.
Luckily there are ZFS cloud storages.
- ZFS Rent. Send these guys a hard drive and they will set up a storage instance for you.
- ZnapZend
- Rsync.net
One of the best non-ZFS 3rd party cloud storage for backups I've found is probably backblaze.
There are options allowing to send and store raw ZFS snapshots on any storage. However, I've got concerns about this idea.
I'm not a fan of that idea though. Native ZFS tooling performs checks allowing to ensure that snapshots are not corrupted. This is important because snapshots are incremental. I'm concerned that the whole data will be lost if any of the raw snapshot gets corrupted for some reason.
Using ZFS with Hardware Raid Controller
Discussion on using ZFS filesystem with a hardware raid
Key takeaways:
- ZFS's software RAID works best when it's aware of hardware configuration.
- Hardware raid hides underlying hardware config which makes the ZFS redundancy feature less efficient
Comments