https://www.tiernanotoole.ie/categories/storage.htmlHugoen-ie2026 Tiernan OTooleFri, 10 Jul 2026 23:30:52 +0100https://www.tiernanotoole.ie/2023/03/07/zfs-over-multiple-dvd-bd-r-images.htmlTue, 07 Mar 2023 09:42:46 +0000https://www.tiernanotoole.ie/2023/03/07/zfs-over-multiple-dvd-bd-r-images.htmlA couple of days back, I started thinking about archiving and backup software. I kind of have backups “sorted”, with my MacBook Pro using BackBlaze to backup to the cloud, Time Machine backing it up to my Synology, my VMs on Proxmox being backed up to Proxmox Backup Server off-site, my Synology and QNAPs being backup to B2 and Hetzner and some other bits and bobs… But for the Archiving stuff, I am not really set up… So, I went looking for archiving software. Couldn’t find anything, so asked on r/DataHoarder. Still no options, at the time of posting, but someone did reply with the idea of using DVDs (or Blu Rays) for ZFS...https://www.tiernanotoole.ie/2017/05/05/zerotier-and-minio-followup.htmlFri, 05 May 2017 00:00:00 +0000https://www.tiernanotoole.ie/2017/05/05/zerotier-and-minio-followup.htmlin a previous post, I talked about setting up a distributed S3 like data storage system using Minio and ZeroTier. Well, this week, the ZeroTier guys tweeted about this. A few people then started asking questions, and looking for a follow up, so here it is. First, a quick recap. I had 4 machines, all running Linux. Three of them were in 1 time zone (GMT+1) and one was in another (GMT). Looking at the Distributed Minio Quickstart Guide again, there is a mention of times being in sync. which is probably why this did not work as planned. and by “not work as planed”, I mean that Minio would crash, or not be responsive, or not write data in the place it should have. which was a pain. But looking at the documentation again, they do mention that Windows support is “experimental” which means, hopefully, some day it will be not so experimental, and might work. Given that most of my machines in house are Windows boxes, this would be a nice feature.https://www.tiernanotoole.ie/2017/01/19/distributed-s3-data-storage-using-minio-and-zerotier.htmlThu, 19 Jan 2017 00:00:00 +0000https://www.tiernanotoole.ie/2017/01/19/distributed-s3-data-storage-using-minio-and-zerotier.htmlSo, something i have been looking into in recient times has been Distributed Storage, and, more specifically, how to use the storage in my many, many machines to protect data, and also increese my usable space… There are a few projects on the market that do this (Ceph, NooBaa and Gluster all spring to mind) but some are more painful to setup than others… which brings me nicely to Minio. Minio is a 20ish MB executable you download from their site, mark it as executable (on Linux or Mac Boxes) and run… and you have yourself a S3 compatable storage server… Simples!https://www.tiernanotoole.ie/2015/08/10/zfs-home-storage-pool.htmlMon, 10 Aug 2015 11:40:00 +0000https://www.tiernanotoole.ie/2015/08/10/zfs-home-storage-pool.htmlOver the weekend, my BTRFS pool for my /home directory on Linux failed… Not sure what happened, but it made me do something i wanted to do for a while: Build a ZFS pool for my home dir. First things first, the pool consists of 4 2Tb hard drives and 1 128Gb SSD. Its setup in RAIDZ1 (equivilent of RAID 5) and then the SSD is set for caching. To create the pool i ranhttps://www.tiernanotoole.ie/2015/04/01/hubic-and-duplicity.htmlWed, 01 Apr 2015 06:00:00 +0000https://www.tiernanotoole.ie/2015/04/01/hubic-and-duplicity.htmlI mentioned HubiC in my last post, and in it i said that you could use Duplicity for backups. Well, this is how you get it to work… First, i am using Ubuntu 14.04 (i think…). I use Ubuntu in house for a few things: its running Tiernan’s Comms Closet, GeekPhotographer and Tiernan’s Podcast all in house, aswell as being used to build this site. The Web Server and MySQL Server are seperated, MySQL running on Windows, web on Ubuntu… but thats a different story… I have a couple of proxy servers running Ubuntu also Other general servers running Ubuntu… dont ask, cause i cant remember what they do half the time… So, Duplicity is a backup application. From their website:https://www.tiernanotoole.ie/2015/03/31/hubic-openstack-swift-and-curl.htmlTue, 31 Mar 2015 21:40:00 +0000https://www.tiernanotoole.ie/2015/03/31/hubic-openstack-swift-and-curl.htmlHubiC is an online storage site, built by the guys at OVH. They are currently offering 30Gb free (if you use the link above) or if you pay, you get 110Gb (insted of the usual 100Gb) for EUR1 a month, or 10.5TB (yup… TERABYTES!) for EUR5 a month… Thats a crazy amount of storage for a not crazy amount of money! So, while playing around with different things, I found they have an API, so other than the usual apps to play with (like the Hubic Apps for iPhone, Android, Windows Phone, Windows Desktop and OSX, Duplicity for backing up *nix boxes, and a few others) you can build your own…https://www.tiernanotoole.ie/2012/10/05/zfs-iscsi-nfs-sftp-hyper-v-and-more.htmlFri, 05 Oct 2012 08:38:13 +0000https://www.tiernanotoole.ie/2012/10/05/zfs-iscsi-nfs-sftp-hyper-v-and-more.htmlAs part of my new task to make my files safer and backups faster, and, well, cheap, I am looking into ZFS for my storage needs. My needs are as follows: Allow me to store lots of different types of data (Photos, Videos, Music, VMs) in different formats (RAW and JPG photos, MP4, AVI and DivX Videos, with DVD and BluRay rips also a posibility, MP3 music and VHD files from HyperV, inclduing ISOs and Snapshots). I also need to store different file systems using iSCSI (Mac and Windows clients will be mounting the storage). must be safe. DO NOT LOSE DATA! must be somewhat fast. I have VHDs weighing in at 100Gb… my photo collection is 600Gb. If i need to move or copy files to the storage system, it must be fast. So, ZFS offers all these features. I can export a file share as iSCSI, NFS, SMB, etc. All works well. But the replication stuff is the interesting part…https://www.tiernanotoole.ie/2012/08/31/understanding-storage-spaces-in-windows-8-and-windows-server-2012.htmlFri, 31 Aug 2012 09:04:14 +0000https://www.tiernanotoole.ie/2012/08/31/understanding-storage-spaces-in-windows-8-and-windows-server-2012.htmlSo, Windows Server 2012 and Windows 8 have both RTMed in the last couple of weeks and will be available to the public in the next month or so (September for Server, October for Client). If you are an MSDN Subscriber, you already have Client, and will (hopefully) get server in the next couple of weeks. Fingers crossed. Anyway, one of the interesting features i am waiting for is Storage Spaces Tim Anderson’s Gadget Writing blog has some information on how Storage Spaces works. handy notes on what to do and what not to do.