[kwlug-disc] Transferring large backup files over the network

[bob+kwlug at softscape.ca]

ZFS for work, BTRFS for home. 

If I am not mistaken, btrfs' ability to add and remove disks from storage pools makes it a good choice for working with eclectic spindles. Something I wouldn't do at work, but definitely at home where "found" hardware rules the day.

BB


> -----Original Message-----
> From: kwlug-disc [mailto:kwlug-disc-bounces at kwlug.org] On Behalf Of
> jason.eckert
> Sent: Thursday, May 23, 2019 8:14 PM
> To: KWLUG discussion
> Subject: Re: [kwlug-disc] Transferring large backup files over the network
> 
> I'll openly admit that I'm a ZFS snob - I've always regarded BTRFS as
> decaf ZFS ;-)
> 
> 
> 
> Sent from my Samsung device running Android (basically Linux in drag)
> 
> -------- Original message --------
> From: CrankyOldBugger <crankyoldbugger at gmail.com>
> Date: 2019-05-23 20:07 (GMT-05:00)
> To: KWLUG discussion <kwlug-disc at kwlug.org>
> Subject: Re: [kwlug-disc] Transferring large backup files over the network
> 
> We looked at BTRFS at work a few months ago and decided that it wasn't
> ready for prime time yet.  I wonder if it's improved since then?  We're
> happy with ext4 and LVM.
> 
> 
> On Thu, 23 May 2019 at 19:08, bob+kwlug at softscape.ca
> <mailto:bob%2Bkwlug at softscape.ca>  <bob+kwlug at softscape.ca
> <mailto:bob%2Bkwlug at softscape.ca> > wrote:
> 
> 
> 	Nothing to add to this but just wanted to give a
> 
> 	+1
> 
> 	For use of BTRFS. Love that FS.
> 
> 	BB
> 
> 
> 	> -----Original Message-----
> 	> From: kwlug-disc [mailto:kwlug-disc-bounces at kwlug.org] On Behalf
> Of Remi
> 	> Gauvin
> 	> Sent: Thursday, May 23, 2019 5:57 PM
> 	> To: KWLUG discussion
> 	> Subject: Re: [kwlug-disc] Transferring large backup files over the
> network
> 	>
> 	> On 2019-05-23 4:40 p.m., Paul Nijjar via kwlug-disc wrote:
> 	>
> 	> >>
> 	> >
> 	> > Hrm. That brings to mind the (non-FLOSS) Windows Subsystem for
> Linux.
> 	> > The problem with many of these "compile Linux tools on Windows"
> is
> 	> > that they are often limited to 32-bit (although I am not sure
> whether
> 	> > MobaXterm is). That actually has caused problems for me in my
> backups
> 	> > when I have tried to use various Rsync for Windows tools in the
> past.
> 	> >
> 	> > But if I install Linux in Windows using WSL, then the 64 bit
> versions
> 	> > of these tools might be available, and then maybe NTFS is not
> going to
> 	> > be the bottleneck any more.
> 	> >
> 	>
> 	> I just use Cygwin for this purpose.  Neither NTFS nor 32-bitness
> are a
> 	> problem, and I have no idea why you think they would be.  I do
> not,
> 	> however, preserve the permissions / Ownership of the Windows host
> to the
> 	> backup.
> 	>
> 	> Sample rsync:
> 	>
> 	> (Note: The --inplace is because I'm using BTRFS and snapshots on
> the
> 	> backup side.  You would not use it otherwise.)\
> 	>
> 	> Note2: I have encountered problems with rsync compression and some
> multi
> 	> GB files.  Compression is instead enabled in the ssh_config if
> sending
> 	> over a slow link.
> 	>
> 	>
> 	> /usr/bin/rsync \
> 	>       -a --no-o --no-g --no-p --chmod=ugo=rwX --info=STATS \
> 	>       --inplace --exclude='.snapshots' --delete \
> 	>       /nas/  \
> 	>       destination_host:/data/nas/
> 	>
> 	>
> 
> 
> 
> 	_______________________________________________
> 	kwlug-disc mailing list
> 	kwlug-disc at kwlug.org
> 	http://kwlug.org/mailman/listinfo/kwlug-disc_kwlug.org
>