[kwlug-disc] Transferring large backup files over the network

[Khalid Baheyeldin]

On Thu, May 23, 2019 at 11:13 PM Paul Nijjar via kwlug-disc <
kwlug-disc at kwlug.org> wrote:

> The reason I think (thought) they would be was because I tried a
> number of versions of rsync on windows in 2014. Several versions of
> rsync had 4GB file size limitations:
>
>
> https://superuser.com/questions/728190/rsync-on-windows-not-transferring-large-files
>
> cygwin did not, but it was really slow when I tried it. Things may
> have improved now. Disabling compression might help a lot.
>
>
The other key point that was mentioned, but I re-iterate since it is
important, is to copy files as
a whole, and not bother to checksum them.

For the daily backup that I do from my laptop to the server, I use this
(commented in the shell
script so I can remember what is going on):

  # -a        : Archive mode, preserve attributes
  # -z        : Compress data as it is being transferred
  # -v        : Verbose output, so we know which files are sent
  # -R        : Use relative path names
  # -x        : Do not go for files on other file systems, e.g. NFS or
sshfs mounts
  # -W        : Copy whole files, without the delta transfer algorithm,
cuts down checksum CPU usage
  # --inplace : Do not create another file and copy to it, so as to save
space on destination disk
  # --delete  : Delete files on the backup server that have been deleted on
this machine
  # -e        : Use ssh, rather than copying to an NFS mount
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://kwlug.org/pipermail/kwlug-disc_kwlug.org/attachments/20190523/4c267c76/attachment.htm>