is RSYNC that slow? (backup feature)

is RSYNC that slow? (backup feature)

Postby raidsm » Wed Mar 02, 2016 2:02 am

Hi!

I want to use the backup feature to backup a remote SMB share located on my Time Capsule as the source to a share (destination) on the NS2.

I know the backup feature uses rsync but , I did not expected to be soon slow.

At fist, to copy the source content I did try to run the backup feature but , it was soo slow , I've read somewhere that the rsync is slower than coping (for the fist data dump) because of the check that rsync must do. So I stopped that and then I used the copy command directly from the shell (ssh) on my NS2.

I took 3 day to copy 500gb? woo. It was painfully slow. My time capsule is directly attached to my NS2 via 1000gbit. I know my time capsule is not the fastest NAS around but I know the NS2 is quite worst. It takes approx 6-7 hours when I attaches a usb drive on my laptop via wifi ac....

After it was done , to "syncronyse" those 2 shares , I used the backup (mirror only from the source) and after 4 hour, I stopped the command and was a bit shocked that it did not finished yet.

I try the to run the rsync from my mac to speed thing a bit but I just remember I stopped it because it was again too slow.

Question is: is the RSYNC that slow over 2 SMB destination? I long it take approx to syncronyse 2 "identical" destination of about 500gb?

When I do it from my TC to a usb drive connected to my mac , it takes maybe around 30 minutes max to sync all the data.

Anyone has an idea? :dontknow :dontknow
raidsm
Donator VIP
Donator VIP
 
Posts: 153
Joined: Wed May 13, 2015 11:40 pm

Re: is RSYNC that slow? (backup feature)

Postby uelpenich » Thu Mar 03, 2016 9:51 pm

I did some guides & tutorials to rsync and the different modes how to use rsync.
I think the fastest way is to use rsync in a client - server configuration. This uses the computing power of both involved machines, and it is optmized for minimal network load.

Which mode did you use for your backup?

This is the end of a rsync log rsyncing a complete share from a NWSP2 to a 2big2 over a gigabit ethernet, rsync configured in client - server mode:
Number of files: 18653
Number of files transferred: 17807
Total file size: 47403553464 bytes
Total transferred file size: 47403553464 bytes
Literal data: 47403553464 bytes
Matched data: 0 bytes
File list size: 454299
File list generation time: 0.001 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 341773
Total bytes received: 47410529925

sent 341773 bytes received 47410529925 bytes 12332129.46 bytes/sec
total size is 47403553464 speedup is 1.00
uelpenich
Donator VIP
Donator VIP
 
Posts: 120
Joined: Sun Jun 12, 2011 4:45 pm
Location: Cologne, Germany


Return to Lacie Network Space vs2 and max version

Who is online

Users browsing this forum: No registered users and 5 guests