Low tranmission in rsync operation

Low tranmission in rsync operation

Postby chrislev7 » Fri Jun 17, 2022 8:10 am

Hello,
My cloudbox (FW 18.2 patched) have a 4TB hard drive mounted in a local Gigabyte network. I try to synchronyze 2TB datas daily for a qnap server (under rsync protocol & NAS not busy) and the transfert can't exceed 3MB/S. It seems to be very low...

In reference, between 2 QNAP NAS, the bandwith is staying at 35MB/S in overall. :doh

Any suggestions ?

BSR

Chris
chrislev7
Donator VIP
Donator VIP
 
Posts: 14
Joined: Sun Jun 19, 2016 7:27 am

Re: Low tranmission in rsync operation

Postby Jocko » Fri Jun 17, 2022 9:55 am

Hi

Did you use directly a rsync command line ? If yes you must not use the option '-z' because it has a drastic impact on the transfer speed with a poorish cpu !

If you use a log file check if there is no many reported errors
Jocko
Site Admin - expert
 
Posts: 11558
Joined: Tue Apr 12, 2011 4:48 pm
Location: Orleans, France

Re: Low tranmission in rsync operation

Postby chrislev7 » Sat Jun 18, 2022 10:32 am

Hi Jocko,

Thanks you for your support.

Unfornately, I tried the option compress on the qnap and the bandwith rocketed from 2.98 to 3.05 kB/s.
I have 2 LACIE NAS and same result ...

Chris
chrislev7
Donator VIP
Donator VIP
 
Posts: 14
Joined: Sun Jun 19, 2016 7:27 am

Re: Low tranmission in rsync operation

Postby Jocko » Mon Jun 20, 2022 9:11 am

Hi

How do you use rsync command ? via its rsync server feature ? In this case did you set a ssh client ? (same thing with a standard rsync, did you use the option -e in your command line).
In all these cases, that means your data are encrypted before transferring. So same behaviour as with the option -z (poorish cpu issue)
Jocko
Site Admin - expert
 
Posts: 11558
Joined: Tue Apr 12, 2011 4:48 pm
Location: Orleans, France

Re: Low tranmission in rsync operation

Postby chrislev7 » Mon Jun 20, 2022 7:39 pm

Hi,
I use effectively SSH because I can't access the nas via 873 classic port on my qnap (login accepted, but impossible to specifiy sub directory) even the twice units are on the same submask.
Not simple in fact...
chrislev7
Donator VIP
Donator VIP
 
Posts: 14
Joined: Sun Jun 19, 2016 7:27 am

Re: Low tranmission in rsync operation

Postby Jocko » Tue Jun 21, 2022 8:55 am

Hi

Just to avoid a misunderstanding, in my previous post. Using a ssh client may have a speed impact only if you set either encryption on a rsync server or a ssh client on a rsync command with the option "-e" (and not open a shell terminal and run a standard rsync command line like "rsync -a /localpath/source /remotehsare/destination")

Now I suggest to try this way
- set a rsync server on your QNAP (see: https://docs.qnap.com/operating-system/qts/4.5.x/en-us/GUID-C8B5E7D3-7241-4F09-8595-1279E694C7EC.html) and enable it
- on fvdw-sl NAS, open the menu "Backup"
- add a remote rsync server (click on the related button)
- enter the port 873, your QNAP host name (should be listed) or set it manually (IP or the fdqn), and login/pwd (either "Shared rsync server account" set on QNAP side or use a local QNAP account if you have enabled the option"Local NAS accounts")
- return at the menu "backup" and check in the droplist when you click on "RSYNC::" you see some remote locations on your QNAP
Jocko
Site Admin - expert
 
Posts: 11558
Joined: Tue Apr 12, 2011 4:48 pm
Location: Orleans, France

Re: Low tranmission in rsync operation

Postby chrislev7 » Wed Jun 22, 2022 12:56 pm

Hello Jocko,

Very interesting evolution,
By the way, I try to connect with port 873 in the sens Qnap->Fvdw-sl no way (sub-directories invisible), but in the reverse sens, it's possible. I can reach the ressources and the bandwith rocketed to 18 mo/s.


To be continue..
chrislev7
Donator VIP
Donator VIP
 
Posts: 14
Joined: Sun Jun 19, 2016 7:27 am

Re: Low tranmission in rsync operation

Postby Jocko » Wed Jun 22, 2022 1:13 pm

Hi

So some changes :thumbup
Now to understand you rightly, can you detail these points :
1/
By the way, I try to connect with port 873 in the sens Qnap->Fvdw-sl no way (sub-directories invisible)
Do you mean, you start a rsync server on fvdw-sl nas side and you try to connect to it from QNAP nas, then no module is visible from QNAP ?
2/
but in the reverse sens, it's possible. I can reach the ressources and the bandwith rocketed to 18 mo/s
So this time you set a rsync server on QNAP side and then you can see some resources on it from fvdw-sl side. And do you have read and write access ?

To valid the point 1, you can also add (but of course no useful) its own rsync server on the fvdw-sl nas (still from backup menu) if you still can not browse on the rsync server (RSYNC::) that means you set badly it. Maybe because the user account that you use to connect to:
- has no write permission on all selected modules if rsync server is the destination
- has no read permission on all the selected modules if rsync server is the source
Jocko
Site Admin - expert
 
Posts: 11558
Joined: Tue Apr 12, 2011 4:48 pm
Location: Orleans, France

Re: Low tranmission in rsync operation

Postby chrislev7 » Fri Jun 24, 2022 6:53 am

With my 2 qnap, I try to acess (sens qnap->fw) with rsync, RTRR srv, CIFS/SMB srv no way...no modules reeched
In sens Fw-> QNAP, It's ok with SSL or not.
To reply at your request about option and login, I use the same login between the two units with all permissions R/W allowed (admin level ).
chrislev7
Donator VIP
Donator VIP
 
Posts: 14
Joined: Sun Jun 19, 2016 7:27 am

Re: Low tranmission in rsync operation

Postby Jocko » Fri Jun 24, 2022 12:00 pm

Hi

Please to give more detail.
So
chrislev7 wrote:In sens Fw-> QNAP, It's ok with SSL or not.
It seeems to be ok and then we stop to deepen this case
chrislev7 wrote:With my 2 qnap, I try to acess (sens qnap->fw) with rsync, RTRR srv, CIFS/SMB srv no way...no modules reeched
First there is no RTRR support with fvdw-sl firmware. It is a QNAP protocol and then can be used only with QNAP hosts (I think)
- So CIFS/SMB what did try to do ? Tried to mount a remote samba share on the QNAP nas
- rsync, you still don't answer my question... Do you mean you enabled a rsync server on fvdw-sl nas and you tried to use a rsync client command line from you qnap ?
If it is your attempt, we can check if at least on fvdw-sl side there is no issue.

So enable the rsync server (and of course you enabled also some modules/users on it). Then open a shell terminal on it and run this command
Code: Select all
/usr/sbin/rsync --port=873 username@nasname::
where username is a login allowing to get at least a read access on a share. If all is ok you should get an answer like this
Code: Select all
root@Acrab:/ # /usr/sbin/rsync --port=873 jocko@ACRAB::
Welcome on the rsync ACRAB server
Perso           Private
public          default

If yes then it is an issue on your qnap side how you tried to connect to the rsync server
Jocko
Site Admin - expert
 
Posts: 11558
Joined: Tue Apr 12, 2011 4:48 pm
Location: Orleans, France

Next

Return to Lacie cloudbox (white casing)

Who is online

Users browsing this forum: No registered users and 10 guests