Page 1 of 2

Low tranmission in rsync operation

PostPosted: Fri Jun 17, 2022 8:10 am
by chrislev7
Hello,
My cloudbox (FW 18.2 patched) have a 4TB hard drive mounted in a local Gigabyte network. I try to synchronyze 2TB datas daily for a qnap server (under rsync protocol & NAS not busy) and the transfert can't exceed 3MB/S. It seems to be very low...

In reference, between 2 QNAP NAS, the bandwith is staying at 35MB/S in overall. :doh

Any suggestions ?

BSR

Chris

Re: Low tranmission in rsync operation

PostPosted: Fri Jun 17, 2022 9:55 am
by Jocko
Hi

Did you use directly a rsync command line ? If yes you must not use the option '-z' because it has a drastic impact on the transfer speed with a poorish cpu !

If you use a log file check if there is no many reported errors

Re: Low tranmission in rsync operation

PostPosted: Sat Jun 18, 2022 10:32 am
by chrislev7
Hi Jocko,

Thanks you for your support.

Unfornately, I tried the option compress on the qnap and the bandwith rocketed from 2.98 to 3.05 kB/s.
I have 2 LACIE NAS and same result ...

Chris

Re: Low tranmission in rsync operation

PostPosted: Mon Jun 20, 2022 9:11 am
by Jocko
Hi

How do you use rsync command ? via its rsync server feature ? In this case did you set a ssh client ? (same thing with a standard rsync, did you use the option -e in your command line).
In all these cases, that means your data are encrypted before transferring. So same behaviour as with the option -z (poorish cpu issue)

Re: Low tranmission in rsync operation

PostPosted: Mon Jun 20, 2022 7:39 pm
by chrislev7
Hi,
I use effectively SSH because I can't access the nas via 873 classic port on my qnap (login accepted, but impossible to specifiy sub directory) even the twice units are on the same submask.
Not simple in fact...

Re: Low tranmission in rsync operation

PostPosted: Tue Jun 21, 2022 8:55 am
by Jocko
Hi

Just to avoid a misunderstanding, in my previous post. Using a ssh client may have a speed impact only if you set either encryption on a rsync server or a ssh client on a rsync command with the option "-e" (and not open a shell terminal and run a standard rsync command line like "rsync -a /localpath/source /remotehsare/destination")

Now I suggest to try this way
- set a rsync server on your QNAP (see: https://docs.qnap.com/operating-system/qts/4.5.x/en-us/GUID-C8B5E7D3-7241-4F09-8595-1279E694C7EC.html) and enable it
- on fvdw-sl NAS, open the menu "Backup"
- add a remote rsync server (click on the related button)
- enter the port 873, your QNAP host name (should be listed) or set it manually (IP or the fdqn), and login/pwd (either "Shared rsync server account" set on QNAP side or use a local QNAP account if you have enabled the option"Local NAS accounts")
- return at the menu "backup" and check in the droplist when you click on "RSYNC::" you see some remote locations on your QNAP

Re: Low tranmission in rsync operation

PostPosted: Wed Jun 22, 2022 12:56 pm
by chrislev7
Hello Jocko,

Very interesting evolution,
By the way, I try to connect with port 873 in the sens Qnap->Fvdw-sl no way (sub-directories invisible), but in the reverse sens, it's possible. I can reach the ressources and the bandwith rocketed to 18 mo/s.


To be continue..

Re: Low tranmission in rsync operation

PostPosted: Wed Jun 22, 2022 1:13 pm
by Jocko
Hi

So some changes :thumbup
Now to understand you rightly, can you detail these points :
1/
By the way, I try to connect with port 873 in the sens Qnap->Fvdw-sl no way (sub-directories invisible)
Do you mean, you start a rsync server on fvdw-sl nas side and you try to connect to it from QNAP nas, then no module is visible from QNAP ?
2/
but in the reverse sens, it's possible. I can reach the ressources and the bandwith rocketed to 18 mo/s
So this time you set a rsync server on QNAP side and then you can see some resources on it from fvdw-sl side. And do you have read and write access ?

To valid the point 1, you can also add (but of course no useful) its own rsync server on the fvdw-sl nas (still from backup menu) if you still can not browse on the rsync server (RSYNC::) that means you set badly it. Maybe because the user account that you use to connect to:
- has no write permission on all selected modules if rsync server is the destination
- has no read permission on all the selected modules if rsync server is the source

Re: Low tranmission in rsync operation

PostPosted: Fri Jun 24, 2022 6:53 am
by chrislev7
With my 2 qnap, I try to acess (sens qnap->fw) with rsync, RTRR srv, CIFS/SMB srv no way...no modules reeched
In sens Fw-> QNAP, It's ok with SSL or not.
To reply at your request about option and login, I use the same login between the two units with all permissions R/W allowed (admin level ).

Re: Low tranmission in rsync operation

PostPosted: Fri Jun 24, 2022 12:00 pm
by Jocko
Hi

Please to give more detail.
So
chrislev7 wrote:In sens Fw-> QNAP, It's ok with SSL or not.
It seeems to be ok and then we stop to deepen this case
chrislev7 wrote:With my 2 qnap, I try to acess (sens qnap->fw) with rsync, RTRR srv, CIFS/SMB srv no way...no modules reeched
First there is no RTRR support with fvdw-sl firmware. It is a QNAP protocol and then can be used only with QNAP hosts (I think)
- So CIFS/SMB what did try to do ? Tried to mount a remote samba share on the QNAP nas
- rsync, you still don't answer my question... Do you mean you enabled a rsync server on fvdw-sl nas and you tried to use a rsync client command line from you qnap ?
If it is your attempt, we can check if at least on fvdw-sl side there is no issue.

So enable the rsync server (and of course you enabled also some modules/users on it). Then open a shell terminal on it and run this command
Code: Select all
/usr/sbin/rsync --port=873 username@nasname::
where username is a login allowing to get at least a read access on a share. If all is ok you should get an answer like this
Code: Select all
root@Acrab:/ # /usr/sbin/rsync --port=873 jocko@ACRAB::
Welcome on the rsync ACRAB server
Perso           Private
public          default

If yes then it is an issue on your qnap side how you tried to connect to the rsync server