Rsync-/usr/bin/rsync: Argument List Too Long

Hi
I am trying to send lakh of small(JPG,PDF) files from one server to another. So am using rsync which helps differential copy, but when using it getting error as /usr/bin/rsync: Argument list too long.

Kindly help, other than rsync if any option is also there kindly update.

Thanks in advance


sswaran


Similar Content



Rsync Operations Not Permitted

hello guys, just want to ask I have files on the server running SUSE 11 and i rsync to My WD Cloud via NFS.

but i notice some it shows some error like "This operation is not permitted"

I had used rsync -av parameters.

But when I used rsync -rltuv parameters it seems to work fine.

Why rsync -av parameter is used there are errors even though I set on WD My Cloud shared folder as the permissions as 777?

Thanks for any input.

Rsync Questions

Hi all

I got two questions about rsync:

1. I am copying a huge dir with lots of files, how do I see the overall progress? I put in the progress flag but now it show the progress each individual files.

2. Is rsync slower than cp? I used CP to copy over a NFS mount and that took about an hour. I am using rsync to copy over the same mount over the same NFS and so far it has taken 10 minutes to copy 7G. I got over 150G of stuff.

I just used rsync -avh --progress ...

Thanks
Davy

Rsync Question

Hey guys, I have rsync going to another remote server
it works good, however, lets say server A deleted a directory, server B wont sync up to it.

if I were to add a directory to Server A, then server B will add it as well. so server B is just not deleting stuff.

is there a proper rsync command i can use ?

would rsync -xzva --delete /src /dst delete everything and start the rsync from scratch? or is there another way to do this

Rsync Exclude File List Question

hi experts

I am running a large rsync job, but the exclude list doesn't seem to be working:

The rsync log shows this file as being copied over
/a/test 4.11/Logs/2015-03-03_PID_1234/x.y

but the exclude file clearly includes this line:
/a/test*/Logs/*PID*

So shouldn't it have been excluded?
Thanks

Rsync Without A Checksum Check? Centos 7

Hi All,
I am trying to perform an rsync without a check sum verification at the end of the copy.

I have tried both the -W (whole file) and the --no-checksum option and at the end of both file copies it performs a verification.


Code:
[root@centsrv01 /]# nice -n 20 rsync -avz --no-checksum  --bwlimit=2000 --progress /opt/vidconvert/converted/testfile.mp4 /opt/RouterUSB/TV/ChromeCast/
sending incremental file list
testfile.mp4
  1400440237 100%    1.94MB/s    0:11:28 (xfer#1, to-check=0/1)


I am copying from an XFS filesystem to a NTFS (CIFS) file system to a Samba share. Unfortunalty NFS is not an option.

Any Ideas?

Thanks

Rsync Cronjob Question

hey guys, sorry for asking a dumb question, but some of the terminology online is not grasping me well, and still leaving me confused


in crontab -e

I have a shell script that contains

rsync /home/willc86 willc86@server02:/home/willc86/backup

the script works good by itself, however i have to put in a password which I understand. i know crontab works, because i used rsync script in the local machine. I am just having problems trying to sync it to another server

how do i get this rsync going in crontab to back it up to another server.

Utilizing Rsync To Backup Data But Symbolic Links To Included

Please forgive me but I'm a little new to Red Hat (RHEL 5). I'm using rysnc to backup critical data and to a second disk; here is what I'm typing at the command line rsync -rvgal /data/disk1/share /data/backup/share. It appears that the softlinks are not transfered to the backup drive and some of the links point to data not located in the source folder (/data/share). After reading the rsync man page I was a little confused about the L option (vs the l option). In order to ensure that the linked files are moved should I type the below:

rsync -rvgaL /data/disk1/share /data/backup/share

A million thanks,
Johnny Mac

What Is The Rsync Flag To Ignore Permissions

I am using Rsync to backup files to a another machine, the users on my fileserver do not exist on the backup server so Rsync throws errors about the permissions. It copies the files fine but I want to get rid of the errors and have Rsync ignore the permissions when backing up.

/backup is a mounted ftp directory

Below is the current command and output:
Code:
root@Fileserver:~# rsync -av --delete /shared/fileshare/ /backup/backup
building file list ... done
created directory /backup/backup
./
manager/
manager/chironfs.txt
manager/cronman.txt
manager/curlftpfs.txt
manager/curlman.txt
manager/getnetaddress.txt
manager/grepman.txt
manager/rsyncman.txt
manager/tarman.txt
public/
user1/
user10/
user2/
user3/
user4/
user5/
user6/
user7/
user8/
user9/
rsync: chown "/backup/backup/manager/.chironfs.txt.c6MbJ7" failed: Operation not                  permitted (1)
rsync: chown "/backup/backup/manager/.cronman.txt.hdBG4P" failed: Operation not                  permitted (1)
rsync: chown "/backup/backup/manager/.curlftpfs.txt.t1sG4L" failed: Operation no                 t permitted (1)
rsync: chown "/backup/backup/manager/.curlman.txt.6oWPoW" failed: Operation not                  permitted (1)
rsync: chown "/backup/backup/manager/.getnetaddress.txt.V8z8Kk" failed: Operatio                 n not permitted (1)
rsync: chown "/backup/backup/manager/.grepman.txt.REh4WW" failed: Operation not                  permitted (1)
rsync: chown "/backup/backup/manager/.rsyncman.txt.ho8VNM" failed: Operation not                  permitted (1)
rsync: chown "/backup/backup/manager/.tarman.txt.BkcmeS" failed: Operation not p                 ermitted (1)

sent 211115 bytes  received 274 bytes  6710.76 bytes/sec
total size is 210263  speedup is 0.99
rsync error: some files could not be transferred (code 23) at main.c(977) [sende                 r=2.6.9]
root@Fileserver:~#

I tried the flag to adding the no flag to -p but it still didn't work, see below:
Code:
root@Fileserver:~# rsync -av --no-p --delete /shared/fileshare/ /backup/backup
building file list ... done
./
manager/
manager/chironfs.txt
manager/cronman.txt
manager/curlftpfs.txt
manager/curlman.txt
manager/getnetaddress.txt
manager/grepman.txt
manager/rsyncman.txt
manager/tarman.txt
public/
user1/
user10/
user2/
user3/
user4/
user5/
user6/
user7/
user8/
user9/
rsync: chown "/backup/backup/manager/.chironfs.txt.6Q3eP2" failed: Operation not permitted (1)
rsync: chown "/backup/backup/manager/.cronman.txt.FC8Orx" failed: Operation not permitted (1)
rsync: chown "/backup/backup/manager/.curlftpfs.txt.mlVSN9" failed: Operation not permitted (1)
rsync: chown "/backup/backup/manager/.curlman.txt.vlJ4b1" failed: Operation not permitted (1)
rsync: chown "/backup/backup/manager/.getnetaddress.txt.LXmft0" failed: Operation not permitted (1)
rsync: chown "/backup/backup/manager/.grepman.txt.SVuaye" failed: Operation not permitted (1)
rsync: chown "/backup/backup/manager/.rsyncman.txt.KTNYqA" failed: Operation not permitted (1)
rsync: chown "/backup/backup/manager/.tarman.txt.zcU90c" failed: Operation not permitted (1)

sent 211115 bytes  received 274 bytes  7686.87 bytes/sec
total size is 210263  speedup is 0.99
rsync error: some files could not be transferred (code 23) at main.c(977) [sender=2.6.9]

Rsync Both Ways

This is probably very basic, but I am totally new to Linux.

I am tryng to sync a usb data stick to Documents directory using:
rsync -auvhi /media/2C24-DC8F/ ~/Documents/

I then sync the other way [rsync -auvhin ~/Documents/ /media/2C24-DC8F/] expecting little or nothing, but end up with a massive list. A typical item being: .f.....g... boats/Siskiwit-Bay-SOF.pdf

My very limited undertanding makes me think that the group has changed during the first operation despite using -a, which I thought preserved the group.

Basically I am trying to keep /Documents and my data stick identical as I move between computers. Any suggestions?

Thanks

How To RSYNC Files Between Two Servers?

Hello--can someone tell me how to RSYNC bteween two servers with IP addresses, username and passwords while removing the files at the senders end? Do I need to login as root on both servers? I appreciate your input.