Slackware :: Rsync Don't Works With Many Files?

Oct 23, 2010

I maintain some packages my synchronized with my remote server but I have a problem ... is very hard to understand, time it works, time not works. When not working the following happens:

Code:
[root@xxxx repository]# rsync -avzP --delete-after --partial-dir=.partial-dir rsync://xxxx@xxx.xx.xxx.xxx/repositorio 13.1

[code]...

View 7 Replies


ADVERTISEMENT

Slackware :: Rsync Exclude Directory With All Subdirectories And Files

Dec 26, 2010

In reading the rsync man page and browsing a lot of websites, I ended up a bit confused, or maybe it was just too much eggnog. Anyway, to exclude a directory "videos" with everything in it, which is /home/user1/camera/videos and I'm rsyncing the whole user1 directory to an external drive

[code]...

View 1 Replies View Related

Software :: Run Rsync To Download Files From A Server Without Rsync Daemon?

Sep 18, 2009

I just tried to sync files from one server to another. After the sync process, I found the files are bigger than original ones.

I looked up the web and found someone mentions the rsync daemon. So I have to run the daemon on one server before I run the rsync?

The command I used is rsync --partial --progress -r source destination

View 1 Replies View Related

Server :: Rsync Can Not Rsync Files With Include Filter

Jul 21, 2010

use rsync to cp such files and dirs under /var/www/html/mydir directory but these two files(/dir4/1.html /dir4/2.html) cant rsync to dest mechine.

rsync configure file,below...

View 2 Replies View Related

Slackware :: Sudo: Umount Works, Mount Not Works?

Jul 8, 2010

I've got a problem in doing sudo working for mounting things (e.g. usb pen or optic discs). Details:The OS: Slackware 13.0The response to sudo -l command:

Code:
User user1 may run the following commands on this host:
root) /sbin/shutdown -h now, /sbin/shutdown -r now

[code]...

View 3 Replies View Related

Slackware :: Using Rsync To Keep Local Copy Of Stable Tree Up To Date

May 14, 2011

when I installed 13.37 I created a local copy of the entire stable tree (source/ and all the rest) just to have all that stuff around to browse offline.

Now, to instruct myself, I'm trying to use rsync to keep this stuff up to date. But I seem either to have misread the rsync man page or ... well, I don't know. I am issuing the following command and getting the results seen below:

Code:

View 3 Replies View Related

Fedora :: Rsync Not Copying All Files?

Sep 9, 2011

My Source folder contains 424.8 GB in 502,474 files. My Destination folder was created fresh, and after the copy contains 394.0 GB in 486.514 files. I am running it as grsync with root authority. The only options are to preserve time, permissions, owner and group., and to produce a verose output and transfer progress. There are no exceptions specified to skip any files.

The rsync command is this:

rsync -r -t -p -o -g -v --progress -c -l -H -D -s /mnt/Backups/monthly.3/ /mnt/EX-Fantom/monthly.3/

I have run it again to give it a chance to get it right. Same result. The source is in an rsnapshot folder, but this is the first backup, the original, containing only whole files, not links.

View 3 Replies View Related

General :: Rsync Would Keep Sending The Files Over And Over Again?

Mar 2, 2010

I'm trying to using rsync to backup some files, about half a TB. It's now it a state where it keeps sending the same files everytime it runs. for example:

rsync -av /data/source/* user@host:/data/dest
sending incremental file list
source/file1.txt
source/file2.txt

I then verify those files are copied over. then the next time it runs it does the same thing

rsync -av /data/source/* user@host:/data/dest
sending incremental file list
source/file1.txt
source/file2.txt

any idea why it's getting stuck on these files? I've tried to wipe the whole dest directory out and start over but no luck.

View 2 Replies View Related

General :: Rsync Only Newest N Gb Of Files?

Jul 27, 2011

I have two directories, dirA whicht contains N gb of data and dirB which is supposed to contain only the newest M gb of data from dirA. When files are added to dirA, they sould also be added to dirB, while the oldest files in dirB should be deleted.Is that possible with rsync? or any other software?

View 1 Replies View Related

Ubuntu :: Rsync Wants To Recopy All My Files On Next Run / Why Is So?

Mar 15, 2010

So I just used rsync to backup about 400gb of data to my NAS. Look just over a day to complete, which is what I figured. I decided I should run rsync again to see how its going to handle comparing and only adding new files to the remote location. So I added a few new files and then ran the backup again. Well rsync is trying to do a complete copy of all of my original data, even though they have not changed.

Is there a way that I can tell rsync to compare the two directories and only add the new files and delete the ones that are no longer in the original location?

Here is command that I am running:

Code:
sudo rsync -azvv --progress --stats /media/sda1/multimedia/movies /home/codeblue/NAS_Share_Point

View 9 Replies View Related

Ubuntu :: 5,149,552 Files In 30.2 GB And RSYNC Out Of Space?

Jun 9, 2011

I am running Ubuntu 10.04. I am transferring roughly 62 GB of data libraries to my 84 GB /home partition. I'm using rsync because scp kept stalling, and I had to restart it over and over. Things were going great until recently when it began to show an error: "failed: No space left on device (28)" These are the things I've done so far: Used the GUI to find out how much I have copied so far: 5,149,552 which take up 30.2 GB. df -h, it tells me that my /home partition is 56% used, and that I have 33 GB available. (42 GB used out of 78 GB with 33 GB available) Also, none of my other partitions are anywhere near 100%. the /home partition is the most-used and it's only a little over half-full. du -s in the directory where I'm copying all of this: it also returned 42206500. Additionally, when I try to save screen captures, it sometimes fails with a "device full" error. What's going on? Am I really out of space? Why doesn't it show me that I'm out of space?

Is there a hidden temp file that rsync uses that just got too full? I did a little research on wikipedia and it said that ext4 has a 64,000 directory limit. Could it be that I somehow broke that limit with all of these files? Solution: not enough inodes for the vast amount of subdirectories on hard drive. This wasn't an RSYNC problem, rather, a partition configuration issue. To check inode usage: df -i If you want to add any inodes, you will need to backup your partition and format it using mke2fs (man mke2fs). Be sure to change the respective inode setting.

View 9 Replies View Related

General :: Rsync With Scp - Copies Everything - All Files

Jul 12, 2011

rsync -r -v -e ssh root@nn.nn.nn.nn:/usr/local/websites/* /usr/local/websites and each time I run it it copies everything - all files. I thought rsync was only supposed to copy files that had been added or modified.

View 3 Replies View Related

Server :: Rsync Files Between Web Servers?

May 20, 2010

I've 15 web servers (in private network) running RHEL, Apache. Needs to sync web files between them. each server is accessible to each other via public key (with passphares).

1) Main server is web1 (where dev upload files initially). So I can make all other servers accessible by web1 without password/passphares and run rsync periodically to update files between them. But security is an issue here as all servers will become easily accessible.

2) Run rsync daemon in all other servers (except web1) on designated port and run rsync command from web1 to sync files. This will do the work but running daemon in all servers might increase overhead and making sure that daemon is running all the time etc. are my concern for this implementation.

View 8 Replies View Related

OpenSUSE :: Rsync Copying All Files Instead Of Just What's Changed

Jan 11, 2011

During my backups I'm finding that rsync is copying all files, instead of just what's changed.

I'm rsyncing between 2 USB external hard drives. One hard drive is FAT32 and one is NTFS. I've examined some of the files and believe that the difference is that there's a 1-second modtime difference developing in some of the files somehow.

Here's an example. These duplicity files were synced from /media/BACKUPHD (the NTFS drive) to /media/VIDEOHD (the FAT32 drive) only a few hours ago this morning. They have not been touched or changed since then, but that 1-second difference in their time stamps has appeared:

Code:
tim@localhost:~> stat /media/BACKUPHD/backups/duplicity/duplicity-full.20110107T145955Z.vol10.difftar.gpg File: `/media/BACKUPHD/backups/duplicity/duplicity-full.20110107T145955Z.vol10.difftar.gpg'

[Code]....

View 8 Replies View Related

General :: Rsync N Newest Files In A Directory?

Nov 8, 2010

What would be the easiest way to go about rsyncing the n newest files in a directory to a remote server?

View 2 Replies View Related

Ubuntu :: Rsync Not Skipping Unchanged Files?

Mar 1, 2010

I am running this command,

Code:

rsync -vrl --progress --stats --perms --delete --exclude '*~' --exclude 'Music' --exclude 'server' --exclude 'Downloads' --exclude 'Ubuntu One' --exclude 'Videos' /home/dave/ /media/server/backup/desktop/dave

It transfers files that remain unchanged. The one that I notice every time is

Code:

.VirtualBox/HardDisks/anOS.vdi

I have several OSes installed in VirtualBox, so this takes a very long time.

View 1 Replies View Related

Ubuntu :: Rsync Really Slow On Large Files?

Mar 1, 2010

I have Ubuntu on both my laptop and desktop machines, both are connected to the same network. I back up the laptop to the desktop by running the following on the laptop:

rsync -avv --stats /home/alisdt alisdt@xxx.xxx.xxx.xxx:/home/alisdt/laptop_backup (with the IP address of the desktop instead of the many x, obviously). Whenever rsync hits a large file (greater than a few MB), the network use rapidly drops to ~60KB/s (that's kilobytes not bits). When I copy the same file to the same place using scp, I get > 500KB/s throughout the transfer. Things I've tried:

* mounting the desktop home dir on the laptop using SSHFS -- a simple file copy is fast, rsync is still slow
* ditto with NFS
* rsync --whole-file option, in case the delta-transfer algorithm was choking on large files
* rsync --inplace option
* HPN-SSH (http://www.psc.edu/networking/projects/hpn-ssh/) to enable dynamic window and unencrypted bulk transfer, just in case it was some ssh bottleneck I think it's either an rsync application problem, or a network problem that is only affecting rsync. Any ideas, or other ideas of what I can try to debug? In case it's relevant, I'm using 9.04 on both machines. (A standing bug prevents me from upgrading the laptop, and I haven't bothered to upgrade the desktop).

View 3 Replies View Related

Ubuntu :: Backup Files To Ntfs With Rsync?

May 31, 2010

well, i know ther are issues when using rsync to copy files to ntfs partition like file permission blah blah. the thing is, i need to backup my music files periodically onto a ntfs partition from ext4. i really dont care about file permissions or any other stuff. when i use rsync, it should update the mp3 files on my ntfs (external) disc with the new ones.can i give a go with this operation? i have lot more important files on the external disc and i dont want this rsync corrupt or delete those files coz they are highly important files.

View 2 Replies View Related

Ubuntu :: Rsync Deletes Files It Should Not Delete

May 4, 2011

I built a script that downloads my podcasts using Gpodder into the directory /HOME/SHARED/PODCASTS/ (with a subdirectory for each podcast)The script then selects the latest episode and copies it over to a target directory (it empies the target directory first and copies over everything) I want to use RSYNC to make sure the 'not so fresh' episodes get deleted and the "fresh" episodes get copied over. Then dropbox can sync the "new" files over to the cloud where i can access them via my ipad/iphone (whole other story).The thing is : i've replaced the cp command with the RSYNC command and now the script is acting strangely.

It selects and sync's over the "newest" podcasts to the destination directory. Then it suddenly DELETES all the episodes in the destination directory and copies over the three last files.

View 8 Replies View Related

General :: Rsync Not Deleting Files On Target

Sep 8, 2010

I'm using the command below to sync two directories. Problem is insted of deleting the files on the target directory it simply appends a ~ character at the end of the file name. Not sure why this is happening?I'd like to have all deletes on the source replicated on target.

View 2 Replies View Related

General :: Rsync, Crontab And Backing Up Files?

Apr 11, 2011

This is a quick one, I don't have any problems yet, I just want to check that this is going to do what I think it is. I added the line

Code:
00 01 * * * rsync -avz --delete /local-storage /mnt/usbackup
to my crontab file, am I to understand that this will backup /local-storage to my external

[code]...

View 4 Replies View Related

General :: Rsync Files With Dates After A Certain Date?

Jun 8, 2010

I was going to do a rsync -r -a -z -v -p -e sshto move some files frome server to another, but then realized all I really need are files which have dates starting June 1, 2008 to current. Is there a way to have rsync only sync those files?he directory structure that's my source goes all the way back to 2004.

View 5 Replies View Related

Security :: Why Rsync Updated Password Files

Mar 26, 2011

I synchronise my data disk to a backup disk daily. Yesterday I noticed that rsync listed in its output my password-managers directory, which contains an old Keepass database and other Windows password programs I used long ago. I haven't accessed this directory in ages, so I was wondering why rsync felt the need to list itthe directories it updated.Modification dates and last accessed dates are what I would expect; nothing recen

View 9 Replies View Related

Software :: Multiple Files Uploading By Rsync?

Jun 16, 2010

I wrote script which should help me to upload multiple files. But I have problem. I want that files uploading executed parallel not Here is my code:

relVersion=1.1a
path="path"
pack="ls *.zip"

[code]...

View 3 Replies View Related

Software :: Rsync Keeps Overwriting Some Unmodified Files?

Jan 7, 2010

'm having this strange problem with rsync. I'm trying to synchronize my music collection with the music collection on my mp3 player (Cowon iAUDIO). The mp3 player has a harddisk with the FAT32 file system. The problem is that it keeps overwriting unmodified files on the mp3 player.I use this command to synchronize:

Code:
rsync -avhpu --delete --progress --exclude-from "/home/serrano/backup-filters-iaudio.txt" "/windows/D/music/" "/media/IAUDIO/music/"

[code]...

View 4 Replies View Related

Debian Configuration :: Rsync - Not Creating Files On Host

Aug 2, 2015

Having an issue with rsync

I launch the following

Code: Select allrsync -avz --remove-source-files --log-file=/home/pi/rsync.log --temp-dir
=/data/temp --partial --progress -e "ssh" 192.168.1.100://data/ext/downloads/File.ext /data/

Basically I download to main PC and rsync to my pi as the pi has a fraction of the speed for some reason when downloading form a source outside of my network.

The first few files will sync fine. Then I start getting errors like this

Code: Select allrsync: rename "/data/temp/.File.ext.y1716M" -> "File.ext": No such file or directory
(2)

The directory on the host has user and group ownership as pi. Rsync has been setup to login without a password.

View 0 Replies View Related

OpenSUSE :: Rsync Backup *cache* Directories And Files?

Mar 4, 2010

I'm creating a backup scheme with rsync.

It is pretty clear not to include these:
/var/lib/named/proc
/var/lib/ntp/proc

[code]...

View 3 Replies View Related

OpenSUSE :: Way To Get Rsync To Delete Files If They Were Deleting At Source?

Jun 11, 2011

I have 2 folders that are synced using rsync. Right now if I delete a file in the source folder, the destination folder still retains that file. Is there a way to get rsync to delete files if they were deleting at the source?I could not find anything in the man page.not sure if I'm missing something or if that feature just doesn't exist.

View 4 Replies View Related

General :: Order Of Transfer All Files Under A Directory By Rsync

Sep 25, 2010

If transfer all files under a directory by rsync, what is the order that rsync determines to transfer the files one by one?At first it looked like rsync transfers files in alphabetical order, but later I found rsync skipped some files in the first sweep through the alphabetic order, and then went back to transfer files that were skipped in the first time and this time still in alphabetic order.

View 1 Replies View Related

General :: Rsync And Making Sure All Files Have Been Transferred Before Applying The Changes?

Nov 15, 2010

I was wondering if there is a way to tell rsync to only apply changes (delete, overwrite,create) only if all files in the file list transferred successfully.Just to clarify, this would essentially be putting a transaction around the transfer.

View 3 Replies View Related







Copyrights 2005-15 www.BigResource.com, All rights reserved