OpenSUSE :: Rsync Copying All Files Instead Of Just What's Changed

Jan 11, 2011

During my backups I'm finding that rsync is copying all files, instead of just what's changed.

I'm rsyncing between 2 USB external hard drives. One hard drive is FAT32 and one is NTFS. I've examined some of the files and believe that the difference is that there's a 1-second modtime difference developing in some of the files somehow.

Here's an example. These duplicity files were synced from /media/BACKUPHD (the NTFS drive) to /media/VIDEOHD (the FAT32 drive) only a few hours ago this morning. They have not been touched or changed since then, but that 1-second difference in their time stamps has appeared:

Code:
tim@localhost:~> stat /media/BACKUPHD/backups/duplicity/duplicity-full.20110107T145955Z.vol10.difftar.gpg File: `/media/BACKUPHD/backups/duplicity/duplicity-full.20110107T145955Z.vol10.difftar.gpg'

[Code]....

View 8 Replies


ADVERTISEMENT

Fedora :: Rsync Not Copying All Files?

Sep 9, 2011

My Source folder contains 424.8 GB in 502,474 files. My Destination folder was created fresh, and after the copy contains 394.0 GB in 486.514 files. I am running it as grsync with root authority. The only options are to preserve time, permissions, owner and group., and to produce a verose output and transfer progress. There are no exceptions specified to skip any files.

The rsync command is this:

rsync -r -t -p -o -g -v --progress -c -l -H -D -s /mnt/Backups/monthly.3/ /mnt/EX-Fantom/monthly.3/

I have run it again to give it a chance to get it right. Same result. The source is in an rsnapshot folder, but this is the first backup, the original, containing only whole files, not links.

View 3 Replies View Related

CentOS 5 :: RSYNC: Listing Files Added & Changed?

Oct 21, 2010

I'm using rsync to create a mirror of the data files on our main server every day. I've looked at the man page, and can't see it; can I get a listing of the files that have been changed on or added to the mirror when it's completed? Can it just log what it's doing to a file?

View 1 Replies View Related

CentOS 5 Hardware :: Rsync - Changed Blocks Or Files?

Sep 9, 2011

how rsync will handle disk images. Will rsync copy only the changed blocks of a vhd or a lun? This is what I've been told, but wouldn't this require overlaying a filesystem on the vhd? How would rsync handle copying a 500GB lun?

View 1 Replies View Related

Programming :: Shell Script To Copy Newly Changed Files With Rsync?

Apr 20, 2010

I've got quite a decent rsync script setup, however I'd like to invoke it whenever there's change to a file. My initial idea was to use find, however this has two major flaws - the first being my particular unix veriant cant understand -print0 which means this doesn't work, the second is that I'm not 100% sure how to put variables into quotation marks so ls can understand the target:

Code:

for i in `find /shares/ -mtime -1 -print`; do ls -ltr $i;done

View 14 Replies View Related

OpenSUSE :: Dolphin Losing Files When Copying Many Files Or Large Folders?

Feb 14, 2010

I've discovered that Dolphin seems to lose random files when copying many large folders.

I first noticed this a few months ago when I tried to copy my music library from one folder to another on the same HDD. It consisted of around 600 folders and 6500 files. During the copy there were no errors but after the copy I found that some of the newly copied folders were missing files. I put it down to human error or a glitch.

Yesterday I tried to copy 13 folders containing rips of some of my DVDs. Each folder basically had one film of either 700MB or 1.4GB. Again no errors showed up during the copy but I found 3 of the newly copied folders were empty.

It's not so critical with music or films but I can't afford to lose work data like this.

Has anyone experienced or seen a similar problem with Dolphin? I'm going to have to do some more extensive testing but this is not good.

The first time I noticed the problem I was running KDE4.3.4 (I think) and now the latest was with KDE4.4.0.

View 9 Replies View Related

Ubuntu :: No Copying Done Using Grsync Or Rsync

May 18, 2011

I'm using Ubuntu 10.10 64-bit and I'm a fairly new linux user. I've been trying to set up Grsync to to make incremental backups to my external harddrive but have some problems. In the file lists it looks like files are actually being copied but when I look at the harddrive none of the new files are actually there. As far as I can understand I'm not making a dry-run. I also found this thread: [URL] And I tried using the commands suggested in that post, with the same results.

View 9 Replies View Related

Software :: Using Rsync For Copying Multiple Partitions?

Sep 1, 2009

Regularly I find myself cloning a machine using rsync. I find it understandable, reliable and fast, faster than dd, and I don't have to worry about different partition sizes etc. However, usually I partition my hard disk in a number of partitions:

Code:
/
/home
/usr
/var

When I start with a new, empty machine, I start up with a USB stick or live CD, and my new, empty hard disk becomes /dev/sdb. After creating the 4 partitions I have /dev/sdb1, /dev/sdb2... etc. My root directory is on the disk I used for booting, usually /dev/sda. So, in order to access my newly created partitions, I mount them on the /mnt/directory of my root:

Code:
mounted now later
/mnt/sdb1 /
/mnt/sdb2 /home
/mnt/sdb3 /usr
/mnt/sdb4 /var

In other words, I mount now /dev/sdb1 on /mnt/sdb1, while after copying /dev/sdb1 will become my root directory, /dev/sdb2 become my /home directory, etc. When I start the resync process to copy the image from a remote machine, I have to copy all 4 partitions separately. First the root directory, excluding /home, /usr, /var, then /home, then /usr, /var, like this:

Code:
action 1:
rsync --exclude='/home' --exclude='/var' --exclude='/usr' my.remote.machine:/ /dev/sdb1/

action 2:
rsync my.remote.machine:/home /dev/sdb2/

action 3:
rsync my.remote.machine:/usr /dev/sdb3/

action 4:
rsync my.remote.machine:/var /dev/sdb4/

That is a lot of typing and waiting. Sometimes I have a different partition scheme so it is not really feasible to write a script to use always. Now the Question: is there a smarter way of mounting the newly formatted disk (/dev/sdb1, /dev/sdb2... etc) in my root tree so I can perform the rsync copy in just one time, without all the excludes, but assuring that the correct source partitions end up on the correct destination partitions?

View 8 Replies View Related

OpenSUSE Network :: Copying Files From FTP?

May 21, 2010

when I try to copy files from ftp server, at some moment speed falls to 0, i recive message "copy stalled" and my system frozen.I used Opensuse 11.2 (kernel linux 2.6.31). Some people advise me to upgrade the kernel. I upgraded it to linux-2.6.34, but it did not fixe a problem.Copying from ftp is very important for me, i like opensuse, but if i will not fixe this problem, i will must to change the OS.

View 5 Replies View Related

General :: RSYNC Challange, Copying 800GB Via 200GB EXT HDD?

Sep 8, 2010

I've got a little rsync challange for myself, I've got lets say 800GB of data, I'm trying to get it to a mate's PC, and need to be able to copy it in 200GB chunks.What I was thinking is.... I should be able to get Rsync to keep copying until it fills the drive, and output which files it syncs. Then use that list as an exclude list the next time... Providing my directory structure doesn't change, this should work.BUT!!! How do I get rsync to do this? I know of the --include and --exclude options, but am not sure how to use them in this case.

View 3 Replies View Related

Software :: Run Rsync To Download Files From A Server Without Rsync Daemon?

Sep 18, 2009

I just tried to sync files from one server to another. After the sync process, I found the files are bigger than original ones.

I looked up the web and found someone mentions the rsync daemon. So I have to run the daemon on one server before I run the rsync?

The command I used is rsync --partial --progress -r source destination

View 1 Replies View Related

Ubuntu Servers :: Rsync - Backup Only Changed Blocks?

Aug 10, 2010

I'm going to make a nightly backup copy from one server to another, using rsync. If I have a sufficiently large file, say 4+ GB or so, I'm not interested in copying the whole file if only a small change has been made. Can rsync detect small changes on block level and backup only those if needed?

View 2 Replies View Related

Server :: Rsync Can Not Rsync Files With Include Filter

Jul 21, 2010

use rsync to cp such files and dirs under /var/www/html/mydir directory but these two files(/dir4/1.html /dir4/2.html) cant rsync to dest mechine.

rsync configure file,below...

View 2 Replies View Related

OpenSUSE Install :: Partition Becomes Read-only When Copying Files To It

Mar 3, 2009

I've been having trouble copying files. When I try to copy something, it starts copying, and after a few GB, I suddenly get an error. It tells me its unable to write to the disk. After this, the only way to be able to write to the disk again, is to reboot the system. I then get to copy a few more files before the same error appears. The partition in question is formatted as ext3, using opensuse 11.0 with KDE.

View 3 Replies View Related

Ubuntu :: Existing Rsync Running And Copying Info To Hard Drive?

Nov 30, 2010

I have a home network that includes a couple of computers {A, B, C, D}. currently, I have a cron jon that runs every minute and updates (using rsync) the hard drives of computers {B, C, D} with the contents of hard drive {A}. So far everything works great, as hard drive {A} barely has any information on it. Now, I am about to copy a lot of information (about 8 GBs) to hard drive {A}. Naturally, the cron job will run (as it runs every 1-min) and try to 'sync' the contents with hard drives {B, C, D}.

Given my network (100Mbit/sec), there is no way the cron job will be able to 'copy' the contents to hard drives {B, C, D} in one minute. It will take much more time. Does this situation create a problem? meaning, will cron re-run a new rsync instance 1min later, even though an existing rsync process is running and still copying information to hard drives {B,C,D}? Will my backups be hurt / slowed down tremendously because of this?

View 2 Replies View Related

OpenSUSE :: Make Files On CD Writable When Copying To Hard Disk

Jan 3, 2011

I've set up my parents' machine running KDE 4.5 and want them to use the Gwenview import function from the Device Manager popup when transferring image files off photo CDs or other inserted media, since it's the easiest method for them to comprehend. All the files on their photo discs are r-xr-xr-x by default so they're unable to rotate or modify the images once copied to their hard disk. I want to set one specific images folder on their system to automatically force any files placed there to be rw-r--r-- (and rw-rw-r-- for another shared images directory elsewhere). It seems that umask won't work since that can only take permissions away and not add them, and I'd rather avoid getting into messy ACL configuration. Is there a way to achieve this either generically or some hidden config in Gwenview itself? I use KRename myself for such tasks but this is way too complex for my parents to understand so I need something that works without them having to do anything.

View 9 Replies View Related

OpenSUSE Hardware :: SD Card Unmount / Mount On Copying Files

Aug 13, 2011

I have a build-in card-reader in my notebook. When I insert a sd-card the card is mounted but as soon as I start copying the files to the harddrive, the sd-card will unmount and than mount again. Every time I start copying I have the unmount followed by a new mount. I tried with different sd-cards and I have the same problem. Card reader works fine on windows. But now I don't have windows anymore on this notebook so I need to use the card-reader on opensuse.

View 9 Replies View Related

General :: OpenSUSE LiveCD Stop Copying Files To The System?

Sep 21, 2011

I was trying to install openSUSE11.4 using the LiveCD. But when it started copying the root filesystem, it hung on 15% and waited forever. The CD stopped spinning too.

View 1 Replies View Related

General :: Change A Line In A Rsync Script And Send The File Changed?

Nov 19, 2010

I'm configuring an rsync between 2 machines, A_Server --> B_Server, using the following script:

Code:
#!/bin/bash
#
# Script de backup a trav�s de Rsync desde RMP-1 hasta RMP-2.
#

[Code]....

The Rsyn is working OK. What i need is to change one of the lines of the /tmp/prueba.txt before sending it to the remote machine (obviously not changing the file in the local machine), i mean, send prueba.txt to the remote machine deleting one line and adding another one...how can i do this?

View 1 Replies View Related

OpenSUSE :: Rsync Backup *cache* Directories And Files?

Mar 4, 2010

I'm creating a backup scheme with rsync.

It is pretty clear not to include these:
/var/lib/named/proc
/var/lib/ntp/proc

[code]...

View 3 Replies View Related

OpenSUSE :: Way To Get Rsync To Delete Files If They Were Deleting At Source?

Jun 11, 2011

I have 2 folders that are synced using rsync. Right now if I delete a file in the source folder, the destination folder still retains that file. Is there a way to get rsync to delete files if they were deleting at the source?I could not find anything in the man page.not sure if I'm missing something or if that feature just doesn't exist.

View 4 Replies View Related

OpenSUSE Install :: Middle Of Copying Files From Comp To Cellphone The Xp Has Crashed?

Apr 9, 2011

in the middle of copying files from my comp to my cellphone the Xp has crashed. When reboot, got a notification that:rootnoverify (hd 0,0)NTLDR is missingchainloader +1I found a way to possibly repair the xxxxxp, I just don't know if it can mess up my suse side, have 11.3this is the solution for xp;If you get the "NTLDR is Missing" error, follow these instructions:

1. Load Windows XP CD into CD drive.
2. Make sure BIOS is set to boot to CD drive.
3. Boot the computer from CD.

[code]....

View 4 Replies View Related

OpenSUSE :: Backup Important Files - Automate The Process Using Rsync And Cron

Aug 14, 2011

I would like to backup important files (totaling about 400GB) on my ext 4 RAID 5 array to an ext4 external hard drive over USB (external drive is mounted to /mnt. In the future I'd like to automate the process using rsync and cron so for now I'm using rsync to transfer the files. My problem is that using the rsync command like this: # rsync -Pr "/dir1" "/dir2" "/dir3" "/dir4" /mnt

rsync shows me the checks and transfers for awhile and then throws up an i/o error (wish I had a screenshot to show but I don't). When I ls /mnt I get a similar i/o error. I then check /dev for the drive and find that it no longer shows up. Originally the partition was /dev/sdc1. I tried unplugging the USB at this point, plugging it back in and mounting the drive back to /mnt, however it has now assigned it to (you guessed it) /dev/sdd1. I get the drive mounted and try the original rsync command again, hoping the first error was a fluke or some kind of one-time drive fart. This time it makes it quite a bit further and then throws up the exact same problem. Am I doing something terribly wrong here? As I said, I'm very new to bash so I'm not making some absolutely moronic, newbie mistake.

View 9 Replies View Related

Software :: Application To Eliminate Doubles In Files / Rename Changed Files With Date?

Jan 12, 2011

I have bought an external usb hard drive on which I back up my three computers every once in a while.Space will quickly be used up.I can't find that little bit of research that I need yesterday.Here is what I would like to find:An application that eliminates doubles in identical files and renames files that have changed by appending the last saved date yyyymmdd to the file name.Does such an application already exist?

View 6 Replies View Related

Ubuntu :: Permissions For My Home Directory Were Accidentally Changed From 'access Files' To 'create And Delete Files?

Nov 25, 2010

the permissions for my home directory were accidentally changed from 'access files' to 'create and delete files', and I changed them back, but ever since then I am not able to change any preferences/settings at all. power management, themes, panels, emerald, anything. my user account is supposed to be the administrator, and all the user privliges are checked. how to get control of my computer back?

View 9 Replies View Related

Fedora :: Copying Files Using Scp And Find?

Aug 29, 2010

I want to use find and scp to copy files. Is there a way to copy files that have spaces in their names? I know you can add " tags for a single file but can find do that? This is the command that i use:

scp $(find -iname "*.avi") destination

View 12 Replies View Related

Fedora :: Copying Files-No Permissions?

Oct 30, 2010

I was told fedora is great operating system but all i run is into trouble, hours spend on searching for solutions and never get an easy answer as it is on Leopard or even windows 7.What's my problem. I installed a new dvd copy of fedora13, and now connected 2 USB hard drives that seem to connect fine, can access everything but if i try to copy files to one of the drives it says i don't have permissions, and the fields to change permissions access are blank.

View 1 Replies View Related

Ubuntu :: Copying Files From OpenBSD 4.5 To OS

Jan 19, 2010

I need to copy some files from an OpenBSD 4.5 server to my Ubuntu set up via flash disk tell me what commands to enter on each in order to do this please? I believe OpenBSD is UFS and I'm running 9.10 so Ubuntu is ext4

View 9 Replies View Related

Ubuntu :: Copying Files Across Network

Apr 6, 2010

I am trying to copy files across a network using terminal. i know this is possible but i can't find a way. but i can paste smb://xxx.xxx.xxx.xxx/myfolder in the address bar in a folder and navigate to the correct area.is there some other way i can do this?

View 8 Replies View Related

Ubuntu :: Copying Files From Other Computers?

Jul 27, 2011

I had to leave rather suddenly (decision was Germany's, not fiancee's), and now am in the States again, but my files are still there. There are lots of things (mainly photos) on there, that I would like to have here. SOME stuff is on CD/DVD, but there is stuff that isn't.

Is there some way that I could access her computer and just copy files to mine?
(I picture two folders, one on hers, one on mine, and I just dragging an icon from one to the other - but I don't suppose anything's THAT easy...)

Naturally, her computer would have to be on, and I assume she could not be using it herself. Naturally also, I would get her permission first...

I assume that it would take a while, but if it were as simple as the icon thing I described above, then I could just go away and come back later. I assume something would be running to make sure that the destination file and source file were identical before proceeding to the next file.

[Before you suggest: why doesn't she just copy the files to DVD's and mail them to me? She is not all that computer saavy, I'm afraid, and trying to explain it all, including the exact folder names and such, Plus, how to use a DVD/CD burner and software... Plus translate it all into German... If I were rich enough, I could just go there and do what I needed, but that is not in the cards for the present. ]

IS there a way to copy stuff from her computer to mine?

View 2 Replies View Related







Copyrights 2005-15 www.BigResource.com, All rights reserved