Fedora :: Rsync Not Copying All Files?
Sep 9, 2011
My Source folder contains 424.8 GB in 502,474 files. My Destination folder was created fresh, and after the copy contains 394.0 GB in 486.514 files. I am running it as grsync with root authority. The only options are to preserve time, permissions, owner and group., and to produce a verose output and transfer progress. There are no exceptions specified to skip any files.
The rsync command is this:
rsync -r -t -p -o -g -v --progress -c -l -H -D -s /mnt/Backups/monthly.3/ /mnt/EX-Fantom/monthly.3/
I have run it again to give it a chance to get it right. Same result. The source is in an rsnapshot folder, but this is the first backup, the original, containing only whole files, not links.
View 3 Replies
ADVERTISEMENT
Jan 11, 2011
During my backups I'm finding that rsync is copying all files, instead of just what's changed.
I'm rsyncing between 2 USB external hard drives. One hard drive is FAT32 and one is NTFS. I've examined some of the files and believe that the difference is that there's a 1-second modtime difference developing in some of the files somehow.
Here's an example. These duplicity files were synced from /media/BACKUPHD (the NTFS drive) to /media/VIDEOHD (the FAT32 drive) only a few hours ago this morning. They have not been touched or changed since then, but that 1-second difference in their time stamps has appeared:
Code:
tim@localhost:~> stat /media/BACKUPHD/backups/duplicity/duplicity-full.20110107T145955Z.vol10.difftar.gpg File: `/media/BACKUPHD/backups/duplicity/duplicity-full.20110107T145955Z.vol10.difftar.gpg'
[Code]....
View 8 Replies
View Related
May 18, 2011
I'm using Ubuntu 10.10 64-bit and I'm a fairly new linux user. I've been trying to set up Grsync to to make incremental backups to my external harddrive but have some problems. In the file lists it looks like files are actually being copied but when I look at the harddrive none of the new files are actually there. As far as I can understand I'm not making a dry-run. I also found this thread: [URL] And I tried using the commands suggested in that post, with the same results.
View 9 Replies
View Related
Sep 1, 2009
Regularly I find myself cloning a machine using rsync. I find it understandable, reliable and fast, faster than dd, and I don't have to worry about different partition sizes etc. However, usually I partition my hard disk in a number of partitions:
Code:
/
/home
/usr
/var
When I start with a new, empty machine, I start up with a USB stick or live CD, and my new, empty hard disk becomes /dev/sdb. After creating the 4 partitions I have /dev/sdb1, /dev/sdb2... etc. My root directory is on the disk I used for booting, usually /dev/sda. So, in order to access my newly created partitions, I mount them on the /mnt/directory of my root:
Code:
mounted now later
/mnt/sdb1 /
/mnt/sdb2 /home
/mnt/sdb3 /usr
/mnt/sdb4 /var
In other words, I mount now /dev/sdb1 on /mnt/sdb1, while after copying /dev/sdb1 will become my root directory, /dev/sdb2 become my /home directory, etc. When I start the resync process to copy the image from a remote machine, I have to copy all 4 partitions separately. First the root directory, excluding /home, /usr, /var, then /home, then /usr, /var, like this:
Code:
action 1:
rsync --exclude='/home' --exclude='/var' --exclude='/usr' my.remote.machine:/ /dev/sdb1/
action 2:
rsync my.remote.machine:/home /dev/sdb2/
action 3:
rsync my.remote.machine:/usr /dev/sdb3/
action 4:
rsync my.remote.machine:/var /dev/sdb4/
That is a lot of typing and waiting. Sometimes I have a different partition scheme so it is not really feasible to write a script to use always. Now the Question: is there a smarter way of mounting the newly formatted disk (/dev/sdb1, /dev/sdb2... etc) in my root tree so I can perform the rsync copy in just one time, without all the excludes, but assuring that the correct source partitions end up on the correct destination partitions?
View 8 Replies
View Related
Sep 8, 2010
I've got a little rsync challange for myself, I've got lets say 800GB of data, I'm trying to get it to a mate's PC, and need to be able to copy it in 200GB chunks.What I was thinking is.... I should be able to get Rsync to keep copying until it fills the drive, and output which files it syncs. Then use that list as an exclude list the next time... Providing my directory structure doesn't change, this should work.BUT!!! How do I get rsync to do this? I know of the --include and --exclude options, but am not sure how to use them in this case.
View 3 Replies
View Related
Sep 18, 2009
I just tried to sync files from one server to another. After the sync process, I found the files are bigger than original ones.
I looked up the web and found someone mentions the rsync daemon. So I have to run the daemon on one server before I run the rsync?
The command I used is rsync --partial --progress -r source destination
View 1 Replies
View Related
Jul 21, 2010
use rsync to cp such files and dirs under /var/www/html/mydir directory but these two files(/dir4/1.html /dir4/2.html) cant rsync to dest mechine.
rsync configure file,below...
View 2 Replies
View Related
Nov 30, 2010
I have a home network that includes a couple of computers {A, B, C, D}. currently, I have a cron jon that runs every minute and updates (using rsync) the hard drives of computers {B, C, D} with the contents of hard drive {A}. So far everything works great, as hard drive {A} barely has any information on it. Now, I am about to copy a lot of information (about 8 GBs) to hard drive {A}. Naturally, the cron job will run (as it runs every 1-min) and try to 'sync' the contents with hard drives {B, C, D}.
Given my network (100Mbit/sec), there is no way the cron job will be able to 'copy' the contents to hard drives {B, C, D} in one minute. It will take much more time. Does this situation create a problem? meaning, will cron re-run a new rsync instance 1min later, even though an existing rsync process is running and still copying information to hard drives {B,C,D}? Will my backups be hurt / slowed down tremendously because of this?
View 2 Replies
View Related
Aug 29, 2010
I want to use find and scp to copy files. Is there a way to copy files that have spaces in their names? I know you can add " tags for a single file but can find do that? This is the command that i use:
scp $(find -iname "*.avi") destination
View 12 Replies
View Related
Oct 30, 2010
I was told fedora is great operating system but all i run is into trouble, hours spend on searching for solutions and never get an easy answer as it is on Leopard or even windows 7.What's my problem. I installed a new dvd copy of fedora13, and now connected 2 USB hard drives that seem to connect fine, can access everything but if i try to copy files to one of the drives it says i don't have permissions, and the fields to change permissions access are blank.
View 1 Replies
View Related
Mar 16, 2010
Why system lags so much while working with a lot of files or with big files (copying them, erasing)? How it can be solved? I am running Fedora 12 x86_64 with ext4 filesystem
View 14 Replies
View Related
Jul 18, 2010
I have a saved a .c file on my department computer and i am able to access it through my computer via SSH. BUT I WANT TO copy and paste it into my system.
View 3 Replies
View Related
Aug 12, 2010
I have a server with RedHat distro which stores and updates someg files and second computer with Windows 7 on it. I must configure both machines so one can get those files from server to Win7 machine using ssh. But I have no idea how to do it.
View 3 Replies
View Related
Mar 11, 2011
I have installed Windows XP with Virtual Machine Manager. The question is how do I access files on my primary linux system? Also can I mount a NTFS partition in my Virtual Machine
View 14 Replies
View Related
Dec 21, 2010
I booted my Fedora 13 live CD on my Dell server, and configured networking and SSHd. On my desktop I logged into the live cd and started copying over a big file (1.5 GB) (i.e. copying from the desktop computer to the server). After copying about half the fil, the download fails with an error message about the filesystem being read-only.I've seen this exact same behavior on both i386 and x86_64 of the same live CD, but don't know why it's happening. I've also had the same issue when copying small files. In /var/log/messages these messages are repeated many times:
Code:
Dec 20 12:32:23 localhost kernel: Buffer I/O error on device dm-0, logical block 684075
Dec 20 12:32:23 localhost kernel: lost page write due to I/O error on dm-0
[code]....
View 6 Replies
View Related
Aug 12, 2009
host A: Fedora 7 has bind 9.4.2
host B: Fedora 11 has bind 9.6.1
I want to migrate my bind configuration from A to B I've read the release notes and man pages and I can't see why copying
/etc/named*
and
/var/named/*
I checked /etc/sysconfig/named too... Seems to have no effect on my brand new install on Fedora 11. Host B stays basically un-configured.
View 2 Replies
View Related
Dec 30, 2010
I currently have three hard drives: (2) 150GB IDE drives (windows) and (1) 500GB SATA drive (fedora13). I'm trying to move files on the IDE drives to the SATA drive so that I only need the SATA drive. The SATA drive is running Fedora 13 and the other two were old NTFS drives that I just use for space now. So most of the files copied fine, however, for a handful of them I receive the following error:Error splicing file: Value too large for defined data type This happens when I try to copy files not only from drive to drive, but even from folder to folder on the same drive. I've read about a 2GB file size limit, but none of the files are that size. I have no idea why this is happening.
View 5 Replies
View Related
Jan 11, 2010
I just bought a HP 3085dx laptop with an intel 5100 agn wireless card.
The problem: copying a big file over the wireless to a gigabit hardwired to the router computer only gives an average 3.5MB/Second transfer rate. If I do the same copy from my wireless-n macbook pro to the same computer. I get a transfer rate of about 11MB/sec. Why the big difference? I noticed the HP always connects to the 2.4 GHZ band instead of the 5GHZ bands...
On the HPL
[jerry@bigbox ~]$ ifconfig wlan0
wlan0 Link encap:Ethernet HWaddr 00:246:36:AC4
inet addr:192.168.1.75 Bcast:192.168.1.255 Mask:255.255.255.0
inet6 addr: fe80::224:d6ff:fe36:acc4/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:639243 errors:0 dropped:0 overruns:0 frame:0
TX packets:1293049 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:53832795 (51.3 MiB) TX bytes:1888619922 (1.7 GiB)
[jerry@bigbox ~]$ iwconfig wlan0
wlan0 IEEE 802.11abgn ESSID:"<censored>"
Mode: Managed Frequency:2.412 GHz
Access Point: 00:24:36:A7:27:A3
Bit Rate=0 kb/s Tx-Power=15 dBm
Retry long limit: 7 RTS thr: off Fragment thr:off
Power Management: off
Link Quality=70/70 Signal level=-8 dBm Noise level=-87 dBm
Rx invalid nwid:0 Rx invalid crypt:0 Rx invalid frag:0
Tx excessive retries:0 Invalid misc:0 Missed beacon:0
I am not getting any errors. I don't know why the bit rate is not known. My airport extreme base station typically reports that the 'rate' for the hp is typically 250~300MBi and about the same for the MacBook Pro. The hp is about 6 inchs away from the base station. Is there anyway to get the rascal to go mo'faster? Is there anyway to get the rascal to use the 5GHZ band.
View 3 Replies
View Related
Aug 3, 2009
I've tried to copy my files from Xamp httdocs in windows to /var/www/html,but I can't paste the file, what should I do so I can paste the files ?I have logged in as a root
View 5 Replies
View Related
Mar 6, 2010
I'm currently learning to use rsync to backup my music collection. I have a Firefox tab open to the rsync manual page(s) and have been reading man rsync and running experimental rsync operations.I've been doing this for the last 3-4 hours. I've used rsync for this purpose in the past with disastrous results. What was and is once again (due to a month and a half of file pruning) a 9000 file music collection had mysteriously grown to over 25,000 music files and 80GB of data! This was likely due to the fact that I didn't really know what I was doing with rsync and had never spent too much time learning about all the parameters, what their functions are and how they may relate to my goal.Here are the particulars:
* Source drive is a 500GB disk, /media/sata500/music/.
* Destination drive is a 250GB USB disk, /media/FreeAgent/music, connected to the same computer that houses the 500GB disk.
* I want to copy or backup files from /media/sata500/music to /media/FreeAgent/music.
* I do not want to create ANY duplicates of files that exist.
* I only want to add files to the destination drive if they are new on the source drive, like if I rip a CD and add the contents to the source. I want them copied over next time I run rsync.
Here's the rsync command in it's most recently used form, and probably very immature at this point.
Code:
rsync -t -r -vv --stats -i --log-file=/home/glenn/rsync.log /media/sata500/music/* /media/FreeAgent/music/
This appears to have copied all files and folders and I'm satisfied that my goal has been met with some success. To convince myself of this I ran the command and then once it was complete I added 2 new songs putting them in their respective folders on the source drive and ran the same command again. The resulting output was
[code]....
Two files transferred. Exactly what I want.Both folders now house 20,931 files and use 40.6GB. Identical as far as I can tell.What I'm concerned about are time stamps and play count data, etc. Anything that changes the original file. I don't want this data to cause a file to be transferred as I'm afraid that the new file will be created along side the old file of the same name thereby starting this whole music collection expansion thing all over again. I've invested a lot of time and effort to get it pruned down to where there are virtually no duplicates and albums are correct in that they contain the proper songs in the proper order.
View 14 Replies
View Related
Feb 14, 2010
I've discovered that Dolphin seems to lose random files when copying many large folders.
I first noticed this a few months ago when I tried to copy my music library from one folder to another on the same HDD. It consisted of around 600 folders and 6500 files. During the copy there were no errors but after the copy I found that some of the newly copied folders were missing files. I put it down to human error or a glitch.
Yesterday I tried to copy 13 folders containing rips of some of my DVDs. Each folder basically had one film of either 700MB or 1.4GB. Again no errors showed up during the copy but I found 3 of the newly copied folders were empty.
It's not so critical with music or films but I can't afford to lose work data like this.
Has anyone experienced or seen a similar problem with Dolphin? I'm going to have to do some more extensive testing but this is not good.
The first time I noticed the problem I was running KDE4.3.4 (I think) and now the latest was with KDE4.4.0.
View 9 Replies
View Related
May 21, 2010
when I try to copy files from ftp server, at some moment speed falls to 0, i recive message "copy stalled" and my system frozen.I used Opensuse 11.2 (kernel linux 2.6.31). Some people advise me to upgrade the kernel. I upgraded it to linux-2.6.34, but it did not fixe a problem.Copying from ftp is very important for me, i like opensuse, but if i will not fixe this problem, i will must to change the OS.
View 5 Replies
View Related
Jan 19, 2010
I need to copy some files from an OpenBSD 4.5 server to my Ubuntu set up via flash disk tell me what commands to enter on each in order to do this please? I believe OpenBSD is UFS and I'm running 9.10 so Ubuntu is ext4
View 9 Replies
View Related
Apr 6, 2010
I am trying to copy files across a network using terminal. i know this is possible but i can't find a way. but i can paste smb://xxx.xxx.xxx.xxx/myfolder in the address bar in a folder and navigate to the correct area.is there some other way i can do this?
View 8 Replies
View Related
Jul 27, 2011
I had to leave rather suddenly (decision was Germany's, not fiancee's), and now am in the States again, but my files are still there. There are lots of things (mainly photos) on there, that I would like to have here. SOME stuff is on CD/DVD, but there is stuff that isn't.
Is there some way that I could access her computer and just copy files to mine?
(I picture two folders, one on hers, one on mine, and I just dragging an icon from one to the other - but I don't suppose anything's THAT easy...)
Naturally, her computer would have to be on, and I assume she could not be using it herself. Naturally also, I would get her permission first...
I assume that it would take a while, but if it were as simple as the icon thing I described above, then I could just go away and come back later. I assume something would be running to make sure that the destination file and source file were identical before proceeding to the next file.
[Before you suggest: why doesn't she just copy the files to DVD's and mail them to me? She is not all that computer saavy, I'm afraid, and trying to explain it all, including the exact folder names and such, Plus, how to use a DVD/CD burner and software... Plus translate it all into German... If I were rich enough, I could just go there and do what I needed, but that is not in the cards for the present. ]
IS there a way to copy stuff from her computer to mine?
View 2 Replies
View Related
Jun 7, 2010
I have a new network attached storage unit that I'm trying to transfer my data to. On this NAS, it has a very basic linux installed with SSH enabled. Browsing through the programs installed on it, i found smbclient. Am I able to copy files directly from my old NAS to my new one using smbclient?It would sure beat transfering 950GB from my old NAS through a computer then onto my new NAS.
View 1 Replies
View Related
Jan 8, 2010
While copying a large amount of data between two linux computers I noticed strange behaviour. The network card activity (computer copying the files) would be dormant for 30 second to a minute and then flash rapidly for just 5 second or so. This repeated for the duration of the copying progress (approx 2 hours at a supposedly constant 5-7MB/s).
The share that I was copying to was via SSH using "connect to server" from the GNOME menu. I was expecting the see the network card activity light constantly flash. I wondered if someone could explain this strange behaviour that I have witnessed.
View 5 Replies
View Related
Jan 3, 2011
How can I copy some files from a windows machine to Linux machine ?
View 13 Replies
View Related
Jan 16, 2010
I am running openSUSE 11.2 KDE 4.3.4 on my ThinkPad R51 laptop.I would like to copy 'File A, File B, File C' (for example) that has photographs of a holiday , to a blank CD inserted into my drive and cannot find a way to 'copy and paste' into the volume.
View 3 Replies
View Related
Apr 19, 2011
i have some files on my server that i can not rename or copy it seems file names are some how strange for linux (centos)the names are like this way :
Spirited.Away.2001.HDRip_-_(Film98-Net).mkv
Up.2009.BRrip_-_(Film98-Net).mkv
How.To.Train.Your.Dragon.2010.720p.Bluray_-_(Film98-Net).mkv
[code]...
View 6 Replies
View Related
