General :: RSYNC Challange, Copying 800GB Via 200GB EXT HDD?

Sep 8, 2010

I've got a little rsync challange for myself, I've got lets say 800GB of data, I'm trying to get it to a mate's PC, and need to be able to copy it in 200GB chunks.What I was thinking is.... I should be able to get Rsync to keep copying until it fills the drive, and output which files it syncs. Then use that list as an exclude list the next time... Providing my directory structure doesn't change, this should work.BUT!!! How do I get rsync to do this? I know of the --include and --exclude options, but am not sure how to use them in this case.

View 3 Replies


ADVERTISEMENT

General :: Recommendations For Regular Maintenance On 800GB Samba Share?

Apr 27, 2010

I know on Windows boxes you can defrag and run disk checks on large file shares to find and fix errors. What would be the equivolent to those for an ext3 800GB samba share containing pictures, documents, and videos? Is their online vs. offline (during a reboot) things that should be done?

View 4 Replies View Related

Fedora :: Rsync Not Copying All Files?

Sep 9, 2011

My Source folder contains 424.8 GB in 502,474 files. My Destination folder was created fresh, and after the copy contains 394.0 GB in 486.514 files. I am running it as grsync with root authority. The only options are to preserve time, permissions, owner and group., and to produce a verose output and transfer progress. There are no exceptions specified to skip any files.

The rsync command is this:

rsync -r -t -p -o -g -v --progress -c -l -H -D -s /mnt/Backups/monthly.3/ /mnt/EX-Fantom/monthly.3/

I have run it again to give it a chance to get it right. Same result. The source is in an rsnapshot folder, but this is the first backup, the original, containing only whole files, not links.

View 3 Replies View Related

Ubuntu :: No Copying Done Using Grsync Or Rsync

May 18, 2011

I'm using Ubuntu 10.10 64-bit and I'm a fairly new linux user. I've been trying to set up Grsync to to make incremental backups to my external harddrive but have some problems. In the file lists it looks like files are actually being copied but when I look at the harddrive none of the new files are actually there. As far as I can understand I'm not making a dry-run. I also found this thread: [URL] And I tried using the commands suggested in that post, with the same results.

View 9 Replies View Related

OpenSUSE :: Rsync Copying All Files Instead Of Just What's Changed

Jan 11, 2011

During my backups I'm finding that rsync is copying all files, instead of just what's changed.

I'm rsyncing between 2 USB external hard drives. One hard drive is FAT32 and one is NTFS. I've examined some of the files and believe that the difference is that there's a 1-second modtime difference developing in some of the files somehow.

Here's an example. These duplicity files were synced from /media/BACKUPHD (the NTFS drive) to /media/VIDEOHD (the FAT32 drive) only a few hours ago this morning. They have not been touched or changed since then, but that 1-second difference in their time stamps has appeared:

Code:
tim@localhost:~> stat /media/BACKUPHD/backups/duplicity/duplicity-full.20110107T145955Z.vol10.difftar.gpg File: `/media/BACKUPHD/backups/duplicity/duplicity-full.20110107T145955Z.vol10.difftar.gpg'

[Code]....

View 8 Replies View Related

Software :: Using Rsync For Copying Multiple Partitions?

Sep 1, 2009

Regularly I find myself cloning a machine using rsync. I find it understandable, reliable and fast, faster than dd, and I don't have to worry about different partition sizes etc. However, usually I partition my hard disk in a number of partitions:

Code:
/
/home
/usr
/var

When I start with a new, empty machine, I start up with a USB stick or live CD, and my new, empty hard disk becomes /dev/sdb. After creating the 4 partitions I have /dev/sdb1, /dev/sdb2... etc. My root directory is on the disk I used for booting, usually /dev/sda. So, in order to access my newly created partitions, I mount them on the /mnt/directory of my root:

Code:
mounted now later
/mnt/sdb1 /
/mnt/sdb2 /home
/mnt/sdb3 /usr
/mnt/sdb4 /var

In other words, I mount now /dev/sdb1 on /mnt/sdb1, while after copying /dev/sdb1 will become my root directory, /dev/sdb2 become my /home directory, etc. When I start the resync process to copy the image from a remote machine, I have to copy all 4 partitions separately. First the root directory, excluding /home, /usr, /var, then /home, then /usr, /var, like this:

Code:
action 1:
rsync --exclude='/home' --exclude='/var' --exclude='/usr' my.remote.machine:/ /dev/sdb1/

action 2:
rsync my.remote.machine:/home /dev/sdb2/

action 3:
rsync my.remote.machine:/usr /dev/sdb3/

action 4:
rsync my.remote.machine:/var /dev/sdb4/

That is a lot of typing and waiting. Sometimes I have a different partition scheme so it is not really feasible to write a script to use always. Now the Question: is there a smarter way of mounting the newly formatted disk (/dev/sdb1, /dev/sdb2... etc) in my root tree so I can perform the rsync copy in just one time, without all the excludes, but assuring that the correct source partitions end up on the correct destination partitions?

View 8 Replies View Related

Ubuntu :: Existing Rsync Running And Copying Info To Hard Drive?

Nov 30, 2010

I have a home network that includes a couple of computers {A, B, C, D}. currently, I have a cron jon that runs every minute and updates (using rsync) the hard drives of computers {B, C, D} with the contents of hard drive {A}. So far everything works great, as hard drive {A} barely has any information on it. Now, I am about to copy a lot of information (about 8 GBs) to hard drive {A}. Naturally, the cron job will run (as it runs every 1-min) and try to 'sync' the contents with hard drives {B, C, D}.

Given my network (100Mbit/sec), there is no way the cron job will be able to 'copy' the contents to hard drives {B, C, D} in one minute. It will take much more time. Does this situation create a problem? meaning, will cron re-run a new rsync instance 1min later, even though an existing rsync process is running and still copying information to hard drives {B,C,D}? Will my backups be hurt / slowed down tremendously because of this?

View 2 Replies View Related

Ubuntu :: Having Only 25gb On A 200gb Partition?

Jul 30, 2010

I open Home from 'places', and at the bottom it says i have (now) 15gb free... but my partition is 200gb and even when i first installed ubuntu, it was 25gb, and im sure that this is something to do with ubuntu, because there is NOTHING else on this drive

View 2 Replies View Related

Debian :: Add In A 200GB IDE Drive And All Worked Fine?

Nov 27, 2010

I have just installed Debian 5 and KDE. All works fine. I wanted to add in a 200GB IDE drive and all worked fine except when I use Konqueror to look at the drive contents it is unmounted. I can mount it o.k., but my question is:

Where do I put the mount command so that the drive mounts at startup? Do I have to set permissions as well and if so can i do this so that the drive is r/w accessible to me as a non root user? My system is just a desktop machine running Openoffice and Internet access.

View 3 Replies View Related

Ubuntu Servers :: Advanced Rsync - Make The Rsync Set Or Keep The User And Group Affiliations?

Nov 17, 2010

Thought I'd post it here because it's more server related than desktop... I have a script that does:

[Code]....

This is used to sync my local development snapshot with the live web server. There has to be a more compact way of doing this? Can I combine some of the rsyncs? Can I make the rsync set or keep the user and group affiliations? Can I exclude .* yet include .htaccess?

View 6 Replies View Related

Ubuntu :: Can't Rsync Gmail / Run Rsync --recursive --times --perms --links --delete?

Jan 7, 2011

When I run rsync --recursive --times --perms --links --delete --exclude-from='Documents/exclude.txt' ./ /media/myusb/

where Documents/exclude.txt is

- /Downloads/
- /Desktop/books/

the files in those directories are still copied onto my USB.

And...

I used fetchmail to download all my gmail emails. When I run rsync -ar --exclude-from='/home/xtheunknown0/Documents/exclude.txt' ./ /media/myusb/ I get the first image at url.

View 9 Replies View Related

Server :: Rsync Execution - With Crontab - Have Given Full Path To Rsync Too

Apr 12, 2011

I have a tiny shell script to rsync files between two servers and remove the source files.

This script works fine, when it has been initiated manually or even when the rsync command is executed on the command line.

But the same script doesn't work, when I try to automate it through crontab.

I am using 'abc' user to execute this rsync, instead of root, as root login to servers are restricted in all of our servers, by us.

As I mentioned earlier, manual execution works like charm!

When this rsync.sh is initiated through crontab, it runs the first command(chown abc.abc ...) perfectly without any issues. But the second line is not at all executed, and there is no log entry i can find at /mnt/xyz/folder/rsync.log.

View 6 Replies View Related

Software :: Run Rsync To Download Files From A Server Without Rsync Daemon?

Sep 18, 2009

I just tried to sync files from one server to another. After the sync process, I found the files are bigger than original ones.

I looked up the web and found someone mentions the rsync daemon. So I have to run the daemon on one server before I run the rsync?

The command I used is rsync --partial --progress -r source destination

View 1 Replies View Related

Server :: Rsync Can Not Rsync Files With Include Filter

Jul 21, 2010

use rsync to cp such files and dirs under /var/www/html/mydir directory but these two files(/dir4/1.html /dir4/2.html) cant rsync to dest mechine.

rsync configure file,below...

View 2 Replies View Related

Server :: Rsync Fails In Cron - Ssh Key - For Rsync?

Dec 8, 2010

I'm using Ubuntu 10.04 LTS server and Postgresql 8.4. I have a .sh script that is run by cron every other hour. That works fine. The .sh script includes an rsync command that copies a postgresql dump .tar file to a remote archive location via ssh. That fails when run by cron; I think because it is (quietly) asking for the remote user's password (and not getting it). I set up the public/private ssh key arrangement. The script succeeds when run manually as the same user that the cron job uses, and does not ask for the password. I am able to ssh to the remote server from the source server (using the same username) and not get the password prompt (both directions), so why doesn't rsync work? I even put a .pgpass file in the root of that user's directory with that user's password, and the user/password are identical on both servers.

I think the problem is rsync is not able to use the ssh key correctly. I tried adding this to my script but it didn't help.

Code:

Here is the rsync command embedding in the .sh script.

Code:

Here is the cron entry:

Code:

View 6 Replies View Related

General :: Copying The LP To CD?

Jul 4, 2011

I have a tube type stereo amplifier (Eico ST-70) and a Empire Troubador turntable, both from 1963. I would like to be able to copy the LP's to CD using Linux.

View 1 Replies View Related

General :: How To Put Progress Bar While Copying

Nov 9, 2009

I want to create a script which will show the amount of data that is been copied from one location to another location. For example: Say I have a file called abc.img which is approximately 4 gb of size therefore every time I copy the file from one location to another I want a progress bar to appear like 50% completed 51% completed and so on.

View 2 Replies View Related

General :: Copying An Audio CD In The Most Accurate Way?

Dec 18, 2010

In cdrecord's man page, EXAMPLES, it says:

Quote:

To copy an audio CD in the most accurate way, first run

cdda2wav dev=2,0 -vall cddb=0 -B -Owav

and then run

cdrecord dev=2,0 -v -dao -useinfo -text *.wav

Now, cdda2wav samples the drive output. But the signal is already sampled in the CD. Do you think this is accurate?

View 7 Replies View Related

General :: Copying Dir To A Usb Thumb Drive?

May 9, 2011

I want to copy my /home to a USB thumb drive recursively. I've wrestled with this for a few hours now and continue to spin my wheels.The device is listed in my Disk Utility as /dev/sdc. However a little further down it is listed as /dev/sdc1 ? Anyway, I relabeled the volume as usb stick and formatted it to Ext4. I mounted it at /media/usb stick Do I have to enter this drive into the fstab? If so, how? what do I write? Using the command : cp -R (what follows... I want to copy /home recursively to the usb thumb drive.)

View 8 Replies View Related

General :: Copying Files Using Smbclient?

Jun 7, 2010

I have a new network attached storage unit that I'm trying to transfer my data to. On this NAS, it has a very basic linux installed with SSH enabled. Browsing through the programs installed on it, i found smbclient. Am I able to copy files directly from my old NAS to my new one using smbclient?It would sure beat transfering 950GB from my old NAS through a computer then onto my new NAS.

View 1 Replies View Related

General :: Copying Permissions From One File To Another?

Nov 4, 2009

copying permissions from one file to another.I know that command for changing permission is "chmod", for example chmod 666 filename However, I have one file filename1 and by listing all contents of a directory with ls -al I can find out its permissions in form -rwwx and similar. Now I want to define exact same permissions to other file "filename2". How to use chmod command to accomplish this. Other way around would be to simply copy permissions from one file to another. Is there any command for this purpose?

View 3 Replies View Related

General :: Copying 1 File To Many Directories?

Jul 25, 2010

The current directory contains:A file called "original.txt" Many directories called "source_001", "source_002", "source_003" ... From the command line how do you copy "original.txt" to "source_001" and "source_002" and "source_003" ...

The total number of these source directories is unknown, it changes every week.

View 4 Replies View Related

General :: Copying Files From Windows?

Jan 3, 2011

How can I copy some files from a windows machine to Linux machine ?

View 13 Replies View Related

General :: Copying Photo Files To CD?

Jan 16, 2010

I am running openSUSE 11.2 KDE 4.3.4 on my ThinkPad R51 laptop.I would like to copy 'File A, File B, File C' (for example) that has photographs of a holiday , to a blank CD inserted into my drive and cannot find a way to 'copy and paste' into the volume.

View 3 Replies View Related

General :: Corrupted MBR By Copying To /dev/sdb1

May 15, 2010

rather by accident, I copied a file to a USB drive by saying

cp <file> /dev/sdb1

rather than

cp <file> /media/USBDISK

I was surprised that this was at all possible (without root privileges and all), but now the drive cannot be mounted.

I did a

dd if=/dev/sdb of=corrupted.disk

but I don't know how to recover the data.

View 2 Replies View Related

General :: KDE - Copying To Root Folders?

Jul 19, 2010

Linux kernel 2.6, slackware 12.0
KDE 3.5.7

I have some directories whose owner is root. When I enter the GUI (KDE) I always do it as normal user john. But then, when I want to copy a file to some of root's dirs, I get an "Access denied" notification. To be sincere, these dirs are in a window$ vfat partition and I can neither change the ownership nor the permissions. So what I do is to switch to a root console and painstakingly type the whole path of both source and destination, with the help, of course, of tab completion. To su to root, copy the file and exit to john would be much more comfortable. But I don't know how to do it. If I do K Menu>Run Command and type 'su root' nothing happens.

View 6 Replies View Related

General :: Protect PDF Against Copying Or Printing?

Apr 23, 2011

How can I do it in ubuntu? OpenOffice 3.2: File - Export to PDF -> Password on copy and print doesn't help. After exporting I can easily copy text from PDF file

View 10 Replies View Related

General :: Getting Rsync Script To Run ?

Feb 24, 2011

I am trying to run a rsync backup Script to backup my data from my HD to my NAS Drive (currently mounted as Samba share, but can change to NFS if that would improve things, if I can work out how!), but when I run the Script I get the following error on every file it tries to copy

Code:

As I mentioned I am mounting my Share from my NAS as Samba and below is the fstab entry

Code:

The rsync command with options is as follows

Code:

The error seems to be with the -a option, but I have no idea why.

View 7 Replies View Related

General :: Rsync Across Many Machines?

May 26, 2010

i have a cheap-arse employer who doesn't provide any data backup for us. so i've setup my own very simple server with ubuntu 10.04 (no raid). from my linux desktop i want to backup to my file server. from my file server i configured samba to allow me to access my data from the many Windows PCs in the place. I also have a USB drive for when i go home or to another building.

most of my work happens on my linux desktop. so i use rsync to 'backup' from there to the file server. can i use rsync to keep my usb drive also sync'ed? in the same command?

when i access files on my file server from a Windows PC via samba, and change something, will rsync pick up that change on the server, and migrate the changes back to my linux desktop?

View 4 Replies View Related

General :: Rsync - Exclude-from Qns ?

Jan 8, 2011

I'm trying to do a sync of the root home directory to a folder call backup and excluding some files.

This is wat i executed:

rsync -a /root/ --exclude-from '/root/rules.txt' /root/backup/

My rules.txt is as below:

- anaconda-ks.cfg

Somehow it doesnt read the rules.txt and it will always include the anaconda-ks.cfg file.

View 3 Replies View Related







Copyrights 2005-15 www.BigResource.com, All rights reserved