OpenSUSE :: Backup Important Files - Automate The Process Using Rsync And Cron

Aug 14, 2011

I would like to backup important files (totaling about 400GB) on my ext 4 RAID 5 array to an ext4 external hard drive over USB (external drive is mounted to /mnt. In the future I'd like to automate the process using rsync and cron so for now I'm using rsync to transfer the files. My problem is that using the rsync command like this: # rsync -Pr "/dir1" "/dir2" "/dir3" "/dir4" /mnt

rsync shows me the checks and transfers for awhile and then throws up an i/o error (wish I had a screenshot to show but I don't). When I ls /mnt I get a similar i/o error. I then check /dev for the drive and find that it no longer shows up. Originally the partition was /dev/sdc1. I tried unplugging the USB at this point, plugging it back in and mounting the drive back to /mnt, however it has now assigned it to (you guessed it) /dev/sdd1. I get the drive mounted and try the original rsync command again, hoping the first error was a fluke or some kind of one-time drive fart. This time it makes it quite a bit further and then throws up the exact same problem. Am I doing something terribly wrong here? As I said, I'm very new to bash so I'm not making some absolutely moronic, newbie mistake.

View 9 Replies


ADVERTISEMENT

General :: Mount Point For Backup Drive - Partition To Backup The Important Files On My Main HDD

May 21, 2011

I'm just setting up a partition on a seperate HDD in my system. I plan to use the partition to backup the important files on my main HDD (to guard against HD crash).

The question I have is about where would be the typical location to auto mount this partition? Which would it be normal to go for:

1. /backup/
2. /media/backup/
3. /mnt/backup/
4. /home/chris/backup/

View 7 Replies View Related

OpenSUSE :: Rsync Backup *cache* Directories And Files?

Mar 4, 2010

I'm creating a backup scheme with rsync.

It is pretty clear not to include these:
/var/lib/named/proc
/var/lib/ntp/proc

[code]...

View 3 Replies View Related

General :: Rsync Runs Back Up But Process Is Already Running The Same Backup

Sep 15, 2010

I have cronjob that uses rsync to back up to a remote directory every hour. how do I set this rsync up so that if initial process is running already, it prevents running same rsync command and checks again in next hour until the process is finished/terminated?

View 5 Replies View Related

Ubuntu :: Backup Files To Ntfs With Rsync?

May 31, 2010

well, i know ther are issues when using rsync to copy files to ntfs partition like file permission blah blah. the thing is, i need to backup my music files periodically onto a ntfs partition from ext4. i really dont care about file permissions or any other stuff. when i use rsync, it should update the mp3 files on my ntfs (external) disc with the new ones.can i give a go with this operation? i have lot more important files on the external disc and i dont want this rsync corrupt or delete those files coz they are highly important files.

View 2 Replies View Related

Ubuntu Servers :: Rsync Backup - Transfer Files With Appropriate Permissions

Dec 4, 2010

I wrote a script to wake up my windows machine and do an rsync backup of some of my files. I wanted to make this command a accessible through local bin so I made it executable. However the problem is that when I copies files is copies them with root permissions and i can edit or delete them. How can I set the files so they transfer with the proper permissions for my Ubuntu user?

Code:
#!/bin/bash
# Description: This script first wakes up the client machine and syncs the appropriate folders.
# Finally the script shuts down the client if it was off to begin with.
if [ "$(whoami)" != "root" ]; then
echo "Permission Denied"
exit 1
fi .....

View 8 Replies View Related

Fedora :: Use Rsync To Backup My Music Collection - Add Files To The Destination Drive?

Mar 6, 2010

I'm currently learning to use rsync to backup my music collection. I have a Firefox tab open to the rsync manual page(s) and have been reading man rsync and running experimental rsync operations.I've been doing this for the last 3-4 hours. I've used rsync for this purpose in the past with disastrous results. What was and is once again (due to a month and a half of file pruning) a 9000 file music collection had mysteriously grown to over 25,000 music files and 80GB of data! This was likely due to the fact that I didn't really know what I was doing with rsync and had never spent too much time learning about all the parameters, what their functions are and how they may relate to my goal.Here are the particulars:

* Source drive is a 500GB disk, /media/sata500/music/.

* Destination drive is a 250GB USB disk, /media/FreeAgent/music, connected to the same computer that houses the 500GB disk.

* I want to copy or backup files from /media/sata500/music to /media/FreeAgent/music.

* I do not want to create ANY duplicates of files that exist.

* I only want to add files to the destination drive if they are new on the source drive, like if I rip a CD and add the contents to the source. I want them copied over next time I run rsync.

Here's the rsync command in it's most recently used form, and probably very immature at this point.

Code:

rsync -t -r -vv --stats -i --log-file=/home/glenn/rsync.log /media/sata500/music/* /media/FreeAgent/music/

This appears to have copied all files and folders and I'm satisfied that my goal has been met with some success. To convince myself of this I ran the command and then once it was complete I added 2 new songs putting them in their respective folders on the source drive and ran the same command again. The resulting output was

[code]....

Two files transferred. Exactly what I want.Both folders now house 20,931 files and use 40.6GB. Identical as far as I can tell.What I'm concerned about are time stamps and play count data, etc. Anything that changes the original file. I don't want this data to cause a file to be transferred as I'm afraid that the new file will be created along side the old file of the same name thereby starting this whole music collection expansion thing all over again. I've invested a lot of time and effort to get it pruned down to where there are virtually no duplicates and albums are correct in that they contain the proper songs in the proper order.

View 14 Replies View Related

Server :: Rsync Fails In Cron - Ssh Key - For Rsync?

Dec 8, 2010

I'm using Ubuntu 10.04 LTS server and Postgresql 8.4. I have a .sh script that is run by cron every other hour. That works fine. The .sh script includes an rsync command that copies a postgresql dump .tar file to a remote archive location via ssh. That fails when run by cron; I think because it is (quietly) asking for the remote user's password (and not getting it). I set up the public/private ssh key arrangement. The script succeeds when run manually as the same user that the cron job uses, and does not ask for the password. I am able to ssh to the remote server from the source server (using the same username) and not get the password prompt (both directions), so why doesn't rsync work? I even put a .pgpass file in the root of that user's directory with that user's password, and the user/password are identical on both servers.

I think the problem is rsync is not able to use the ssh key correctly. I tried adding this to my script but it didn't help.

Code:

Here is the rsync command embedding in the .sh script.

Code:

Here is the cron entry:

Code:

View 6 Replies View Related

OpenSUSE :: Rsync Backup : Upgrade To 11.4 64 Bit?

Mar 14, 2011

had some 'files disappearing' probs for rsync after upgrade to openSuSE 11.4 - solution seems to be to add :

--exclude=/var/lib

View 1 Replies View Related

Ubuntu Installation :: Automate Shut Down Computer After Cron-apt Job Finished?

Jul 9, 2010

Hopefully a simple question but one I have had a hard time finding:I am using cron-apt to automate updates as follows:

Code:
graham@graham-desktop:~$ sudo cat /etc/cron.d/cron-apt
#

[code]....

View 3 Replies View Related

OpenSUSE Install :: Mount - Run Cron To Backup Home Folder?

Jan 4, 2010

I installed a second HD, and formatted it to ext4. I gave it the "/backup" label. I am trying to figure out how to mount it so that I can run cron to backup my home folder onto it once a week. This is what the fstab looks like now

[code]...

View 9 Replies View Related

General :: Most Important Directories To Backup On A Server?

May 21, 2010

I'm running an Ubuntu 9.10 Linux server. I'm trying to find a way to backup the machine while it is running and from what I see, this eliminates the disk clone utilities. All of the disk clone stuff I have seen for Linux requires that you reboot into a special live CD.So my question is this, what is the best solution for backing up the system while it is running? Also, I don't really care about the OS config too much, I just want to be able to keep my stored files and my programs that I have installed on it.

View 3 Replies View Related

Ubuntu :: Backup Mbr And Superblock/grub/important Info?

Jan 15, 2011

Right now I use dd to backup mbr and the first 512 bytes of every partiton.

Code:
dd if=/dev/sd? of=sd?.bin bs=512 count=1 That would take care of the partition tables and grub in the mbr, but what about the superblock, the stuff that XP stores and the superblock?

Code:
dd if=/dev/sd?1 of=sd?1.bin bs=512 count=1 Is it save to assume that if grub was on sd?1 it is backed up?
Does it backup the superblock so if some bug or power failure makes the partition unmountable because of bad superblock it can be fixed by copying back the first 512 bytes? I am of course not changing partition size or type of filesystem and not messing around with grub.

View 1 Replies View Related

General :: Automate A Definition Process?

May 24, 2011

I would like to automate a definition process. I have 11,581 to define. :|

I would like to read each word, copy the definition(s) and append it next or below the word or save definitions to file.

The word list has one word per line.

Python script?
Bash?
Perl?

Its an interesting project but I cant seem to figure it out. Lack of programming skills.

View 2 Replies View Related

General :: How To Automate Log Deletion Process

Feb 25, 2010

I have RHEL Machine in production server where we gets usual alerts that logs filling up spaces. We archive those logs but in case it grows maximum we delete the old ones. Any idea how can we autiomate the process.

View 1 Replies View Related

Server :: How To Automate Starting A Process In Gnu Screen And Restart It When It Crashes

Sep 10, 2010

I have a java service that needs to be run in a gnu screen session so that I can -r into it to access it's interactive shell. I would like this to run at start-up. More importantly, it crashes frequently so I need the service to restart itself when it crashes. How do I go about doing this myself? My previous experience with shell scripting amounts to putting ./service in a file and marking it executable. This will be running on a FreeBSD server, but I might put it on a Linux server soon also. So any caveats on the differences would be useful information.

View 6 Replies View Related

General :: Bash Script To Automate The Virtual Host Creation Process?

Mar 14, 2011

This is my sample code in /etc/httpd/conf.d/applications.conf file currently we are creating subdomain mannually for every new subdomain. I want to automate this process througs bash script , how its possible.

Code:

<VirtualHost *:80>
ServerName google.com
ServerAlias google.com

[code]....

In this code which i marked BOLD that content only we'l change for every subdomain. while manually doing this most of the times errors are coming to avoid that i need to automate this process.

View 3 Replies View Related

Ubuntu Servers :: Write A Shell Script In Order To Automate The Process Of Uploading A File?

May 21, 2010

I am trying to write a shell script in order to automate the process of uploading a file onto an FTP server using the built in FTP commands in ubuntu server (lucid). In order to connect I can use the following:

Code:

ftp wsbeorchids.org.uk
Name (wsbeorchids.org.uk:danielgroves): USERNAME
Password: PASSWORD

In need to pass my username and password in when prompted the prompts. How should I go about doing this? I have tried echoing the values without success. Please not that I am something of an amateur with scripting.

View 6 Replies View Related

Ubuntu Servers :: Cron Will Not Run Rsync Job

Mar 30, 2011

I am running a headless Ubuntu server accessed through Webmin. The server is running 10.4.2 64 bit version. I have a number of cron jobs including a simple back-up job which is:
Code:
rsync -av /media/server/ /media/backup/backup/
All of the other jobs run fine but for some reason this job which is scheduled to run each day at midnight does not run. If I SSH into the server and run the job manually it works fine.

The output of 'crontab -l' is:
@daily rsync -av /media/server/ /media/backup/backup/
11 3 * * * /etc/webmin/package-updates/update.pl
@daily tar czf /media/backup/serversystem.bz2 --exclude=/proc --exclude=/lost+found --exclude=/backup.tar.bz2 --exclude=/mnt --exclude=/media --exclude=/sys /
@reboot inadyn --username ********** --password ********** --update_period_sec 600 --alias **********
@daily /etc/webmin/backup-config/backup.pl 12978522112842

The output of 'crontab -e' is:
Error opening terminal: unknown.
crontab: "/usr/bin/sensible-editor" exited with status 1

View 9 Replies View Related

Server :: Using Rsync With Cron On Different Port?

Nov 14, 2010

I'm trying to set-up a cron job that uses rsync to transfer back files from a remote server. ssh on the remote server is running on port 12345 but this seems to be a problem. My script looks like this:

Code:
#!/bin/sh
RSYNC=/usr/bin/rsync
SSH=/usr/bin/ssh
KEY=/home/username/.ssh/id_rsa.pub

[Code]...

View 6 Replies View Related

Ubuntu :: Rsync Bash Script Different In Cron?

Feb 19, 2010

I've got a bash script that uses rsync via SSH to back up data from a remote webserver.
This script works fine when I run it myself but when it runs as a cron job I get the following error:

Code:
2010/02/20 08:15:01 [6786] Unexpected remote arg: user@www.server.com:~/www
2010/02/20 08:15:01 [6786] rsync error: syntax or usage error (code 1) at main.c(1219)

[code]....

View 9 Replies View Related

Ubuntu :: Rsync Sh File Don't Work With Cron

Mar 25, 2011

I have a backup sh file that I have been using for a long time. It has always worked. 2 Days back I switched to a different pc and now suddenly the script don't work.If I run it manually in the terminal it works. But when it execute with cron it doesn't copy any files to the backup destination. It starts but doesn't copy anything.Can someone help me as to why it works manually but not with cron ?

View 9 Replies View Related

Software :: Run Rsync To Download Files From A Server Without Rsync Daemon?

Sep 18, 2009

I just tried to sync files from one server to another. After the sync process, I found the files are bigger than original ones.

I looked up the web and found someone mentions the rsync daemon. So I have to run the daemon on one server before I run the rsync?

The command I used is rsync --partial --progress -r source destination

View 1 Replies View Related

Server :: Rsync Can Not Rsync Files With Include Filter

Jul 21, 2010

use rsync to cp such files and dirs under /var/www/html/mydir directory but these two files(/dir4/1.html /dir4/2.html) cant rsync to dest mechine.

rsync configure file,below...

View 2 Replies View Related

OpenSUSE :: Rsync Copying All Files Instead Of Just What's Changed

Jan 11, 2011

During my backups I'm finding that rsync is copying all files, instead of just what's changed.

I'm rsyncing between 2 USB external hard drives. One hard drive is FAT32 and one is NTFS. I've examined some of the files and believe that the difference is that there's a 1-second modtime difference developing in some of the files somehow.

Here's an example. These duplicity files were synced from /media/BACKUPHD (the NTFS drive) to /media/VIDEOHD (the FAT32 drive) only a few hours ago this morning. They have not been touched or changed since then, but that 1-second difference in their time stamps has appeared:

Code:
tim@localhost:~> stat /media/BACKUPHD/backups/duplicity/duplicity-full.20110107T145955Z.vol10.difftar.gpg File: `/media/BACKUPHD/backups/duplicity/duplicity-full.20110107T145955Z.vol10.difftar.gpg'

[Code]....

View 8 Replies View Related

Software :: Rsync Behaves Differently Under Cron And Under My Normal Environment

Mar 16, 2010

I am making a backup on an ntfs disk, mounted with:

using the following command:

Running this (or rather the shell script containing it) from the command line is OK, but if I run it as a cron job, I get thousands of messages:

(without line breaks, actually).

These files are all ordinary files made under Windows; the above should read "offici�le stukken", and from the command line it does, but not in cron.

I guess I need to set an environment variable, but which one?

View 1 Replies View Related

OpenSUSE :: Way To Get Rsync To Delete Files If They Were Deleting At Source?

Jun 11, 2011

I have 2 folders that are synced using rsync. Right now if I delete a file in the source folder, the destination folder still retains that file. Is there a way to get rsync to delete files if they were deleting at the source?I could not find anything in the man page.not sure if I'm missing something or if that feature just doesn't exist.

View 4 Replies View Related

Ubuntu :: Important Files - OS X Won't Boot

Mar 11, 2010

i was working in this Macbook (its my mothers i do not use apple very much), just looking at ..... and normal stuff. no installations or anything, only used my external harddrive. Next time i turned on my computer, this weird gray screen showed up with something written like "kernel mismatch from your hardware" or something like this, i panicked and didnt know what to do so i restarted like the message in multiple languages said so. Nothing happened.

I tried to boot from CD (press C key) and it worked so i went on disk utility and looked for errors but all says fine. I tried making a copy of the Macintosh HD to my external hard drive so that i could re install mac but after a while copying it stops and gives me an error saying "operation not supported". I asked a professional and he suggested using a live cd of Linux (ubuntu 9. ) to try and retrieve my files from there. I did this and the live cd worked and i could see into all my folders but when i went to /Users/myuser/ none of those folders would let me copy, open and see the files. Desktop is where the important data is. It gave an error file permissions. I cant compress, open, see the files nor copy them. This is very annoying as the files are extremely important and i cannot do anything to delete them.

500gb external hard drive
Macbook Pro
Linux Ubuntu

Apple Original Install DVD (Snow Leopard) way to retrieve these files and copy them onto something. I really need this with urgency.

View 4 Replies View Related

Ubuntu :: Using Rsync For Backup?

Mar 2, 2010

I saw in a magazine reference to using rsync to have identical copies of folders. This looks like something I could find useful as I have a large number of items in need of safe backup.

I have the folders on an old system on a home network and would like to copy these over to a USB Hard Drive.

Currently the folders reside on SFTP xxx.xxx.xxx.xxx and I wish to sync them to a USB port on my laptop.

View 9 Replies View Related

Ubuntu :: Backup Using Rsync

Aug 2, 2010

I have a samba share to a windows 7 computer I do not know if I will be able to use backintime or not so I want to know how to have rsync do my backup.I read the man but I'm not sure if I understand the it.on same computer different hard drive to run every hour in a script. Leanne is windows 7 share and backup is the other hard drive in the computer rsync -arvRzEP /media/leanne /media/backup.

View 1 Replies View Related







Copyrights 2005-15 www.BigResource.com, All rights reserved