I am getting a little fed up with the fiddly-ness of Clonezilla and checked out the Members' Choice Awards for a better solution. Seems like rsync is very popular as a backup tool. But can it be used for creating an image of a partition which could later be readily used for a bare metal complete system re-install?
View 9 RepliesThought I'd post it here because it's more server related than desktop... I have a script that does:
[Code]....
This is used to sync my local development snapshot with the live web server. There has to be a more compact way of doing this? Can I combine some of the rsyncs? Can I make the rsync set or keep the user and group affiliations? Can I exclude .* yet include .htaccess?
When I run rsync --recursive --times --perms --links --delete --exclude-from='Documents/exclude.txt' ./ /media/myusb/
where Documents/exclude.txt is
- /Downloads/
- /Desktop/books/
the files in those directories are still copied onto my USB.
And...
I used fetchmail to download all my gmail emails. When I run rsync -ar --exclude-from='/home/xtheunknown0/Documents/exclude.txt' ./ /media/myusb/ I get the first image at url.
I have a tiny shell script to rsync files between two servers and remove the source files.
This script works fine, when it has been initiated manually or even when the rsync command is executed on the command line.
But the same script doesn't work, when I try to automate it through crontab.
I am using 'abc' user to execute this rsync, instead of root, as root login to servers are restricted in all of our servers, by us.
As I mentioned earlier, manual execution works like charm!
When this rsync.sh is initiated through crontab, it runs the first command(chown abc.abc ...) perfectly without any issues. But the second line is not at all executed, and there is no log entry i can find at /mnt/xyz/folder/rsync.log.
I just tried to sync files from one server to another. After the sync process, I found the files are bigger than original ones.
I looked up the web and found someone mentions the rsync daemon. So I have to run the daemon on one server before I run the rsync?
The command I used is rsync --partial --progress -r source destination
I want to make an image of a partition containing a Windows XP system.
I know that Norton Ghost can do it, and I think Clonezilla, and many other programs also.
But I was wondering whether a simple dd would work.
The basics would be something like this:
Boot the computer from a CD or USB containing a live Linux. Then:
dd if=/dev/hda1 of=/someExternalDisk/xp.img
where hda1 is an NTFS filesystem containing an XP system.
To restore,
dd if=/someExternalDisk/xp.img of=/dev/hda1
Obviously it needs a few other things to make it nice, like:
bs=2M,
pipe to gzip
zeroing the empty space before compressing,
But would the basic scheme work? I don't think dd cares what's in the partition, so it should work.
I'm searching for a GUI disk imager, something, that will be the GUI front end for dd. Ghost4Linux G4L is not an option, I want to be able to make security backups of my USB thumb drives, CDs, DVDs...
View 9 Replies View RelatedI need to take an image from my laptop hard disk which has Linux SUSE installed , and I want to restore the image to another laptop (which is the same as mine). how can I do this ? in Windows environment , many programs can do this easily , but I don't know how to do this in Linux .
View 5 Replies View RelatedI am learning how to use DD for creating images across networks and locally but needed some clarification.
1 - When creating an image, I noticed that there is no verbose to show you the progress, How can I accomplish this?
2 - When I run this on a 8G usbstick it takes a long time to image. How can I speed up this process?
PHP Code:
dd if=/dev/sdb of=/home/test/images/image.dd
3 - When an image is restored like
PHP Code:
dd if=/home/test/images/image.dd of=/dev/sdb
will that give me a working bootable usbstick? For example if I imaged a working usbstick with Ubuntu on it using DD and restored it like the example above on a different usbstick, will this give me a booting new usbstick? I hope that came across ok?
I have a hardware device that has Slackware 12 installed on it. I have my software I created installed I want to imgage this and send to a company to produce thier hardware using what I created. I would hope they won't have to install slaceware first.
View 1 Replies View Relateduse rsync to cp such files and dirs under /var/www/html/mydir directory but these two files(/dir4/1.html /dir4/2.html) cant rsync to dest mechine.
rsync configure file,below...
I have recently upgraded from lenny to squezee and I noticed some problems during upgrade with some python files. Now I have same problem with them and I need to resolve it so that I can install sane:
Code:
dpkg --configure -a
Setting up python-imaging (1.1.7-2) ...
Traceback (most recent call last):
File "/usr/local/lib/python2.5/runpy.py", line 95, in run_module
filename, loader, alter_sys)
[Code]...
aptitude -f install reports same problems with python-reportlab and python-imaging.
I have to image a sparsely populated 20GB NTFS partition onto an ext4 volume. While doing dd if=/dev/sdb2 bs=10M | gzip F14 64bit falls into kernel panic screen. What other method of taking per-sector image of a HDD is possible?
View 7 Replies View RelatedI have an hp laptop with 2 hdd slots, both are sata. it came with a 320gb hdd with vista ultimate 64. i added another 320gb hard drive to my laptop and installed kubuntu on the second hard drive. Since vista was my primary hard drive, parts of grub were installed on it i.e. stage 1.5. And the rest was installed on the kubuntu hard drive. Because of that neither os would boot independently of one another.
I eventually got tired of kubuntu and in wanted to uninstall it. I formatted that disk. Now vista gave me grub errors, like I knew it would.I was going to fix the vista boot sector and mbr by running bootrec.exe off of the vista disc. But since I have an hp laptop, hp doesnt provide a recovery disc with just vista, it is an install of the factory image of the os plus software and therefore doesnt have the utilities I need to fix my problem.I ended up navigating to some sort of command line in the windows recovery environment and tried running it there, but no luck.
I tried navigating in the hp recovery environment, and accidently had vista start to reinstall itself on the drive, and actually I did that 3-4 times, each of which I stopped the recovery early on, within 30 seconds, but it had managed to mess up my partition table. I was wondering if there is some utilities in linux/ windows that will help me restore the partitions back the way they should be? I have done a data recovery with get data back for ntfs, and was pretty successful getting some stuff back, figures since the mft was screwed up.
So first of all I want to make an exact clone of the hard drive. Something like dd but just make an image file for now. Since there are no partitions on the drive I dont think I can use partimage, or drive image xml and I wonder if clonezilla will work. And I dont know how to test it without have to reload the image and wiping the drive in the process. I have imaged the drive with get data back but it does me no good cause I cannot restore that image back to the drive, or at least dont think I can.
Second I would like to see if I can recover the partition table , or mft that was over written. Here is a list of programs I can use for imaging or recovering. [URL]Third, since I have 2 320gb hard drives, one that is corrupted, and one that I took kubuntu off of and loaded vista with the recovery disks. Can I take the mbr, and partition table, or boot sector off of the working vista and move it to the broken 320 and fix it that way?
[URL]
I'm using Ubuntu 10.04 LTS server and Postgresql 8.4. I have a .sh script that is run by cron every other hour. That works fine. The .sh script includes an rsync command that copies a postgresql dump .tar file to a remote archive location via ssh. That fails when run by cron; I think because it is (quietly) asking for the remote user's password (and not getting it). I set up the public/private ssh key arrangement. The script succeeds when run manually as the same user that the cron job uses, and does not ask for the password. I am able to ssh to the remote server from the source server (using the same username) and not get the password prompt (both directions), so why doesn't rsync work? I even put a .pgpass file in the root of that user's directory with that user's password, and the user/password are identical on both servers.
I think the problem is rsync is not able to use the ssh key correctly. I tried adding this to my script but it didn't help.
Code:
Here is the rsync command embedding in the .sh script.
Code:
Here is the cron entry:
Code:
I'm running fedora 10 on a virtual machine. I'm trying to create a kernel so that I can use the imaging software FOG on multiple computer makes and models. I'm pretty new to linux so I'm sure I'm missing something I just need someone to point me in the right direction. I have installed the "Development Tools" and qt3-devel. When I run make xconfig or make menuconfig it errors out. The following is what I get...
make xconfig
[root@localhost linux-2.6.26.2]# make xconfig
scripts/kconfig/qconf arch/x86/kconfig
init/kconfig:514: can't open file "usr/Kconfig"
make[1]: *** [xconfig] Error 1
make: *** [xconfig] Error 2
[Code]...
Has anyone found a good cloning program like pq magic etc. I looked at clonezilla but could not find a dload for fedora/redhat (would installing it via tarball work?)
View 6 Replies View RelatedI can see from /var/log/messages error messages and weird crashes that the disk in my laptop is on the way out. I plan to replace it but to do this I'd rather not have to install everything again.My laptop has these partitions:Windows Recovery (10GB)Windows 7 (NTFS 96.6GB)Linux /boot (ext4 100MB)Linux LVM (encrypted, 143GB)I need software that will allow me to create an image (or images) of all these partitions, save the image(s) to a USB hard drive and restore from those images once I've put the new, blank, hard drive into the laptop. Does anyone know of software (either open source or commercial pay-ware) or a technique to do this?
View 1 Replies View RelatedAm doing a simple partition imaging program. Am using libparted for partition things. Before that I want to list the available hard disks (/dev names) attached to the PC Programmatically.
View 2 Replies View RelatedI'm trying to setup a server at home, it has some practical implications, but largely it is just to take a stab at it. But I need the help of someone with more experience than I in defining exactly what I'm looking to do.
Here's what I have: old PC running Gutsy server connected to router. Several laptops at home connected via wifi to router. All laptops running either Windows or Ubuntu. Here's what I'm looking for: The server centralizes file storage for all clients. I would likely incorporate a RAID and some synchronised imaging of the files. I also want the server to create disk images of the clients hdd, regardless of client OS.There would also be some shares that would be publicly accessible (myself and friends accross the country would be able to access the same drive).
So I was thinking something like what corporate environment would be nice, you log into a profile that exists on the server. Like a dumb client...all data would be stored on the server. But I'm thinking that's more like a network boot and wouldn't work via wifi (or would it?). Also that wouldn't lend itself well to laptops used on the road in areas without net access. now I'm thinking each client would have its own locally installed OS, and they would just access networked shares. I could store sensitive files on the shares, but that wouldn't provide complete backup solution for each client.
Without rambling on anymore, anyone care to throw out some ideas? I'm really just looking to see if I can do what I want. The focus is on centrallizing files, securley backing up data and client OS's and ability to restore said images quickly.
The problem is every forum I read pretty much ends up with someone suggesting DD, everyone agreeing and the threads dead-end. This is not a good solution for real world large scale usage which is what I'm trying to do. At least it doesn't appear to be unless there is some switch I have misinterpreted when invoking the command. The problem I have with it is it's super bloated and god awful slow. It tries to write out the entire partition or set of partitions (based on the choice I have made) reguardless of if any of the space had been empty, and lets say the partition I copied from was 80 GB and I copy it to a 160 GB disk/partition... I am left with an 80 GB partition and 80 GB unused space and a need to use another tool such as Gparted to resize the newly imaged disk accordingly.
Right now what I use is Norton Ghost and it can do the job I need in only a couple minutes instead of a couple hours and it sizes the partition to max size all at once. I do not want to use this program tho... The fact is in order to make ghost run at a usable speed I have to use it's Windows and not its DOS version which leaves me using something like BartPE and... that's worse than using Windows ME. Surely someone out there has noticed this is a problem and developed a better program that can at least run on par with Ghost.
why I was hoping for a Linux solution it's because I would like to use a "one stop shop" disk, so to speak, where I can boot into a small linux distro such as Puppy and have a full suite at my disposal rather than booting with one disk, wiping, rebooting with another disk, ghosting then testing everything. I suppose if anyone knows of a distro that can already do all that including a good ghost alternative already packaged I would love that.
I have just installed " partimage" partition imaging - I want to perform a FULL system back up - problem is I cannot find where this programme is sitting to be able to perform my back up .
View 2 Replies View RelatedI want to use rsync in order to have a folder synced at startup with my fat32 partition. I figured out how to mount the fat32 partition automatically at startup but I'm failing with the rsync command.I came across this script but it works only the first time, when there is a new file to sync it fails.
View 3 Replies View RelatedI've bought a NAS (Western Digital My Book World Edition 1TB) which I want to use to make backups (preferably incremental) of some important files.
After much deliberation in finding suitable backup software it seems like good old rsync is the best thing for the job (backintime struggles to copy to remote locations?)
I have enabled SSH on the NAS config. I'm using the following command to do a test run on a small folder:
Code:
sudo rsync -azvv -e ssh /home/matt/Careers/ admin@192.168.1.100:/public/AutoBackup/
And I get the following error:
Code:
admin@192.168.1.100's password:
[Code].....
Anyone know where I'm going wrong here? I'm sure it's probably something simple but I can't crack it. I've tried variations on the destination folder such as admin@192.168.1.100:/AutoBackup/ without success.
I want to use rsync to synchronize some folders on my LAN. I have this working with two scripts; one runs at the beginning of my work session and gets the latest directory tree from the server, and the other runs at the end of the session to put any local changes back on the server. My "get" script looks something like this:
Code:
rsync -avuzb --backup-dir=/home/user/rsync_backup_dir --delete my_server:/home/bak/common_data/ /home/user/data
This works well, and with the "b" option any file that has been deleted from the master directory tree on the server will be deleted from the local machine and moved to the local backup directory. This is a safety measure to prevent the loss of files through a mistake (on my part).
The problem is the "put" script:
Code:
rsync -avuzb --backup-dir=/home/user/rsync_backup_dir --delete /home/user/data/ my_server:/home/bak/common_data
I want to run both scripts from the local machine, but the "put" script will not save deleted files to a backup directory. I tried using a remote backup directory like "my_server:/home/user/rsync_backup_dir" but this did not work. Is there a way to backup files deleted from a remote server from an rsync script run locally?
I saw in a magazine reference to using rsync to have identical copies of folders. This looks like something I could find useful as I have a large number of items in need of safe backup.
I have the folders on an old system on a home network and would like to copy these over to a USB Hard Drive.
Currently the folders reside on SFTP xxx.xxx.xxx.xxx and I wish to sync them to a USB port on my laptop.
I setup keyed ssh between two of my computers on my lan. It was working great. I used Ubuntu's Passwords and Encryption Keys tool to generate the key.
Yesterday I tried rsync'ing a grip of files to the ssh server and couldn't get it to work, I figured I was just messing the rsync command up. Today I just tried to log in using ssh and it just hangs there after I type the ssh command.
With verbosity on it stops at checking the blacklist file. Does this mean it decided my key is one of the badly generated ones? Why would it decide this now I thought it was supposed to catch that when generating the key.
Also I just checked that file it's trying to check doesn't even exist. Should it?
Code:
I'm currently trying to have crontab to automatically backup files from ramdisk. It works perfectly when I run it myself by simply cd:ing to scripts directory and type ./save_world.sh.
The problem is, that crontab DOES (at least it looks like it) run that command every one minute. /var/log/syslog does show it executing that line every one minute without any errors. I'm currently very confused what I did wrong here. I have tried rebooting, fiddling with crontab line, tried sudo crontab -e but nothing seems to work.
My script is called save_world.sh and it is located in /home/phoe/minecraft/rpg/
Code:
My crontab -e has one line and it is following:
Code:
I haven't determined any specific time yet, because I'm just trying to get it work first.
Snippet from /var/log/syslog:
Code:
I have a samba share to a windows 7 computer I do not know if I will be able to use backintime or not so I want to know how to have rsync do my backup.I read the man but I'm not sure if I understand the it.on same computer different hard drive to run every hour in a script. Leanne is windows 7 share and backup is the other hard drive in the computer rsync -arvRzEP /media/leanne /media/backup.
View 1 Replies View RelatedI am trying to run a rsync backup Script to backup my data from my HD to my NAS Drive (currently mounted as Samba share, but can change to NFS if that would improve things, if I can work out how!), but when I run the Script I get the following error on every file it tries to copy
Code:
As I mentioned I am mounting my Share from my NAS as Samba and below is the fstab entry
Code:
The rsync command with options is as follows
Code:
The error seems to be with the -a option, but I have no idea why.