Software :: Using Rsync For Copying Multiple Partitions?

Sep 1, 2009

Regularly I find myself cloning a machine using rsync. I find it understandable, reliable and fast, faster than dd, and I don't have to worry about different partition sizes etc. However, usually I partition my hard disk in a number of partitions:

Code:
/
/home
/usr
/var

When I start with a new, empty machine, I start up with a USB stick or live CD, and my new, empty hard disk becomes /dev/sdb. After creating the 4 partitions I have /dev/sdb1, /dev/sdb2... etc. My root directory is on the disk I used for booting, usually /dev/sda. So, in order to access my newly created partitions, I mount them on the /mnt/directory of my root:

Code:
mounted now later
/mnt/sdb1 /
/mnt/sdb2 /home
/mnt/sdb3 /usr
/mnt/sdb4 /var

In other words, I mount now /dev/sdb1 on /mnt/sdb1, while after copying /dev/sdb1 will become my root directory, /dev/sdb2 become my /home directory, etc. When I start the resync process to copy the image from a remote machine, I have to copy all 4 partitions separately. First the root directory, excluding /home, /usr, /var, then /home, then /usr, /var, like this:

Code:
action 1:
rsync --exclude='/home' --exclude='/var' --exclude='/usr' my.remote.machine:/ /dev/sdb1/

action 2:
rsync my.remote.machine:/home /dev/sdb2/

action 3:
rsync my.remote.machine:/usr /dev/sdb3/

action 4:
rsync my.remote.machine:/var /dev/sdb4/

That is a lot of typing and waiting. Sometimes I have a different partition scheme so it is not really feasible to write a script to use always. Now the Question: is there a smarter way of mounting the newly formatted disk (/dev/sdb1, /dev/sdb2... etc) in my root tree so I can perform the rsync copy in just one time, without all the excludes, but assuring that the correct source partitions end up on the correct destination partitions?

View 8 Replies


ADVERTISEMENT

Fedora :: Rsync Not Copying All Files?

Sep 9, 2011

My Source folder contains 424.8 GB in 502,474 files. My Destination folder was created fresh, and after the copy contains 394.0 GB in 486.514 files. I am running it as grsync with root authority. The only options are to preserve time, permissions, owner and group., and to produce a verose output and transfer progress. There are no exceptions specified to skip any files.

The rsync command is this:

rsync -r -t -p -o -g -v --progress -c -l -H -D -s /mnt/Backups/monthly.3/ /mnt/EX-Fantom/monthly.3/

I have run it again to give it a chance to get it right. Same result. The source is in an rsnapshot folder, but this is the first backup, the original, containing only whole files, not links.

View 3 Replies View Related

Ubuntu :: No Copying Done Using Grsync Or Rsync

May 18, 2011

I'm using Ubuntu 10.10 64-bit and I'm a fairly new linux user. I've been trying to set up Grsync to to make incremental backups to my external harddrive but have some problems. In the file lists it looks like files are actually being copied but when I look at the harddrive none of the new files are actually there. As far as I can understand I'm not making a dry-run. I also found this thread: [URL] And I tried using the commands suggested in that post, with the same results.

View 9 Replies View Related

OpenSUSE :: Rsync Copying All Files Instead Of Just What's Changed

Jan 11, 2011

During my backups I'm finding that rsync is copying all files, instead of just what's changed.

I'm rsyncing between 2 USB external hard drives. One hard drive is FAT32 and one is NTFS. I've examined some of the files and believe that the difference is that there's a 1-second modtime difference developing in some of the files somehow.

Here's an example. These duplicity files were synced from /media/BACKUPHD (the NTFS drive) to /media/VIDEOHD (the FAT32 drive) only a few hours ago this morning. They have not been touched or changed since then, but that 1-second difference in their time stamps has appeared:

Code:
tim@localhost:~> stat /media/BACKUPHD/backups/duplicity/duplicity-full.20110107T145955Z.vol10.difftar.gpg File: `/media/BACKUPHD/backups/duplicity/duplicity-full.20110107T145955Z.vol10.difftar.gpg'

[Code]....

View 8 Replies View Related

General :: RSYNC Challange, Copying 800GB Via 200GB EXT HDD?

Sep 8, 2010

I've got a little rsync challange for myself, I've got lets say 800GB of data, I'm trying to get it to a mate's PC, and need to be able to copy it in 200GB chunks.What I was thinking is.... I should be able to get Rsync to keep copying until it fills the drive, and output which files it syncs. Then use that list as an exclude list the next time... Providing my directory structure doesn't change, this should work.BUT!!! How do I get rsync to do this? I know of the --include and --exclude options, but am not sure how to use them in this case.

View 3 Replies View Related

Ubuntu :: Existing Rsync Running And Copying Info To Hard Drive?

Nov 30, 2010

I have a home network that includes a couple of computers {A, B, C, D}. currently, I have a cron jon that runs every minute and updates (using rsync) the hard drives of computers {B, C, D} with the contents of hard drive {A}. So far everything works great, as hard drive {A} barely has any information on it. Now, I am about to copy a lot of information (about 8 GBs) to hard drive {A}. Naturally, the cron job will run (as it runs every 1-min) and try to 'sync' the contents with hard drives {B, C, D}.

Given my network (100Mbit/sec), there is no way the cron job will be able to 'copy' the contents to hard drives {B, C, D} in one minute. It will take much more time. Does this situation create a problem? meaning, will cron re-run a new rsync instance 1min later, even though an existing rsync process is running and still copying information to hard drives {B,C,D}? Will my backups be hurt / slowed down tremendously because of this?

View 2 Replies View Related

Ubuntu :: Copying Files Between Windows Partitions

Jan 20, 2010

I need to copy ~300GB of drives from one Windows hard drive to another using a Ubuntu live CD. (I currently don't have enough power connectors for my Windows system drive AND both existing and new data drives. Stupid power supply.)

By Windows drive, I mean the drives are only data drive (no Windows install) but the files on the first drive were created and are used by my Windows system, both were formatted NTFS in Windows, and the files will again be used by Windows on the second drive.

Are there any pitfalls I need to be aware of, or can I literally just drag the files across in Nautilus? Is there a faster copy utility available (I know there are Windows programs that can copy faster than drag-n-drop, but I'm sure Ubu doesn't have the same problem ) Will using a Live CD cause any specific issues?

View 8 Replies View Related

General :: Copying A File To Multiple Machines?

Mar 7, 2011

Is it possible to copy a file on multiple remote machines through scp in one command?

View 3 Replies View Related

General :: Copying Doc Files From Multiple Directories To One?

Feb 1, 2010

I have 60+ directory's each containing multiple .doc files. I need to move them to a single directory and keep their file name intact. I don't think cp will do that with out listing all the file names. I was thinking of something like: cp -r /dir/*.doc /newdir . Or should I use a combo like find -type *.doc|cp /newdir?

View 5 Replies View Related

Programming :: Copying Multiple AVI Files To NAS Server

May 18, 2009

I am working with DM355 target board. Here we record. The video coming from IP cameras. Now I have to write c program for copying. The recorded avi files with date and time to NAS server using scp. I wrote a script to copy single file to NAS server.

#!/bin/bash
DATE=$(date +%Y%m%d_%H_%M_%S)
mv Camera1.avi Camera1_$DATE.avi
scp Camera1_$DATE.avi root@192.168.1.4:/root/test/
mv Camera1_$DATE.avi Camera1.av

But I have to write c program for copying multiple avi files with Date and Time to NAS server.

View 5 Replies View Related

Software :: Rsync With Multiple Timezones?

Jun 10, 2011

I have a backup server that is a backup destination for 10 servers.

Unfortunately each of those servers is in a different time zone. When Rsyncing to this box, it misses some files because the timezones are different.

View 3 Replies View Related

General :: Copying Files From Multiple Locations To One Destination

Feb 21, 2011

Suppose I have a tree structure like this:
/home/mahmood/sim/a/b/file1.cpp
/home/mahmood/sim/a/b/file2.h
/home/mahmood/sim/a/c/file3.txt
/home/mahmood/sim/d/file4.txt

How can I copy all of them to /home/mahmood/sim. So that when I run "ls" in /home/mahmood/sim, I see all files:
file1.cpp
file2.h
file3.txt
file4.txt

Can 'cp' search for all file and copy them in another folder?

View 3 Replies View Related

General :: Copying And Renaming Multiple Files In Working Dir

Apr 8, 2010

How can I copy multiple files, each with a slightly different name from the SOURCE in the same directory?

Example: '/home/junk' contains A.txt, B.txt

I want to copy /home/junk/A.txt to /home/junk/A1.txt and /home/junk/B.txt to /home/junk/B1.txt using a single command.

View 11 Replies View Related

Software :: Multiple Files Uploading By Rsync?

Jun 16, 2010

I wrote script which should help me to upload multiple files. But I have problem. I want that files uploading executed parallel not Here is my code:

relVersion=1.1a
path="path"
pack="ls *.zip"

[code]...

View 3 Replies View Related

Ubuntu :: OpenOffice Spreadsheet Slowdown When Copying Multiple Cells

Dec 13, 2010

Does anyone else find that Openoffice 3.2's spreadsheet app becomes unresponsive when copying and pasting multi-cell selections? I've had this problem ever since I started using Ubuntu 10.04, which comes with OO.O 3.2. The problem becomes noticeable whenever I make a selection more than about 8-10 columns across. Once the flashing border appears around the selected cells, the spreadsheet app becomes very sluggish. The mouse still moves normally, but it takes several seconds after a click until the highlight moves to another cell, or to un-select the cells, or copy them. These slowdowns happen both in old spreadsheets and in freshly created ones. They didn't happen with Openoffice 3.1 or earlier. Haven't tried it under Windows, so I'm not sure whether this is an issue specific to Linux OpenOffice 3.2. Other apps don't seem to be affected.

View 1 Replies View Related

General :: Automate Copying Files To Multiple Directories With Log For Admin

Sep 30, 2009

Description: I am a newly appointed system engineer taking care of linux servers. We have a new set of data coming in which need below configuration: How to do a script with function?:

for files with ".txt" in sm
copy each of the files to folder : sm1 and sm2 (log every copy)
if succesful:
remove original
log into the log file
if not successful: (not successful copying 1 particular file to all the folders)
retain and retry
log into the log file
mail out the admin with that particular file name

I have already do try a bit:
cd /export/home/
for dir in sm1 sm2; do
cp -p sm/*.txt $dir/
done
Is my starting right? How to do the rest parts?

View 6 Replies View Related

Red Hat / Fedora :: Multiple Partitions - 14 ?

Feb 17, 2011

After installing Fedora 14 and opting to overwrite the whole drive with the new operating system I think I see multiple partitions that I did not create. fdisk -l shows:

PHP Code:

View 1 Replies View Related

General :: How To Manage / Create Partitions For Multiple OS

Aug 3, 2011

How do I divide my hard drive into multiple OS'es/partitions for my test machine? For example:
Win XP
Win 7
Gentoo
Ubuntu
Storage
Can Linux'es share swap area? I was told to leave the first primary for the grub and linux cores.

View 1 Replies View Related

Ubuntu :: Multiple Partitions Shown In Nautilus?

Jan 4, 2010

For two of my partitions on sda (they are NTFS parts) I have configured them via the NTFS Configuration Tool to mount at boot. This is OK - I can see them in Places, Computer; they are listed together with the mounted icon to the right. However, there is also two other partitions listed - that are not shown as mounted - with the same label name. (I can also see these duplicate parts listed if I click on Places ad look down at the various devices attached under Computer). If I right click on these unmounted parts I see there is a greyed out option to Remove. How do I remove these duplicate partitions?

View 1 Replies View Related

Ubuntu Installation :: Multiple Grubs And Partitions Of Same HDD?

Mar 3, 2011

I searched through with several different terms and couldn't find it.I recently got a DELL Inspiron B120 laptop that had Windows 2000 on it as its sole OS. I'm refurbishing it to some degree. It needs a new LCD Screen and a Wireless Lan card; but that's not important here, I don't think.I'm running it headless and connecting to my desktop through X11VNC.

I decided to put the live disk Ubuntu 10.04 on it and see if I liked it. I decided yes, and went for the install.
Before it installed, it asked me how I wanted to partition the drive. It showed me examples, and I decided to keep the Windows 2000 on there, along with the little DELL diagnostics, etc. part and divide the 40GB drive up into pieces: 18GB for Win2k, 4GB for Dell, and 18GB for Ubuntu 10.04.Once installed I wanted to change the timeout for the GRUB to longer than 3 seconds before it boots the top choice (which is Ubuntu).

I noticed when I could catch it; that it was titled GNU Grub 1.98. I'm not really familiar with multiple GRUBs, so I didn't think about it. Then after a few days, I started getting updates for Ubuntu. The first one was the Ubuntu 10.04.2 LTS, kernel 2.6.32-28-generic from the original kernel 2.6.32-24-generic. Then it went to kernel 2.6.32-29-generic, and yesterday to kernel 2.6.32-30-generic.

That's fine; but the GRUB list is still saying 2.6.32-28-generic as the most recent. Also, the last update asked me if I wanted to create a menu.lst file.I thought I had a GRUB.cfg file that had the list of boots...But I answered yes anyway, and installed the GRUB menu.lst. I changed the timeout to 15 seconds in menu.lst; but the list is still showing as the GNU Grub 1.98 and the list of boots is still topped with 2.6.32-28-generic.I have no idea what's going on now; nor how to update it so that I use the GRUB with the menu.lst and delete or suspend the GNU Grub 1.98.

View 9 Replies View Related

Software :: Mounting Images With Multiple Partitions?

Jul 12, 2010

Say I have an image of a file system. I made it with dd by copying it off my USB stick. e.g. "sudo dd if=/dev/sdb1 of=./image.ext2" I can mount said image with the command: "sudo mount -t ext2 -o loop ./image.ext2 /mnt/" Now, say instead of copying a partition with dd, I copy a whole drive. e.g. "sudo dd if=/dev/sdb of=./image.img". sdb had 2 partitions on it. How can I mount those separate partitions without copying that image back onto the USB drive?

View 1 Replies View Related

Fedora Hardware :: Create Multiple Partitions To Install Several Other OS's On?

May 31, 2010

Say I have this computer and this computer has a 1TB hard disk. I install Fedora 13 on this disk and let the installer do as it wishes with this 1TB of space. I'm going to end up with the LVM thingy. (Can you tell yet that I know nothing about LVM?). Can I, at a later date, use some of the available space to create another partition to install another OS on. Can I create multiple partitions to install several other OS's on?

View 7 Replies View Related

Debian :: Mount The Multiple Partitions Of A Pendrive - Flashcard?

Dec 27, 2009

I did this with :

Code:

I made two partitions as below

Code:

3. Partition Compact Flash

Make two partitions on CF (use linux fdisk or anything else that is able to make linux filesystem)

1. at least 8MB FAT

2. rest ext2 (recommended) or ext3 - at least 50MB

Copy vmlinuz, initrd, linexec and params.txt to FAT partition.
Uncompress rootfs.tar.bz2 to ext2 partition. (command details at ref. [1])

But :

fdisk -l says only one /dev/sdd1

not sdd1a
not sdd1a

How can I mount those 2 created partitions, since they are hidden under /dev/sdd1 ?

Is it a bug of the kernel?

View 4 Replies View Related

Debian :: Setting Up A RAID Array With Multiple Partitions

May 23, 2011

I need to set up a RAID 1 array on Squeeze. I have 3 partitions: sda1 is root, sda5 is home, and sda6 is swap. (sda2 is the extended partition containing home and swap. This was a clean installation, so I don't know what happened to sda3 and sda4...)

All the information that I've been able to find recommends doing something like this:

mdadm --create --verbose /dev/md0 --level=mirror --raid-devices=2 /dev/sdb1 /dev/sdc1

Do I need to type a separate command for each partition, or is there a better way to do it? Also, should I use the UUID instead of the dev names?

View 4 Replies View Related

Server :: Benefits To Creating Multiple Partitions For RAID1 Setups?

Dec 21, 2010

I am rebuilding a bunch of servers and want to do it right. They are Dell R200s and R300s with on-board LSI SAS1068E SCSI controllers with 2 SATA drives. The only RAID level supported on these cards is RAID 1. So, to the server, we have 148GB of space to deal with. They currently run 32-bit Ubuntu 8.10; I will be installing x64 Ubuntu 10.04.

I have always seen that it is best practice to partition in such a way that /boot, /var/log, /temp, and /home for example are separated out from /. Usually this is on a RAID5 or higher box. Is there any benefit to doing that sort of thing on a RAID1 box? I realize that this is in some ways a matter of opinion, but I would like the opinion of folks with experience. I'm pretty new to Linux in general.

The main services running on these boxes are Apache2, Tomcat6, MySQL, and Java.

View 2 Replies View Related

Debian Multimedia :: PCManFM - X-gvfs-show Not Working With Multiple Partitions

Aug 20, 2015

Entries from fstab:

Code: Select allUUID=04E2891117C6D1E8 /mnt/Movies auto user,nosuid,nodev,nofail,x-gvfs-show 0 0
UUID=22C19F6A209C7999 /mnt/Storage/ auto user,nosuid,nodev,nofail,x-gvfs-show 0 0
UUID=366C25EB7664050D /mnt/Recovery/ auto user,nosuid,nodev,nofail,x-gvfs-show 0 0
UUID=2983C8A82A5FEF6C /mnt/Down/ auto user,nosuid,nodev,nofail,x-gvfs-show 0 0

The only one that shows in PCMANFM is the Movies partition. All others listed here are missing.

I checked syslog and it looks like they all mount correctly.

This puzzles me since all of them have the same options set.

View 0 Replies View Related

Ubuntu Installation :: Lucid - Multiple Active Partitions Error At Startup?

Aug 4, 2010

I created a customized Lucid image and installed on my computer which has 1 hard drive (/dev/sda)When I booted up .. it gave me an error indicating "Multiple active partitions" ... and did not boot up ...

I used my live CD and run as live session to check on the hard drive, When I issued the command fdisk -l on an terminal , the out put indicated that only /dev/sda1 is bootable, and other /dev/sda* were not bootable ...

I am not sure why I got the "Multiple active partitions" message at boot up time ..

View 3 Replies View Related

Ubuntu Installation :: Cloning Entire Drive With Multiple Partitions In One Step?

Aug 6, 2010

I have used GParted several times but I only know how to clone a single partition. I am looking for a way to clone and entire drive that has several partitions, along withthe MRB, unpartitioned space and everything else in one step. I have a 500 GB drive that is going out and I want to clone it to a 1 TB drive so I don't have to reinstall 3 different OSs and fix the GRUB. One of the other OSs is on anther drive so I'm not sure that it would work even if I can clone everything exactly. I'm not sure if the drive that is failing is the one with the MBR on it or not. how to do this in GParted or know another good program I can run from a live CD to do this?

View 2 Replies View Related

General :: Installing Multiple Distros - Create Another / And /home Partitions For The New Distro?

Nov 20, 2010

My partition layout is as follows:

sda1: 14GB / ext4
sda2: 10GB /iso ext4
sda3: 4GB /home ext4
sda4: 86GB Extended
sad5: 2GB swap

I have 84GB free space on this hard drive and want to install another distro. Will I be able to create another / and /home partitions for the new distro?

View 6 Replies View Related

CentOS 5 :: SMART Error (FailedOpenDevice) - Unreadable Partitions On Multiple Drives?

May 23, 2010

I've looked high and low but I haven't been able to find any example of what I'm currently experiencing with my hard disks.First off, I'm running CentOS as a Samba file server, on a Soltek SL-K8TPro-939 and AMD 64 3200+ (all the rage of five years ago). Here's my disk setup

Drive #1 (80 GB)
-Boot partition
-LVM partition (this drive holds the root filesystem[code]....

Ok, so I get a notification in my system mail yesterday: The following warning/error was logged by the smartd daemon:

Device: /dev/sda, unable to open device

For details see host's SYSLOG (default: /var/log/messages).You can also use the smartctl utility for further investigation.No additional email messages about this problem will be sent.

View 8 Replies View Related







Copyrights 2005-15 www.BigResource.com, All rights reserved