General :: Rsync --link-dest Not Creating Hard Links On External Usb Drive?
Aug 24, 2009
CentOS 5.2 64bit 2.6.18-92.el5xen. Use rsync with --link-dest for nightly backups, works well. Was recently asked to start weekly backups to an external drive for off-site storage. The regular syncing works but hard linking seems to be ignored. So the backup is long with no space saving advantage. Here is an example of the command being run:
rsync --stats -axzvl --numeric-ids --delete --link-dest=/mnt/DISASTERBACKUPS/austinBackups/backups/2009-08-21 /AUSTINBACKUPS/backups/2009-08-24 /mnt/DISASTERBACKUPS/austinBackups/backups/
View 4 Replies
ADVERTISEMENT
Apr 1, 2010
I'm running rsync and outputting the log to a file using --log-file option. I am also using the --link-dest option, which in turn is adding the hard link creation output for EVERY file in the log file. I want to ONLY show the actual file transfer (if any) that take place.
In the 'log format' section of rsyncd man page here I assume you can do this, I just can't make sence about the code. If someone has better experience with reading it, can you please assist ?
View 2 Replies
View Related
May 20, 2011
I have an OpenBSD and a FreeBSD system and a mac. I also have a Linux server. What i would like to do is back up all these systems to an external hard-drive using rsync when the external usb disk is connected to my linux box.If i format the external usb disk with cfdisk and the create a non-bootable ext3 file system on this external disk and create and put all the necessary public keys on the Linux box then from the BSD's or the mac issue the command:
Code:
Will this back up the entire systems so that they can be restored in the event of an emergency? I should store each OS just in a separate disk file of the external usb drive each time right? Because i would rather not have to format the external usb drive for each different OS. Would this work? and would the restoration command for these BSD's be:
Code:
I just need to know the basics. I'm sure given that i'll be able to automate the process. I don't want to clone the disks for forensics. I just want to have a way of restoring to a clean OS. This is the most basic question:All the howto's never mention whether or not you have to have an rsync server running on the machine your backing up to. So do you just push or pull from one end of the connection only or do you have to have a client at one end and a server at the other, as is traditional?
View 1 Replies
View Related
May 20, 2011
I have an OpenBSD and a FreeBSD system and a mac. I also have a Ubuntu server. What i would like to do is back up all these systems to an external hard-drive using rsync when the external usb disk is connected to my Ubuntu box.If i format the external usb disk with cfdisk and the create a non-bootable ext3 file system on this external disk and create and put all the necessary public keys on the Linux box then from the BSD's or the mac issue the command:
Code: #rsync --progress -avhe ssh --delete / user@ubuntuBox:/usb/disk/path/dir/ Will this back up the entire systems so that they can be restored in the event of an emergency? I should store each OS just in a separate disk file of the external usb drive each time right?? Because i would rather not have to format the external usb drive for each different OS. Would this work? and would the restoration command for these BSD's be:
Code:
rsync -avze ssh UbuntuBox:/usb/disk/path / I just need to know the basics. I'm sure given that i'll be able to automate the process. I don't want to clone the disks for forensics. I just want to have a way of restoring to a clean OS. This is the most basic question:All the howto's never mention whether or not you have to have an rsync server running on the machine your backing up to. So do you just push or pull from one end of the connection only or do you have to have a client at one end and a server at the other, as is traditional?
View 3 Replies
View Related
May 25, 2011
There are basically two main limitations with hard links:
Hard links normally require that the link and the file reside in the same file system. Only the superuser can create a hard link to a directory.
Thus, symbolic links were introduced to get around the limitations of hard links. So, the question is, are hard links still needed? Might there be situation where they are more useful?
View 5 Replies
View Related
Jul 3, 2009
I have heard that creating hard link to a directory is not possible however when reading the man page of "ln" the "-d/-f" option says hard link directories ( super-user only). Thus this mean the super user i.e root can create hard link to directory and not a normal user , If yes then you . Even on specifying the above options I get a operation not permitted for a super user.
View 9 Replies
View Related
Jul 13, 2011
I am using rsync for incremental backups. I am backing up to a second hard drive on my computer. When I check the individual backup directories (backup.0 through backup.4) with du -hs they each show 12G; when I check the parent directory squeeze it shows 15G. Over 4 backups I have added 3G. I haven't made very much for changes to directories I'm backing up and am using hard links. I have included some info below.
Quote:
Backup script:
#!/bin/bash
mount /mnt/backup
cd /mnt/backup/squeeze/
rm -rf backup.7
[code]....
View 2 Replies
View Related
Jul 17, 2010
Evince in non-gnome systems is unable to open external link. The error msg it shows is
Code:
Unable to open external link The specified location is not supported. I have already googled it, however it only says it is a bug, without any solution available. Evince in gnome systems however work just fine. Is there any way evince can use sensible-browser to open external links?
View 2 Replies
View Related
Mar 11, 2010
I am trying to use ln to create a hard link to file a and whenever I do it, it creates a copy of the file instead. After having edited file a, when opening the link, it shows the old information and opening file a shows the new information. The command I am using is
Code:
ln /home/user/file
within the new directory i am trying to link from. I am using centos 5.4.
View 7 Replies
View Related
Jan 25, 2010
I got a dell inspiron 1501 laptop with a 80Gb sata drive what is the best solution to add data storage space for someone that love to have multiples operating systems at hand Note: I use mostly linux so I won't need to change my laptop for many years maybe ...
View 2 Replies
View Related
Jan 15, 2010
I have a 1TB USB external drive, currently formatted as fat32. What I need to do is copy two folders and all their subfolders, totaling about 500GB, to that external drive. The USB drive will have to transfer back and forth between RHEL, Windows XP, and Mac OSX computers freely.What format should I go with on the USB drive, FAT32 or NTFS?What rsync switches should I use? I know I don't want to use -a because I don't want any permissions restored. I'm guessing I'll have to run rsync a couple times to fully get all the files, so I need to be able to cancel an rsync, then have it pick back up where it left off, not start over and recopy every file again.
View 8 Replies
View Related
Jun 28, 2010
I am copying my home folder from my old computer (Ubuntu 9.10) to my new one (Ubuntu 10.04)
I thought that I would make a tar archive of my home directory (~60GB), then copy it across the network and untar it in my new home folder.
The problem is that I have several hard links (30 at most). When I try and untar the tar in my new computer it runs into errors with the hard links.
I think the problem is that it has unzipped the hard link before it's target and detected an error.
One solution is to add --hard-dereference to the tar command , this will create a separate copy of each hard link. but I would really like an exact copy of my home folder on my new computer.
Does anyone have any ideas? Either copying my home directory, or how to make tar handle hard links sensibly?
View 2 Replies
View Related
Jan 18, 2010
anyone shed some light into these errors I keep getting for multiple files when I run rsync in verbose mode to a FAT32 external hard drive?
rsync: stat "/mnt/usbdrive/Batch 2/od venezuelan" failed: No such file or directory (2)
rsync: recv_generator: mkdir "/mnt/usbdrive/Batch 2/joseph gangster" failed: No space left on device (28)
I have 588GB available on my external hard drive, and i'm only trying to rsync 200GB to it, so its not out of space or anything like that. I've tried rsync with -r -t --size-only --delete and -r -t --modify-window=1 --delete and both ways seem to give me the message. or should i just reformat as NFTS and start over? i already had another 200GB data set copied on here, was trying to add a second. its all JPG pictures.
View 14 Replies
View Related
Jan 14, 2009
I have 2 ubuntu's: 1 on my ineternal hard drive, 1 on my external
When I startup without my ext drive =>GRUB error 21.
And when I plug it in I can choose: the standard ubuntu kernel is the one on my external, and the original one is listed under other...
I'd like to be able to startup without external hard drive and make the ubuntu on my internal drve the standard.
View 14 Replies
View Related
May 9, 2011
I have never used rsync before, only DD. But from what I have been reading, rsync is better becasue it will basically mirror your hard drive, thus being able to run the cloned software from the new hard drive. My problem is I do not know what is the best commands or even the basic commands to use in rsync. I am trying to make an image from a external hard drive to a usb drive. That way my chances of messing up he original software is not as risky becasue I'll just restore the image onto another hard drive. Does anyone know the best script to have rsync make an image file of a hard drive and place it on a usb drive and then restore it?
View 8 Replies
View Related
May 31, 2010
As my proficiency with Linux improves slowly, I've been trying to find the answers for myself, but in this situation I must admit I find myself rather stumped. I have a perfectly nicely working Fedora 12 install on an 80GB SATA drive, and when it hit an error and wouldn't boot last week (easily fixed with fsck from the initial command line) I panicked and ordered a new 250 GB drive. It got here and I might as well use it, I thought to myself, so I went about trying to figure out how to move my install without having to reset all of my settings, programs and so on. I didn't want to mess with dd because I'm not so so clear on resizing my partitions once the copy is done (if someone thinks this is a better idea I'm open to suggestions.) After some poking around I found this set of instructions which I attempted to follow to the letter, but hit some snags. I understand this thread I am referring to may be a bit outdated, which is why (I assume) I hit a bump here
Code:
# mount /dev/hdy1 /boot
mount returns an error demanding I specify the file system type. At a loss, I barreled on until
Code:
[Code]...
To summarize, I partitioned and mounted my new drive using fdfisk and the instructions provided above, then used rsync to copy over all of the files, so as far as I know the new drive is ready to go, just not yet bootable. Opening the Grub.conf file in Kwrite (as root) returns a blank page. What do I do now?
As a side note, you can see that I am not too squeamish about the terminal, so I would prefer to find a "command line only" solution to this relatively simple (?) procedure.
View 5 Replies
View Related
Jan 7, 2011
When I run rsync --recursive --times --perms --links --delete --exclude-from='Documents/exclude.txt' ./ /media/myusb/
where Documents/exclude.txt is
- /Downloads/
- /Desktop/books/
the files in those directories are still copied onto my USB.
And...
I used fetchmail to download all my gmail emails. When I run rsync -ar --exclude-from='/home/xtheunknown0/Documents/exclude.txt' ./ /media/myusb/ I get the first image at url.
View 9 Replies
View Related
Jan 22, 2010
We are in the process of pruning our directories to recuperate some disk space.
The 'algorithm' for the pruning/backup process consists of a list of directories and, for each one of them, a set of rules, e.g. 'compress *.bin', 'move *.blah', 'delete *.crap', 'leave *.important'; these rules change from directory to directory but are well known. The compressed and moved files are stored in a temporary file system, burned onto a blue ray, tested within the blue ray, and, finally, deleted from their original locations.
I am doing this in Python (basically a walk statement with a dictionary with the rules for each extension in each folder).
Do you recommend a better methodology for pruning file systems? How do you do it?
View 2 Replies
View Related
Nov 4, 2010
if I try to install a linux distro on an external hard drive, while I have windows XP on my primary, will the Linux stlil install a Grub on the Windows MBR. Or have I got that wrong.
View 2 Replies
View Related
Feb 2, 2011
I am trying to create an empty file based on the remaining hard disk space. The problem is that when I create a file that is 1 GB large, the df command shows the remaining space to be only 12 kb smaller than it was before the file was created.
someone@here:/tmp/delete# df
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/sda1 36827144 5031592 29924788 15% /
[code]....
View 2 Replies
View Related
Mar 27, 2011
I have Red Hat Enterprise Linux 6 installed on my machine. I am unable to mount an External Hard (NTFS). I have tried several options which are as under:
Option 1:After making a dir /media/windows mount /dev/sda1 /media/windows/ -t ntfs -o nls=utf8,umask=0222
Option 2: mount -t ntfs /dev/sdb1 /media/windows
View 2 Replies
View Related
Apr 6, 2010
I've been thinking about it and I have a few ideas how I could do this...
I could always just image the drive...
Code:
dd if=/dev/sda of=/media/EXHD/bakup_$(date +%F).iso
Also; I could use rsync...
Code:
rsync -auv --delete / /media/EXHD/bakup_$(date +%F)/
[Code]....
I've been doing mostly "dd" images...but was wondering if I'm just wasting time backing up a mostly empty HD (256GB and only 5% is used...so dd-ing seems like kinda of a waste).
View 2 Replies
View Related
Mar 18, 2011
but I have literally just starting using Linux (Centos) in the last week or so. I am using a standalone PC that is not networked, and as I will be downloading and generating a lot of data on this machine, I would like to regularly backup onto an external hard driveIdeally I would likethis to happen automatically as there will be other people using the machine.There seem to be many different ways of doing this, and I am getting a bit confused about the best method to use.
View 2 Replies
View Related
Nov 4, 2010
I have a Seagate external hard drive and I want to use it to back up my home server since it runs Ubuntu 6.10 and the upgrade to 10.10. My problem is that I am not able to format the drive to use it. I can not change the permissons or if I try to format I have all sorts of trouble. I have tried doing it on the home server running 6.10 and another pc running 10.10 and had no luck. Is there a better way? I have even tried chmod and chown with no luck.
View 2 Replies
View Related
Jan 20, 2010
I am trying to recover files off a 3.5" IDE Hard Drive that had Windows ME installed on it. I have access to a MacBook, Windows XP Desktop PC, and a cd with Ubuntu 8.10 on it.
Attempts:
1) If I make the HD the only primary master HD it won't boot up.
2) If I make it a slave drive it won't boot up.
3) I purchased an external enclosure from Radio Shack which turned out to be crap and online reports supported this conclusion. I got nowhere with that thing. Bestbuy doesn't sell 3.5" IDE enclosures.
4) By using an IDE / SATA to USB kit, I am able to connect the HD to the PC via USB cable. XP will detect the drive, however the HD will not my displayed under "My Computer" nor "Disk Management".
Onto linux (this is where I grabbed the Ubuntu cd):
5) When connected, the HD will show up under "Computer" as a "USB Drive". When I double click on it I get the error "Unable to mount location Can't mount file".
Allow me to show you some commands I ran:
Code:
Code:
Code:
View 14 Replies
View Related
Aug 21, 2010
I was in the process of backing up data from my hard drive to an external usb drive when the drive suddenly became read only. Does anyone know how I can make it read/write again? I am using Debian Lenny and the drive is ntfs formatted. I have another ntfs formatted usb drive that is not effected in this way.
View 7 Replies
View Related
Feb 27, 2010
I have a 250 GB external hard drive formatted with Windows NTFS file type.How do I format it to use linux and what file type is best. I'm done with Windows so that is not a concern.
View 4 Replies
View Related
Feb 3, 2010
Ubuntu 9.10 recognizes my Freecom 120gig external hard-drive (when it's plugged in) and I can manage its contents OK - except via the command line. I don't seem to be able to find its path-name. See below:
mike@mike-desktop:~$ cd /media
mike@mike-desktop:/media$ ls
cdrom cdrom0 FREECOM HDD
mike@mike-desktop:/media$ sudo fdisk -l
[Code].....
Despite all this info, I fail to get into the external hard-drive from the command line.
View 7 Replies
View Related
Oct 21, 2010
I recently had a laptop die on me. I, of course, then to recover the hard drive. I wanted to install slackware to a partition on my drive, so I can have a linux distro with me( also I have a FAT32 partition for shared space) I have a Slackware 13.1 disk one (which i need, since I don't need a graphical environment or anything), and proceedd to follow setup program. I have a 5GB '/' partition, a 10GB '/home' partition, and a 2GB swap partition. My ROOT partition is bootable. The setup program seemed to complete succesfully, but it won't boot. When I choose to boot from my hard drive (in the bios), it reverts to the slackware disk, if present, or the standard windows drive.
I installed LILO to the superblock of my external, because according to the setup the MBR option installs to "The MBR of your first hard drive", and I wasn't sure if that was right, since my first hard drive is my windows one. Since i'm not even seeing LILO, I think it has to do with installing to the superblock. I want to be able to boot a basic linux distro if needed from whatever computer I want. I'm not sure if slackware was the right choice, but it was one that I had worked with installing before, and knewthat you didn't necasarraly have to instal all the graphics stuff. I just want a shell. Sorry if my question sounds retarted, I'm new to the whole "Multiple drives, and operating systems" thing
View 3 Replies
View Related
Aug 4, 2010
In Ubuntu 10.04 all I had to do was turn on my external hard drive and it would automatically be detected and mounted. I just switched over to Ultimate Edition, which I think is Ubuntu 10.04 with a lot of stuff added on to it. The funny thing is when I turn on the external hard drive it doesn't get mounted, and I don't think it's even being detected. I looked in gparted and it doesn't show up there. If I boot into Ubuntu 10.04 and turn on the hard drive it still gets detected and mounted, so there's nothing wrong with it. Ultimate Edition can detect other things connected to USB, like my iPod, so I'm wondering why it can't detect my hard drive.
Edit: When I do tail -f /var/log/messages and if the drive gets detected, this is what it says:
[ 230.520892] usb 1-2.4: new high speed USB device using ehci_hcd and address 6
[ 230.639400] usb 1-2.4: configuration #1 chosen from 1 choice
[ 230.639717] scsi9 : SCSI emulation for USB Mass Storage devices
[ 235.631550] scsi 9:0:0:0: Direct-Access Maxtor OneTouch 0122 PQ: 0 ANSI: 4
[Code]....
View 1 Replies
View Related
