Red Hat / Fedora :: Rsync And External Usb Drive - Mpath Blacklist?
Jan 16, 2011
I've been trying to get a cold backup of a 1TB database this weekend, started the whole process Friday and still have yet to get a single device backed up. I'm using rsync to copy files from my /u17 thru /u29 mounts, and the usb is formatted ext3. Each time the rsync would start off fine but after about 30 minutes it would fail with any number of errors but the most prevalent is "Read only file system", "broken pipe". Here are samples:
rsync: writefd_unbuffered failed to write 4 bytes: phase "unknown" [sender]: Broken pipe (32)
rsync: write failed on "<path to one of my .dbf files" failed: Read-only file system (30)
rsync: chown "<path>" failed: Read-only file system (30)
rsync: rename "<path of .dbf> -> <rename attempt>": Read-only file system (30)
rsync error: error in file IO (code 11) at receiver.c(305)
rsync: connection unexpectantly closed (16787 bytes received so far) [generator]
rsync error: error in rsync protocol data stream (code 12) at io.c (359)
I've unmounted and remounted a number of times and kicked off the rsync again and it goes about 30 minutes and I get the same errors. This was all as user 'root', so I tried to do the rsync as user 'oracle' and I get the same thing. After looking into the device as it is recognized, it is being picked up by multipath. Would the fact that a usb device is being managed by multipath be a problem? Currently it is mpath15. How would I add usb devices to the mpath blacklist? The usb is being assigned /dev/sdbj but I'm worried that it would change at a reboot. I've searched the web for all of these errors and still no answer.
Note: I've also just tried to do a copy using 'cp' and got the same "Read only file system" errors. I can sometimes touch a file and sometimes I can't. I want to try and get this backup done this weekend.
View 9 Replies
ADVERTISEMENT
Jan 15, 2010
I have a 1TB USB external drive, currently formatted as fat32. What I need to do is copy two folders and all their subfolders, totaling about 500GB, to that external drive. The USB drive will have to transfer back and forth between RHEL, Windows XP, and Mac OSX computers freely.What format should I go with on the USB drive, FAT32 or NTFS?What rsync switches should I use? I know I don't want to use -a because I don't want any permissions restored. I'm guessing I'll have to run rsync a couple times to fully get all the files, so I need to be able to cancel an rsync, then have it pick back up where it left off, not start over and recopy every file again.
View 8 Replies
View Related
Jan 18, 2010
anyone shed some light into these errors I keep getting for multiple files when I run rsync in verbose mode to a FAT32 external hard drive?
rsync: stat "/mnt/usbdrive/Batch 2/od venezuelan" failed: No such file or directory (2)
rsync: recv_generator: mkdir "/mnt/usbdrive/Batch 2/joseph gangster" failed: No space left on device (28)
I have 588GB available on my external hard drive, and i'm only trying to rsync 200GB to it, so its not out of space or anything like that. I've tried rsync with -r -t --size-only --delete and -r -t --modify-window=1 --delete and both ways seem to give me the message. or should i just reformat as NFTS and start over? i already had another 200GB data set copied on here, was trying to add a second. its all JPG pictures.
View 14 Replies
View Related
May 20, 2011
I have an OpenBSD and a FreeBSD system and a mac. I also have a Ubuntu server. What i would like to do is back up all these systems to an external hard-drive using rsync when the external usb disk is connected to my Ubuntu box.If i format the external usb disk with cfdisk and the create a non-bootable ext3 file system on this external disk and create and put all the necessary public keys on the Linux box then from the BSD's or the mac issue the command:
Code: #rsync --progress -avhe ssh --delete / user@ubuntuBox:/usb/disk/path/dir/ Will this back up the entire systems so that they can be restored in the event of an emergency? I should store each OS just in a separate disk file of the external usb drive each time right?? Because i would rather not have to format the external usb drive for each different OS. Would this work? and would the restoration command for these BSD's be:
Code:
rsync -avze ssh UbuntuBox:/usb/disk/path / I just need to know the basics. I'm sure given that i'll be able to automate the process. I don't want to clone the disks for forensics. I just want to have a way of restoring to a clean OS. This is the most basic question:All the howto's never mention whether or not you have to have an rsync server running on the machine your backing up to. So do you just push or pull from one end of the connection only or do you have to have a client at one end and a server at the other, as is traditional?
View 3 Replies
View Related
Aug 24, 2009
CentOS 5.2 64bit 2.6.18-92.el5xen. Use rsync with --link-dest for nightly backups, works well. Was recently asked to start weekly backups to an external drive for off-site storage. The regular syncing works but hard linking seems to be ignored. So the backup is long with no space saving advantage. Here is an example of the command being run:
rsync --stats -axzvl --numeric-ids --delete --link-dest=/mnt/DISASTERBACKUPS/austinBackups/backups/2009-08-21 /AUSTINBACKUPS/backups/2009-08-24 /mnt/DISASTERBACKUPS/austinBackups/backups/
View 4 Replies
View Related
May 20, 2011
I have an OpenBSD and a FreeBSD system and a mac. I also have a Linux server. What i would like to do is back up all these systems to an external hard-drive using rsync when the external usb disk is connected to my linux box.If i format the external usb disk with cfdisk and the create a non-bootable ext3 file system on this external disk and create and put all the necessary public keys on the Linux box then from the BSD's or the mac issue the command:
Code:
Will this back up the entire systems so that they can be restored in the event of an emergency? I should store each OS just in a separate disk file of the external usb drive each time right? Because i would rather not have to format the external usb drive for each different OS. Would this work? and would the restoration command for these BSD's be:
Code:
I just need to know the basics. I'm sure given that i'll be able to automate the process. I don't want to clone the disks for forensics. I just want to have a way of restoring to a clean OS. This is the most basic question:All the howto's never mention whether or not you have to have an rsync server running on the machine your backing up to. So do you just push or pull from one end of the connection only or do you have to have a client at one end and a server at the other, as is traditional?
View 1 Replies
View Related
Nov 25, 2010
I am thinking of using rsync to sync my Music folder to another folder called Music on an external USB drive. I will be using the Scheduled Tasks front end to schedule the syncs. What should the syntax look like when I put it in Scheduled tasks. I want this to be as simple as possible.
View 8 Replies
View Related
May 30, 2011
I have 350GB external Western Digital USB hard Drive.When I try to remove it from the system by executing Safely Remove Drive menu the fedora 15 system gets stuck.The processor starts giving a hum sound and it goes on even if it is left for half an hour in the stuck state.The Mouse is not working and everything is halted.
View 13 Replies
View Related
Mar 30, 2011
i have installed fedora 14 with so many libraries ,development tools installed on my pc but i usually have to present some projects which can run on my system .........and can't be executed or compiled due to absence of libraries and tools there so, i there some way to so that i can use this current installation on my hard drive of my pc to some external media like external hard disk and plug and use that installation anywhere on any system..
View 2 Replies
View Related
Mar 6, 2010
I'm currently learning to use rsync to backup my music collection. I have a Firefox tab open to the rsync manual page(s) and have been reading man rsync and running experimental rsync operations.I've been doing this for the last 3-4 hours. I've used rsync for this purpose in the past with disastrous results. What was and is once again (due to a month and a half of file pruning) a 9000 file music collection had mysteriously grown to over 25,000 music files and 80GB of data! This was likely due to the fact that I didn't really know what I was doing with rsync and had never spent too much time learning about all the parameters, what their functions are and how they may relate to my goal.Here are the particulars:
* Source drive is a 500GB disk, /media/sata500/music/.
* Destination drive is a 250GB USB disk, /media/FreeAgent/music, connected to the same computer that houses the 500GB disk.
* I want to copy or backup files from /media/sata500/music to /media/FreeAgent/music.
* I do not want to create ANY duplicates of files that exist.
* I only want to add files to the destination drive if they are new on the source drive, like if I rip a CD and add the contents to the source. I want them copied over next time I run rsync.
Here's the rsync command in it's most recently used form, and probably very immature at this point.
Code:
rsync -t -r -vv --stats -i --log-file=/home/glenn/rsync.log /media/sata500/music/* /media/FreeAgent/music/
This appears to have copied all files and folders and I'm satisfied that my goal has been met with some success. To convince myself of this I ran the command and then once it was complete I added 2 new songs putting them in their respective folders on the source drive and ran the same command again. The resulting output was
[code]....
Two files transferred. Exactly what I want.Both folders now house 20,931 files and use 40.6GB. Identical as far as I can tell.What I'm concerned about are time stamps and play count data, etc. Anything that changes the original file. I don't want this data to cause a file to be transferred as I'm afraid that the new file will be created along side the old file of the same name thereby starting this whole music collection expansion thing all over again. I've invested a lot of time and effort to get it pruned down to where there are virtually no duplicates and albums are correct in that they contain the proper songs in the proper order.
View 14 Replies
View Related
Jan 14, 2009
I have 2 ubuntu's: 1 on my ineternal hard drive, 1 on my external
When I startup without my ext drive =>GRUB error 21.
And when I plug it in I can choose: the standard ubuntu kernel is the one on my external, and the original one is listed under other...
I'd like to be able to startup without external hard drive and make the ubuntu on my internal drve the standard.
View 14 Replies
View Related
Apr 15, 2011
I need to re-format an external drive. All the instructions I have found start with figuring out where the drive is mounted (sda, hda, etc.). However, as soon as my RH Linux machine sees the drive's format (ntfs) it decides it won't even mount it in the first place. Gives me an error message. Also, the drive doesn't show up at all via "df -k". how to convince RHL to be a little more accepting?
View 5 Replies
View Related
Aug 11, 2010
Does anyone know how to rename an external usb hard drive?
View 3 Replies
View Related
May 15, 2011
I have a computer with an Asus M2N68-AM plus mother board running Fedora 14 that will not show external usb flash drives or hard drives when I plug them in. I used to run Linux Mint 9 on this computer and switched to Fedora because of easier LVM support out of the box. Mint would mount these devices just fine.
To simplify the issue and rule out anything I did since the installation, I tested this on both the Mint 9 live DVD and Fedora 14 live cd (both 32-bit versions, if that makes a difference) with the same results.
Just to be clear, I'm still somewhat new to Linux. I'm reasonably sure it's an issue with seeing the devices in the first place and not just an auto-mounting problem.
View 5 Replies
View Related
Sep 28, 2009
I have a Western Digital Pasport 320 GB hard drive. I wanted to create a live installation on it like a USB stick. I wanted it to serve as a portable OS that I could use to boot any other computer off of, and use it for diagnostics and anti-virus scanning on Windows based computers. The additional space is for my own personal use, kind of like having a mobile desktop where I have all of my documents in one place.What I need to know is how to set up Fedora 11 so that the hard drive will boot on most PCs regardless of their architecture. I also need to know what's a good Anti-virus to install onto it for the sake of fixing Windows hard drives.
Please keep in mind I'm a noob when it comes down to a lot of things, so if there's an antivirus I have to install manually, please included a step by step.
View 1 Replies
View Related
Aug 3, 2009
Background is this: Laptop has an internal h/d (obviously) so I removed it from laptop. Then set Bios to boot from external h/d. Installed Fedora 11 on ext. h/d no swap partition as drive already has 4 partitions. Fedora ran lovely!! I then replaced internal hard drive but left bios to boot from external hard drive. Boot screen for fedora came up, hit enter and fedora started loading. The little balloon started filling up, got to a quarter full and then screen went black. Had to reboot to get going again,same thing happened. Can anybody tell me what may be causing it,i.e. black screen. Fedora boots up and runs lovely with internal h/d removed. Any help very gratefully received. M/c has intel dual core processor, 3 gig of ram.
View 2 Replies
View Related
Jan 17, 2010
I'm having an issue with LVM on an external USB drive. When booting, the system drops into a recovery console if the external drive is not powered on because it cannot find the volume group and members. The setup is one system drive with fedora 12 installed, one internal data drive; LVM volume group vg1 with 5 partitions and one external backup drive LVM volume group vg2 with 5 partitions. Both the data drive and external backup are the same size and identical layout.
I use an rsync script that I wrote to execute backups (mirroring actually).
fstab is set 'noauto' on the external partitions.
I am new to LVM and I'm stumped as how to make the system 'ignore' the external drive at boot, if not powered on.
View 1 Replies
View Related
Jun 19, 2011
I have windows on my box, I have fedora 14 on my external that goes through my usb. Grub is installed on my usb. Since the only thing stored on my external was fedora i really didn't have to do much to it. just go into bios and boot from usb. Now that im using fedora more, Id like to add Vista to my choices. I guess the numbers change once your using an external drive. Ive read some of the problems like mine but they didn't quite do it. Im going to inclose 2 screen shots of my drives/partitions and my grub.conf.
# grub.conf generated by anaconda
# Note that you do not have to rerun grub after making changes to this file
# NOTICE: You have a /boot partition. This means that
[code]....
View 2 Replies
View Related
Oct 15, 2010
i have a 1 TB external hard drive and i have created 4 partitions as 3 of 300 GB , and one of 100 GB and i have format it as FAT but it is not showing 4th partitionand when i use fdisk -l it shows it as linux partitions and they are mounting in linux onlywhen i use the drive in windows , disk is not able to mount
View 3 Replies
View Related
Nov 3, 2010
Installing in external drive at the point where to put the GRUB loader I have these choices :
1. Master Boot Record (MBR) at -dev/sda (internal HDD)
2. First Sector of boot partition - dev/sdc1 (external USB HDD)
How can I put MBR in sdc instead of sdc1?
View 2 Replies
View Related
Jun 20, 2009
I am thinking about using aida to nuke my drive and then I'll re-partition it with gparted. I don't want to lose my 15 GB installation of Fedora Core 10 in the process and have an external 80 GB drive. How could I back up Fedora to this drive with the intention of copying it back to my internal drive?
View 2 Replies
View Related
May 23, 2010
In Fedora 12 how do I make it so a specific program can't talk to the internet?
View 14 Replies
View Related
May 29, 2009
I have a server which currently has a samba share for a printer and my home directory. Both have been working fine for a while now. I have a drobo (which is like a little USB RAID machine) connect via USB to the linux box. While trying to share it via samba I get weird messages from my windows machine (see screenshot). I have tried to share multiple folders on this drobo and no luck, all the same result.
I also tried a symbolic link, no good.
Here is a screen shot
http://aivila.com/temp/screen.jpg
Here is my smb.conf file:
Code:
[home]
path = /home/savona
read only = no
[Code]...
View 12 Replies
View Related
Dec 1, 2009
I would like to backup up my linux files to an external hard drive from a laptop. What would be the most simple and easiest way to do this? How would I format an external hard drive in linux.
View 4 Replies
View Related
Aug 17, 2010
I just had a fresh install of Fedora 13 x86_64 on my notebook after using fedora 13 x32 for a while.I am using KDE Desktop.Everything seemed to be working fine out of the box except for minor problems with sound and plugins.The biggest issue is that Fedora does not recognize when I plug an external USB HDD (WD 320 GB for this matter).The USB light on the HDD does not go on, and nothing is auto mounted.It seems that USB does not work at all - I have tried to plug another USB device and it didn't seem to have power.
View 2 Replies
View Related
Dec 23, 2010
I have an external hard drive that is connect to my laptop through USB port. But it won't show in my folder. I've looked every where but could located.
View 1 Replies
View Related
Jan 23, 2011
I am having the following problems with samba.
1. I cant share a folder on an external USB drive. (I have no problem doing so in UBUNTU)
2. I cannot seem to get Samba Swat to work.
I've Tried 127.0.0.1:901
my ip address:901
severname:901
I made sure that xinet was installed and started as well as smb and nmb. I can access other shares on the server just cant get samba swat to work nor can I set up a share on an External USB. I can access it from my side but not my Wifes side. I even made the root of the drive a share like so:
in smb.conf
[FreeAgent Drive]
comment=Shared Server Drive
path= /media/FreeAgent Drive
read only = no
browseable = yes
create mask = 0777
directory mask = 0777
valid users = argedion, perky
what am i missing or doing wrong? I have a simular set up on a server running UBUNTU 10.10 and it is sharing paths from a USB external. (note: I did not have to share the root of the drive in ubuntu.)
I know that Fedora is not UBUNTU nor GOD willing will it ever be. forgot to mention that firewall is off and i cannot access it even as root
View 14 Replies
View Related
May 27, 2011
Running fedora14 on a dell latitude-d600 laptop and I'm trying to access a 500gb sata external hard drive that is connected via usb. The laptop can see the drive as '500 GB Hard Disk: 524 MB Filesystem' and it's clearly mounted under the '/media' directory. However, when I attempt to read the files on it, I am only able to see the 524mb section of the drive. The external hard drive is an ext3 file system (running fedora13) and I believe it's encrypted.
View 14 Replies
View Related
Mar 24, 2010
I've got this hard drive that I know that is formatted to either ext3 or ext4, but I want to find out which format it is. I'm unfamiliar with many commands, I tried 'fdisk -l' but it didn't yield any useful information to me. Is there a command wherein I can easily find out the format of disks?
View 3 Replies
View Related
Apr 25, 2011
I have a hard drive from a server that had a severe hardware failure. I have it attached via usb to the new server. I need to dump the database from the hard drive to a .sql file and then import the dump into the new server.
/mnt/external_drive/var/lib/mysql/ mysqldump -u root -p database name > backupdatabase.sql
My problem is, I enter in the root password, and it gives me an access denied error. I know this is the root password because that is how I am logged into the server. How can I test the credentials of the database that is located on the external hard drive? And, I've used all the credentials that could open this database (database user and root user) and still no go. If I can never get the password for the database on the external hard drive, what are my options?
View 1 Replies
View Related
