Ubuntu Servers :: Will Be Able To Recover Data 1TB Drives / Should Backup 80GB Drive As Well?
Feb 25, 2011
I am using software RAID in Ubuntu Server Edition 9.10 to mirror(RAID1) two 1TB harddrives. These are used for data storage and websites.I also have a 80GB harddrive for the operatigsystem. This drive has no backup or RAID at all. Should this drive crash and the system therefore to become no longer bootable, will I be able to recover the data the 1TB drives or should I backup the 80GB drive as well?
I'm breaking into the OS drive side with RAID-1 now. I have my server set up with a pair of 80 GB drives, mirrored (RAID-1) and have been testing the fail-over and rebuild process. Works great physically failing out either drive. Great! My next quest is setting up a backup procedure for the OS drives, and I want to know how others are doing this.
Here's what I was thinking, and I'd love some feedback: Fail one of the disks out of the RAID-1, then image it to a file, saved on an external disk, using the dd command (if memory serves, it would be something like "sudo dd if=/dev/sda of=backupfilename.img") Then, re-add the failed disk back into the array. In the event I needed to roll back to one of those snapshots, I would just use the "dd" command to dump the image back on to an appropriate hard disk, boot to it, and rebuild the RAID-1 from that.
Does that sound like a good practice, or is there a better way? A couple notes: I do not have the luxury of a stack of extra disks, so I cannot just do the standard mirror breaks and keep the disks on-hand, and using something like a tape drive is also not an option.
My sister-in-law (SIL) has a Western Digital ShareSpace 4TB network access storage that was setup in a RAID 5 configuration (four 1TB hard drives). To make a long story short, a blinking red light on the device and a call to Tier 2 technical support, one of the guys mentioned using Fedora as a way to retrieve the data from the hard drives (seems like the hard drives are good but maybe the actual NAS device crapped out).
I will not have access to the hard drives till this weekend and of course Tier 2 technical support is closed on the weekends. I have almost no Linux knowledge but can follow instructions pretty darn well. I am looking to install Fedora 14 Desktop Edition 64 bit on my desktop sometime tonight or tomorrow. Once I have Fedora installed, how would I mount the hard drives and have Fedora read the RAID 5 array?
I am running 8.04 Ubuntu server. Unfortunately a couple of days ago I thought I should upgrade as desktop upgrades usually go without a hitch and are very easy. I forgot that my server is live with a few websites and a radius server set up just the way I need (took painfully long time to figure out). Needless to say the upgrade caused many config file changes and many things stopped working. I panicked since this is a live server so I went straight to the backups to recover my system. I booted from a live CD and copied the entire system overtop the new one.
Everything that needed to work works, however now I get this message in my mail about every 10-20mins: Subject: Cron <root@IMwebserver> [ -x /usr/lib/php5/maxlifetime ] && [ -d /var/lib/php5 ] && find /var/lib/php5/ -type f -cmin +$(/usr/lib/php5/maxlifetime) -print0 | xargs -r -0 rm Content-Type: text/plain; charset=ANSI_X3.4-1968 X-Cron-Env: <SHELL=/bin/sh> X-Cron-Env: <HOME=/root> X-Cron-Env: <PATH=/usr/bin:/bin> X-Cron-Env: <LOGNAME=root> xargs: xargs.c:443: main: Assertion `bc_ctl.arg_max <= (131072-204' failed. Aborted
Googling it, I found that its a problem with findutils. I tried to reinstall findutils with no luck. My backup script looks like so: @daily /usr/bin/rdiff-backup --exclude /dev --exclude /tmp --exclude /var/run/cups/cups.sock --exclude /var/log --exclude /mnt --exclude /media --exclude /proc --exclude /sys --exclude /var/cache/apt / /media/removable/BACKUP/rdiff/ How can I fix my system so the above e-mail no longer occurs?
I have a 1Tb Western Digital Network drive. I was showing someone the photos on this on their XP computer and noticed that each file also had a capitalized version beside. I assumed this was a copying mistake and highlighted all the capitalized copies and deleted them. To my horror all files have vansihed. The next horror came in that XP apparently doesn't move deleted files to the recycle bin it just deletes them. I rapidly went back to my ubuntu machine and mounted the network drive. However none of my normal recovery file methods work on network drives. PhotoRec doesn't list the drive. and sudo ddrescue -r 3 ~/.gvfs/SFTP for [myname] on [address]/[path] ~/LOGFILE tells me permission is denied.
I have a laptop with Fedora 12 on it and I accidentally did an dd if=/dev/zero of=/dev/sda (since then I learned to think before I type) anyway, I stopped it in time (I hope), it only zeroed first 60 MB. So, it killed partition table and boot partition. What I need is home partition, and it should be untouched. home is on a LVM device (fedora default install settings), and I tried testdisk (supposedly handles LVM) but it found only one partition (I guess it's a LVM physical device, as there should be 3 partitions, /, /home and swap) and said it's not recoverable.
Is there a way to get access to files on that partition (partition itself, including file table should be untouched). Partition contains various data (video, audio, and text) I need back (and it's my data, not backed up, and not something I can redownload). Is there any software that can help me with this, and if not, is it theoretically doable (I believe it should be, as the partition itself is not damaged, so it should be possible to read file names and link them with data on disk, am I right)? what is a good way to image the disk, so I can reinstall the laptop while trying to rescue data from image?
I was using a Buffalo LinkStation Duo to store pictures and the OS in the unit failed. As far as I know, the data on the two 1 TB drives is fine, and since Buffalo uses a Linux kernel in their LinkStation and the format is xfs, it should be possible to get the data off if I can mount one of the drives on a Linux box. I've put one of the drives into an external USB enclosure and attached it to my Linux system, but I cannot get the drive to mount, probably because it is one element of a Raid 1 array.
Most of what I can find on the Web concerns setting up a new Raid array, not creating an array around a drive that already contains data. I have installed mdadm, and I'm running Mint Linux release 9 (Isadora) on an Intel box. When I run mdadm -D /dev/sdb or sdb6, the device and the partition where the data is located, it reports that the device does not appear to be an md device. I'm not sure what that means. Any help would be greatly appreciated, as I've got around 13,000 photos on these disks that have no backup (I figured what could go wrong with mirrored copies?).
Using F12 with a LVM Volume, Single disk with OS on and boot partition. The OS HDD is getting i/o errors, but will still boot to the login screen. I've removed the HDD and connected it to a Fedora Live OS on my laptop, connected the HDD and it registers as :
[root@localhost]# fdisk -l /dev/sdd Disk /dev/sdd: 250.1 GB, 250059350016 bytes 255 heads, 63 sectors/track, 30401 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x000e0069
Device Boot Start End Blocks Id System /dev/sdd1 * 1 26 204800 83 Linux Partition 1 does not end on cylinder boundary. /dev/sdd2 26 30401 243991201 8e Linux LVM
And it tried to mount /dev/sdd2 to view and see if I can recover some files. [root@localhost]# mount /dev/sdd2 /mnt -t ext4[root@localhost james]# mount /dev/sdd2 /mnt -t ext4 mount: wrong fs type, bad option, bad superblock on /dev/sdd2, missing codepage or helper program, or other error In some cases useful info is found in syslog - try dmesg | tail or so
Any way to mount the partition to allow me to try and get some data back, or if trying to do a full backup of the drive you can get it to ignore i/o errors.
I currently have an Ubuntu 10.04 Server with 10 2TB hard drives (Hot Swappable). I discovered that having a software raid over 16TB is not supported, so I split the drives into 2 sections and have 2 Software Raid arrays storing my movies, audio, pictures, and other software. The total current usage is around 7TB. Since backing the files up to DVDs or even BlueRay is laughable, I am going to backup the system to 2TB hard drives probably 4 of them, the problem becomes that I can only hook one backup drive at a time into the system using a hot swap tray. Now I know that I can do this manually by copying the files one at a time to the drive until it is full, switching the drive out and repeating this, but I am hoping for an automated solution, Start backup, plug first drive in, system fills up drive, swap and repeat. Also it would be nice if the system remembered what had already been backed up so when I add files to the system, I only need to attach the last drive and not start the process over.
I've been trying to discover how can I recover data from a hard drive that as been previously configured with LVM, although not encrypted,but I have been having mixed results. I've been using LVM more and more lately to configure hard drives and my greatest fear is to have a motherboard fail on me and get locked out of the contents.
I have 3 drives in my computer. I installed Fedora 11 on my two biggest one, with the LVM treating them as one single drive. I attempted to install XP on my last drive. As I was installing, I selected my third drive (I'm 100% sure it is the correct drive as it is an 80gb whilst the others are 120 and 200 respectively) and told it to delete the partition on that drive and format. After I did that, it started to format, starting with my 120! I'm fairly sure that it was merely a quick format, as it only took 5-10 seconds for it to format, and that my data is still there. Is there any way to recover my "lost" data, or did I just really screw myself over?
Last night I made the mistake of formatting my media drive. Before the format, it was ext4. then I formatted it to ext4 again because I wasn't paying attention to what I was doing(this mistake only gets made once). Now im looking for away to recover any/all of my data. The drive in question is 1tb. I have not written any new files to this drive.
I am running Ubuntu 10.04, and i recently purchased an tandberg LTO-4 SAS tape drive. I want to access it and backup data on it. Do I simply just connect plug it into the server,and I should be able to backup/transfer data to the tape drive? Or are there intermediate steps before I can do that. Here are some results from commands that I have typed:
I already have an ubuntu backup server in my location and need this one server to be backed up remotely in another state. this other location is a helpdesk so there's a danger that they can gain access to confidential data. I'll be setting up this new server as an ftp server but need to set the ftp folder to only allow access to the backup server and me. Because its remote on the helpdesk side, they'll need some access to the file system but need to be completely blocked off from the ftp folder where all the data is at. How can I make sure I can keep them away from my data and still be able to retrieve or copy files over without permission issues between both servers?
I am under orders from She who must be obeyed that I must fully backup her data as she had a loss of information due to a hard drive failure.Presently I am having her make available her info as shared documents on her XP system and I am copying this data over to my Ubuntu (Karmic) desktop. I would also like to have a USB Hard Drive save the information in order that I can safely store this away from a live system.
So far things are working not too bad but She wishes to have all her backup that was available on DVDs and salvaged from posted material assembled as one complete resource. I can with some effort put this into some semblance of order but do not feel like doing the work twice.I would like some method of easily copying / transferring data to the external HD. Additionally I would like to be able to update data daily and be able to with minimal effort have this synced onto the external HD.
How to backup in such way that, data will be backed up in every 1 hour...but every time not full data;; only the data/file which have been modified within last 1 hour. Its on locally. And how to back up local data to remote system. Because I have tried with ssh-keygen also , but everytime its requiring password.
All my data is stored on a separate device/partition: a 2TB USB disk with one ext4 partition. I have 3 more USB disks: 1x 1TB + 2x 500GB = 2TB right ? I want to backup my data from the 2TB volume to the (older/slower/cheaper) other volumes combined. I am thinking to use LVM to group the 3 smaller USB disks into one 2TB logical volume and use that to back up the 2TB primary volume. Do you think that is a good idea? In case of disaster I can replace the 2TB primary disk and restore from my 2TB logical volume right ?
What happens if :
I have to replace my internal hard disk and reinstall ubuntu? Can I re-attach the logical volume ?One of the physical volumes of my volume group dies ? Can I remove it and replace it with a new physical volume (bound to have other dimensions) ?Understandably I will loose my backup data?PS: running Ubuntu 10.10 .
Here is my brief hardware and software detail in my production environment : AMD Phenom X4 3.4gHZ (Over clock to 4gHZ, 8G of Memory, 1TB 7200rpm Harddrive, Running Ubuntu server 10.10.My web production environment were pieced together 3 weeks ago.Here is my dilemma. started out with less that 40 users and now hitting 4,000 unique users per day.Now I am thinking I need faster write to disk and backup of data so I am thinking about putting together a Raid5.
I preparation for this.I have bought a new motherboard, AMD Phenom X4 3.6, and 2 more 2TB 7200rpm (Currently, I have a 2TB 7200rpm not used much)Been digging around this forum for posts with raid setup but still not sure how to seamlessly moving the some 10Gig of data from my current running prod environment once I have RAID5 installed on this new machine via the LIVE Ubuntu Server CD.
Now that we got that out of the way, here's the problem and I hope someone can help me. Before posting, I read everything I could find here about partitioning in gparted (at least what I think applied to my situation). I'm pretty sure that this has an easy answer (or I hope it does).
I originally installed Ubuntu 10.10 on a USB stick to try and retrieve files from a failed NAS drive. That worked pretty well a very smart guy who posted instructions on how to do the hex editing necessary to realign and enter a reiserfs disk) so I decided I'd jump in and play with Ubuntu. I decided to port my USB install to an 80GB USB drive I had kicking around, but the install didn't actually take the whole disk the way I thought it would, it only took the 7.xGB from the USB drive.
I didn't notice (I know, dumb) and then I did the 11.04 upgrade to it. I'm trying to recapture the other 65GB of unused space via gparted, but I can't for the life of me figure out how to extend the original boot partition (I have no /home partition). i tried to format the unused space to ext4, but no matter what i do I can't expand that original partition (I can shrink it if that matters). Just to be clear, I booted from a live cd 10.10, and I'm running gparted on the unmounted USB drive. The boot partition should not be active.
My screen shots capability is not working correctly right now, but I'll post one if I can. I can only get a full screen shot, and this is on a 30" monitor.. I just want the active window the /dev/sdj1 partition is on the left (7.11GiB) witha boot flag, then the Ext/Swap at 377MiB each /dev/sdj2 and 5) and then another 68,85 GiB partition, currently formatted to Ext4 on the right labeled /dev/sdj3. No other partitions. I can extend the Ext/swap, but not the boot partition.
Is there any somewhat straightforward way of lock the drive letters to certain drives at boot?
I have searched a lot on this and the only thing that have come up is a rather long and complicated way using scripts etc.
A simple fstab example on how to make an uuid to boot at say sda1 everytime and not like now totally random even though I have the same drives in the same places with no portable devices and only a std setup with /boot, /, /home, /swap. +some storage drives.
This uuid creates a havoc on my Truecrypt favorites mounting that relies on labels.
If this is not possible how far back do I have to go get rid of uuid?
I know that 10.04 LTS was working fine at first, is it in the kernel version that it is decided?
so this is really the result of another problem. There seems to be an issue with CPU spiking to 99% forever (until reboot) if I run apt-get or synaptic or update manager while an external USB drive is plugged in. Note, other USB peripherals are no problem, just an external HD.
So my work around was to eject the drive when doing apt-get or other installation work, then reattaching it to remount. Now, on to the present problem. I'm using the basic backup script (the rotating one) found in the Ubuntu Server manual. It uses tar and gzip to store a compressed version of the desired directories on my external USB. (which sits in a fire proof safe - this is for a business)
However, it seems tar and gzip which run nightly 6 days a week via cron as root, don't ever want to die, and they don't release the drive. I have to reboot the system (I can't logoff) to release the drive, unplug it, the I can do update/install work.
Of course, if apt etc. would work fine without conflicts with the external device, I'd not care about the tar/gzip problem other than it generally isn't a proper way for them to function and it chews up some CPU cycles. (they run about 0.6 and 1.7 percent respectively) I also can't kill them via kill or killall. They seem undead.
i have recently setup and installed Ubuntu 9.04 on a virtulal drive usingVMWare 6.04, installed the desktop gui as well, I need to add other drives for data and loggng, which I did in the VMWare side. I can see the 2 drives in ubuntu, but can not access them, I get he unable to mount location when I try. How can resolve this please as I need these to virtual drives to be used as data drives.
I have never preformed a rebuild of an RAID array. I am collecting resources, which details how to build an RAID 5 array when one drive has failed. Does the BIOS on the RAID controller card start to rebuild the data on the new drive once it is installed?
I have a ubuntu sever with a raid1 data drive formated in native linux ext3. I have searched for answers to my question but most likely I'm not asking it correctly. I want to use the data drive to store backups of files from various ubuntu and windows machines. Do I need to reformat the drive as ntfs to enable windows use or can it remain as ext3? For that matter can I reformat as ext4 as a soultion? Again, I wish to use the data drive as a backup storage.