Red Hat / Fedora :: Growing RAID5 Without Back Up Data?
Feb 15, 2011
I am trying to build a media server for my home and still in the process of evaluating my OS options (Ubuntu Server, Fedora Core, or Win Server). I am planning to use four 1TB drives initially for the RAID5 array. Once it fill up i will add more 1TB drives.
My question is can Fedora Core create a RAID5 array and grow latter without having to back up data to external hard drive and re-create the array? I am looking for something that is easy to use and manage. If Fedora Core doesnt have this option, can you recommend other distributions that can do this?
I am trying to build a media server for my home and still in the process of evaluating my OS options (Ubuntu Server, Fedora Core, or Win Server). I am planning to use four 1TB drives initially for the RAID5 array. Once it fill up i will add more 1TB drives.
My question is can Fedora Core create a RAID5 array and grow latter without having to back up data to external hard drive and re-create the array? I am looking for something that is easy to use and manage. If Fedora Core doesnt have this option, can you recommend other distributions that can do this?
My fileserver initially had 3 1TB drives in RAID 5 configured with mdadm as /dev/md1. (System root is a mirrored raid on /dev/md0) I went to go add a 4th 1TB drive to /dev/md1 and grow the raid 5 accordingly. I was initially following this guide: [URL] but ran into issues on the 3rd and 4th commands. I've been trying a few things to remedy the issue since, but no luck. The drive seems to have been added to /dev/md1 properly, but I can't get the filesystem to resize to 3TB. I also am not entirely sure how /dev/md1p1 got created, but it appears to be the primary partition on the logical device /dev/md1. Relevent information:
The filesystem originated as ext3, I believe its showing up as ext2 in some of these results because I disabled the journal when doing some initial troubleshooting. Not sure what the issue is, but I didn't want to blindly perform operations on the filesystem and risk losing my data.
I currently have two hard drives, with my root partition configured in RAID0. I'd like to add two additional hard drives, and include them in my RAID0 array. I need to recreate the array to do this, so I'd like to copy everything off of the existing array, add the drives, build the new array, and copy everything back. I have an external hard drive with four times the capacity of my current array. What would be the best way to copy this data so that nothing is missed, so I can just copy everything back and boot back up? dd, image the entire root partition, mount it after creating the new array, copy everything back (at the filesystem level) dd, image the entire root partition, write it back out to the new array, I'm not sure how this would work, because the partition will be the wrong size, I don't know much about dd. rsync, just rsync everything on root over to the external something else? I plan on booting to a live CD and mounting my current array there, so I won't be working on a live filesystem.
I was trying to free some memory as my /var was about to fill.I went to Add /remove software and ried to remove some of the unwanted software and it asked for dependency and i clicked ok.After a while i saw some of my aplication like Evolution,Empathy blackening and i killed the Uninstallation. I was sure by time that something wrong has happened and i did not switch off my monitor so that i can retain my application.I tried lot to increase teh /var so that i can update my yum and install some lost application but allin vain i tried Gparted which can only decrease the size . I had 40 GB unallocated space so i tried to boot from Live Fedora 12 DVD and was able to see my all the files and filesystem. All my data in /home was intact.I tried to go to grub and went to boot hte kernel and Initrd and was able to go to #root but again was not able to update the system as network was missing.The SYSTEM was Not booting and stuck in between. Tried to change the /var to var1 copied /var content to /var1 and made changes in teh /etc/fstab still did not work ,so finally went to repair with Live cd but could not get "Linux rescue" anywhere not even to upgrade option so finally installed the New linux without touching / and /home partition rest were deleted and formatted for new instalation.Now i could not see my data in /home directory although i could see data in /root(old) and all ..i am now lost ..my data is nowhere ..please help me.I can only see /home(old) but it says empty and shows 6 GB unused and 3.3 GB used when seen in Gparted .
I have an Acer Altos EasyStore SATA NAS box that hung, the only way to reboot was to crash the system (unplug it). Upon reboot it was not recognising the hard drives (it wanted to do a destructive reinitialize). Most of the importent data was backed up, however some was overlooked and we'd quite like to get it back. Removing the disks and placing them in a PC with enough SATA bays to cope, and booting with a live linux distribution (System Rescue CD) I can see the 4 drives are not suffering hardware error and that the original partions exist. Using mdadm I can assemble the Arrays without error (seems to be three but the only one I am concerned with is the RAID5 array of about 3TB). /dev/m1p2 mounts as a loopdevice once an offset is entered. In turn this mounts as an XFS parition. However despite df showing the partition almost to be full. ls -l or ls -a on the mount point shows it to be empty!
I got thusfar using a translation from a German language forum, unfortunately I only speak a little German, and the only other English language post on a simlilar matter I found within that site had no replies. The next step was to unmount loop, then run xfs_chack and xfs_repair on the file system. xfs_check returns that there is are a few dir size and offset errors along with link count mismatches. This I would presume normal for a file system that has become slightly corrupted. xfs_repair (version 3.0.3) gets as far as Phase 3 it finds and corrects zerolength entries, offsets on directories and bogus inode numbers. However the final two lines are:
A search on the error missing out data size just returns code to generate it, is anybody able to explain what it means? Also remounting hard drive, ls and varients of still do not return anything. Am I missing some thing (root I am logged in with now would have different credentials presumably to root on the NAS box, so how do I get around this)?
Here is my brief hardware and software detail in my production environment : AMD Phenom X4 3.4gHZ (Over clock to 4gHZ, 8G of Memory, 1TB 7200rpm Harddrive, Running Ubuntu server 10.10.My web production environment were pieced together 3 weeks ago.Here is my dilemma. started out with less that 40 users and now hitting 4,000 unique users per day.Now I am thinking I need faster write to disk and backup of data so I am thinking about putting together a Raid5.
I preparation for this.I have bought a new motherboard, AMD Phenom X4 3.6, and 2 more 2TB 7200rpm (Currently, I have a 2TB 7200rpm not used much)Been digging around this forum for posts with raid setup but still not sure how to seamlessly moving the some 10Gig of data from my current running prod environment once I have RAID5 installed on this new machine via the LIVE Ubuntu Server CD.
I've got a raid5 array of 4 disks with ubuntu 8.04 runing on it that is currently still working:
/dev/sda /dev/sdb /dev/sdc /dev/sdd
Smartmontools for /dev/sdc tell that there are 9 sectors pending for reallocation:
Code:
197 Current_Pending_Sector 0x0012 100 100 000 Old_age Always - 9 198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 9 And /dev/sdd has increasing number of reallocated sectors (about 1 every couple of minutes):
Code:
5 Reallocated_Sector_Ct 0x0033 100 100 036 Pre-fail Always - 1735 /dev/sdc has failed a coulple of times this week (but I have always sucessfully readded it to raid5) . But the increasing number of reallocated sectores on /dev/sdd concerns me even more.
I'm affraid that during removal of /dev/sdd and adding new /devs/sdd disk, raid might fall appart. That's why I would try to do it in Ubuntu Live CD:If the raid falls appart (/dev/sdc fails) during the readding of new /dev/sdd disk, I might still remove the new /dev/sdd and return the previous one and assemble the raid with:
/dev/sda /dev/sdb /dev/sdd (old one that was previously removed)
Does assembling Raid in Ubuntu Live and adding new disk for /dev/sdd write anything on /dev/sda, /dev/sdb and /dev/sdc in the process of adding /dev/sdd into raid5?
I have this little problem. I wanna backup a big file that is constantly growing. Is there any way to make one backup and then have some way to take incremental backup of it?
Have the following partitions, I've grown md1 from 3 drives to 4 drives with mdadm. It is now the size below of 531899712 from 354599292.
[Code].....
As you can see above however, the filesystem is not growing. What am I missing. I don't believe I need to do anything with the partitions. I should just resize my array as I have and xfs_grow and be finished.
I wanted to shrink my Windows NTFS partition to allow me to grow my extended partition which contains my Linux partitions, namely to grow my swap space and home directory some however it just fails at enlarging the extended partition. Is this a known problem because I know there were rewrites to the storeage backend of Anaconda.
I have no drive failures but just need to recreate a raid5 set as the next free MD disk number. Originally I built a temp OS of debian on a single drive and had 4x2TB drives in a raid5 software array (MD0) this worked fine and allowed me to move all data to it, and remove our old fileserver. I have now pulled out the 4 x 2TB Raid 5 drives and created a new OS on two new 80GB drives, partioned as follows,
MD0 is now 250mb Raid1 as /boot MD1 is 4GB Raid1 Swap MD2 is 76GB Raid1 as /
If I turn off and push back in the 4x2TB drives I cannot see a MD3. I presume I would need to create a MD3 from these 4 drives but I dont want to mess things up as its live data. So im here asking for help, or a bit of hand holding to get it done right.
PS - Its a Debian Lenny 5.0.3 Raid1 fresh install replacing a Debian Lenny 5.0.3 on a single disk.
Okay so I made a mistake and I have to reinstall Linux (see: http://ubuntuforums.org/showthread.php?t=1602329)
Since I can no longer boot to my existing installation (the graphical version OR the text version), I am having trouble saving off what I don't want to lose.
Can I boot from the CD and get to my stuff through there? I am in the CD version of Mint right now (posting this) and I cannot navigate to /home/myusername/ (obviously). So where would I find those files?
Do I have to mount that partition or something? It looks like a lot of my stuff is mounted already in this CD version... which worries me.
An alternative is that I still have Windows 7 installed that I can boot to if needed. If thats a way to extract my files I am all for it.
I want to back up my data on my MacBook Air using time machine. I have a desktop with Debian gnome installed where I want to store my back up data. But I can't manage to find a hard drive to start time machine on.
I have four hard drives installed in my Debian computer and I also want to share them over my home network. I am very new to Debian ...
So I am working on a clients PC, and after I saved their data on an external hard drive I left it plugged in while I reinstalled Windows for them.....I HATE Windows. Stupid OS doesnt know any better than to just go deleting everything. Ubuntu would have known better than to delete multiple hard drives like that.
Anyway, please tell me I can salvage this data for my client? It was probably just reformatted. The data should still be there right?
I have a problem I don't know how to solve. Today I bought a netbook and while waiting for the new Ubuntu Unity release to come out, I thought of trying out Crunchbang instead of Windows that came with it. Browsing on my Ubuntu desktop machine, I found a guide for making Crunchbang live USB stick, and i followed the procedure. However, I made a very stupid mistake. The guide said I should enter the command: sudo dd if=/path/to/iso/crunchbang-10-alpha-01-openbox-i686.iso of=/dev/sdX bs=4M;sync
where "of=...." part should be replaced with the name of the HDD. I forgot that I have an external HDD mounted and mistakenly copied the data to it. After this, I cannot see the content of my external HDD anymore. Instead, i have this 620mb large Crunchbang-install device.
I know what I did was stupid, but is there a way to get the content of my HDD back? I have some valuable data on it.
A directory /test/test1 is created & under /test1 there are some files & subdirectories with data in it. I had copied the files (text & script files) with command as,
cp -irv /test/test1/.* /test as per the requirement but what i see in destinarion i.e, /test that no files or directory has been copied in /test & the files/directories is also removed from source i.e, /test/test1
so my query is how can i get the files/directories back with data?
I stupidly unplugget my USB-cable, which was connected to my Nokia music phone, just as if I were in Windows. What do I do? I've lost my music on the phone, or, it seems it may be there (the correct mass of data), but my phone now tells me there is no music... Can I recover this? And - what is the correct way to unplug a USB unit in Ubuntu? To make it work, and find the phone/drive - I just typed "sudo lsusb" in the terminal, and it found and opened the memory automatically... How should you unmount the USB, and maybe even how do I get my data back?
I believe that the attacker somehow got in through the ssh daemon(OpenSSH 5.3p1) on June 12. From here, a user account named "crond" was created(can anyone confirm weather this is normal?) and according to the log, this account was accessed several times between Jun 12 and Jun 18 from the same ip address. Also on Jun 12, the MOTD on the ssh server was messed up and remained that way until it was reinstalled. The default ssh client(OpenSSH 5.3p1) was made completely non-functional.
I became alerted to the problem when my ISP advised me to run a virus scan on the machines on my network. Not knowing of any linux based anti-virus software, I decided to check for suspicious files on my hard drive. I found one, in the /tmp directory was a subdirectory called ".popscan". Inside was a script and a list of about 40 very default sounding usernames and passwords. There was also a file called "back.txt" in the root of my filesystem. Which is a pearl script that aparently spawns a shell.
At this point I disconnected the server from the internet and mirrored the drive. I found a suspicious home directory for "crond" I'm hesitating on setting up the server again for fear that it might just get rooted again. I would also like to find out how he got in so it can be prevented for other people aswell.
I used a Kingston 8Gb flash drive as a live usb recently (copied the live iso image over using dd). I am done with the installations and all but seem to have a problem. i cannot format my flash drive. It now shows as a live CD (800 or so mb). Is there a way to fix the partition table back? I guess if i copy a partition table image from some other 8 gb drive that might fix the problem but i dont have any other flash drives. Is there a solution possible or am i stuck with a live usb forever
Note: This how-to assumes you are using LVM on top of the RAID5
Example scenario: VG0 <-> md0 = RAID5(3x500GB) = sda1, sdb1, sdc1 Volume Group VG0 is made up of a single Physical Volume (md0), which is made up of 3x500GB hard drives in
i`ve been learning a lot from your Decent site long ago, a long with my Linux Self-Study , i`m a MS System-Admin with 6 months Linux experience and growing ..
## My Situation ## :-
-CentOS 5.6(Final) x86_64 2.6.18-238.9.1.el5xen, Running as Backup-Server. -4 HDD, 1x500GB , 3x1TB -2 Raid Arrays (/dev/md0)-RAID1, (/dev/md1)-RAID5 -/boot on (/dev/md0)-RAID1 using ( /dev/sda1, /dev/sdb1)
I've initialize a virtual disk and deleted the partition table didn't notice that i've done that to the wrong one, data still on the physical hard disks but....how I'll get my data back safe without losing it?
I have just bought 4 1TB drives and set up a Software Raid level 5. Using Disk Utility tool I have created a GPT partition table and now when I want to create a partition, I get:
Error creating partition: helper exited with exit code 1: In part_add_partition: device_file=/dev/md0, start=0, size=3000610848768, type= Entering MS-DOS parser (offset=0, size=3000610848768) MSDOS_MAGIC found found partition type 0xee => protective MBR for GPT
[Code].....
it does say nothing about creating an partition on the /dev/md0, although Gnome Disk Utility allows to do that - if I just run mkfs.xsf /dev/md0 - it works fine, yet Disk Utility tells me that disk has not been partitioned, see image:
I had FC 14 installed on an SSD, and 4 500Gig drives in a software RAID-5 configuration. However, just recently, my FC14 failed horribly. Fortunately my admin had recently backed up the /etc directory. When FC14 failed, he reinstalled FC14 on the SSD. Is there any way for me to re-establish the RAID-5 drives, since they were not affected?
Here's the deal: I had a nice little fileserver running under 2.6.27.21-170.2.56.fc10.x86_64.
3 disks in raid 5 ext4fs, then I thought..."hey I'm a greedy bastard..I want another drive!!
So I get it..do a normal mdadm --grow...after around 1100 minutes .. FINISHED!..whee..happy...
I decide to do a upgrade to 2.6.29.2-52.fc10.x86_64 to get the fix for growing the ext4..
reboot...
Code: md: bind<sda3> md: sdc3 has same UUID but different superblock to sda3 md: sdc3 has different UUID to sda3 md: export_rdev(sdc3) md: sdd3 has same UUID but different superblock to sda3
I'm currently in the process of getting my server moved over from a Server 2003 machine to one based on Fedora 12. My issue is that I have an existing RAID5 array on a rr1740 card. When I install this in the new system each individual drive show up as sdc sdd etc not as one volume. I have tried installing the highpoint driver but I get an error that sata_mv cannon't be unloaded. I have tried adding this to /etc/modprobe.d/blacklist to no avail.
System currently looks like this. ASUS mini ITX Atom D510 based board with 2x on board SATA, attatched to these are a 160GB OS drive, 400GB data drive. Highpoint RR1740 PCI card with 5x500GB drives in RAID5.
