Ubuntu Servers :: Faster Write To Disk And Backup Of Data , Putting Together A Raid5?

May 13, 2011

Here is my brief hardware and software detail in my production environment : AMD Phenom X4 3.4gHZ (Over clock to 4gHZ, 8G of Memory, 1TB 7200rpm Harddrive, Running Ubuntu server 10.10.My web production environment were pieced together 3 weeks ago.Here is my dilemma. started out with less that 40 users and now hitting 4,000 unique users per day.Now I am thinking I need faster write to disk and backup of data so I am thinking about putting together a Raid5.

I preparation for this.I have bought a new motherboard, AMD Phenom X4 3.6, and 2 more 2TB 7200rpm (Currently, I have a 2TB 7200rpm not used much)Been digging around this forum for posts with raid setup but still not sure how to seamlessly moving the some 10Gig of data from my current running prod environment once I have RAID5 installed on this new machine via the LIVE Ubuntu Server CD.

View 3 Replies


ADVERTISEMENT

Ubuntu Servers :: Does Replacing Failed Disk On Raid5 Change Any Data On Other Disks In Raid

Jan 9, 2011

I've got a raid5 array of 4 disks with ubuntu 8.04 runing on it that is currently still working:

/dev/sda
/dev/sdb
/dev/sdc
/dev/sdd

Smartmontools for /dev/sdc tell that there are 9 sectors pending for reallocation:

Code:

197 Current_Pending_Sector 0x0012 100 100 000 Old_age Always - 9
198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 9
And /dev/sdd has increasing number of reallocated sectors (about 1 every couple of minutes):

Code:

5 Reallocated_Sector_Ct 0x0033 100 100 036 Pre-fail Always - 1735
/dev/sdc has failed a coulple of times this week (but I have always sucessfully readded it to raid5) . But the increasing number of reallocated sectores on /dev/sdd concerns me even more.

I'm affraid that during removal of /dev/sdd and adding new /devs/sdd disk, raid might fall appart. That's why I would try to do it in Ubuntu Live CD:If the raid falls appart (/dev/sdc fails) during the readding of new /dev/sdd disk, I might still remove the new /dev/sdd and return the previous one and assemble the raid with:

/dev/sda
/dev/sdb
/dev/sdd (old one that was previously removed)

Does assembling Raid in Ubuntu Live and adding new disk for /dev/sdd write anything on /dev/sda, /dev/sdb and /dev/sdc in the process of adding /dev/sdd into raid5?

View 2 Replies View Related

Ubuntu Servers :: Convert Mdadm 6 Disk Raid5 To 5 Disk Raid5?

Jun 30, 2011

I know you can fail and then remove a drive from a RAID5 array. This leaves the array in a degraded state.

How can you remove a drive and convert the array to just a regular, clean array?

View 9 Replies View Related

Ubuntu Servers :: 10.04 Server Hangs When RAID5 Disk Is Removed

Jul 20, 2010

I've got a new Ubuntu 10.04 server install with a new 3 disk RAID 5. The boot disk is separate, not part of the RAID. I was trying to practice what I would do if a disk died to recover the RAID, so I unplugged one of the three disks. The machine now just hangs on startup. It shows fsck at the top of the screen but doesn't got anywhere from there. If you press a key it shows the Ubuntu splash screen. If I plug the disk back in, everything boots up normally. So, my question is, how do I get the machine to boot with one of the RAID members missing? I know I can recover it using the Live CD, but it would be nice to be able to get back into the machine without the CD.

View 9 Replies View Related

Ubuntu Servers :: OS Drive /dev/sda Changed Labels With Raid5 Disk /dev/sdc?

Jun 25, 2011

My original config:

**Partition/Drive info**

/dev/sda Boot----------> 298.09 GB Hitachi HDT72503
20GB /
16GB /swap
50GB /var

[code]....

1. For some odd reason I tried connecting to a samba share as I had it setup and I could not.

2. Looked at webmin and it said my whole /dev/md0 RAID5 was being used..about 7.8TBs. decided to check my RAID5 setup and drives and noticed

**NEW Partition/Drive info**

/dev/sda Raid Array 1 1.82 TB SAMSUNG HD204UI
/dev/sdb Raid Array 1 1.82 TB SAMSUNG HD204UI
/dev/sdc1 /

[code]....

I didn't connect any new drives or anything. I had checked my "mdadm.conf" and "fstab" and everything looked the same?

View 3 Replies View Related

Ubuntu Installation :: Partition Second Hard Disk For Use As Backup Data

Sep 29, 2010

My primary drive is 250GB and has the root, home and var (I'd read it's good to put var on a separate partition for MythTV which I'm planning on doing) on separate partitions. I have a second 1TB drive that I'll be using to backup the 250GB drive and also host less critical data. I've created two partitions on this drive, one 250GB and the other covering the rest of the drive. I'd like to move the Videos directory out of Home on the 250GB onto the 1TB drive but can't find a definitive way of doing this. Should I just follow this guide for moving the home folder to a new partition? Next question is when performing a backup of the 250GB drive how do I make sure it's going to the 250GB partition on the 1TB drive? Can the different partitions be mounted separately?

View 2 Replies View Related

General :: Compress And Backup Data In Hard Disk

Apr 30, 2011

My hard disk is failing and I amnot able to boot into the system! Currently I have logged into the system uing Live CD! Any way to compress and back up the data in my hard disk in an efficient way!

View 6 Replies View Related

Ubuntu Servers :: Remote Backup Ftp Server With Confidential Data?

Feb 15, 2011

I already have an ubuntu backup server in my location and need this one server to be backed up remotely in another state. this other location is a helpdesk so there's a danger that they can gain access to confidential data. I'll be setting up this new server as an ftp server but need to set the ftp folder to only allow access to the backup server and me. Because its remote on the helpdesk side, they'll need some access to the file system but need to be completely blocked off from the ftp folder where all the data is at. How can I make sure I can keep them away from my data and still be able to retrieve or copy files over without permission issues between both servers?

View 9 Replies View Related

Fedora Servers :: Data Backup - Will Be Backed Up In Every 1 Hour ?

Jan 8, 2009

How to backup in such way that, data will be backed up in every 1 hour...but every time not full data;; only the data/file which have been modified within last 1 hour. Its on locally. And how to back up local data to remote system. Because I have tried with ssh-keygen also , but everytime its requiring password.

View 1 Replies View Related

Ubuntu Servers :: Backup Data From The 2TB Volume To The ( Cheaper ) Other Volumes Combined?

Jan 6, 2011

All my data is stored on a separate device/partition: a 2TB USB disk with one ext4 partition. I have 3 more USB disks: 1x 1TB + 2x 500GB = 2TB right ? I want to backup my data from the 2TB volume to the (older/slower/cheaper) other volumes combined. I am thinking to use LVM to group the 3 smaller USB disks into one 2TB logical volume and use that to back up the 2TB primary volume. Do you think that is a good idea? In case of disaster I can replace the 2TB primary disk and restore from my 2TB logical volume right ?

What happens if :

I have to replace my internal hard disk and reinstall ubuntu? Can I re-attach the logical volume ?One of the physical volumes of my volume group dies ? Can I remove it and replace it with a new physical volume (bound to have other dimensions) ?Understandably I will loose my backup data?PS: running Ubuntu 10.10 .

View 5 Replies View Related

Ubuntu Servers :: Will Be Able To Recover Data 1TB Drives / Should Backup 80GB Drive As Well?

Feb 25, 2011

I am using software RAID in Ubuntu Server Edition 9.10 to mirror(RAID1) two 1TB harddrives. These are used for data storage and websites.I also have a 80GB harddrive for the operatigsystem. This drive has no backup or RAID at all. Should this drive crash and the system therefore to become no longer bootable, will I be able to recover the data the 1TB drives or should I backup the 80GB drive as well?

View 3 Replies View Related

Ubuntu Servers :: Best Way To Remote Backup Of Its Server Disk(mounted)?

Dec 20, 2010

Is possible to backup disk(whole) on remote server which is mounted? If yes how,

View 2 Replies View Related

Debian :: Disk Health Warning - Disk Part Of RAID5 Array

Feb 17, 2016

I received the following error when I got home from work today. If this was a windows environment, my first inclination would be to boot off my dvd and then run a chkdsk on the drive to flag any bad sectors that might exist. But there's a complication for me.

Code: Select allThis message was generated by the smartd daemon running on:
   host name:  LinuxDesktop
   DNS domain: [Empty]

The following warning/error was logged by the smartd daemon:
Device: /dev/sdc [SAT], 1 Currently unreadable (pending) sectors
Device info:
WDC WD5000AAKS-65V0A0, S/N:WD-WCAWF2422464, WWN:5-0014ee-157c5db9a, FW:05.01D05, 500 GB
For details see host's SYSLOG.

You can also use the smartctl utility for further investigation.The original message about this issue was sent at Sun Feb 14 13:43:17 2016 MST.Another message will be sent in 24 hours if the problem persists.

From gnome-disks
Code: Select allDisk is OK, 418 bad sectors (28° C / 82° F)

I did a bit of reading and it seems that most people suggest using badblocks to first get a list of badblocks from the drive and save it to a file. Then use e2fsck to then mark the blocks listed in the badblocks file as bad on the hard drive. My problem here is that this drive is part of a RAID5 array that hosts my OS. I wanted to confirm if this was still the correct process.I boot to my Live Debian disk, stop the raid array if it's active. Then run badblocks + e2fsck commands on the drive in question and then reboot.

View 1 Replies View Related

Ubuntu Servers :: Hard Disk Filling Up \ Mount /var/log/data To New HDD?

Mar 16, 2011

I have a directory /var/log/data its about 80 GB,It filling up quit rapidly.I don't have much space left in the system them So i will attaching another External HDD.My question is that i need to mount /var/log/data to new HDD.So i have old data and pulse new coming up.I don't want to copy data from /var/log/data then mount new HDD to /var/log/data you know what i am taking about is there a simple way like linking or any other.

View 4 Replies View Related

Server :: Putting MTA On A RAM Disk

Sep 14, 2010

Can any one tell me how to put the MTA on a RAM disk for faster sending of mails..

View 1 Replies View Related

General :: Write A Simple Backup Script To Backup A Single Folder Nd?

Sep 15, 2009

I am trying to create a backup script that will back up a single folder for a class i am in. I was wandering if I could get some help. If possible I would also like to know how to write a script that can encrypt that same file . I will be putting the back up in my /home/usr/Backup directory. I am not trying to back up my whole system just a single folder. I am using Fedora 11

View 2 Replies View Related

Hardware :: Poor Write Speeds With RAID5 On 10.10

Jul 21, 2011

I am getting extremely poor write speeds with my RAID. My setup is as follows: > HP Proliant Microserver > 4 2TB Samsung F4 drives > 60GB root drive > Ubuntu 10.10 64bit > mdadm 3.2.2. I have two of the above servers, connected via gigabit LAN. The read speeds I am happy with, but write speeds are running at about 20Mb/s at the very best, Especially when people with a similar setup on a machine like this are running at about 90MB/s write speeds. My array is as follows (mdadm --detail -D /dev/md0):

[code]...

I have also started the partitions at 64 instead of 63 in a bid to correctly align the partitions, although this doesn't seem to have made any difference.

View 3 Replies View Related

Ubuntu Networking :: Mdadmin RAID5 Very Slow Write Speed?

Jul 5, 2011

I am hoping someone can help me I setup a brand new ubuntu 11.04 64bit system with:-AMD Phoenom 840 (3.7GHz overclocked) 8GB DDR3 RAM.WD20EARS x 4madmin (RAID5) SetupFor some reason I cannot get the write speed above 15mb/s & I have tried modifying the cache_Stripe_size from 256 to 8192.My read speeds are great burst at 120mb/s & stable at about 60mb/s.The only other possiblility is it could be my HDs which I read causes slow writes not sure if thats true though. point me in the right direction so I can fix this issue as I don't want to move to the dark side (Windows) .

View 1 Replies View Related

Red Hat / Fedora :: Growing RAID5 Without Back Up Data?

Feb 15, 2011

I am trying to build a media server for my home and still in the process of evaluating my OS options (Ubuntu Server, Fedora Core, or Win Server). I am planning to use four 1TB drives initially for the RAID5 array. Once it fill up i will add more 1TB drives.

My question is can Fedora Core create a RAID5 array and grow latter without having to back up data to external hard drive and re-create the array? I am looking for something that is easy to use and manage. If Fedora Core doesnt have this option, can you recommend other distributions that can do this?

View 1 Replies View Related

Fedora :: Growing RAID5 Without Back Up Data?

Feb 15, 2011

I am trying to build a media server for my home and still in the process of evaluating my OS options (Ubuntu Server, Fedora Core, or Win Server). I am planning to use four 1TB drives initially for the RAID5 array. Once it fill up i will add more 1TB drives.

My question is can Fedora Core create a RAID5 array and grow latter without having to back up data to external hard drive and re-create the array? I am looking for something that is easy to use and manage. If Fedora Core doesnt have this option, can you recommend other distributions that can do this?

View 2 Replies View Related

Server :: Recovering Of RAID5 Data Loss?

Aug 11, 2010

how to recover A mounted RAID5 data???

View 5 Replies View Related

Debian :: Used Backup-manager - Restore The Backup Data?

Feb 4, 2011

I am now preparing myself to upgrade lenny to squeeze and decided to do a backup on my system. I used backup-manager to do the job and it worked fine. how do you restore said backup data?

View 4 Replies View Related

Ubuntu :: Can't Add A New Disk To A RAID5 Array

Jun 10, 2011

I am trying to build a new array after adjusting TLER on my disks, which permanently changed some of the drives sizes. I am not sure if the following inconsistencies are related to the newly mismatched drive sizes.

Using:

Code:
mdadm --create --auto=md --verbose --chunk=64 --level=5 --raid-devices=4 /dev/md1 /dev/sdd /dev/sde /dev/sdf /dev/sdg
Nets me (build-time was two full days):

[Code]....

On a side note, since I'm recreating my array from scratch, I was wondering if anyone here knows of any optimized settings I could use. I've got 3Tb of data to transfer, so lots of test material.

These are Western Digital First Generation 2TB Green Drives (WD20EADS-00R6B0) with WDidle3 fix applied & TLER=ON. These are pre Advanced Format (aka not 4K).

Code:
mkfs.ext4 -E stripe-width=48,stride=16 /dev/md1

View 9 Replies View Related

General :: Why Is JFS Faster Than A Raw Device For 1.5TB Disk

Aug 19, 2010

I have a 4 * 1.5TB RAID5 disk array (software linux RAID, formatted with jfs) on my Fedora 12 system and want to expand it by adding another 1.5TB disk. I have added a drive to the system and conducted a simple performance check on it to make sure it was functioning properly:

Code:

# dd if=/tmp/bigfile.dat of=/dev/sdg1
5478774+1 records in
5478774+1 records out
2805132609 bytes (2.8 GB) copied, 168.77 s, 16.6 MB/s

But 16.6 MB/s is lousy. I ran an iostat -dmx 2 on this drive at the time of this lousy performance, and typical output was:

Code:

Device: rrqm/s wrqm/s r/s w/s rMB/s wMB/s avgrq-sz avgqu-sz await svctm %util
sda 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
sdb 1.50 0.00 258.50 0.00 16.25 0.00 128.74 0.17 0.66 0.36 9.30
sdg 0.00 3556.00 4160.00 32.00 16.25 16.00 15.76 135.73 35.11 0.24 100.05

(note that sda and sdb are a linux raid mirror set for the / filesystem that holds /tmp). I formatted the new drive (/dev/sdg1) with jfs and mounted it under /mnt2:

Code:

# jfs_mkfs /dev/sdg1
jfs_mkfs version 1.1.13, 17-Jul-2008
Warning! All data on device /dev/sdg1 will be lost!
Continue? (Y/N) y

[code].....

I would like to know what the performance will be like before I add the disk to the array because I don't want to wait for the whole array to be rebuilt before finding out my array is performing badly. The array is used as part of a mythtv system and has up to 6 simultaneous recordings running on it, so it needs to perform well.

View 6 Replies View Related

Ubuntu :: Backup The Entire Disk Using Some Popular Backup Tool?

Sep 1, 2011

I have installed Ubuntu 11.04 onto HP EliteBook 8540w notebook and would like to backup the entire disk using some popular backup tool.

I have searched in the internet and found the closest tool is PartImage. But the bad news is that it does not support ext4 fs!

View 5 Replies View Related

OpenSUSE Network :: Putting Hard Disk To Idle State After It Has Been Unmounted?

Oct 22, 2010

As i understand, after autofs unmounts disk (network or otherwise) it keeps spinning. It costs energy, so i wonder is there any way to put hard disk to idle state after autofs timeout kicks in?

View 4 Replies View Related

Ubuntu :: Extend Raid5 Array With One Disk

Mar 6, 2011

I wanted to extend my raid array with one disk, but I made a major error. I forgot partition the new disk to utilize the full 640GB. I used the following commands to extend the array:

Code:
mdadm --add /dev/md0 /dev/sdf
mdadm --grow --raid-devices=6 /dev/md0
xfs_growfs /dev/md0

After noticing that something was wrong I used these commands to remove the new disk:

[Code]....

How can I repair this situation? Before starting this adventure I made a back-up of everything that was stored in the raid array.

View 1 Replies View Related

Ubuntu Servers :: Putting The CD Image On The HDD?

Apr 27, 2010

Here's a trick I'd like to be able to do. You know how on Windows systems, you can copy the contents of the install disk to a folder, then point the system at it and when it would normally ask you to insert your Windows CD, it just reads that folder?

That's pretty much what I want to do. I want to put the contents of the Ubuntu CD-ROM on the HDD such that if I ever need to refer to the CD, it thinks it's already inserted and just reads from there.

This may sound like an odd request, but I'm asking because my Linux server is an old cheapo computer that doesn't have an internal CD-ROM drive. I have one that I can hook up, but it's a pain in the butt to open the case, set the jumpers, attach the drive, reboot, etc.

This would be a lot simpler for me. This way, if I ever need to access something that was on the Ubuntu Server CD-ROM, I want to be able to just get it from right on the hard disk. (I've got the drive space, after all.)

View 2 Replies View Related

Server :: Recover RAID5 Storage Array DATA Using Xfs_repair?

Jul 5, 2011

I have an Acer Altos EasyStore SATA NAS box that hung, the only way to reboot was to crash the system (unplug it). Upon reboot it was not recognising the hard drives (it wanted to do a destructive reinitialize). Most of the importent data was backed up, however some was overlooked and we'd quite like to get it back. Removing the disks and placing them in a PC with enough SATA bays to cope, and booting with a live linux distribution (System Rescue CD) I can see the 4 drives are not suffering hardware error and that the original partions exist. Using mdadm I can assemble the Arrays without error (seems to be three but the only one I am concerned with is the RAID5 array of about 3TB). /dev/m1p2 mounts as a loopdevice once an offset is entered. In turn this mounts as an XFS parition. However despite df showing the partition almost to be full. ls -l or ls -a on the mount point shows it to be empty!

I got thusfar using a translation from a German language forum, unfortunately I only speak a little German, and the only other English language post on a simlilar matter I found within that site had no replies. The next step was to unmount loop, then run xfs_chack and xfs_repair on the file system. xfs_check returns that there is are a few dir size and offset errors along with link count mismatches. This I would presume normal for a file system that has become slightly corrupted. xfs_repair (version 3.0.3) gets as far as Phase 3 it finds and corrects zerolength entries, offsets on directories and bogus inode numbers. However the final two lines are:

Code:

realloc failed in blkent_append (2671166480 bytes)
zsh: segmentation fault xfs_repair /dev/loop1

A search on the error missing out data size just returns code to generate it, is anybody able to explain what it means? Also remounting hard drive, ls and varients of still do not return anything. Am I missing some thing (root I am logged in with now would have different credentials presumably to root on the NAS box, so how do I get around this)?

View 5 Replies View Related

CentOS 5 Hardware :: Install Ruined By RAID5 Disk Failure?

Mar 8, 2010

I've tried to type this message twice in detail, but the computer won't submit it. What are the proper steps to take when a SCSI drive fails in a RAID five array running CentOS 5.4?

Yes, I read the manual. On a Dell 6650 system the drive can't be rebuilt because it is not recognized as the correct size. Linux rescue doesn't work... won't find the linux partitions that are still there according to fdisk -l

View 7 Replies View Related







Copyrights 2005-15 www.BigResource.com, All rights reserved