Ubuntu Installation :: Unacceptable Write Performance Of Software Raid1 On Lucid Server?
May 20, 2010
Compared to my laptop notebook with a HD of 5400rpm, the write performance of raid1 on an ubuntu lucid server is unacceptable. In the begining, I installed ubuntu 9.04 server(alternate) using raid1 with two WD 1TB HDs of 7200rpm(Green Power) and then performed dist upgrade to 9.10 and then to 10.04.
I guess the write performance initially was reasonable since the installation and data migration(copy from another computer over LAN) didn't take too much time. However, after upgrading the server to 9.10 or so, I found large file upload through samba or ftp tends to block and time out. It is of no use whether to change the daemon or the client program so that I tried to test the read/write performance on the server to figure out the situation.
To my surprise, using strace I found even a simple program like cp would easily get blocked eventually in a write() system call for decades of seconds. Hence, I perform another disk writing test using dd for data size ranging from 50MB to 1GB. Performance test commands are listed as follows:
Quote: dd if=/dev/zero of=test.img count=[5|10|15|20|100] bs=10M
if the data to write is equal or fewer than 150MB, the command returns immediately at very hight speed but the raid disks starts to sync and busy so that the terminal prompt seems to freeze. I think this behavior is normal under the raid1 configuration, isn't it?
But when the data size is equal to 200MB, the test command blocks for seconds and the write speed is measured at about 16.6MB/s. Of course, the raid disk still starts to sync and busy afterwards. Next, I test writing with data of size 1GB. The command blocks so long for about 770 seconds(<2MB/s) while the same test runs for only 17.49 seconds(60MB/s) on my laptop.
I also burn a Lucid LiveCD to boot the server and mount the raid device to run the test again but the results remain similar. Does that means even I re-install the system on the raid, the problem never disappears?
PS: the disks run under the mode of UDMA6 without change.
View 2 Replies
ADVERTISEMENT
Nov 16, 2010
I wasn't sure where to post this question so administrators, feel free to move it.I have a media server I set up running Ubuntu 10.4 Server, and I set up a software raid 5 using 5 Western Digital Caviar Green 2TB 7200RPM 64MB drives. Individually they benchmark (using the Ubuntu's mdadm GUI (pali?somthing...) at about 100-120mb/s read write.I set the raid 5 up with a stripe size of 256kb, and then I waited the 20 hours it took to synchronize. My read speeds in raid are up to 480mb/s, but my write max is just under 60mb/s. I knew my write performance would be quite a bit lower than my read, but I was also expecting at least single drive performance. I have seen other people online with better results in software, but have been unable to achieve the results they have gotten.
My bonnie++ results are more or less identical (I used mkfs.ext4 and set the stride and stripe-width).The PC has 2048mb of RAM and a 2.93Ghz Dual Core Pentium (Core 2 Architecture), so I doubt think that's the bottle neck. These drives are on the P55 (P45*) South Bridge SATA controller.
View 7 Replies
View Related
Jan 5, 2011
I have recently migrated my file server over to a HP Microserver. The server has two 1TB disks, in a software RAID-1 array, using MDADM. When I migrated simply moved the mirrored disks over, from the old server Ubuntu 9.10 (server) to the new one 10.04.1 (server).I Have recently noticed that write speed to the RAID array is *VERY* slow. In the order of 1-2MB/s order of magnitude (more info below). Now obviously this is not optimal performance to say the least. I have checked a few things, CPU utilisation is not abnormal (<5%) nor is memory / swap. When I took a disk out and rebuilt the array, with only one disk (tried both) performance was as to be expected (write speed >~70MB/s) The read speed seems to be unaffected however!
I'm tempted to think that there is something funny going on with the storage subsystem, as copying from the single disk to the array is slower than creating a file from /dev/zero to the array using DD..Either way I can't try the array in another computer right now, so I though I was ask to see if people have seen anything like this!At the moment I'm not sure if it is something strange to do with having simply chucked the mirrored array into the new server, perhaps a different version of MDADM? I'm wondering if it's worth backing up and starting from scratch! Anyhow this has really got me scratching my head, and its a bit of a pain! Any help here would be awesome, e-cookies at the ready! Cheers
View 6 Replies
View Related
Mar 21, 2010
I just have a few questions about LVM and RAIDs. It seems they are basically the same thing. Is this correct? I can add two drives together on both of them and it appears as a larger drive, along with other setups like raid1 and raid5, etc.. And is there a difference in performance between them?
And my second question.. I know one is stripped and one is not, but is the performance between a raid1 and a raid0 the same? I've been told that raid1 is faster than raid0 because the data is written twice.. and therefore can be read from two different disks which equals faster read speed, but slower write speed since it writes to the two.
View 1 Replies
View Related
Feb 27, 2011
I've faced the problem with server freeze on heavy write.
System
CentOS 5.5 x64_86 with latest updates and kernel (2.6.18-194.32.1). Also tried 2.6.18-194.26.1 and 2.6.37-2 from ELRepo with the same results.
CPU: Intel(R) Core(TM) i7 CPU 920 @ 2.67GHz
Memory: 3 x 2Gb DDR3.
HDDs: 2 x Western Digital WDC WD1002FBYS-02A6B0
[Code].....
View 19 Replies
View Related
Sep 12, 2010
I've been having some problems copying files to USBs. If I'm copying a large (100MB+) amount of data, at random points the transfer will just stop for 30+ seconds before continuing. Sometimes it doesn't start up again at all. Consequently, the write speed drops to less than 1MB/sec, sometimes as low as 100 KB/sec. I do not have these problems on Windows 7, where I achieve speeds of ~16 MB/sec easily. I have had the same results with several USBs (2-32 GB) on several file systems (fat32, ext2) with several different computers running fully patched versions of Ubuntu 10.04, which suggests the problem is related to the way the OS accesses the hardware.
View 6 Replies
View Related
Sep 7, 2010
I'm currently experiencing some serious issues with WRITE performance on a RAID-1 array. I'm running Ubuntu 10.04 64 bit server with the latest updates. To evaluate the performance ran the following test: [URL]... (great article btw!) Using dd to measure, write performance is only at 8.7 MB/s. Read is great though at 74.5 MB/s. The tests were ran straight after rebooting and I have not (YET!) done any kernel tuning or customization, running the default server package of the Ubuntu kernel. Here's the motherboard in the server: [URL]... with a beta bios to support drives over 300GB.
[code]...
As you can see from the bo column there is definitely something stalling. As per top output, the %wa (waiting for i/o) is always around %75 however as per above, writes are stalling. CPU is basically idle all the time. Hard drives are quite new and smartctl (smartmontools) does not detect any faults.
View 4 Replies
View Related
Oct 27, 2010
So I have been doing some RAID 5 performance testing and am getting some bad write performance when configuring the RAID with an even number of drives. I'm running kernel 2.6.30 with software based RAID 5. This seems rather odd and doesn't make much since to me. For RAID 0 my performance consistently increases as I add more drives, but this is not the case for RAID 5. Does anyone know why I might be seeing lower performance when constructing my RAID 5 with 4 or 6 drives rather than 3 or 5?
View 2 Replies
View Related
Oct 27, 2010
I am experiencing disk write performance issues and I cannot find the cause. I have LSI-9211-8i SAS 2 controller (latest firmware), Centos 5.5 latest x86_64 kernel (2.6.18-194.17.4.el5 #1 SMP with latest LSI driver v. 7.00 datet Jul 27) and Seagate Cheetah ST3600057SS drives. These drives have a std write performance (sustained) of > 200MB/s (and read as well); with Fedora core 13 (same machine), issuing a dd if=/dev/zero of=/dev/sdo bs=1024k count=16384 (16 GB direct device write), gets normally to 213 MB/s (repeated retries). On Centos 5.5 I am getting speeds around 110/113 MB/s.
iostat does not show anything specific (just 1.3 % wait, CPU 99.7 idle).
There are 14 drives: tried with several of them, same figures. Reads go around 200 MB/s.
View 2 Replies
View Related
Sep 5, 2011
Currently running openSUSE 11.2.
Obtained the 11.3 and 11.4 DVD(s) and tried to run an upgrade/update via the DVD(s). Both generate an enormous list with "conflicts". It starts with the first screen with 3 conflicts and after the choices have been made the next screen shows up with an effectively unmanageable list of conflicts.Worse, the DVD upgrade procedures touch and change files on the system in the /etc directory without consent!
Decided to try to upgrade to 11.4 via zypper as described here:
SDB:System upgrade - openSUSE
The description is good, however the description does not even mention the possibility of "conflicts" that have to be resolved. The word "conflict" does not even appear on the page. It appears to me that these "tested" upgrades have been tried on a pristine 11.2 and a pristine 11.3! If so, it would be good to mention this!
After effectively wasting hours trying to resolve conflicts, searching through forums and Internet to find a solution the general impression is that "upgrade" although supposedly supported url does not ***REALLY*** work as seamless as pretended. Several posts on the forum suggest a clean install as "upgrades are quirky".Needless to say... Clean installs (even when all data remains in place) are unacceptable!
I have run openSUSE now for a number of years for desktop solutions. Within a version 11.0, 11.1, 11.2 YaST and zypper seem to perform well upgrading those versions. However, upgrading versions alike 11.0->11.1 has caused serious headaches and/or required complete reinstalls.
When I compare this to FreeBSD The FreeBSD Project, where through a described upgrade process of cvsup->build->install I have upgraded systems alike 5.2->5.3->5.4->6.2->6.3->6.4->7.2->7.3 without a hitch the upgrade solutions for openSUSE just do not cut it.
View 7 Replies
View Related
Jul 7, 2010
I have a dedicated server with Fasthosts. It's currently running Ubuntu Server 8.10 and I want to update it to 10.04.
The only issue I have so far is it runs Matrix Server Appliance 2.0-38
Does anyone know if this will be affected by the upgrade in a bad way?
I have had no luck finding a site for Matrix or any other information.
For the upgrade itself, I was hoping to run do-release-upgrade.
View 2 Replies
View Related
Aug 2, 2011
I have an Intel server, which has it's two SATA HDD's in "Intel Embedded Server RAID Technology 5.4" RAID1 volume. How to proceed with a system image in case two of those SATA HDD's fail at the same time? Should one take the first HDD of RAID1 volume, connect it to another machine and execute:
Code:
# ddrescue /dev/sda1 /media/External/image_of_first_hdd /media/External/log_of_first_hdd
* HDD from the problematic RAID1 volume would be recognised as /dev/sda1 behind new machine
* /media/External/ is a mount point for large external HDD in the new machine
* log_of_first_hdd would be the log file
..and then take the second HDD to another machine and execute:
Code:
# ddrescue /dev/sda1 /media/External/image_of_second_hdd /media/External/log_of_second_hdd
how to make system image using ddrescue in case disks are in "Intel Embedded Server RAID Technology 5.4" RAID1?
View 1 Replies
View Related
Dec 22, 2010
I just got a new PC with 2TB of HDD space and it's running Ubuntu 10.04.1 32bit. I have created a user for networking, called share and have created a folder within the home folder called public. I then shared the folder and gave 777 access to it as I want this to be public - but for my local network and my later for ssh access. I have installed samba, and under the sharing options I allowed for guest logins and people to write and delete from folder. SO how would I be able to "see" this from my windows machine? It's running XP pro and it has a domain other than workgroup - but that shouldn't affect it should it?
Also, the laptop with XP is on the wireless with and internal IP of 10.0.0.135 and my PC is on the LAN connection with and internal IP of 10.0.0.1 I'm sort of familiar with networks, but I have NO clue as to how to do this.
View 3 Replies
View Related
May 17, 2010
I am self teaching everything I need to develop a home-based web server (linux/apache/php/mysql/html/css/etc...) It's quite an undertaking, but not beyond my abilities. I thought this question could have gone in either the linux - software or linux - hardware forum, and certainly not in the n00b section, but I figured it's best be put in the linux - server forum, since that's what this is related to.
I have been looking into the software and hardware RAID solutions for linux because I wanted to make sure that the boot drive of the web server I set up is mirrored with transparent disk fail/replace/recovery. I mean, setting up a boot drive for RAID1 sounded perfectly logical to me, and why wouldn't it to anybody else? So, since I knew RAID controllers were expensive, I looked into the native software RAID support in linux. My findings have revealed an issue with software raiding a boot drive in not only linux but windows as well. Apparently, if the primary drive fails (not the mirror), you have no other option but to power down the system to properly replace the failed disk, reboot, play some config crap, resync the drive, do some more config crap, reboot again, and -hopefully- it'll be ok. Well, that procedure is simply out of the question since the idea behind RAID is to transparently proceed as if nothing happened.
I'd like to know if it's even possible to RAID1 the boot drive for transparent and automatic fail/hot-swap/recover WITHOUT rebooting the system and with no intervention on my part other then replacing the drive whether it be a software raid or hardware raid solution. Eventually, what I'd like to do for a drive configuration is have 3 RAID volumes on the server configured like so:
RAID volume 1 = boot drive w/ webserver installed
RAID volume 2 = database files
RAID volume 3 = flatfile storage
Each raid volume will be a RAID1 of a 1TB drive (total = 6 x 1TB drives)
I've seen a lot of people having failure issues with the software RAID in these forums. Is this more common than not? I'm certainly not opposed to buying a hardware RAID solution as long as they're reliable and provide transparent/automatic recovery. So what's the best way to RAID1 the boot drive for transparent/automatic failover?
View 4 Replies
View Related
Mar 31, 2011
I've 2 servers (xen1 and xen2 - their hostnames) with perversion configuration below: Each server have 4 SATA disks, 1 Tb each.
16 Gb ddr3
debian squeeze x64 installed:
root@xen2:~# uname -a
Linux xen2 2.6.32-5-xen-amd64 #1 SMP Wed Jan 12 05:46:49 UTC 2011 x86_64 GNU/Linux
Storage configuration: Former 256 Mb + 32 Gb of 2 of 4 disks are used as raid1 devices for /boot and swap respectively. The rest of space, 970 Gb on all 4 sata disks are used as raid10. There is LVM2 installed over that raid10. Volume group is named xenlvm (that servers are expected to use as xen 4.0.1 hosts, but the story is not about Xen troubles). / , /var, /home are located on logical volumes of small size (just found out I got mixed up with lv names and partitions, but that's not the problem, I think):
[Code]...
View 3 Replies
View Related
Aug 30, 2010
I want to install Ubuntu Server distro. First i downloaded ubuntu-10.04.1-server-amd64.iso and "burned" it to my usb-pen using UltraIso software for windows. That booted from the usb, but just after punshing in the language etc it complains that it cant find the cdrom or something like that. then i try the [url], but that wont boot at all with this same iso mentioned above. and burn it to a darn CD. it boots, but somewhere during the process it stops and asks for the same cd that is actually in the drive already. there is a thread about this here: [url] I then wanted to find an easy iso that i could throw on my usb-pen and install the whole thing through ftp like i did in the old days with floppies. but man, i got lost in the documentation with no clear path on how to do it.
View 1 Replies
View Related
Sep 9, 2009
I'm planning to setup a ubuntu file server. I'll be using the 8.04LTS server edition. the system is probably going to have 4 harddrives. at the end they shall form an software RAID10 system. I'd like to use lvm at some point in order to able to make snapshots as I read through some mdadm and lvm docu/tutorials I could think of two possible setups:
in both cases:
small raid1 of 2 partitions that will form /boot
small raid1 of 2 different partitions as swap space
1. the rest will form 2 large raid1, which will be combined to a single virtual drive via lvm
2. make a raid10 out of the rest with mdadm, then make a lvm volume group just consisting of the 1 virtual raid0 device are there pros/cons for either solution? is lvm as powerfull as mdadm in striping? will the first solution produce less overhead?
View 3 Replies
View Related
Apr 21, 2010
I installed a raid1 on a debian lenny box with only 1 drive "--raid-devices=1" because I didn't have the other drive yet. When I got the other drive, I used "mdadm --grow /dev/md0 --raid-devices=2" and "mdadm --manage /dev/md0 --add /dev/sdb1" The original drive is sda1. I watched /proc/mdstat until it was completely synced, and after a reboot, the system will not reassamble the raid. It fails with "mdadm: no devices found for /dev/md0" This is where root is, therefore, I get nowhere. From a rescue cd I can disable the other drive and shrink back down to 1 device and it boots fine.
View 1 Replies
View Related
Jul 25, 2011
how can I stop resyncing permenently & how can I check whether the normal sata HDDs can support RAID before/after buying HDDs. Because on every saturday or sunday resync is starting itself even there is no entry about resncing in crontab. But if I run "cat /proc/mdstat" it is showing RAID1 is perfect. see the below output
#cat /proc/mdstat
Personalities : [raid1]
md0 : active raid1 hdb1[1] hda1[0]
513984 blocks [2/2] [UU]
[code]....
View 5 Replies
View Related
Aug 9, 2010
Not sure on what is going on here. The server is RAID1 through hardware RAID. It was running an unusual high load so I rebooted it. Now it won't boot up. I am getting these errors after the CentOS boot screen:sda: Current [descriptor]: sense key: Medium ErrorAdd.Sense: Address mark not found for data field
end_request: I/O error, dev sda, sector 3040555357
device-mapper: raid1: A read failure occurred on a mirror device.
device-mapper: raid1: All sides of mirror have failed.
[code]....
View 10 Replies
View Related
Jun 1, 2010
I just tried to install with Ubuntu 10.04 AMD64 Alternate on RAID1 and Encryption but after reboot the screen just stays black.
my system is a AMD Athlon 64 X2 Dual Core 4200+ on a Abit AN-M2HD Motherboard, and 2 HDs each 250.1 GB
i split the HD into
* 50GB for /
* 200GB for /home
* 1GB for swap
all get a RAID1
/home is encrypted with passphrase (Twofish 256, cbc-essiv:sha256)
swap is encrypted with random (Blowfish 128, cbc-essiv:sha256)
where can i check RAID and hardware compatibility?
View 9 Replies
View Related
Oct 10, 2010
I just made a complete reinstall of my fileserver. After the installation the system cannot autostart my Raid1. For some reason it seams that only one of the identical disks are found by mdadm"disk utility" states "not running, partially assembled"If i immediately stop the raid in the disk utility I can restart it and mount it.some diagnosticsmdadm.confQuote:
# by default, scan all partitions (/proc/partitions) for MD superblocks.
# alternatively, specify devices to scan, using wildcards if desired.
DEVICE partitions
[code]....
View 1 Replies
View Related
May 6, 2010
I'm trying to install Lucid server (64 bit) and I'm having trouble getting it to boot from software RAID. The hardware is an old Gateway E-4610D (1.86GHz Core2 Duo, 2GB RAM, 2 500GB HDs).
If I install on a single HD, it works fine, but if I set up RAID1 as described here, the install completes fine, but on reboot this is what I get:
Code:
mount: mounting /dev/disk/by-uuid/***uuid snipped*** on /root failed: Invalid argument
mount: mounting /dev on /root/dev failed: No such file or directory
mount: mounting /sys on /root/sys failed: No such file or directory
[Code].....
When I set up the RAID using the ubuntu installer, I created identical main and swap partitions on each of the two drives (all four are set as primary), made sure the bootable flag was on on the two main partitions, then created a RAID1 out of the two main partitions, and another RAID1 out of the two swap partitions.
View 9 Replies
View Related
Apr 21, 2011
I'm trying to install 10.04 Server on an old Dell Poweredge 600SC I had lying around, and I'm having an issue with the installation. I can boot from the disk without any issues, I select a language for the installer, and I get to the main menu (Install Ubuntu Server, Check Disk for defects, Test Memory, etc). When I select Install Ubuntu Server, it waits a couple of seconds and then goes straight to a blank screen. No flashing cursor or anything.
I've tried some digging on the issue and another thread from a while back said to add "vga=771" to the installer line and when I did that, I got an error from my monitor itself complaining about an incompatible video mode.I know I'm not the only one who has had this issue, I just don't know how to address it. This is the first problem I've ever had on an installation.
View 2 Replies
View Related
Jan 7, 2011
We have the following server at collocation: [URL]
Provider's technicians were working for 3 hrs but finally were unable to set up hardware RAID1 on it.
What could prevent them from doing it? Is it difficult to set up RAID1? It is mentionned as basic function in specifications.
They said debian not booting after raid configured...
View 2 Replies
View Related
Mar 6, 2011
I am a college student (compSci) that moves around a lot with a laptop. I back it up often, but I dont want a simple usb hd that can be stolen from my dorm and/or damaged (its already been damaged). I am making a file server with RAID 1 that will sit at my parents house for safer backups. I just need a few pointers, I have never experimented with RAID before.
Software: Fedora 14 - Software RAID 1. I will only have ssh running on a port other than 22, behind a router, with keyed entry only so I can remotely backup my stuff.
Hardware: A new(ish) P4 mobo with two (2TB) hd's (for RAID 1) and one small hd for the OS.
My questions:
1) Should I have the OS installed on a separate drive or on the two RAID drives? I am using software RAID, not hardware, so I assume I need two external drives for the RAID.
2) Should I be using more then two hd's for a RAID 1 array?
3) How can I encrypt the RAID drives? As I said before, I have no experience with RAID.
4) If the OS drive fails, can I just grab a new hd and install Fedora on it to get the data off my RAID array? Or do I need to image the Fedora drive every so often?
5) If one of the RAID drives fail, is there some sort of daemon that can tell me? I will not be at my house physically, so I will not be able to hear scratching platters :P. Also, because the size of a single disk in the array is 2 TB, can I just go out and get any kind of 2 TB drive to replace the failed one?
6) If the MoBo fails, can I just pop in a new one (of any kind) and continue using my same array?
View 1 Replies
View Related
Jul 31, 2010
I just wanted to know if having my laptop set to ondemand, will this affect performance in any way? I realize it increases the clock speed to performance when the CPU is under load, but does the time it take to go from ondemand to performance affect speed? Will there be any noticeable difference between the two setups? I have a dual core intel at 2.2GHz when in performance. When ondemand is set with no load it downclocks to 800Mhz.
View 7 Replies
View Related
Sep 27, 2010
I recently set up an old desktop computer on my home network for use as a file server. I installed Ubuntu 10.04 Server on it and I'm slowly learning how to make it do what I want (I'm used to the GUI, so this is a bit of a jump for me).My plans are to put two 1.5TB hard drives in the computer (there's already a 160GB with the OS installed) and put them in a RAID1 configuration. This, as I understand it, will write all data to both drives, creating two identical drives. I'll only have 1.5TB total space for backup, but if one of the hard drives die, I can replace it without losing any data.
Hopefully I understand all that correctly. Now, my questions are how to actually set a RAID configuration up. I don't have a controller or anything, assuming I could do it off the two SATA ports in the motherboard (the 160GB is IDE) in software RAID.Once I have the two hard drives set up in RAID1, how do I allow the house to access the file storage?We're all on Windows 7 computers.If one of the hard drives fail, how will I know? Can I set it up so I receive some sort of notification? Also, how does the replacement process work; can I just pop the broken drive out and put a similar one in? Do I need to readjust any settings after replacing one?
View 9 Replies
View Related
Aug 1, 2011
I just installed Ubuntu server edition to my computer (brand new, no OS) and finished installation. In the terminal I used apt-get ubuntu-desktop to install a desktop interface.In my rig, I have two 500GB HDDs. I set them up through my computer BIOS as RAID1 drives, yet as I understand I still need to configure the Ubuntu software raid for it to work correctly. Unfortunately, I already partitioned my drives! I used the easy way (guided with LVM or whatever) and let it do it for me. Now, RAID1 is very important to me! Is there anyway to repartition the disks to use RAID1, or do I need to wipe my computer and reinstall Ubuntu?
View 5 Replies
View Related
May 2, 2010
When this happens you have to open a terminal, get the process id for mysql-server-5 then kill that process. Like this:
Code:
ps -A
then from the list of processes that it spits out look at the process id (the number at the beginning of the line) for mysql-server-5.
Now type
Code:
sudo kill -9 XXXXX
where XXXXX is the process id for mysql-server, and enter your password. The upgrade process should now resume.
View 1 Replies
View Related