Server :: VirtualBox - RAID5 - Iscsitarget - And Performance ?
Jun 8, 2010
I broke down and spent some $$ on a new server for home use. I mostly do technical research and testing, plus store movies and music. My interests are mainly in the IET iscsitarget performance.
Server system consists of an AMD Phenom II 550, 8GB RAM, 1x 80GB system partition, and a LVM-vg0 software raid5, running Ubuntu 10.04 server x64.
The vg0 consists of 3 x 500GB 7200RPM SATA drives (mdadm) sliced up with 100GB for VBox VMs, one slice is an iscsitarget for a Windows 2k3 server, and another slice iscsitarget for a desktop.
With this setup, the win2k3 server is booted from a .vdi image stored on the ext4 lvm raid5 vg0. Here are the DiskTT stats.
Code:
However, with the Win2k3 server and the MS iscsi initiator I get using DiskTT:
Code:
The speeds are incredibly slow considering a non iscsi connection is screaming fast in comparison. Any ideas?
All nics are 1GB.
Here is my ietd.conf
Code:
View 1 Replies
ADVERTISEMENT
Mar 5, 2010
I recently installed a new home backup server with Ubuntu 9.10 x86_64 using the alternate CD. I used the CD's installer to partition my disk and created a software RAID 5 array on 4 disks with no spares. The root file system is located outside the raid array.
At first the array performed nicely but as it started to fill up, the io performance dropped significantly to the point where I get a transfer rate of 1-2MB/s when writing!
[Code]...
View 9 Replies
View Related
Jul 3, 2011
I have set up a Linux software RAID5 on three hard drives and want to encrypt it with cryptsetup/LUKS. My tests showed that the encryption leads to a massive performance decrease that I cannot explain. The RAID5 is able to write 187 MB/s [1] without encryption. With encryption on top of it, write speed is down to about 40 MB/s.
The RAID has a chunk size of 512K and a write intent bitmap. I used -c aes-xts-plain -s 512 --align-payload=2048 as the parameters for cryptsetup luksFormat, so the payload should be aligned to 2048 blocks of 512 bytes (i.e., 1MB). cryptsetup luksDump shows a payload offset of 4096. So I think the alignment is correct and fits to the RAID chunk size.
The CPU is not the bottleneck, as it has hardware support for AES (aesni_intel). If I write on another drive (an SSD with LVM) that is also encrypted, I do have a write speed of 150 MB/s. top shows that the CPU usage is indeed very low, only the RAID5 xor takes 14%.
I also tried putting a filesystem (ext4) directly on the unencrypted RAID so see if the layering is problem. The filesystem decreases the performance a little bit as expected, but by far not that much (write speed varying, but > 100 MB/s).
Summary:
Disks + RAID5: good
Disks + RAID5 + ext4: good
Disks + RAID5 + encryption: bad
SSD + encryption + LVM + ext4: good
The read performance is not affected by the encryption, it is 207 MB/s without and 205 MB/s with encryption (also showing that CPU power is not the problem). What can I do to improve the write performance of the encrypted RAID?
[1] All speed measurements were done with several runs of dd if=/dev/zero of=DEV bs=100M count=100 (i.e., writing 10G in blocks of 100M).
Edit: If this helps: I'm using Ubuntu 11.04 64bit with Linux 2.6.38. Edit2: The performance stays approximately the same if I pass a block size of 4KB, 1MB or 10MB to dd.
View 1 Replies
View Related
Jan 9, 2010
I have no drive failures but just need to recreate a raid5 set as the next free MD disk number. Originally I built a temp OS of debian on a single drive and had 4x2TB drives in a raid5 software array (MD0) this worked fine and allowed me to move all data to it, and remove our old fileserver. I have now pulled out the 4 x 2TB Raid 5 drives and created a new OS on two new 80GB drives, partioned as follows,
MD0 is now 250mb Raid1 as /boot
MD1 is 4GB Raid1 Swap
MD2 is 76GB Raid1 as /
If I turn off and push back in the 4x2TB drives I cannot see a MD3. I presume I would need to create a MD3 from these 4 drives but I dont want to mess things up as its live data. So im here asking for help, or a bit of hand holding to get it done right.
PS - Its a Debian Lenny 5.0.3 Raid1 fresh install replacing a Debian Lenny 5.0.3 on a single disk.
View 2 Replies
View Related
Jan 7, 2010
I virtualized XP, and it's rather slow. I allocated 1.5 gb of ram, dynamically expanding storage. When I go to system in control panel, it says my processor is 880 mhz fast. I have an amd64 2.0 dual core.
View 1 Replies
View Related
Oct 15, 2010
I'm configuring a CentOS 5.5 2.6.18-194.17.1.el5.centos.plus server in order to have multiple VirtualMachines in it. The throughput of the machine is at least 300KBps (yes KB), I configured two web servers one on the virtual machine and the other in the physical machine, the difference was: 300bps-3 KBps on the virtual machine, 230KBps on the physical machine.
The configuration is as follows:
Code:
If I attach the public ip address to the virtual machine this gets smoothly.
View 1 Replies
View Related
Mar 14, 2010
I have desktop with DVD-RW drive that runs primarily on Linux (namely Ubuntu 9.10). My wife has netbook that rins Windows XP with no cd/dvd drive. There's also LAN through our ADSL modem/router. I've "ported" (actually, I've just grabbed sources and ran dpkg-buildpackage) iscsitarget package from Ubuntu Lucid to Karmic (here are packages), installed it (sudo aptitude install iscsitarget; sudo m-a a-i iscsitarget) and configured it in the following way (/etc/ietd.conf):
Target iqn.2020-01.local.develop7-desktop:storage.disc.dvdrw
Lun 0 Path=/dev/sr0,Type=blockio
#I've skipped commented lines
[Code]....
what's wrong with my config/iSCSI target/whatever else? Or, in short
View 1 Replies
View Related
Jun 14, 2011
I cant seem to get my RAID 5 (consisting of 8 1tb hard drives) assembled for some reason and I have no idea why and cant find any solutions online. Ill go ahead and show what my problem is:
here is all my hard drives:
Code:
server:~$ sudo fdisk -l
Disk /dev/sda: 10.2 GB, 10242892800 bytes
255 heads, 63 sectors/track, 1245 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x0004f041
[Code]....
So as you can see the array for those last four look fine however for the first four it marks the last four drives as faulty for some reason. I am kind of clueless to do from this point on honestly, I have data on this array that I'd really like to save.
View 3 Replies
View Related
Oct 29, 2010
I've had software RAID 5 arrays for a while now, so they were set up before a RAID array could be partitioned. I had two separate RAID 5 arrays on the same set of drives. One was for / and the other for /home. I moved the / to an SSD and figured I'd expand the other RAID array by failing a drive, repartitioning it then adding it back in. After repeating for the remaining drives, I could then expand the RAID array to use the full size of the drives.
Partway through the second drive being added back in, the RAID array stopped with a kernel error. The drive I was adding and another drive both showed as failed. I couldn't restart the array so I copied the failed drive (Seagate's SeaTools did show it as faulty, but without SMART being tripped) to a new one and tried again. dd_rescue reported the drive copied correctly but I still couldn't restart the array.
So I tried the old standby of recreating the array. This allows me to start it but the ext3 file system won't mount. So I then tried my script (listed in another thread) to try every combination of drives to assemble the array and mount the file system. Still no luck.
View 2 Replies
View Related
Mar 26, 2010
So here it is, I have a fileserver setup on Ubuntu Server 9.10 AMD64. In this system is 4 1.5TB SATAII drives. They are configured in RAID5 using MD. Now everything is working beautify, except when you need to create a directory. When you do, the system hangs for about 30 seconds. The I/O wait in top jumps up as well. Then the directory is created and everything works once again.
The odd part is it is only Directory creation that does this. I can copy, move, download and stream files off the server perfectly. I am baffeled as to what is causing it. It might be related to the fact that I expanded the array from 3 to 4 drives, it was after that, that I first noticed the problem.
View 2 Replies
View Related
Mar 10, 2010
For the troubleshooting of one server (having 73Gb 3HDD, Raid5 of 140Gb). When I check in the Array The Logical Vol Appears as One HDD not Online
0 HDD1
1 HDD2
2 HDD3
0 HDD not showing Online, When we set it for Oneline & save, After restarting it will go off.
View 1 Replies
View Related
Aug 11, 2010
how to recover A mounted RAID5 data???
View 5 Replies
View Related
Jun 30, 2011
I know you can fail and then remove a drive from a RAID5 array. This leaves the array in a degraded state.
How can you remove a drive and convert the array to just a regular, clean array?
View 9 Replies
View Related
Jul 20, 2010
I've got a new Ubuntu 10.04 server install with a new 3 disk RAID 5. The boot disk is separate, not part of the RAID. I was trying to practice what I would do if a disk died to recover the RAID, so I unplugged one of the three disks. The machine now just hangs on startup. It shows fsck at the top of the screen but doesn't got anywhere from there. If you press a key it shows the Ubuntu splash screen. If I plug the disk back in, everything boots up normally. So, my question is, how do I get the machine to boot with one of the RAID members missing? I know I can recover it using the Live CD, but it would be nice to be able to get back into the machine without the CD.
View 9 Replies
View Related
Dec 5, 2010
I'm a light linux user over the last couple of years and I decided to built a HTPC/NAS device.
Setup:
40gb ide -> usb boot drive
3x2tb sata (4k Sector) drives
I've got another 2tb identical drive but it's holding data that is going to be copied to the raid after it's up and running and then be 'grown' into the raid array to yield a final 5+tb array. I tried doing a disk util raid array and it ended up failing after reboot due to it using the /dev/sd* designations and they swapped. I have no idea how to do the UUID version, my googlefu and practical guide to ubuntu. So I decided to do it manually in order to also fix the sector issue as disk util wasn't formatting them correctly and once formatted wouldn't let me create a raid array from the discs.
[Code]....
View 9 Replies
View Related
Jun 8, 2010
I have a 2-quad core Intel Xeon system that I have set to RAID-5. I then attempted to install Ubuntu Server. When the message came up about enabling SATA RAID, I said NO because I have hardware RAID installed on the box. So I completed the install, and when I go to view the RAID configuration using the Intel Matrix Storage Manager during boot, it says:Volume0, Level: RAID5(Parity), Status: DegradedWhen I install enabling SATA RAID, I get a message asking me to "configure iSCSI volumes". When I click on that, I get another message: Loginto iSCSI targets. When I click on that I get another message: "Enter an IP address to scan for iSCSI targets". I have no idea what to put as thye iSCSI target portal address!
View 5 Replies
View Related
Oct 6, 2009
is there a way to set-up a file system, where you have multiple nodes (PC's) linked to one storage pool? ZFS seems to support this idea with multiple disks on one node, but could you connect multiple nodes in this manner?
View 3 Replies
View Related
Jun 17, 2011
I am currently looking for a file system that needs to be distributed over several nodes and need redundancy, like RAID5, and the ability to grow if needed, like LVM. Also not all nodes are going to be located in the same data center, but I guess that's not that important as long as the connection between DCs is sufficiently fast. I am currently looking at AFS, Coda, GFS and OCFS to see if they have what I need.
Edit: I just figured that it may be better to have the RAID5-like setup within one location, and have RAID1-like mirroring between the locations. That would probably better for performance, right?
View 2 Replies
View Related
Mar 23, 2010
I am setting up a new server and am in the midst of testing RAID. This is an Ubuntu 9.10 server. RAID1 (/dev/md1) is spread across 12 one-terabyte SCSI disks (/dev/sdi through /dev/sdt). It has four spares configured, each of which are also one-terabyte SCSI drives (/dev/sdu through /dev/sdx). I have been following the instructions on the Linux RAID Wiki ([URL]....
I have already tested the RAID successfully by using mdadm to set a drive faulty. Automatic failover to spare and reconstruction worked like a champ. I am now testing "Force fail by hardware". Specifically, I am following the advice, "Take the system down, unplug the disk, and boot it up again." Well, I did that, and the RAID fails to start. It outright refuses to start. It doesn't seem to notice that a drive is missing. Notably, all the drive letters shift up to fill in the space left by removing a drive. The test I did was to:
[code]....
Is removing a disk from the bus a reasonable test in the first place? Meaning, is this likely to happen in a production environment by other means than a human coming by and yanking out the drive? Meaning, is there a hardware failure that would replicate this event? Because, if so, then I don't know how to recover from it.
View 1 Replies
View Related
Jul 5, 2011
I have an Acer Altos EasyStore SATA NAS box that hung, the only way to reboot was to crash the system (unplug it). Upon reboot it was not recognising the hard drives (it wanted to do a destructive reinitialize). Most of the importent data was backed up, however some was overlooked and we'd quite like to get it back. Removing the disks and placing them in a PC with enough SATA bays to cope, and booting with a live linux distribution (System Rescue CD) I can see the 4 drives are not suffering hardware error and that the original partions exist. Using mdadm I can assemble the Arrays without error (seems to be three but the only one I am concerned with is the RAID5 array of about 3TB). /dev/m1p2 mounts as a loopdevice once an offset is entered. In turn this mounts as an XFS parition. However despite df showing the partition almost to be full. ls -l or ls -a on the mount point shows it to be empty!
I got thusfar using a translation from a German language forum, unfortunately I only speak a little German, and the only other English language post on a simlilar matter I found within that site had no replies. The next step was to unmount loop, then run xfs_chack and xfs_repair on the file system. xfs_check returns that there is are a few dir size and offset errors along with link count mismatches. This I would presume normal for a file system that has become slightly corrupted. xfs_repair (version 3.0.3) gets as far as Phase 3 it finds and corrects zerolength entries, offsets on directories and bogus inode numbers. However the final two lines are:
Code:
realloc failed in blkent_append (2671166480 bytes)
zsh: segmentation fault xfs_repair /dev/loop1
A search on the error missing out data size just returns code to generate it, is anybody able to explain what it means? Also remounting hard drive, ls and varients of still do not return anything. Am I missing some thing (root I am logged in with now would have different credentials presumably to root on the NAS box, so how do I get around this)?
View 5 Replies
View Related
Jun 7, 2011
I recently upgraded a server from Fedora 6 to Fedora 14. In addition to the main hard drive where the OS is installed, I have 3 1TB hard drives configured for RAID5 (via software). After the upgrade, I noticed one of the hard drives had been removed from the raid array. I tried to add it back with mdadm --add, but it just put it in as a spare. I figured I'd get back to it later.Then, when performing a reboot, the system could not mount the raid array at all. I removed it from the fstab so I could boot the system, and now I'm trying to get the raid array back up.
I ran the following:mdadm --create /dev/md0 --assume-clean --level=5 --chunk=64 --raid-devices=3 missing /dev/sdc1 /dev/sdd1I know my chunk size is 64k, and "missing" is for the drive that got kicked out of the array (/dev/sdb1).That seemed to work, and mdadm reports that the array is running "clean, degraded" with the missing drive.However, I can't mount the raid array. When I try:mount -t ext3 /dev/md0 /mnt/fooI get:
mount: wrong fs type, bad option, bad superblock on /dev/md0,
missing codepage or helper program, or other error
In some cases useful info is found in syslog - try
[code]....
View 1 Replies
View Related
Jul 2, 2010
Can anyone tell me in performance tunning of apache-tomcat and jboss application server?when I deploy some application in apache-tomcat the performance is say 100 users per second and incase of jboss it is even worst (35-40 users per second)i want to improve my performance 1000 uesrs per second..
View 1 Replies
View Related
Feb 25, 2009
I have a weird performance issue with a centos 5 running a nfs server and a rh8 client. I think the fact that it is rh8 client should be downplayed. It is just that with rh8 client the performance degradation seems more clear. See test details below OS in server is Centos 5 x86_64 kernel 2.6.18-92.1.22.el5
1Gb connection between machines File to test over NFS is a 1GB file. First of all I wanted to measure how the network alone performs while using NFS. So in the server side I run a "cat" command on the 1GB file to /dev/null. Please note that the disk read speed is about 98MBs. At this point the file system has the 1GB file cached in memory. In the client side a "cat" on the same file gives me a speed of about 113MBs. It seems then that the bottleneck in this instance is the network and it is very close to nominal speed. So the network performance is really good. (BTW I know that the server got that file from cache because a vmstat or iostat shows no disk activity.)
The second test is reading from disk with no caching involve. In the server I flushed the 1GB file from the memory. For instance by reading another 5GB file and I repeat the same thing as above in the client (a cat on the 1GB file). Now, the server has to go to disk.(vmstat or iostat shows the disk activity). However the performance, now, is about 20MBs, I was expecting something closer so 90MBs. (since the reading speed in the server in the first test showed 98MBs).
This second test was repeated for ext2, ext3, xfs with no significant differences. A similar test using a RH8 NFS server and client gets me close to 60MBs for a 1GB file not cache by the file system in the serverSince network speeds and disk read speeds are not the bottlenecks ... what or where is the limiting factor then?
View 4 Replies
View Related
Feb 4, 2010
On my local apache web server I had installed gnome desktop, because I wanted it to use as a TV. But when I installed the gnome desktop, my requests for web pages became terribly slow (4-5 seconds!). When I deinstalled the gnome desktop, the request where fast again. But I still want to watch TV on my server, so I wander if people know why the gnome desktop harms the performance of the server?
PS. with gnome desktop, ping was <1 ms, samba server worked like charm, wget localhost was <1 ms, but for some reason, when tried to get a webpage from my webserver to a remote machine, it took seriously 4-5 seconds to load a page.
View 4 Replies
View Related
Jul 31, 2010
I just wanted to know if having my laptop set to ondemand, will this affect performance in any way? I realize it increases the clock speed to performance when the CPU is under load, but does the time it take to go from ondemand to performance affect speed? Will there be any noticeable difference between the two setups? I have a dual core intel at 2.2GHz when in performance. When ondemand is set with no load it downclocks to 800Mhz.
View 7 Replies
View Related
Oct 2, 2010
I am hosting apache service on the CentOS5.4. I configure the Apache in default setting mostly. But keep getting complaints from others about the website download too slow, pdf cannot download at all, flash cannot play smoothly, etc.. But on my own machine, everything works fine. Is there any tool for analyzing this problem?
View 5 Replies
View Related
Jan 29, 2010
how much of a performance impact full disk encryption (say, AES 256-bit) has on disk-related activities? On one particular project I'm involved in I am trying to weigh out security vs performance issues.
View 1 Replies
View Related
Jan 4, 2011
I have installed a linux server, centos gui server with Raid1, his role will be only a file server. I installed samba and configured it. The file system is EXT3. the server got 4 gigs of memory.There is a program in windows that writes files to the share.I searched and i found that there is some commands that you add and they boost the performance.
I got complains that the writes are not fast enough. Before me another IT guy configured the file server and it was faster, what he told my customer that he changed some command of cache but i dont know exactly what he did. I have been asked to find how to boost the performance.Please give me more commands to try to boost the performance of Samba or tell me if i need to change anything..
View 2 Replies
View Related
Jun 22, 2010
Just want to know if solid state drive supported by slackware 13.1? Coz I want it to try to boost my server performance???
View 5 Replies
View Related
Feb 4, 2010
I am starting to get bottlenecks in the loading of webpages via squid. It is not the actual playback of video that has performance issues, this is very good. However, when a webpage is first requested, it is the initial response that takes more than a few seconds to load the page. I am wondering how to troubleshoot the issue as I don't know whether it is squid, the dns lookup, the number of users, RAM, or the bandwidth. Bandwidth seems to be the least likely since the server has a high bandwidth and video streaming appears to have no problems. I do not have caching turned on yet, which would certainly help because I do not want to cache flb, mp3, etc. files and the last time I turned on caching the performance was actually worse. The slow loading of pages has only just beguin to creep into the performance, it wasn't an issue before.
View 5 Replies
View Related
