Ubuntu Servers :: 64 Software Raid Speed And CPU Usage?
Dec 4, 2010
I am playing with my new 5 disk 2TB software RAID 5 setup and after I had a hard drop out, I deleted the RAID set and recreated it with only 4 drives. I am working on getting the other drive included by doing a grow. (I hope)
The RAID is now rebuilding and seems to average a write speed of around 87 meg/sec, with lows in the high 60's to highs in the mid 90's but mostly in the higher 80's. But it is only showing about 16% CPU usage and maybe a second usage of around 7%.
Is this normal? It seems low to me, but it is a a quad core 2.5 GHZ processor. Screen shots attached.Is it "normal" for software RAID to drop a drive? I thought that was only a hardware RAID issue. Coder68
View 1 Replies
ADVERTISEMENT
Feb 1, 2011
Could any RAID gurus kindly assist me on the following RAID-5 issue?I have an mdadm-created RAID5 array consisting of 4 discs. One of the discs was dropping out, so I decided to replace it. Somehow, this went terribly wrong and I succeeded in marking two of the drives as faulty, and the re-adding them as spare.
Now the array is (logically) no longer able to start:
mdadm: Not enough devices to start the array.Degraded and can't create RAID ,auto stop RAID [md1]
I was able to examine the disks though:
Code:
root@127.0.0.1:/etc# mdadm --examine /dev/sdb2
/dev/sdb2:
Magic : a92b4efc
Version : 00.90.00
code....
Code:
mdadm --create --assume-clean --level=5 --raid-devices=4 /dev/sda2 /dev/sdb2 /dev/sdc2 /dev/sdd2
As I don't want to ruin the maybe small chance I have left to rescue my data, I would like to hear the input of this wise community.
View 4 Replies
View Related
Jul 29, 2011
Trying to understand grep,sed,awk but maybe its too early for me and also i suspect iostat is not the correct program for exactly what i'm looking for...The goal is to print only the current read and write speeds of the disk, represented in a numerical value with two separated commands. So for example when writing a file to disk from an external disk, the value reflects the speed of the process.
"iostat -dk sda" prints
Code:
Linux 2.6.38 (Infidel) 07/30/2011 _x86_64_ (4 CPU)
[code]....
View 8 Replies
View Related
Mar 4, 2009
I'm trying to to determine the speed of my Raid Hot swappable disks. I need to determine if each disk is ether 10,000 rpm or 15000 rpm. I know that each disk is 72GB in size: I have tried to find this information ind/proc/diskinfo and using dmesg but no luck.
Hardware spec:
dl380 with P400 raid controller
/dev/cciss/c0d3: (Smart Array P400) RAID 1 Volume 0 status: OK.
/dev/cciss/c0d3: (Smart Array P400) RAID 1 Volume 1 status: OK.
/dev/cciss/c0d3: (Smart Array P400) RAID 1 Volume 2 status: OK.
/dev/cciss/c0d3: (Smart Array P400) RAID 1 Volume 3 status: OK.
[root@smstcatp11 cciss_vol_status-1.03]# df
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/cciss/c0d0p6 29134940 2806224 24848732 11% /
/dev/cciss/c0d1p1 59122668 20567660 34972516 38% /apps
/dev/cciss/c0d0p1 101086 11353 84514 12% /boot
/dev/cciss/c0d3p1 56616620 102716 53056720 1% /cdr
/dev/cciss/c0d3p2 2466732 61816 2279612 3% /home
/dev/cciss/c0d2p1 59122668 626432 54913744 2% /data
none 2073896 0 2073896 0% /dev/shm
/dev/cciss/c0d0p2 16516084 78820 15598272 1% /tmp
/dev/cciss/c0d0p3 16516084 198828 15478264 2% /var
View 2 Replies
View Related
Jan 5, 2011
I have recently migrated my file server over to a HP Microserver. The server has two 1TB disks, in a software RAID-1 array, using MDADM. When I migrated simply moved the mirrored disks over, from the old server Ubuntu 9.10 (server) to the new one 10.04.1 (server).I Have recently noticed that write speed to the RAID array is *VERY* slow. In the order of 1-2MB/s order of magnitude (more info below). Now obviously this is not optimal performance to say the least. I have checked a few things, CPU utilisation is not abnormal (<5%) nor is memory / swap. When I took a disk out and rebuilt the array, with only one disk (tried both) performance was as to be expected (write speed >~70MB/s) The read speed seems to be unaffected however!
I'm tempted to think that there is something funny going on with the storage subsystem, as copying from the single disk to the array is slower than creating a file from /dev/zero to the array using DD..Either way I can't try the array in another computer right now, so I though I was ask to see if people have seen anything like this!At the moment I'm not sure if it is something strange to do with having simply chucked the mirrored array into the new server, perhaps a different version of MDADM? I'm wondering if it's worth backing up and starting from scratch! Anyhow this has really got me scratching my head, and its a bit of a pain! Any help here would be awesome, e-cookies at the ready! Cheers
View 6 Replies
View Related
Jul 31, 2011
Have 4xSamsung F4 HDDs in an Ex503, Raid 05 - don't know how to format them to get maximum speed out of them. I've read [URL] tor_issues and other things but guess i am too dumb. Some claim using GPT Partition table and gparted and i shouldn't have any problems because it's automatically doing what i want, but i am not sure about that.
View 3 Replies
View Related
Apr 11, 2010
I want to install a ShoutCast Server on Ubuntu, but I coudn't decide qualities of the server. I am planning to have 5,000 listeners continuously with 32kbs bit-rate. How would be usage of CPU and RAM ? I have 99MBit bandwidth, I think it is enough.
View 2 Replies
View Related
May 6, 2011
i am learning to using ubuntu as my server and learning using vps too
now i getting consfuse about my server memory usage i just have 3 sites , 1 blog site and 2 company profile but apache memory usage is more than 300MB and total of memory use in my server is more than 500 MB (maximum 512MB burst memory)
i am using drupal for my website is this normal ? because in last week, memory consumption in my server no more than 380 MB
View 2 Replies
View Related
Nov 5, 2010
Is their from the CLI a way to test the internet speed between two servers?I'm thinking some sort of ping test that can calculate it or something.
View 2 Replies
View Related
Jan 18, 2010
i have a pc that is set up as a torrent slave / file server and media pc i want to set i up so that is goes in to suspend when there is no need for it to be on. I wnat it to wake at a set time to run a cron script for me, to check if there are any new torrents out, if there are , download an seed to till rtorrent auto stops the seeding (for me thats set at 1:1), then go back in to standby mode, if there are no active downloads then i want it to go back in to standby straight away.
as its also used as a file server, is there any way to have the shares still visable, with the pc in stand by, then when a user accesses it wake up the server, and if there is no activity after a set time out then go back in to standby. i would also like it to wol when i try to ssh in to it as a htpc is runns moovida, i would also like it to only go in to standby mode if i am not playing a video.
View 1 Replies
View Related
Jul 3, 2010
Is there something which can act as a fully fledged proxy (exactly like squid) but which can also monitor data usage?
At the moment what I do is I log data usage of IP addresses (allocated by DHCP) by using IPFM. Obviously getting a new IP address from a DHCP server isn't hard and this could be abused.
So I was thinking if I require proxy authentication and log usage that way, there is no way for anyone to abuse the system.
Does anyone know of a proxy server capable of logging data usage?
View 5 Replies
View Related
Aug 19, 2010
I am running latest apache2 available in the lucid repos on my desktop. All packages are updated as of this moment. Now in the root of my web server I have placed several soft links that point to folders on another ext3/ntfs partitions on the same disk. When I try to download any large file (say above 500M)on this server using firefox, when the 'save' window appears, my desktop freezes, I notice very high cpu-ram-disk usage, even though I have not yet clicked on 'ok' to save the file. This issue is not present when the file size is small. Note that firefox and the webserver are running on the same computer.
Also I have tried nginx and lighttpd and the issue is present there as well. When I tried downloading the same files using Internet Explorer 6.0 using a XP VM the issue is not present. However on Windows as well using Firefox the issue recurs.
View 3 Replies
View Related
Dec 13, 2010
I've just installed ubuntu 10.04 and the message text that shows when you ssh in shows the disk usage of /home.How do I get it to show the disk usage of the entire root / instead? (like it used to on some older version of ubuntu)
View 1 Replies
View Related
Jun 20, 2011
I'm monitoring all kind of things like ( Mem, network, cpu, IOPS,..) But still not found a command where i can see the CPU usage but in MHZ ( or Hz). Using top or looking into /proc/cpuinfo doesn't give me the info i want.
View 4 Replies
View Related
Dec 16, 2010
I'm deploying new ubuntu server which should act as a router. I've already set up the NAT for local network, and also did some shaping for different groups of users, but now I'm facing new problem.I need to make a scheduled URL filter. I know it's not a problem with cron and simple script, but maybe there is existing way to do that? And also, I need to make statistics on web-traffic. I need to have list of URLs visited by users (source ip, destination url). Is it possible with iptables? or with any other software but without using proxy servers.
View 9 Replies
View Related
Jan 18, 2010
Any command line tool to measure the network speed between my two linux servers without taking disk speed into account? My network is supposed to be 100Mb, but it doesn't feel like that so I wonder where the bottleneck is. The numbers that I see doesn't correlate well to that. So I'd like to know the speed network card to network card.
View 2 Replies
View Related
Mar 10, 2010
With three 1.5TB, 7200RPM drives in RAID0, they thrash. And yet the network out, 4 gigabit ports LAG'd together to create a single 4 gigabit connection, can't even push a single gigabit a second.
Here's what I've done so far:
I've enabled jumbo frames on the bond: ifconfig bond0 mtu 9000
Tweaked SAMBA performance:
Tweaked hdparm:
I haven't enabled jumbo frames on the switch but I'm almost sure that won't help me much after trying all this.
I'm running out of ideas here guys. The clients connected are pulling down images in both Ghost and WIM (ImageX) format. Large files too, upwards of 12 gigabytes.
View 6 Replies
View Related
Mar 16, 2010
Is there a way to limit the speed that apache will send a page to a specific computer in my LAN? I would like to be able to test what my pages would be like if they loaded at 25KB/s for example. My Server is 192.168.0.2 and the other 'browser' computer is 192.168.0.4.
View 3 Replies
View Related
Apr 7, 2009
top says there's only 12MB free (out of 1GB), but I can't figure out what's using all the RAM. rtorrent is using 13MB, and the rest are in bytes. (ran top as root)
[Code]...
View 13 Replies
View Related
Oct 15, 2009
Having major problems with mysqld causing CPU usage to rocket to 100% on one core for a short time, which usually drops back down again to 1-7%, though sometimes it can last an extended period of time. This is a problem because things using mysql become unresponsive in this time.
[Code]...
View 4 Replies
View Related
Dec 16, 2010
Is anyone here fluent with the usage of the .htaccess file? Is it the way to go to deter search bots or is there a better method? Never mind. I already have a thread about .htaccess here.
View 1 Replies
View Related
Jan 31, 2010
I was wondering why after a couple of days of my ubuntu server running, that it goes from starting off at 94mb of ram usage all the way up to 498mb of ram usage?
View 2 Replies
View Related
Feb 16, 2010
I am running Ubuntu 8.04LTS x64 on a Dell Poweredge 1900 with a Perc 5i RAID Controller. There are 3 500Gb SAS drives in a RAID 5 configuration. The Kernel is Linux dtpfs 2.6.24-27-server #1 SMP Wed Jan 27 23:39:33 UTC 2010 x86_64 GNU/Linux Approximately once every 1 - 2 months I have a problem where the disk usage starts to rise for no apparent reason. When I run df the usage grows steadily over 2-3 days from 26% to 100%. At this point Samba reports that the disks are full. Baobab does not report the additional usage and the tape backup ignores the 'extra' usage and just backs up what was previously there. When I reboot the machine the usage is set back to normal and we can continue.
View 2 Replies
View Related
Jun 27, 2010
Am using 10.04 and quite happy with the way it is working. my nephew and my mother have also switched to ubuntu.
To save on internet usage and load on the ubuntu servers, can i download upgrade files in one computer and then upgrade all systems?
View 3 Replies
View Related
Aug 20, 2010
Recently our houses internet usage has skyrocketed and i'm trying to keep an eye on it using bandwidthd (installed on the server). It installed fine and counts traffic fine, the problem is we have a server that hosts our music/movies/etc and when people pull music off the server it skews their bandwidth usage. I'm looking for a way to exclude all traffic on the local network and only count internet traffic. This is the filtering part of the config file
[Code]...
View 2 Replies
View Related
Mar 9, 2011
I've noticed this happening on some servers that I manage. I'll be downloading updates around 300 kb/s - 500 kb/s and then out of nowhere it will drop to about 3 kb/s. It will stay here forever, if I let it. I then have to cancel (Ctrl-C) the updates and restart them. This happens over and over and over until I finally get the full download. Why does this happen?
View 5 Replies
View Related
May 3, 2011
im on 10.10(desktop) and mdadm was v2.8.1 from 2008, very out of date so i tried 3.2.1 -> no change. mdadm raid1 read speeds are the same as single disk. note i used the tests in the disk utility benchmarking tool at first --these showed raid 5 atleast to be much better but when i tried dd reads raid5 dropped off with larger data to almost the same (slow) speed as raid1. compare:
[code]....
using two partitions will be enough to show raid1 performs at single disk speed. I dont really want to use a 4 disk raid0 just to get the read speed i should be able to get with raid1 as i dont really care about the size loss. I would of course use raid10 but i have found this suffers from the same problem (achieve same read speed as 2 disk stripe). So whilst im shocked others aren't reporting this, unless there is some obscure reason why my system would give these results i think raid1 in not behaving as it should.
View 6 Replies
View Related
Jul 18, 2011
Code:
$cat /proc/mdstat
Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5] [raid4] [raid10]
[code]....
1/4 of my drives died after about 3 years of usage. I replaced it with an identical drive and did a mdadm -add to re-add it to the array. I expected this to take quite a long time, but not more than 1 million minutes to complete!
View 5 Replies
View Related
Aug 2, 2011
I am upgrading my (as I call it) archive server. It is server used for archiving anything from user files, to images, backup data etc. lots of files of different sizes. It has 8 WD320RE disks in RAID5 for total little above 2T space. Disks were working perfectly good for 4 years. I will be replacing them with 8 WD2000RE disks in RAID-5, somewhere around 12T of usable space. I am currently using RaiserFS as file system, because it was hip at the time and as turned out once, when I had to copy data to other disk, is about 20% more efficient than ext3. I can save about 20% more data on Raiser. My question is. What file system do you suggest for using with new configuration considering that space is more valuable than speed.
View 1 Replies
View Related
Jan 7, 2010
how to Check the disk usage of different linux servers using df -h linux command. My host server is 66.50.100.1, I can check its disk usage by using df -h command. I got my disk usage. Now using my host server Im going to check the server 66.50.100.3 disk usage. Is its possible to check the disk usage of 66.50.100.3 using my host server?
View 4 Replies
View Related
