Debian :: Samsung F4 HDD Used In External Raid (Ex503) - Format Them To Get Maximum Speed Out Of Them?
Jul 31, 2011
Have 4xSamsung F4 HDDs in an Ex503, Raid 05 - don't know how to format them to get maximum speed out of them. I've read [URL] tor_issues and other things but guess i am too dumb. Some claim using GPT Partition table and gparted and i shouldn't have any problems because it's automatically doing what i want, but i am not sure about that.
With three 1.5TB, 7200RPM drives in RAID0, they thrash. And yet the network out, 4 gigabit ports LAG'd together to create a single 4 gigabit connection, can't even push a single gigabit a second.
Here's what I've done so far:
I've enabled jumbo frames on the bond: ifconfig bond0 mtu 9000
Tweaked SAMBA performance:
Tweaked hdparm:
I haven't enabled jumbo frames on the switch but I'm almost sure that won't help me much after trying all this.
I'm running out of ideas here guys. The clients connected are pulling down images in both Ghost and WIM (ImageX) format. Large files too, upwards of 12 gigabytes.
I have an AMD Athlon Regor 2.8 Ghz Dual Core CPU. About a month ago I overclocked the bad boy to 3.36 Ghz, on stock voltage. Since I have an AMD chip, I have the Cool and Quiet feature. With CnQ on, it never shows more than 2.8 Ghz (my stock speed), even on Full Load. However, with it off, it shows the correct 3360 Mhz all the time. I would like to keep CnQ, as well as my overclock. I've read in forums that it's okay to do that, that CnQ will automatically clock up to overclock when needed. But for me, with CnQ on, it only hits 2.8. Nothing more. Is this an Ubuntu problem? Is there a setting where I can change the maximum allowed speed of my CPU?
I am currently in process of remodeling my home file server and would like some advice. The server has two internal hard drives that are rather small (10-15G) and I've now ordered a larger 2 TB drive which for the time being will have to run as an external drive through USB 1 (going to be rather slow).
I'm probably going to put the OS and swap on one of the internal drives but I was wondering if there was a good option for increasing the system's performance by making the second internal drive act as a kind of buffer for the 2TB usb drive. I'd like both the advantages of the large size of the USB drive and the fast read/write speed of the internal drive. Would it be possible to put it together so all reads and writes to the fileserver would first go to the fast internal drive (or even better, to internal drive and USB drive at once, although I suppose RAID is not an option with USB attached storage), and would then be put to the large drive. It would also be nice if the most used files from the large USB drive would be cached on the internal drive for fast read speed. I understood that ZFS would help me accomplish something the like but as I understand, it's not that easily available on Linux.
The current plan is to make the large drive a simple XFS drive and build a small daemon on the server that would simply move all new files from the internal drive to the USB one, once they are not used but it would be nice to have a more low level solution.
i have external hard drive which will be used for windows and i have to format it. i tried with disk utility program but it tells me all the time device is busy. in terminal its too complicated for me.
Santa brought me an early Christmas present: a new External HD - Verbatim CLÖN - 250GBPlug it in and it works great. Problem is this: I do not use Windows at all just Debian Squeeze and this thing is formatted FAT32 - an ancient format.I would prefer EXT3 or maybe NTFS to be compatible with Windows "IF" there is a need (cousins etc).However as soon as I format it to NTFS or Ext3 it becomes "root" only.This is my HD, how can I format it and keep permissions for myself?
A friend suggested changing /etc/fuse.conf # Set the maximum number of FUSE mounts allowed to non-root users. # The default is 1000.
Have Lian Li Ex 503 External Raid System, using 4x2TB, using Raidmode 10 for good performance [ Just for those who are interested: http://www.lian-li.com/v2/en/product/pr ... ex=115&g=f ]
[Code]...
But using e-sata my transfer rates are very low (from internal drive to external ex503), around 60-70mb/sec But hdparm tells me:
I am about to purchase a new external hard drive which will be driven through the USB port. It will probably be a 1.0 TB drive from Frys/CompUSA/MicroCenter or some discount source. It will probably come formatted to run on a Windows machine and I intend this drive to be run only from my Linux laptop. I'd like to format it to be able to make the most of it from my Linux machine. Although re-formatting may not be absolutely necessary, as it probably will work "OK" just out of the box as is, how can I format it to get the maximum usage out of this new drive?
I am playing with my new 5 disk 2TB software RAID 5 setup and after I had a hard drop out, I deleted the RAID set and recreated it with only 4 drives. I am working on getting the other drive included by doing a grow. (I hope)
The RAID is now rebuilding and seems to average a write speed of around 87 meg/sec, with lows in the high 60's to highs in the mid 90's but mostly in the higher 80's. But it is only showing about 16% CPU usage and maybe a second usage of around 7%.
Is this normal? It seems low to me, but it is a a quad core 2.5 GHZ processor. Screen shots attached.Is it "normal" for software RAID to drop a drive? I thought that was only a hardware RAID issue. Coder68
I'm trying to to determine the speed of my Raid Hot swappable disks. I need to determine if each disk is ether 10,000 rpm or 15000 rpm. I know that each disk is 72GB in size: I have tried to find this information ind/proc/diskinfo and using dmesg but no luck.
I have recently migrated my file server over to a HP Microserver. The server has two 1TB disks, in a software RAID-1 array, using MDADM. When I migrated simply moved the mirrored disks over, from the old server Ubuntu 9.10 (server) to the new one 10.04.1 (server).I Have recently noticed that write speed to the RAID array is *VERY* slow. In the order of 1-2MB/s order of magnitude (more info below). Now obviously this is not optimal performance to say the least. I have checked a few things, CPU utilisation is not abnormal (<5%) nor is memory / swap. When I took a disk out and rebuilt the array, with only one disk (tried both) performance was as to be expected (write speed >~70MB/s) The read speed seems to be unaffected however!
I'm tempted to think that there is something funny going on with the storage subsystem, as copying from the single disk to the array is slower than creating a file from /dev/zero to the array using DD..Either way I can't try the array in another computer right now, so I though I was ask to see if people have seen anything like this!At the moment I'm not sure if it is something strange to do with having simply chucked the mirrored array into the new server, perhaps a different version of MDADM? I'm wondering if it's worth backing up and starting from scratch! Anyhow this has really got me scratching my head, and its a bit of a pain! Any help here would be awesome, e-cookies at the ready! Cheers
I have built a couple RAID's, but I'm uncertain of how I should format the partitions of the raid. Should I format partitions on each disk, and then add them to a raid, or should I create a raid on unformated disks and then format the raid as a partition? Does it matter, and are there performance/reliability issues? I'm creating a RAID-5 using 3 SATA disks on RHEL for user data area.
I have created a software raid 5 array which is currently sitting idle all space is unallocated. My plan was to use all 4.5 TB as a single partition for multimedia files. My problem is that I am trying to set up a file server acessible to windows systems al well as linux. Is there a file system I can use to partition this space that will geve me what I want?
I am finally, and happily ditching Windows IIS, SQL Server, and ASP in favor of LAMP. Not only will I save a bunch of money on operating systems but I've found php and MySQL development to be much faster than their Microsoft counterparts.Currently I have two W2008 and two Ubuntu servers running and doing virtually parallel tasks. I want to can the W2008 machines but I am not 100% sure of my Ubuntu mirrors.Everything seems to be working fine. I've copied tons of data back and forth as a primitive test but sometimes things work fine for all the wrong reasons. Here's where I get confused.
Question 1:Do I need to partition the RAID device (MD0) and then format it?From my experience this is necessary to get the device to mount.
Question 2:In this case was it also necessary to format the individual drive partitions?
Question 3:If I do a daily cat /proc/mdstat is this all I need to do to check the drive status.
Question 4:Is there any other check I can do to assure that the mirrors are created, mounted, and operating correctly?
I would like to format my new external hard drive (1.5TB) so it can be accessed on both Linux (Ubuntu) and OSX. Is that possible without using FAT system? If yes, what file system should I use?
I put a larger drive in my netbook and stuck the old in an external USB enclosure so I could use it for backups. It had three partitions on it, ntfs and linux so I deleted all the partitions and created one big linux partition. Every time I write and exit fdisk the removable disk utility in KDE pops up and says ntfs drive. If I ignore it and try to formatit wants to use ntfs, if I fsck.ext3 it saysThe superblock could not be read or does not describe a correct ext2filesystem. If the deviceis valid and it really contains an ext2filesystem (and not swap or ufs or something else), then the superblockis corrupt, and you might try running e2fsck with an alternate superblock:e2fsck -b 8193 <device>2fsck -b 8193 doesn't work either.It seems like its caching something, I can print the partition table and see the one linux partition I created.
My System Intel Core Duo E5300 Mobo - Gigabyte G31M-ES2L 1GB DDR2 800MHz RAM 4 x WD20EARS HDD I have been trying to install Fedora or Ubuntu for over a week. I thought it would take an hour and i would be away. I have been trying to install using the mdadm Software RAID feature. Everytime it takes about a day to format the drives and then i get an installation error. The drives state they are ready to use as is on any operating system other then WinXP, but this does not appear to be the case.
I am very new to Fedora... I have been doing some reading.[URL].. That information has been promising. I have been able to get into Fdisk off the live CD but i can't figure out how or if it is possible to do what i want it to.
Has anyone had any luck getting these drives to function correctly in a software RAID? I have had good luck with WD drives in the past and just assumed these drives would do what i wanted to but alas i have been proven wrong.
The partitions i wanted was... - A 2GB swap parition - A 10 GB RAID 1 partition for Fedora - The remaining space as a Raid 5 for files.
Am i just banging my head against a wall here, or is this possible.
I have just got a new external harddisk. I used it strait in window I copy some files on it. without formating it. Now when I use ubuntu it said that it is total only 10Giga, but the external harddisk is 1000 Giga. How come ? is htis because it has to be formated before ubuntu se the total size ?
I just bought a new 320gb laptop hard drive and mounted it into an external enclosure. The hard drive has never been formatted. I plugged it into my computer running Ubuntu 10.10 and nothing happens. I expected something toopup and say the drive has not been formatted and give me formatting choices. I looked in Places>Computer and it's not there. I even looked in Gparted and it does not show it. So how on earth do I format a new external hard drive?
I wanted to get started with Ubuntu so I partitioned an external hard drive with Ubuntu 11.04 onto it. After finding out my computer couldn't but up from a external hard drive I wanted to format my drive. When I plugged it into my computer, Windows would not recognize it. I then dual booted Ubuntu 11.04 onto my laptop and attached my drive. Ubuntu found it a recognized it as 3 separate disks. I then opened up disk utility and told it to format the drive. After clicking a couple "OKs" I got an error message: An error occured while performing an operation on "500 GB Hard Disk" (Seagate FreeAgent GoFlex): The device is busy I clicked details and got:One or more partitions are busy on /dev/sdb. I was wondering what I could do since it isn't doing anything in the first place. I just want to format the whole thing.
I have a Seagate external hard drive and I want to use it to back up my home server since it runs Ubuntu 6.10 and the upgrade to 10.10. My problem is that I am not able to format the drive to use it. I can not change the permissons or if I try to format I have all sorts of trouble. I have tried doing it on the home server running 6.10 and another pc running 10.10 and had no luck. Is there a better way? I have even tried chmod and chown with no luck.
I have a 250 GB external hard drive formatted with Windows NTFS file type.How do I format it to use linux and what file type is best. I'm done with Windows so that is not a concern.
I have an external 500GB USB drive that I want to sell. I've copied some stuff to it and practiced partitioning and formatting with it, but I want to use something to erase it completely. Is this possible if the USB is connected to a ThinkCentre 8187-EJU with an Ubuntu 10.04 OS? I've used Dban to erase regular hard disks but don't any software that could be installed on my computer that would erase a USB drive.
I got a new hard drive 2TB for extending the storage. I am working on fedora15 and would like to format the disk as a linux partition and external hard drive. me how to format this disk and partitioning!
and am running Ubuntu 9.04 version. My wife's USB flashdisk has picked up viruses from computers running Windows in her office. My quick solution is to format it (and external hard disks as well) in my machine.
can't find an answer for this here or elsewhere. I recently installed Ubuntu on my laptop with no problems...until now. I bought a Seagate portable drive for backup/extra storage purposes. When I plug in the drive and start up Disk Utility, it recognizes the Drive and whatnot, but when I click "Format Drive" I end up (after clicking through the warnings) with an error message stating:Error Formatting DriveAn error occurred while performing an operation on "640 GB Hard Disk" (Seagate Portable):The device is busyI clicked for details, which resulted in:One or more partitions are busy on /dev/sdb(Not that detailed, if you ask me.)I then entered the command line (a scary place for someone who came over from OSX) Code:sudo lshw -C diskgave me this info about the hard drive I'm trying to format:
I've got this hard drive that I know that is formatted to either ext3 or ext4, but I want to find out which format it is. I'm unfamiliar with many commands, I tried 'fdisk -l' but it didn't yield any useful information to me. Is there a command wherein I can easily find out the format of disks?