General :: Read - Writes Are Slow On NFS
Oct 23, 2010Read/writes are slow on NFS.How can we diagnosing the issue, what commands are used for the error finding
View 8 RepliesRead/writes are slow on NFS.How can we diagnosing the issue, what commands are used for the error finding
View 8 RepliesI have two ntfs partitions I use to store music and data. I've been using them in all my linux boxes without any problems. Simply use Ntfs-3g with noatime and everything works great.
However, since the update to OpenSuse 11.3 writing to my NTFS partitions takes FOREVER. I've specified noatime, relatime and norelatime successively without success. The partitions have plenty of space and are defragmented.
When copying large files, It starts fast at first, but in the last hundred MB it slows down to about 1.5MB/s. Even after the transfer is supposedly done, the HD led remains on and all other read/write activity involving the partition is completely halted.
This can take between 5 minutes to 10 or more depending on the size of the file. When copying several small files, (100 MB or less) it starts at about 1.5MB/s from the beginning.
I have the latest versions of fuse and ntfs-3g installed
I have a fileserver running 10.04 server 64bit and samba. I connect it to my desktop which is 10.04 desktop 64bit.I have the server mounted on my desktop in fstab as://10.0.0.2/share /media/share cifs guest, uid= 1000.Up until 30 June 2010 it was all fine. Now when I write the server it is very slow e.g. 2Mbps though when I read I get >100Mbps so I think my network is still ok. If i use nautilus smb://10.0.0.2/share I can write at >100Mbps and also read at >100Mbps...So any ideas why the write speed via the fstab mount samba has started to go really slowly in the last couple of days?
View 6 Replies View RelatedI have a 6 disk mdadm RAID 10 array of Western Digital RE3 drives. IOZone and all the other tools I have tried are showing pretty lackluster reads for a six drive RAID 10 array, in the area of 200MB/s. Writes are closer to what I'd expect in that area, around 340MB/s. These drives fly with an Adaptec RAID controller, but as soon as I stick them in an mdadm array, the reads just aren't what I'd expect.
I am using what I believe to be optimal settings:
-C /dev/md2 --chunk=1024 -n 6 -l 10 -p f2 /dev/sda5 /dev/sdb5 /dev/sdc5 /dev/sdd5 /dev/sde5 /dev/sdf5
-b 4096 -E stride=256,stripe-width=768
where to writes the commands if i am using fadora 11?
View 2 Replies View RelatedWe are graphing various system parameters using Cacti. One of our graphs shows hard drive reads and writes. A question came up: why do we need this graph?
View 3 Replies View RelatedIs there a way under linux to find out directory with frequent writes and/or deletes?
I'm using Ubuntu and recently bought SSD. I moved /tmp to ramdisk and did some other tweaks to avoid wear. But I was wondering if there's a way to pinpoint hotspots in filesystem where files are often written. For example webserver's log directory with many appends every minute or user's download directory where he downloads gigabytes of stuff only to be moved elsewhere soon after finishing.
I came across inotify which could probably do the trick but it seems it'd require lot of scripting which I'm not very familiar with
I hav Debian Sqeeze, and not knowing what I did, it suddenly starts to consider all pressing of e key as 0128. Also some other key, which I don't know currently. I use different layout, however it happens on others too.
View 2 Replies View RelatedIs there already a program that reads multiple pipes or file descriptors and writes to the standard output (not splitting lines).Like cat, but reading all files simultaneously and preserving lines.It is needed to avoid coding of select/epoll loops or using multithreading in simple programs. Like "select loop for bash".
View 1 Replies View RelatedI started a thread in the hardware section, but I've narrowed it down to being a software issue. The problem is that all USB devices are written to at about 1MB/s, and is read at equally slow speeds. After testing my computer on an older Ubuntu release (8.04 32bit), I verified it wasn't a hardware issue, because the read and write speeds were like they were supposed to be. Then, I downloaded the 32bit release of the Ubuntu version I'm currently using (an up-to-date version of Natty) and booted the live cd of it. It was equally slow there as well.
The read/write speeds are equally poor on openSUSE and Arch Linux, so I don't think that it's an issue with Ubuntu, as much as it seems like a kernel issue (or maybe not, you guys can correct me if it seems like it isn't ).
I set up software RAID 5 on three 7200rpm Seagate Barracudas (2x80GB, 1x40GB) with 40 GB partitions on the beginning of all three disks.Now, when I do benchmarks using the Disk Utility I get about 52 MB/s read speed on the array. This seems kinda slow considering the average read speed on each individual drive is about 48 MB/s. Also, boot up takes about 30 seconds, which is the same as when I had Ubuntu installed on just one of the 'cudas, without RAID. Now, I am I missing something? Shouldn't the read speed be more that twice as fast since it can read from all three disks?
View 1 Replies View RelatedI have a problem with speed of read/write operations (3Mb/s max)
Hardware - HP DL160.
CentOS 5.5 working on VMWare ESXi4.1.
R/W operations on CentOS 5.5 without ESXi - 60Mb/s
I am running Lenny. USB storage devices are painfully slow, if the data to be copied is above 4GB it works on transferring for more than half an hour and then comes up with an error dialog(saying something like file size is too big). The problem exists in both read and write.
I did google a bit and here is the output of lsmod | grep hci
ehci_hcd28428 0
uhci_hcd18672 0
usbcore118192 4 usb_storage,ehci_hcd,uhci_hcd
[Code].....
I am having a problem with my CentOS based server where the hard drive speeds are incredibly slow for both of the hard drives installed -
Code:
Timing cached reads: 16512 MB in 2.00 seconds = 8272.92 MB/sec
Timing buffered disk reads: 12 MB in 3.01 seconds = 3.98 MB/sec
I have looked around but do not understand the complexities of rebuilding kernel etc so would need some assistance. I have checked IO_support and it is set to 0
Code:
Here are the results for hardware installed after a quick lspci -v
Code:
If there are any noticeable incompatibilities here and how I could work to speed this up. I only have SSH access and could possibly get a KVM on it as it is currently locked up in a DataCenter.
I am new to Centos and linux in general. I have just got myself a Dell 1950 server with 2x 1T SATA2 hard disks in it. now the server comes with a PERC5i Raid card with 512Mb. Well I put these in raid 0 and the raid card initilzed the disks to 128 writeback and read ahead. When I loaded centos it did not recognize the dell layout so therefore wanted to initalize it again, so I done this as it wanted. Now I created a 80gb boot and o/s partition and a 100gb swap the rest was created into LVM space to run solus vmwear. But I found the raid 0 to be getting extreamly slow read and write speeds.
Example same disks
Desktop PC max 214mb/s windows vista 64
Server with centos 104mb/s
Now I am not sure but I am told that I need to align the o/s with the raid card settings but I have no idea how to do this. How to do this in plain easy step by step instructions. I mean how to calculate it, how to format the disk this way, and what files to edit where if needed. I have spent hours trying to figure out why my raid 0 is slower than a single disk.
I want my samba to keep my windows attributes exactly what the user setted in windows I mean if it has read only file in win box and copy it to samba share ,samba keep it read only and same for other attributes but it does not do it now with my configuration:Quote:
[global]
workgroup = DOMAIN
server string = File Server
[code]...
I have good experience in microsoft enviroment, now tiring to use linux, i tried Ubuntu 9.10, OpenSuse on different computers bur there is same big problem: Very slow download speed compared to microsoft.same file at same time downloaded by microsoft winxp toke incomparable short time. for example file 5.5MB attached to e-mail on Yahoo toke ~1minute to download on winxp computer,same file at same computer but with Ubuntu takes more thane 30minutes!
View 3 Replies View RelatedGNU/Linux kernel 2.6
MS Windows XP 5.1 (Service Pack 3)
I want to install windows XP but every time I do so I need several days to get linux running again. In linux I use lilo (don't remember the version no.), which I am familiarized with.how to fix the linux partition after I install xp
Hibernating windows 7 on dual-boot laptop (9.10 Ubuntu - W7) writes something on MBR which breaks GRUB2. GRUB2 does not load at all after hibernating W7 and the best solution is to reinstall GRUB with Ubuntu 9.10 cd, just follow the instructions at [URL]
View 4 Replies View RelatedIn RC 10.4 abcde still writes no tags. Sadly, I should say, since I've always used abcde for ripping CDs.
View 2 Replies View RelatedI'm seeing sustained disk writes of about 2 MB/s in the indicator-multiload indicator in Unity. I determined that it is writes on my 500GB HDD on /dev/sdb. This behaviour started after I used Gparted to create a single 500GB ext4 partition and also selected that it should be formatted to ext4 in Gparted.
Is this usual? It also survived a reboot.. I assume that it is the full formatting taking place in the background?
I saw no activity using pidstat or iotop. Only using vmstat -d revealed the writes.
Does Linux have a way to trace writes to a file?
For each write, I would like to know the time, date, process id, user, file position, byte count, and the data written.
I could use this with a script to replay the writes to a backup of the original file, and reproduce the file contents as they were at a point in time.
I'm using 9.10 Desktop 64bit on a Dell Latitude D830. I have 4 gigs of RAM and a 7200 rpm sata hard drive. Everything works pretty well, video, sound, and network. Flash isn't as smooth as in Windows but I assume that's a Flash/64bit thing and not necessarily an Ubuntu thing.
However, one area of performance still lags far behind my Windows XP experience, and that's disk writes. For instance, when I'm copying a large amount of information from a USB drive or from my Windows partition to my native partition, I can barely switch windows until the task is complete, nevermind trying to surf the Web. I thought that that might be related to the slow performance of the ntfs driver, but recently I have been doing a lot of work with VMWare, and I get the same result when trying to pause virtual machines - it writes a largish amount of information to disk in a short amount of time and I can't do much until it finishes.
Here are some things I looked at based on other threads to try to debug my issue:
~$ sudo hdparm /dev/sda
/dev/sda:
multcount = 8 (on)
IO_support = 1 (32-bit)
readonly = 0 (off)
readahead = 256 (on)
[Code].....
That disk read speed is a little faster than average - several more tests showed it hovering around the 66 MB/sec range. Of the other info, I see that UDMA is on which I understand is good, but if there is something else there that I should fix I don't see it.
I know that my computer can handle these tasks (at least the vmware stuff) without such a significant interface slowdown because in XP I did it with less RAM than I have now. Is this just the way that the linux kernel scheduler fails to account for UI needs?
System spec:
Core 2 Quad, Q6600, 2.4GHz OC'd to 3GHz
Asus Rampage Formula m/b
2x WD RE2 500GB HDDs ("linux boot" and "winxp boot")
1x Seagate Barracuda HDD ("boneyard")
4GB DDR2-800 RAM
Ubuntu 10.04 LTS
I'm having a really annoying problem with disc activity on my desktop system. Basically, if anything is writing a large amount of data to the hard drive (say, 10MB or over), the machine basically freezes solid. The mouse goes jittery (you move it and it takes a second then moves in one big leap).
For instance, if I try to image a USB hard drive to a file:
# dd if=/dev/sdh of=usbdrive_dump bs=1G
Effectively this works in two portions: it reads 1GB of data to RAM, then blats it out into a file. The machine is perfectly responsive while the USB drive is getting thrashed, but locks solid when the internal SATA drives are in use. Writing to USB HDDs doesn't seem to have the same effect -- I can copy 1GB files to/from them all day long and the machine is perfectly happy.
I'm working on a project using CentOs 5.3 that uses a solid state drive (SSD) as the boot device. It is desired to configure it such that writes do not typically occur run-time but configuration files can be saved. There are 2 reasons we do not want writes to occur run-time. 1) Writes will wear out a SSD over time. 2) A system disruption during a write can cause a file system error.
View 3 Replies View RelatedWhat are the possible problem when Windows access the file from Ubuntu got Read Only even though have a full permission to read, write and execute the file? Ubuntu to Ubuntu accessing the file there is no problem only Windows got a problem.
View 1 Replies View RelatedI have Fedora installed on a netbook. I customarily mount several NFS shares on this machine, from both a desktop system running F11 and a small server running FreeBSD. On the server side the shares are write-enabled. On the server side the shares are write-enabled. In the past this has worked fine.
However since upgrading to F12, my configuration no longer works as before. Reading from the NFS shares is no problem, but as soon as I try to write to one, either in Nautilus or from any other program, including on the cmd line, all hell breaks lose. Nautilus crashes, and I am unable to remount the shares. Usually rebooting the client is the my only recourse.
There are no clues in dmesg on either the client or the server. In terminal trying to remount a "trashed" share I see this:
Code:
$ sudo mount -v venus:/media/disk8 /media./disk8
mount: no type was given - I'll assume nfs because of the colon
mount.nfs: timeout set for Sat Feb 20 17:34:59 2010
mount.nfs: prog 100003, trying vers=3, prot=6
[Code].....
The NFS versions under F11, F12, and FreeBSD are the current ones (all updates applied).
I had the idea to cache writes to my nfs filesystem on my local hard drive.
It seems CacheFS exists to cache reads, but not writes to nfs.
I would imagine that if I could cache writes to my nfs on a local drive I could have a fast system, but keep all my files where I want them on my network.
I'm thinking about this because I am planning on buying a SSD, and I would imagine if I could set things up this way the system could be lightening fast while keeping things on the network. Currently if I copy a large file (hundreds of MB) it is quite slow, with an SSD and caching, I would imagine the copy could be very fast.
I run a website that a very steady flow of traffic and Im seeing recent issues that I just dont like. Server is 10.04.2 on a supermicro i7-950/6gb RAM with two 500gb Samsung F3 drives in a software RAID1 (1x5400, 1x7200) and for several weeks, its been running very well. Recently, Im seeing the server hang for 5-20 seconds. IOwait goes through the roof, nothing can write to the disk. Apache logs stop, redis fails to rebuild caches, mysql errors and then it continues and moves back to normal operation
/ is ext4, the kernel was 2.6.32-server-x64 but since updating to 2.6.38-server-x64, the issue has dropped from maybe once per 10 minutes to once per 15 minutes. 3 IOstat copy/pastes show this when it hangs.
Code:
Total DISK READ: 0.00 B/s | Total DISK WRITE: 0.00 B/s
TID PRIO USER DISK READ DISK WRITE SWAPIN IO> COMMAND
[code]...
No smart errors or smart diags show any issues with any of the disks and kernel.log shows near nothing other than a process hang, 120 seconds about 5 days ago.
like my alias a retired person, and Its never to late to learn something½ve just installed Ubuntu and found a tutorial online about bash-script.Manage some, but I cant to this one:[Write a script that makes file executable and writes a message that it has been done.If I run the command > <scriptName> <fileName> , then the file fileName should be executable and then it should indicate that fileName have been executable.]
Ive read man pages up-n-down and search the web, and I think I should let the script use chmod and ls -l, but I cant get the hole picture here. Actually I have nothing to show up, so I hope someone could help me with some ideas or a soloution - just to the how it should look.This is my first post, ever, at a forum like this, so please be nice if I didnt follow any rules here, I dont know if you even will answer this post, but at least give me some clues, a skeleton-code ti be based on