Ubuntu :: Very SLOW File Copy Speed (disk To Disk)
Mar 27, 2011
i have amd athlon x2 3gb RAM ddr2 two hdd one 80gb other 1tb in this computer i got only ubuntu all disk in EXT4.i want to copy 10gb many file of 700mb or 1gb ( many linux ISO )the transfer is 1mb/s this is SOOO SLOW.i did a touch /forcefsck just in case but nothing happen it is still slow!!what might be the problem ??
On a modern system--Lucid, SATA 3.0--does the location of a file on the physical disk make an appreciable difference to its access speed? If so, is there a (safe) way to put a file in a particular place on the disk?
I ask because I would like to reserve some space on disk to remain unused without messing with the partition table. My thought was to do this by using dd to create some large files (4 Gb each, or so) containing zeros.But obviously I would like to put them on the slowest part of the disk, as they won't be used for anything.
S.M.A.R.T.tells me my primary fedora drive has lots of bad blocks,so I ordered a used identical drive from ebay.I want to do the very basic process of making a full backup of my existing drive - so as to replace it with a more or less identical replacement. Logically identical - not necewsarily sector to sector identical.im not literate in unix and its children - and seem to find a plethora of descriptinos of how to do what I want to do. which is
1. format the drive - what you may call low level format - ie op sys independent.
2. create a partition system compatible with my existing disk.
3. copy everything from my existing disk to the new disk.
4. put existing disk on the shelf as a backup and start to use new disk.
I plan to reformat & reinstall my linux (centos).Before doing this, I got to backup my files into my USB external hard disk from Seagate (FreeAgent). The problem I faced is that I could not copy file into the hard disk even I was in root user. It prompted me that it is only read-only. I just wonder why.I have tested with my thumb drive. It worked. May I know why I could not copy file to the USB FreeAgent hard disk. Due to file system?
I have some issue with my amanda backup server, which is connecting with Scalar Quantum i500 via FC. I got the error as below 3 days ago. These dumps were to tape 000289. *** A TAPE ERROR OCCURRED: [No more writable valid tape found].
Normally I will load the proper tapes and run the amflush to push stuff from the holding disk to tapes manually. However this time amflush in this case did not help, Amanda immediately responded with an out of tape error again.
Meanwhile I got some errors from dmesg as well st3: Error 18 (sugg. bt 0x0, driver bt 0x0, host bt 0x0). scsi1 (0,3,0) : reservation conflict
In mi fstab file I mount a smb file server at boot. The code is: //<ip address>/data /home/eng-2/NAS smbfs credentials=/home/eng-2/.smbcredentials,dir_mode=0775,gid=1000,uid=1000 0 0 Transfer rate to the server is approx 100 KB/s Whilst transfer rate from the server 16 MB/s If I mount it from Places>connect to server. Both to and from speeds are 16 MB/s. Why is it so slow when mounted through fstab?
I am having a very weird problem, of which I have never heard before. The problem, shortly (I will give details in the following), is that the copy speed between the partition in which I am running my Fedora and another partition where I store backup data is 50K/s, which is extremely slow (it has been usually around 10M/s, almost 200 times faster).
My laptop is a HP Pavillion Dv7 2080 ep, in which I have two disks of 250G. One of the disks is partitioned between two operational systems, Fedora 14 64 and Windows 7 64, and the other disk contains the above referred partition where I store my backups (lets call it backup disk). The problem happens ONLY when I try to copy anything from my home in Fedora to the backup disk. I first thought it could be a problem in the backup disk. Then I login into the windows and made a copy of some AVI files (3G approx) to the backup disk, which went normally, within a few seconds, thus eliminating this possibility. I try therefore to make the inverse process, a copy from the backup disk into my home folder in Fedora. It went normally, copying 4 G also within few seconds, actually with an excellent speed of 50M/s. After searching in google, I saw some people also complaining of slow copy speed (although they had 7M/s, more than 100 times faster than what I have now), and one cause could be that the source file system (in my case the Fedora home folder) would be near its full capacity. I therefore eliminate everything that I could, around 15G, and now I have like 20G of free disk space, which I think is more than enough for everything. However, the problem persists. Some people also said that it could be the type of files and/or amount of data. I therefore tried several kinds of files (from raw data files to AVI and RMVB regular video files), and several amounts of data (from single files with a few Megas to folders with 20G) and in all cases I had the same unacceptably low copy speed of 50K/s.
It seems to be a problem in the software, caused by the updates, since until 10 days ago it was everything ok. However, I usually make the updates whenever they appear but make my backups much less frequently. Therefore I don't know for sure what has changed in Fedora through the updates since the last backup I made, when everything was working fine.
I have a 160GB harddrive which I installed a F12, would like to upgrade to a bigger drive, but I hate to have to re-install everything.
Recommend a good disk copy utility? The utility should be able to not only copy files, but boot sector and everything. So I just need to make a copy, change my BIOS to boot from the new drive and run everything as before.
Whenever I transfer a movie into my 16GB USB flash disk, my whole system becomes windows-like and unusable!
When i drag the file(s) into the USB disk folder, it starts out fine and pretty darn fast (25mb/sec) then slowly decreases until it's unbearably slow (3m/sec) and as a side effect my whole system starts deteriorating. I basically have to wait for the file to finish transferring before i can use my desktop again!
This has been happening with every version since Karmic (all 64bit)- I put up with it because I don't use the USB stick that much.. but lately it's been my go to source for transfering large files to/from work.
When i try to copy files from my samba server (Ubuntu 9.10) to my windows seven media center, the speed is extremely slow. So slow that is better to download 100mb file from the internet, than from my lan. And on my lan, every card and switch is at 1000 mbps speeds on cat5 cables. And from XP or other linux machine
I have what seems to be a hard disk Write speed problems with my first hard drive. Timing the cp command of a 700 Meg file takes about 8 secs from disk 2 to 3 but takes 25 minutes from disk 2 to disk 1.
Here are the details: Kubuntu 9.04 (Kernel 2.6.28-15-generic) Hard Disk 1 : /dev/sda (WDC WD2500KS-00MJB0) Partitioned /dev/sda1 ext3 / 10 Gigs /dev/sda2 extended 222 Gigs /dev/sda5 linux-swap 2 Gigs /dev/sda6 ext /home 220 Gigs
Hard Disk 2 : /dev/sdb (WDC WD2500AAKS-00F0A0) Partitioned : /dev/sdb1 ntfs 16 gigs /dev/sdb2 xfs /home/eric/data_drive 216 Gigs Hard Disk 2 : /dev/sdc (ST3500320AS) Partitioned: /dev/sdc1 xfs /home/eric/data_drive2 465 Gigs
By doing 'time cp ...sdb1/test.avi ...sdc1' takes about 8 seconds and same vice-versa. the command 'time cp ...sdb1/test.avi ...sdb1/test1.avi takes about 11 seconds and the same holds true if sdc1 is used But copy sdb1 or sdc1/test.avi to either sda1 or sda6 and it takes 25 minutes. Same problem if I copy from the same drive partition (sda). I have booted a livecd Knoppix 6.2 and the same problems happens.. So safe to say it's not Kubuntu. The only thing that is left to do is backup and reformat the partitions as XFS and try again. I also did a full smartcontrol Extended test and no errors. Checked all the various logs and nothing found.
How do I check my hard disk Revolutions Per Minute (RPM) speed from a Linux shell prompt without opening my server case? any other third party utility please let me know.Ieferenced some other articles. they give only model number, serial number and disk space.
I've recently updated my ubuntu lucid to maverick (32bit).However I noticed a strange issue at boot. My boot time is increased more than three times(tried to reprofile, but with no improvement) from 24s to 1.23min.After some bootcharting,I noticed that the disk utilization during maverick boot seems to be at 50% for most of the time and also the cpu seems to work at half speed for most of the time...My laptop is an asus m51sn, intel t8300, nvidia geforce 9500m gs, 3gb ram, 500Gb WD scorpio blue hdd.
im on 10.10(desktop) and mdadm was v2.8.1 from 2008, very out of date so i tried 3.2.1 -> no change. mdadm raid1 read speeds are the same as single disk. note i used the tests in the disk utility benchmarking tool at first --these showed raid 5 atleast to be much better but when i tried dd reads raid5 dropped off with larger data to almost the same (slow) speed as raid1. compare:
using two partitions will be enough to show raid1 performs at single disk speed. I dont really want to use a 4 disk raid0 just to get the read speed i should be able to get with raid1 as i dont really care about the size loss. I would of course use raid10 but i have found this suffers from the same problem (achieve same read speed as 2 disk stripe). So whilst im shocked others aren't reporting this, unless there is some obscure reason why my system would give these results i think raid1 in not behaving as it should.
Trying to understand grep,sed,awk but maybe its too early for me and also i suspect iostat is not the correct program for exactly what i'm looking for...The goal is to print only the current read and write speeds of the disk, represented in a numerical value with two separated commands. So for example when writing a file to disk from an external disk, the value reflects the speed of the process.
"iostat -dk sda" prints Code: Linux 2.6.38 (Infidel) 07/30/2011 _x86_64_ (4 CPU)
i have an old copy machine (canon gp225). the hard disk makes a whistling noise and i suppose it is just a question of time when it will bust.i do have some stone-aged computers here and i think i could use one of this hard disks as a replacement.how do i get the operating system (probably unix/linux or similar) plus the content of the boot sector plus the software on this new hard disk? i think if i could do a one-to-one copy i might have a chance that i could replace the old hard disk and it will work.
Does anyone know if this is possible? I am attempting to copy one "master" hard drive to two or more "destination" drives. I hope to use the DD command because the master drive is encrypted and I need to make exact copies to "destination" drives.
I have used dd if=/dev/sda of=/dev/sda and it works for one-to-one operations. I tried dd if=/dev/sda of=/dev/sdb of=/dev/sdc but the command skips the of=/dev/sdb and copies to sdc....I knew that was going to be too easy
My disk is very slow after I installed ubuntu 10.04 over my old 9.04. Doing some tinkering helped a little code...
But it is still far too slow. On the other version, I had a custom partition setup, with the home partition with 100GB, and ext3 (and other partitions for swap, boot, root folder and space for a windows partition I never cared to install ).
This time I am using a standard Lynx setup (2 partitions, the swap and the main one with almost 250Gb, using ext4).
Some applications I develop, that use disk for some unit tests, are now very slow to work with. Is there a way to making it faster? Going back to 9.04? Waiting for 10,10? Gparting and making partitions smaller on ext3? I don't know if any of these will work.
I spend the vast majority of my time in Ubuntu, but every so often I still encounter the odd errand that requires a free copy of Windows that came with my hardware.
So I have Windows 7 on my laptop which I like slightly better than XP and a whole lot better than Vista. I am not in there a lot besides that its required for a web design class and sometimes for a few stubborn games, but I would very much like to copy my Windows 7 partition to a 100gb partition on my TB HDD.
How do I do it? Keep in mind, I am barely two tiers above noob on a scale of 1 to 20. I am working on it though.
I also want this partition to be bootable. I dont care if I lose the rest of the data on the disk. I want to redo everything anyway. I definitely want it to boot though, not just for the data to exist.
I'm trying to clone a 2GB USB memory stick to another stick just like it (same size and brand). The src drive has three partitions, one fat, one ext2 and one encrypted (in that order). It also has an mbr. I create the clone using the following command:
Once it's done the mbr, the ext2 and the encrypted partitions seem fine, but the fat one is slightly modified on the clone. Here is a hex dump of the (broken) clones fat partition followed by a dump of the original partition.