Fedora :: File Transfers (cp, Mv And Rsync) Slow System Tremendously
Aug 24, 2011
When ever I transfer large files using cp, mv, rsync or dolphin the system will slow down to the point that it's unusable. It will sometime hang completely and not accept any input until the file is transferred. I have no clue what could be causing this problem but I know it shouldn't be happening.I am using Fedora 15 (2.6.40.3-0.fc15.x86_64) with KDE 4.6. have a Phenom II 955 processor, 6 GB of system ram and the OS and swap file is on an 80 GB SSD. Copying files in the SSD doesn't cause any problem, but moving files between my other two large HDDs causes the extreme slow down. Using htop I can see that my system load jumps to between 3 and 4, but my RAM and CPU usage stays low during the transfer. Here are two commands that take about 10 mins to run and make the system unusable while it's running. It usually transferring around 2-20GB worth of data during the transfers:
cp -a /media/data.1.5/backup/Minecraft/backups/* /media/data.0.5/backup/Minecraft/backups/
rsync -a /media/data.1.5/backup/ /media/data.0.5/backup/
/media/data.1.5/ is the mount point for a 1.5 TB internal SATA drive, and /media/data.0.5/ is the mount point for a 500 GB internal SATA drive.
View 6 Replies
ADVERTISEMENT
Oct 30, 2010
Has anyone else noticed that file transfers on Maverick are significantly slower than on Lucid? A review of Maverick on Tom's Hardware finds that it is considerably slower. My own test says: On 10.10, file copy between two NTFS drives maxes at 30 MBytes/s; on 10.04.1, the same operations clock in at 40 MBytes/s. Both drives are capable of rw speeds of 70-90 MBytes/s, which I got on WinXP, and hdparm's cached read results back that up.
why file transfers are so slow, and especially why Maverick is even slower than Lucid?
View 1 Replies
View Related
Jun 10, 2010
I have a server set up as an NFS share, and the share mounted on my laptop. Using linksys wireless g router and 15mb internet connection. Laptop is on wireless connection and server is wired.While transferring files from the laptop to the server I only get about 55kb/s. Is this normal for wireless g?
View 1 Replies
View Related
May 25, 2011
Has anyone else noticed that file transfers on Maverick are significantly slower than on Lucid? A review of Maverick on Tom's Hardware finds that it is considerably slower. My own test says: On 10.10, file copy between two NTFS drives maxes at 30 MBytes/s; on 10.04.1, the same operations clock in at 40 MBytes/s. Both drives are capable of rw speeds of 70-90 MBytes/s, which I got on WinXP, and hdparm's cached read results back that up. Any ideas why file transfers are so slow, and especially why Maverick is even slower than Lucid?
View 9 Replies
View Related
Feb 2, 2010
I am running Samba on a debian Lenny box on a wireless home network. I find that file transfers to the samba share are very slow. It takes over a minute to copy a 40MB file to the linux box, but only 20 seconds to copy the same file to a windows XP box on the same network.
Anyways, I could use a little direction on how to proceed with this, I'm really not sure where to start,
View 9 Replies
View Related
Nov 1, 2010
1. When I'm not logged into the server, only the shares are visible on my Windows computer. Clicking on the share folder displays an error message. As soon as I log in at the server, the files within the shares become accessible on the Windows box.
2. File transfers between the machines are extremely slow. Watching the system monitor, there's a brief burst of network activity followed by 10-30 seconds of nothing...on a gigabit network, the effective transfer rate is ~120kbs. There's no other network activity going on that would account for this behavior.
View 9 Replies
View Related
Nov 16, 2010
I just installed ubuntu as my primary OS, but I have the disk with XP on it and I don't want to go back, but I need faster network connectivity. I have a T60p with Intel Gigabit jacked into my Gigabit router which also has my desktop (running XP) and my NAS. If I FTP files from my NAS (or SCP), I get transfer speeds around 250-500 KB/s (which is not very fast). On this same switch, from my XP desktop I get transfer speeds around 12 MB/s. I get the same speeds using my 802.11n card (Atheros) as with the ethernet NIC (250-500 KB/s).The drivers for the ethernet card and the atheros card are e1000e and ath9k respectively.I have disabled IPv6. Since the problem occurs using either interface, I am just going to concentrate on fixing it for the Ethernet interface (since I believe it to be a systemwide problem).
Code:
skinnersbane@albert:~$ sudo ethtool eth0
Settings for eth0:
Supported ports: [ TP ]
Supported link modes: 10baseT/Half 10baseT/Full
[code]....
Clearly my card is running at Gigabit, but why the bad transfer speeds? I am using filezilla for FTP (technically FTPES). I closed every other program. My CPU utilization does seem high and I wonder if this is part of the problem. I had no problems with throughput using either interface in Windows XP just one week ago.
View 1 Replies
View Related
Mar 21, 2011
As an example, I have two servers, sm-i222 and fileserv. sm-i222 is a Win2k3 system running cygwin. fileserv is a linux box running RHEL 4.7. sm-i222 maps /cygdrive/c to the c: drive and /cygdrive/d maps to the d: drive(actually a single 4TB RAID). from the sm-i222 server /cygdrive/c I call a small script from the crontab. The internal IP for fileserv is 10.0.0.7. See below.
cd /cygdrive/d/fileserv/home
rm -rf /cygdrive/d/fileserv/home/*
rsync -avz -e 'ssh -c blowfish' root@10.0.0.7:/home/* .
These three lines perform well in that they make a full transfer of the fileserv:/home/ directory on fileserv to the appropriate place on sm-i222 using rsync. I use rsync instead of scp because I have to traverse subdirectories and symbolic links in the /home/... filesystem on fileserv. What I'm looking to do is use rsync to do an incremental transfer/backup of only the files that have changed since the last full backup. I'll manage the times I do this manually or in crontab. A colleague says this is do-able, but not how. Rsync.org says this is do-able but not how. Cygwin says this is do-able... see rsync.org. I believe what I'm looking for is a single rsync line like I have above that only transfers the changed files on fileserv to sm-i222.
View 14 Replies
View Related
May 31, 2011
I am transferring 80gb of files from my computers hard drive to an external drive and while the speed should around 25mb/s, it's going at exactly 1mb/s. Ubuntu 11.04 64-bit on a Mac Mini, 8gb RAM.
View 9 Replies
View Related
Nov 21, 2010
With Ubuntu 10.10 server installed on an
- AMD Athlon II X2 235E CPU AM3
- 2GB DDR3
Installed on a software raid 1 of 16 GB usb sticks that can sustain 24MB/s read and 13MB/s write rates
running
- ssh
- zfs-fuse installed from apt
- samba
With the zfs using the sata II controller, with a 2TB, 1.5TB and 500GB in a raidz1 (I know, it's uneven, I'll be changing them all to 2TB once I get the data off those drives).
However I'm experiencing a REALLY REALLY exceptionally slow zfs performance of only 600KB/s transfer rate even when using the command:
To test. CPU usage is only at 25% (with dedup=on) however I notice that the usb sticks are regularly transferring data during this write to the zfs pool. Also when doing a zpool scrub it completes 9.6GB of scrubbing in well under 2 minutes. Admittedly it shouldn't actually be doing much as no data was changed by me while the 3rd drive was unavailable.
I'm thinking that there is some data being temporarily saved to the main system drive (usb sticks) and then transferred to the pool, and this is causing a bottle neck. Note both 16gb usb sticks are plugged in to the same usb 2 host controller, but the combined write bandwidth of those sticks is not enough to saturate a usb2 bus.
How to track down this bottle neck?
View 3 Replies
View Related
Apr 14, 2009
I am having a problem with slow data transfers with both Samba and scp. I have gigabit NIC's on both all three machines that I am transferring to and from, connected to a gigabit switch. My data transfers under both smb and scp average around 21 MBit/s, (I am using nload to monitor transfer speeds).The machines are configured as follows,1) desktop
AMD Athlon 64 X2 6000+
6 gig Corsair memory
Realtek RTL8168C(P) gigabit NIC (on board)
[code]....
View 2 Replies
View Related
Nov 25, 2009
What file system should I use to partition a slow and old hard drive? I know that ext2 was best for old computers which mine is not but I am using an old hard drive for extra storage and I was curious if anyone knew if using ext2 or ext4 would show any performance differences.
View 4 Replies
View Related
Jan 4, 2011
I regularly rsync directories to an external usb drive. Recently I've started getting errors which look:
blah blah:Read-only file system (30)
The external usb drive has two partitions (ext3 and fat32) and I rsync to the ext3 one. The rsync command is
rsync -ahi --delete /home/mike/some_dir /media/usb_drive
People have reported this error with faulty usb cables but everything was working fine until recently so it seem unlikely a usb cable would suddenly wear off.
View 6 Replies
View Related
Aug 1, 2010
I recently built a home media server and decided on Ubuntu 10.04. Everything is running well except when I try to transfer my media collection from other PCs where it's backed up to the new machine. Here's my build and various situations:
Intel D945GSEJT w/ Atom N270 CPU
2GB DDR2 SO-DIMM (this board uses laptop chipset)
External 60W AC adapter in lieu of internal PSU
133x CompactFlash -> IDE adapter for OS installation
2(x) Samsung EcoGreen 5400rpm 1.5TB HDDs formatted for Ext4
Situation 1: Transferring 200+GB of files from an old P4-based system over gigabit LAN. Files transferred at 20MBps (megabytes, so there's no confusion). Took all night but the files got there with no problem. I thought the speed was a little slow, but didn't know what to expect from this new, low-power machine.
Situation 2: Transferring ~500GB of videos from a modern gaming rig (i7, 6GB of RAM, running Windows7, etc etc). These files transfer at 70MBps. I was quite impressed with the speed, but after about 30-45 minutes I came back to find that Ubuntu had hung completely.
I try again. Same thing. Ubuntu hangs after a few minutes of transferring at this speed. It seems completely random. I've taken to transferring a few folders at a time (10GB or so) and so far it has hung once and been fine the other three times.Now, I have my network MTU set from automatic to 9000. Could this cause Ubuntu to hang like this? When I say hang I mean it freezes completely requiring a reboot. The cursor stops blinking in a text field, the mouse is no longer responsive, etc.
View 4 Replies
View Related
Jul 19, 2010
I need to transfer 330G of data from a hard drive in my workstation to my NAS device. The entire network is gigabit and being run with new HP procurve switches. All machines have static IP addresses. The NAS is a Buffalo Terastation PRO which has the latest firmware, is set to jumbo frames, and has just been upgraded with 4 brand new 500G drives giving us a 1.4TB raid 5 setup. My workstation is a dual Quad core xeon box running on an Intel S5000XVN board with 8G of ram. My OS is Ubuntu 10.04 x64 running on a pair of Intel X25 SSDs in a raid mirror. The data drive is a 500G SATA drive connected to my onboard controller. The file system on the SATA drive is XFS. This problem was ongoing before I got my new workstation, before we had the GB switches, and before the NAS got new drives. When I transfer a small file or folder (less than 500M) it reaches speeds of 10-11 MB/sec. When I transfer a file or folder larger than that the speed slows to a crawl (less than 2MB/sec). It has always been this way with this NAS. Changing to jumbo frames speeds up the small transfers but makes little difference in the big ones. I verified with HP that the switches are jumbo frame capable.
View 2 Replies
View Related
Jul 11, 2011
I tried using ssh between my netbook and desktop, but it was going to take around 30 hours to transfer 39GB over the home network. Also SSH is very sketchy and often drops connections.I've been messing with it all day and I'm quite frustrated.What I'm looking to do is use my netbook as more of a primary computer and the desktop as a storage computer. Not quite a server, because I'd like to still keep a GUI on it. I'd like to be able to keep my music and movies on the desktop and stream them to the netbook (SSH sucks for this, always drops connections). I've already set up the web client for Transmission bit torrent client so I can torrent on a machine that's almost always on and connected.
Is there a better setup for all of this? I like the netbook because of the portability; I like the desktop because it's always connected (for torrents) and it has a larger storage capacity. It would be mainly used around the house. I would like to back up a file or two while abroad, but I'm not looking to stream music while I'm across town or anything.
View 2 Replies
View Related
May 20, 2010
after successfully configuring the dwa-552 to work in master mode in ubuntu 10.04 (ath9k driver) I ran some file transfer tests. The download speed is very good (~50mbps) but the upload speed spikes at about 10-20mbps for the first few KB and then it's nonexistent (0-1kbps). This only affects file transfers or otherwise bandwidth consuming processes. Normal web browsing or ssh is not affected. After running a speedtest of my internet connection which is routed through the AP I could upload to the internet with 1mbps which is my inet connection maximum so apparently this is not affected. Tried the same file transfers with netcat to eliminate any other factors and had the same problem. dmesg and hostapd debug did not report anything unusual
View 2 Replies
View Related
Mar 1, 2010
I have Ubuntu on both my laptop and desktop machines, both are connected to the same network. I back up the laptop to the desktop by running the following on the laptop:
rsync -avv --stats /home/alisdt alisdt@xxx.xxx.xxx.xxx:/home/alisdt/laptop_backup (with the IP address of the desktop instead of the many x, obviously). Whenever rsync hits a large file (greater than a few MB), the network use rapidly drops to ~60KB/s (that's kilobytes not bits). When I copy the same file to the same place using scp, I get > 500KB/s throughout the transfer. Things I've tried:
* mounting the desktop home dir on the laptop using SSHFS -- a simple file copy is fast, rsync is still slow
* ditto with NFS
* rsync --whole-file option, in case the delta-transfer algorithm was choking on large files
* rsync --inplace option
* HPN-SSH (http://www.psc.edu/networking/projects/hpn-ssh/) to enable dynamic window and unencrypted bulk transfer, just in case it was some ssh bottleneck I think it's either an rsync application problem, or a network problem that is only affecting rsync. Any ideas, or other ideas of what I can try to debug? In case it's relevant, I'm using 9.04 on both machines. (A standing bug prevents me from upgrading the laptop, and I haven't bothered to upgrade the desktop).
View 3 Replies
View Related
May 4, 2011
Long story short, I have a failing RAID3 array which is showing file corrupted blocks (and the RAID controller card is periodically not initializing). [URL].. I thought I had robust backups but as it turns out, my backup volumes seem to have been misplaced (don't ask ) so I have no viable backups. I'm trying to back up as much as I can before the inevitable impending catastrophic failure.
I must be doing something wrong because running rsync on my Unix FreeBSD/FreeNAS server (syncing to local USB drive) is really slooooow. Below you will see an example. A 500MB file took almost 10 minutes to sync to a local USB drive! I can FTP this file in a few minutes over my LAN.
Just ran a test and it took 20 seconds to FTP this file across my gigabit LAN where rsync took 10 minutes to perform a local copy)
[Code]...
View 9 Replies
View Related
Jan 30, 2016
So I have a GoFlex NAS driver, which according the specs has a theoretical maximum performance of 100 MB [URL] .....
I connected by ehternet to my PC (GNU/Linux, Debian 8 ) to do a backup.
I mounted it with cifs:
Code: Select allmount -t cifs "//goflexhome.local/GoFlex Home Personal" /mnt/gf/per/ -o credentials=/root/gfpass,uid=1000,gid=1000
And then tried rsyncing my home folder.
Code:
Select allDIR=/home
BACKUP_FILE=/mnt/gf/per/bck2016/
FLAGS=" --archive --one-file-system --acls --xattrs --numeric-ids --fake-super --progress --human-readable --ignore-existing --log-file="backup.log" "
FLAGS+=" ${DIRS} ${BACKUP_FILE}"
rsync ${FLAGS}
I then used iptraf to check the performance and I get miserable results (from the PC), even below 1 MB:
total 74.7 kbits
in 30.4 kbits
out 48.5 kbist
View 0 Replies
View Related
Dec 7, 2010
This is a recent problem, and I can't pinpoint any change/upgrade that would cause this. Rsync transfer from Client to Server:
sent 11756196 bytes received 1032741 bytes 138258.78 bytes/sec
total size is 144333466390 speedup is 11285.81
Pinging back and forth from each machine is fine. No Ifconfig errors Client, but Server has RX packet errors.
eth0
Link encap:Ethernet HWaddr 00:11:25:37:ee:44
inet addr:192.168.1.101 Bcast:192.168.1.255 Mask:255.255.255.0
inet6 addr: fe80::211:25ff:fe37:ee44/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:41786 errors:2157 dropped:0 overruns:0 frame:2157
TX packets:34138 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:55615449 (55.6 MB) TX bytes:4737538 (4.7 MB)
What's the next step?
View 3 Replies
View Related
Apr 17, 2011
Whenever I transfer a movie into my 16GB USB flash disk, my whole system becomes windows-like and unusable!
When i drag the file(s) into the USB disk folder, it starts out fine and pretty darn fast (25mb/sec) then slowly decreases until it's unbearably slow (3m/sec) and as a side effect my whole system starts deteriorating. I basically have to wait for the file to finish transferring before i can use my desktop again!
This has been happening with every version since Karmic (all 64bit)- I put up with it because I don't use the USB stick that much.. but lately it's been my go to source for transfering large files to/from work.
View 3 Replies
View Related
Oct 4, 2010
My system went for three days w/o a software update... Is this normal(anyone experiencing this?)...?
It seems like to me.. Fedora 13 has a longer update interval than Fedora 12.. I remember back in Fedora 12 I get security updates like every other 12 hrs.. (I know as with security patches the less the "better"(in some way))..
But I am still concerned.. security updates has been slow for me.
View 3 Replies
View Related
Apr 28, 2011
I am currently running Fedora 14 on an x86_64 system that acts as a whole house server for named, dhcp, nfs, nis, htpp, samba, etcMy issue has existed for a few years and I am just now getting around to posting about it.I have a simple samba configuration for sharing files to a windows VM on another box.Here is the config:
[global]
workgroup = NERD
server string = Samba Server on NERD
[code]....
View 7 Replies
View Related
Dec 9, 2009
I installed Fedora 12, 64 bit on my Dell Latitude D820 laptop with Core2 Duo processor(7200 speed) and 2 gigabyte Memory.
I have updated the yum. I have enabled the rpm repositories.
It is very weird that my system suddenly works very slowly and hangs. every time I login after a while the CPU usage goes up to the end with out any reason!
Before this I had installed Fedora 12, 32 bit and I had the exact same problem.
I have installed Fedora 6, 7, 8, 9, 10 and 11 on my laptop before and I had non of these problems with them.
The interesting point is that after hanging my system works constantly slow even when I restart my system! It is slow even in booting the BIOS and start up and choosing the kernel page!
The only remedy to get rid of the slow working for a while is to Shut down the system completely and turn it on again. Restarting do not make it work normally just shutting down makes it normal for a while.
View 1 Replies
View Related
Jan 11, 2010
Does any one have a way to speed up the internet on Fedora 12? I have a dual boot system with Vista x64 on the flip-side, and my wireless connection there is just fine. But when I get on this side, it goes back to the dial-up days (yes I said the DU word). yum updates seem to be just fine, and e-mail seems to be fine. just firefox is slow. And now that I put the x64 Flash in (thanks to leigh123linux), with that working too it seems even a little slower again.
View 3 Replies
View Related
Feb 18, 2010
After a new Fedora 12 installation, i cannot automount my Windows partition. My system is setup originally at windows XP ,partitioned, then change to Fedora 10. Change to Fedora 11 through update.System very slow.
I decided to upgrade to fedora 12 by DVD installer, then i have to mount manually to access my back-up, when typing su -c '/sbin/fdisk -l' at terminal, this is the code:
View 6 Replies
View Related
Mar 27, 2010
My system clock loses about 10 seconds every minute. The hwclock is fine. I've tried different kernel args (clocksource=acpi_pm, nohz=off, highres=off). None of these have any effect. I am running Fedora 11 with kernel 2.6.30-105.2.23.fc11.x86_64 on an AMD Istanbul node (Processor 2439 SE).
View 3 Replies
View Related
Jan 11, 2010
I have good experience in microsoft enviroment, now tiring to use linux, i tried Ubuntu 9.10, OpenSuse on different computers bur there is same big problem: Very slow download speed compared to microsoft.same file at same time downloaded by microsoft winxp toke incomparable short time. for example file 5.5MB attached to e-mail on Yahoo toke ~1minute to download on winxp computer,same file at same computer but with Ubuntu takes more thane 30minutes!
View 3 Replies
View Related
May 7, 2009
I have connected two computers with each other both having fc installed. Now, when I tried to transfer a file from one computer to another using scp command, sometimes the file transfers very slowly and sometimes very fast. I wana know that why it sometimes transfers slowly. By slow I mean much slower than a file downloaded from a dsl.
View 2 Replies
View Related
