Software :: Local Rsync To USB Speed Is Horrendously Slow?

May 4, 2011

Long story short, I have a failing RAID3 array which is showing file corrupted blocks (and the RAID controller card is periodically not initializing). [URL].. I thought I had robust backups but as it turns out, my backup volumes seem to have been misplaced (don't ask ) so I have no viable backups. I'm trying to back up as much as I can before the inevitable impending catastrophic failure.

I must be doing something wrong because running rsync on my Unix FreeBSD/FreeNAS server (syncing to local USB drive) is really slooooow. Below you will see an example. A 500MB file took almost 10 minutes to sync to a local USB drive! I can FTP this file in a few minutes over my LAN.

Just ran a test and it took 20 seconds to FTP this file across my gigabit LAN where rsync took 10 minutes to perform a local copy)

[Code]...

View 9 Replies


ADVERTISEMENT

General :: Rsync Speed For Single Files And Directory?

Mar 23, 2010

Recently i am trying to check on the rsync speed for single file(2.4GB iso) directory ( 900MB directory with files inside ) When i run the rsync for single file: the speed i get is average 50MBps However, for a directory: average speed is 10MBps Is there any reason behind this ? i tried to google but unable to get the concept.

View 2 Replies View Related

Software :: Rsync From Remote To Local?

Sep 22, 2010

I'm trying to rsync a folder(and all subfolders) down to a local directory, upon completion I'd like the remote folder to be deleted.

What I've come up with is

Code:
rsync -rvtW --remove-sent-files -e ssh user@example.com:/remote/folder /local/folder

What this is doing is simply wiping the remote files within folders(not the folders themselves) and not actually syncing anything down to my local folder(as in no files at all on my /local/folder)

View 1 Replies View Related

General :: Sync Local And Remote Directories Using Rsync?

Jul 14, 2010

I have two linux box that i would like to keep in sync. I see option -avz syncs the remote with local but new local files are not pushed.

View 2 Replies View Related

Ubuntu :: Using Rsync To Backup The Local Home Directory?

Oct 14, 2010

I went ahead and created this directory

mkdir /tmp/rsync-backup

and, ran this

rsync av /home /tmp/rsync-backup

this is the result

rsync: link_stat "/av" failed: No such file or directory (2)
skipping directory home
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1060) [sender=3.0.7]

View 5 Replies View Related

Ubuntu :: Sync Local Folders - Not Unison Or Rsync?

Apr 14, 2011

I need a program to run on Ubuntu that must be easily set up to do a series of different cloning operations at specific times between the USB drives on a single Ubunu pc, depending on the day of the week." So on Monday folder B is forced to match folder A, Tuesday C forced to equal D ... and on Sunday a whole bunch of these clonings happen. This must all run unattended (at 2am) and be robust with no "what do you want to do next messages" or having the whole thing give up if there is a problem with one file. Though I do need a log of success or failure. Windows programs that do this stuff are FolderClone and GoodSync. I looked at Unison and Rsync and one or two others, but none appeared set up to do what I need, or to be excessively complex / general. I don't need something that can sync two copies, or over internet ....

View 5 Replies View Related

OpenSUSE :: Download With Rsync All Packages And Make Local Repo?

Nov 28, 2010

in home I do not have internet connection, but in work I have internet connection, in home I install Fedora 14 for my 6 years old daughter and she use it for play games like supertux and openarena and .So I want install opensuse for my daughter and I want test it. for fedora , I download all packages with rsync in work and move them to home by USN flash and then I make localrepo in home and install all packages , I need , I want do this for OpenSUSE , all of us know DVD , does not has all packages , I need , so I have to download all packages and make localrepo in home and install all packages , I need , Can I do this for OpenSuse or not ,I want download all packages need by OpenSuse by rsysc and make loacl repo, How I can do this for Opensuse ?

View 9 Replies View Related

General :: Why Doesn't Rsync Use Delta-transfer For Local Files?

Jan 17, 2011

I have a big iso image which is currently being downloaded by a torrent client with space-reservation turned on: that means, file size is not changing while some chunks in in (4 Mib) are constantly changing because of a download.

At 90% download I do the initial rsync to save time later:

$ rsync -Ph DVD.iso /media/another-hdd/
sending incremental file list
DVD.iso

[Code]....

Then, when the file's fully downloaded, I rsync again:

total size is 2.60G speedup is 1.00

Speedup=1 says delta-transfer was not used, although 90% of the file has not changed, target dir is on another FS and copying takes several minutes. Why doen't it try to speedup the transfer?! How can I force rsync to use delta-transfer?

View 1 Replies View Related

Slackware :: Using Rsync To Keep Local Copy Of Stable Tree Up To Date

May 14, 2011

when I installed 13.37 I created a local copy of the entire stable tree (source/ and all the rest) just to have all that stuff around to browse offline.

Now, to instruct myself, I'm trying to use rsync to keep this stuff up to date. But I seem either to have misread the rsync man page or ... well, I don't know. I am issuing the following command and getting the results seen below:

Code:

View 3 Replies View Related

Ubuntu :: Rsync Really Slow On Large Files?

Mar 1, 2010

I have Ubuntu on both my laptop and desktop machines, both are connected to the same network. I back up the laptop to the desktop by running the following on the laptop:

rsync -avv --stats /home/alisdt alisdt@xxx.xxx.xxx.xxx:/home/alisdt/laptop_backup (with the IP address of the desktop instead of the many x, obviously). Whenever rsync hits a large file (greater than a few MB), the network use rapidly drops to ~60KB/s (that's kilobytes not bits). When I copy the same file to the same place using scp, I get > 500KB/s throughout the transfer. Things I've tried:

* mounting the desktop home dir on the laptop using SSHFS -- a simple file copy is fast, rsync is still slow
* ditto with NFS
* rsync --whole-file option, in case the delta-transfer algorithm was choking on large files
* rsync --inplace option
* HPN-SSH (http://www.psc.edu/networking/projects/hpn-ssh/) to enable dynamic window and unencrypted bulk transfer, just in case it was some ssh bottleneck I think it's either an rsync application problem, or a network problem that is only affecting rsync. Any ideas, or other ideas of what I can try to debug? In case it's relevant, I'm using 9.04 on both machines. (A standing bug prevents me from upgrading the laptop, and I haven't bothered to upgrade the desktop).

View 3 Replies View Related

Ubuntu :: Slow Run From USB / Speed It Up?

May 20, 2010

I am running Ubuntu 10.04 from a USB key (16GB). Overall I'm pretty fine with it but there are a few problems I am having. It seems to be very slow. In particular, Firefox and Pidgin freeze every now and then, before becoming active again. The same thing also happens for other applications such as Rhythmbox, Gedit, and the terminal. Additionally my start up and shut down times are horrible (worse than when I use Vista and Ubuntu 8.04). I was wondering if there is something with my install or if this is all due to the fact that I am running from a USB. I don't think it's the USB since I ran 8.04 from a USB HDD (55GB) and didn't have any problems with speed.

View 4 Replies View Related

General :: Setup Rsync To Backup A Remote Directory To Local Drive?

May 24, 2010

I'm trying to setup rsync to backup a remote directory to my local drive.

I cd to the directory that I want to pull the files to, then I enter:

rsync -vrtW account@remote.com:~/public_html

I enter the password then it starts running. I get all the files listed, but none of them actually transfer. What am I missing?

View 1 Replies View Related

Debian :: Slow USB Transfer Speed With MC

Nov 15, 2010

I have a 500gB USB drive connected to my laptop for backups and filestorage. But I can't get it to play nice with Midnight Commander. My transfer speeds max ut at 2MB/s wich is painfully slow when moving large files such as movies. Worker FM transfers the same files to the same drive much MUCH faster (not sure by how much, though). This leads me to the conclusion that the problem lies with MC.

View 5 Replies View Related

Fedora :: Internet Speed Is Very Slow ?

Jul 24, 2010

I'm using Fedora 13 x86_64. The internet speed is very very slow. I have enough hard disk space, RAM. Processor AMD Athlon II 2.6GHz. What can be the reasons?

View 7 Replies View Related

Ubuntu :: 9.10 Running Slow / Speed It Up?

Feb 25, 2010

I just installed Ubuntu 9.10, replacing Windows 7.

its running a little slower than I hoped it would, loading movies takes a while, and when i switch to full screen, it takes about 5 seconds to catch up.

im suspicious that my video card driver might not be configured correctly. can anyone tell me what I might need to configure to get things running smoother?

other things on the computer are also running slow, like opening Firefox, it takes a while for the window to appear.

- Athlon 64 x2 5200+
- Gigabyte GA-MA78GM-S2h motherboard
- Radeon HD 3650 512mb pci-e
- 4gb DDR2 800

and I do have ATI catalyst installed

View 2 Replies View Related

Ubuntu One :: Very Slow Upload / Speed It Up?

Apr 25, 2010

I have been trying out Ubuntu One for the past couple of days but find it to be incredibly slow. At first i had put a folder will a large amount of images in the ubuntu one folder. The total size of it was 35Mb, after over 26 hours only 11,5Mb of that had been uploaded.

After looking around some on these forums i saw several comments about it being slow when it is a large amount of files, no matter if the filesize is small or large. I decided to try it out with a larger single file. I erased everything that was in the previous share and then put my testfile of 350Mb in the Ubuntu One folder.

After two hours of waiting i could still not see it on the U1 website so i decided to see how long it would take with dropbox and put a copy of that file in my dropbox folder as well. The file was uploaded correctly to dropbox in just a couple of minutes but it has still not been uploaded to the U1 website even though it has been 4-5 hours since i first put it in my U1 folder.

View 9 Replies View Related

Ubuntu :: Which Application Use To Slow Speed Down?

Apr 14, 2011

I need to transcript some recordings to a friend of mine. I woule like to have the sound playing slower than usual. Is it possibe on any Ubuntu (L. Lynx) anyway? How?

View 7 Replies View Related

Debian Configuration :: Direct Ethernet Rsync To NAS Very Slow (74kbits)

Jan 30, 2016

So I have a GoFlex NAS driver, which according the specs has a theoretical maximum performance of 100 MB [URL] .....

I connected by ehternet to my PC (GNU/Linux, Debian 8 ) to do a backup.

I mounted it with cifs:

Code: Select allmount -t cifs "//goflexhome.local/GoFlex Home Personal" /mnt/gf/per/ -o credentials=/root/gfpass,uid=1000,gid=1000

And then tried rsyncing my home folder.

Code:

Select allDIR=/home
BACKUP_FILE=/mnt/gf/per/bck2016/

FLAGS=" --archive --one-file-system --acls --xattrs --numeric-ids --fake-super --progress  --human-readable --ignore-existing --log-file="backup.log" "                                                                                                                 

FLAGS+=" ${DIRS} ${BACKUP_FILE}"

rsync ${FLAGS}   

I then used iptraf to check the performance and I get miserable results (from the PC), even below 1 MB:

total 74.7 kbits
in 30.4 kbits
out 48.5 kbist

View 0 Replies View Related

Fedora :: File Transfers (cp, Mv And Rsync) Slow System Tremendously

Aug 24, 2011

When ever I transfer large files using cp, mv, rsync or dolphin the system will slow down to the point that it's unusable. It will sometime hang completely and not accept any input until the file is transferred. I have no clue what could be causing this problem but I know it shouldn't be happening.I am using Fedora 15 (2.6.40.3-0.fc15.x86_64) with KDE 4.6. have a Phenom II 955 processor, 6 GB of system ram and the OS and swap file is on an 80 GB SSD. Copying files in the SSD doesn't cause any problem, but moving files between my other two large HDDs causes the extreme slow down. Using htop I can see that my system load jumps to between 3 and 4, but my RAM and CPU usage stays low during the transfer. Here are two commands that take about 10 mins to run and make the system unusable while it's running. It usually transferring around 2-20GB worth of data during the transfers:

cp -a /media/data.1.5/backup/Minecraft/backups/* /media/data.0.5/backup/Minecraft/backups/
rsync -a /media/data.1.5/backup/ /media/data.0.5/backup/
/media/data.1.5/ is the mount point for a 1.5 TB internal SATA drive, and /media/data.0.5/ is the mount point for a 500 GB internal SATA drive.

View 6 Replies View Related

Debian :: Have Slow Download For Update / Speed This Up?

May 26, 2010

I am using debian(lenny) on a pc coexisting with windows. I use grub to decide which o/s to boot.

I picked debian, logged in as a regular user. I selected "Administration" under the "System" tab and then selected "Update Manager". I had to provide the root password.

I was asked to insert Binary DVD-1 and was told to use smart update. I did at which time 16 files begun downloading at between 4400 B/s and 4800 B/s from the Security server. It looks like it is downloading a new linux image.

Is there any way to speed this up?

View 4 Replies View Related

Fedora :: Yum Update Through Mirrors Very Slow / Speed It Up?

Aug 7, 2010

Does anyone know if the Yum fastestmirror plugin only makes decisions based on latency to pick the best host or does it measure bandwidth? On my laptop for the last few weeks I've been getting super slow yum updates (3.5kB/sec), when I force it to use the baseurl it runs as fast as I'd expect (160+KB/sec).

So the fastestmirror plugin doesn't seem to work unless maybe it's measuring latency as fast but the actual download speed is slow. If so, fastestmirror plugin should really take both into account.

View 2 Replies View Related

OpenSUSE :: 11.4 Slow In Terms Of Speed / Performance

Jun 30, 2011

I'm new to openSUSE and my computer is quite slow although my computer isn't that bad. I opened up ksysguard and it appears that my CPU is the bottleneck. My CPU usage is usually 100%, then after a few seconds, it goes down to 20-60% and then it goes back up to 100% after another few seconds. It says I have 141 processes running (I don't know if that's normal or not).

My Specs are:
CPU: AMD Duron (tm) processor 1.8GHz
Graphics Card: NVIDIA GeForce 6200
Memory: 2GB RAM
I'm using KDE.

View 9 Replies View Related

OpenSUSE Hardware :: Slow USB Transfer Speed ?

Feb 1, 2011

I'm trying to transfer some files to my USB stick, and it's transferring at the most pitiful rate, around 200-400kb/s, occasionally shooting up to 1MB/s, but not for more than a few seconds.

I realize a lot of factors can play into this, so I'll try to provide as much detail as I can.

I'm using OpenSUSE 11.3, KDE 4.6 RC2, and a Corsair Mini Voyager 16GB. My motherboard is a Gigabyte EP45-DS3L.

dmesg output:

Code:

lsusb -t output:

Code:

Sometimes too, the transfer just stops all together. It just... doesn't transfer for a while, then it'll go back to 400kb/s etc, then it'll stop again for a minute.

View 3 Replies View Related

Ubuntu Networking :: Why Is Internet Speed Is So Slow?

Feb 10, 2010

When using launchpad and the ubuntu daily build website it is very slow. I get 1.2mb/s normally and the speed drops quickly to 0kb/s This is the case from any version of ubuntu that is installed on my laptop.In windows it is no problem, equally there is no problem from a live cd or an install on my external hard disk. Is canonical blacklisting/slow listing my ip?

I am behind a university network but am sure this problem occurs at home .I did a clean install and had no problem until about an hour ago. When I tried to re download a project using bzr my speed instantly ropped.I had downloaded it fine a couple of hours ago. I hope that someone can shine some light on this, its very hard to work on projects if I can't download them.

View 5 Replies View Related

Ubuntu :: DC Power - Runs At Very Slow Speed

May 25, 2010

I have a HP nx7400 laptop. Now I have a docking station DC power adapter - Works Fine. Ordered another DC so i could travel with it, but when used ubuntu runs at a very slow speed.

View 3 Replies View Related

Ubuntu :: Burning DVD With Braserio Really Slow / Speed It Up?

Feb 14, 2011

I use Brasero 2.32.0 to burn DVD's and the max speed I reach writing on my 16x DVD's is 2.5x (more or less).

Follows info's about my OS and HW setup code...

View 6 Replies View Related

Ubuntu Networking :: 10.10 - Very Slow Wireless Speed

Mar 28, 2011

I have very suboptimal Internet speed in Wifi with Ubuntu. Normally in WIndows 7 I get download speeds up to 800 KB/s and a very fast Wifi experience, but in Ubuntu I get 100KB/s maximum and web page load speed is very extremely slow. Also, pinging to AP often gives very high response times and a lot of lost packages while in Windows they are very low and none packages are lost. I have a Netgear wg111v3 which worked out of box when I installed Ubuntu but always with this problem. It is updated and I've reinstalled Ubuntu many times..

Also I forgot to say that in Ubuntu the connection goes down very often and sometimes will not connect again until I reboot. Again in Windows never happened that.
Motherboard: GA-MA74GM-S2H
CPU: AMD Athlon 64X2 dual core
2 GB RAM
Ubuntu 10.10 64 bit
Wireless adapter Netgear wg111v3 USB .....

View 9 Replies View Related

Networking :: File Transfer Speed Too Slow ?

Oct 14, 2009

We have a server and we have instales an Open suse 10.3 on it. We created a Samba server also. Made to share folder, that we acces from network from other computers that have xp.

The problem is if we try to copy from server it is very slow only 100-300kb/s. The strange thing is that if i copy 1 file then its slow but if i start to copy another one the speed gos up to 10-15mb/s. Evry time i want to copy somethin or install from that server i need to start another copy. If i copy from a comp to that server the speed is normal only if i copy from server its slow.

View 3 Replies View Related

Ubuntu Networking :: Rsync Transfer From Client To Server - Slow LAN Connection

Dec 7, 2010

This is a recent problem, and I can't pinpoint any change/upgrade that would cause this. Rsync transfer from Client to Server:
sent 11756196 bytes received 1032741 bytes 138258.78 bytes/sec
total size is 144333466390 speedup is 11285.81
Pinging back and forth from each machine is fine. No Ifconfig errors Client, but Server has RX packet errors.

eth0
Link encap:Ethernet HWaddr 00:11:25:37:ee:44
inet addr:192.168.1.101 Bcast:192.168.1.255 Mask:255.255.255.0
inet6 addr: fe80::211:25ff:fe37:ee44/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:41786 errors:2157 dropped:0 overruns:0 frame:2157
TX packets:34138 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:55615449 (55.6 MB) TX bytes:4737538 (4.7 MB)

What's the next step?

View 3 Replies View Related

Debian Hardware :: Blu-ray Writing Speed Is Slow (250kb/sec)

Oct 21, 2014

I mount a BD-RE in Debian Jessie to write about 20GB of data. But the writing speed is terrible slow. I get a Speed of 250kb/sec.

Are there any options to increase the speed of writing? I don't use packet writing and no wodim, no growisofs, nothing. I just mounted the disk and I use mc (Midnight commander) to copy the data.

View 0 Replies View Related







Copyrights 2005-15 www.BigResource.com, All rights reserved