Ubuntu Networking :: Fast CLI File Transfer Solution With Time Preservation?
Mar 4, 2011
I use basic ssh and scp on a regular basis and sometimes for file transfer... certainly over public networks. However, often I want to transfer large (several GB) files from one place on my LAN to another.
I've read that FTP is the fastest, and when I'm transfering many GB, fast matters. Of course I know it's not secure, but I don't need security on my home wired LAN. What I do need many times is preservation of date and time of each file when uploading. Filezilla does that and I use it, but sometimes I need a CLI solution. I have use ncFTP and been happy with it until I realized it doesn't preserve date and time on uploads (probably not on downloads either, haven't looked).
Is there a CLI FTP solution out there that will preserve file date and time information on file transfers (including uploads)?
I was wondering how to calculate some problems related to network transfer speed. If someone can show me a function to calculate network transfer speed over time, I would appreciate it.I'm in the midst of transferring 1.3TB of data to a network storage system. By looking at the stats, 4.6GB file transferred out in 6 min and 30 seconds. How long would it take to transfer 1.3TB of data?
i am trying to transfer a file from my live linux machine to remote linux machine it is a mail server and single .tar.gz file include all data. but during transfer it stop working. how can i work and trouble shooot the matter. is there any better way then this to transfer huge 14 gb file over network,vpn,wan transfer. the speed is 1mbps,rest of the file it copy it.
[root@sa1 logs_os_backup]# less remote.log Wed Mar 10 09:12:01 AST 2010 building file list ... done bkup_1.tar.gz deflate on token returned 0 (87164 bytes left) rsync error: error in rsync protocol data stream (code 12) at token.c(274) building file list ... done code....
I'm looking for a most possible, secure solution to transfer data using rsync over Internet between 2 linux server. I have 3 option: SSH, IPSEC and Kerberos. Which one in your opinion should be most secure solution?
My wireless seems to be fast for a good 30secs then bang takes good while to load the next page almost as if it's disconnecting and then reconnecting/scanning reconnecting. Why cant it stay connected. I have WAP PSK security here is my network setting please let me know if I should change any of them:(side not is there a way to fix this problem occuring so frequently it says on the wiki that it should only occur once in a whilce https:[url].....
I managed to ssh lan for file transfer but now i want to connect to ssh again for file transfer but from another city,not lan, What ip do i type in Host Ip? I mean,i can tell them to start the ssh server but then i need to type the external ip.
I have ubuntu 10.04 on my netbook and all my files on my XP desktop. How can I connect the two so that I can transfer files from the XP machine to the Ubuntu netbook? Both have WiFi and ethernet. I am not fluent in windows networking but could manage to join two xp machines using an ethernet cable and naming the two with the same workgroup then setting a folder as shared!
I am trying to set up a computer so that I can remotely torrent files and then transfer the files to my PC while I am at college. I set up my computer so that it has a dynamic dns as well as hosting via DynDns. I have recently hit a wall when trying to find a way to transfer my files from the computer at home to my Windows 7 computer at school.
Having a bit of a issue with Debian Squeeze and transferring files to the Sony PSP..Hook up PSP to USB port and Debian mounts it..I go to drag a 125 meg mp4 to video folder..Copy windows takes about 10 seconds to transfer it..Exit USB mode and there is no video there. Go back into USB mode and look at video folder on the PSP memory stick and there is no video..It vanished. From another after copy progress closed I right clicked PSP and unmounted it..
It error-ed saying device was busy and could not unmount..Looking at light on PSP i see memory stick is still being written to..i wait for light to stop flashing..About a minute or so..Then am able to unmount it..Go to PSP video and theres the video ready to be watched. Debian isnt accurately showing the copy progress...Its showing complete when it isnt..I have to watch the light on PSP to know when it is truly finished.
I have a lan network. I want to transfer a file from one Pc (connected to Lan) to another one. I know that the best way to do this it's ssh because it's very safe . But i know Samba too. Are there other ways to tranfer a file in a Lan?
I am unable to transfer files in pidgin. I am working under the assumption that I need to create an exception in iptables in order to rectify this problem. I have done a bunch of google searches trying to figure out how to do this specifically to allow file transfers using pidgin.
I am unfamiliar with iptables (I know I know, read the man page) and I'm not sure which port pidgin uses to transfer files. Can anyone help me figure out how to add an exception to so I can transfer files?
I am trying to use the Linux Ramdisk y machine and followed the instructions oninux/Ramdisk/ramdisk.html to create a 4GB ramdisk (total memory is 8GB, linux 2.6.9)The issue is that it is taking me almost exactly the same time to read a 1GB file from ramdisk as it is from disk. I was expecting it to be atleast twice as fast.Has anyone encountered this before?
I have a bash script that is tracking ERROR connections (running in a cron every 15 minutes), sometimes the errors are true and are not connecting. But most of the time, the disconnects/reconnects are between 30 seconds are sending out false positives. I am looking for a time comparison code to pick out the 30 second disconnects and know that this is and "ok" error. Here is a section of the log with timestamps, errors, etc.
Tue 2010-06-01 22:01:30 ERROR [DataBufferSendService] 172.31.0.1:8016 caught exception: [NetworkAPI] Exception: [SocketStream] socket error Tue 2010-06-01 22:01:32 ERROR [DataBufferSendService] 172.31.0.2:8016 caught exception: [NetworkAPI] Exception: [SocketStream] socket error Tue 2010-06-01 22:02:00 INFO [Client] 172.31.0.1:8016 connecting to 172.31.0.1 on port 8016 Tue 2010-06-01 22:02:02 INFO [Client] 172.31.0.2:8016 connecting to 172.31.0.2 on port 8016
I have connected two computers with each other both having fc installed. Now, when I tried to transfer a file from one computer to another using scp command, sometimes the file transfers very slowly and sometimes very fast. I wana know that why it sometimes transfers slowly. By slow I mean much slower than a file downloaded from a dsl.
We have a server and we have instales an Open suse 10.3 on it. We created a Samba server also. Made to share folder, that we acces from network from other computers that have xp.
The problem is if we try to copy from server it is very slow only 100-300kb/s. The strange thing is that if i copy 1 file then its slow but if i start to copy another one the speed gos up to 10-15mb/s. Evry time i want to copy somethin or install from that server i need to start another copy. If i copy from a comp to that server the speed is normal only if i copy from server its slow.
Ok, the only thing I remember doing is changing out my hard drive because it went bad. I swapped in a new one and reformatted with Windows 7. (I can hear the boos and hisses as I type) Anyway, now file transfers are exceedingly slow. They are ~10KB/s when they should be ~40MB/s. The odd thing is that it mostly occurs on large files, but not all large files and sometimes smaller files are affected. Copying files from one hard disc to another on the server, as well as copying from the server to Win7. Local files are not affected. The problem does not occur on my laptop which has Slackware Linux on it.
Another thing about the problem is that when I mount a disc image on a virtual drive, access time is very slow and windows explorer is very unresponsive and often locks up completely.
I have a samba server with Slackware Linux on it and a Windows 7 client. DHCP is configured through dnsmasq. (dhpc-host=<mac address>,<computer name>) Every now and again, dnsmasq seems to conk out when I try to access the network with my Win7 machine. I then have to reboot the server, as my only access to it is via SSH and I don't have a video card in it. After the server reboots everything is fine until accessing the network with my Win7 machine conks it out again.
I've tried different MTU settings, different network cards on the Win7 machine(Dlink and realtek), various regedit hacks, but none of them produce any results.
I've fixed almost everything except this problem. My network card worked fine on Windows but since I switched from Windows, file transfer over the network using my network card is horribly slow, 30kbps max on 100mbps wired connection. I know my network card is working fine, and I'm trying to copy files between my Ubuntu PC and windows PC, I've set up Samba as recommended by these forums, I can transfer files when using wireless connection, but I still can't transfer files at a speed faster than 30kbps on a wired connection.And the funny part is, it's fast when copying files from Ubuntu to Windows but it's slow the other way. And I've tried this with more than 4 different Windows computers.lspci returns this for the network controllerCode:Silicon Integrated Systems [SiS] 191 Gigabit Ethernet AdapterIs there any way of updating drivers or something that I can do to fix this problem
this is all on LAN.Whenever I transfer files through the router A to a pc connected wirelessly, the internet hit the speed of molasses. What can I do to rememdy this? I was thinking about having my fedora box connect wirelessly to the internet, through router A, and then bridge via ethernet to router B and then have my pc always connected to router B, so when i transfer files, router A remains unaffected. Is this correct logic?
I am having a problem trying to transfer large file (~700MB) from one station in my home to another. I have 3 PCs hooked up through a router. 1 is wired to the router and the other two are wireless. One wireless is a laptop that has a built-in Atheros wireless card that was supported during the FC13 install. The other wireless has a plug-in wireless card made by Belkin (F7D1101). I had to use ndiswrapper to get it to work on FC13.(BTW all PCs are running FC13)
The one with the Belkin card is, I think, the problem. The one with the Atheros card will transfer files at a rate of about 8MB/sec to the one with the wired ethernet connection. The one with the Belkin card will not transfer at rates over 300KB/sec to either of the other two PCs. I have tried file transfers both encrypted and not and it makes no difference.
I am working on Ubuntu-10.4 and I want to transfer 'hello.txt' file form my computer to mobile phone (Nokia 7210).When I run command, My mobile ask for accept the connection from ubuntu (device name connected to ubuntu). I accept the connection, Then I got the error log given above.
I am running Ubuntu Linux 9.10 on my laptop and desktop. I would like to transfer files from one to the other using an Ethernet Cross Over Cable. Is there software already installed in the bundle, that would allow me to setup network drives for each machine when the cable is connected. Also how would I setup the configuration.
I do IT work for a decently-sized bookstore. Over the past year or so we have had a recurring problem crop up where file transfers with networks outside of our building will be interrupted, or those receiving our uploads will get truncated files. It is an intermittent problem and I have not been able to narrow it down to any particular day of the month or time of day. Files that are dealt with in our web browsers have no issues - I can happily download and upload large files all day without interruption. Yet when our little postage meter machine tries to connect to its update server, it sometimes has its connection interrupted downloading its update files. Our credit card machines sometimes have trouble holding a connection long enough to batch out, and our storewide POS system often has to resend its credit batch multiple times before it can maintain connection long enough to push the whole file through. One server daily ftp's a ~11mb file to an associate, and a few days a month they will receive a truncated file that appears to have been cut off mid-transfer. Our bandwidth is handled through three T1 lines that share phone line and internet service. Our voice calls never get dropped and have good line quality, but mobile credit card terminals will have trouble maintaining a connection when they dial out.
I'm thinking this is either an ISP issue or an internal network problem. I don't know what protocol the mobile machines use, but it's possible it could be restricted to ftp or, I dunno, telnet? Maybe a port forwarding conflict? Files sent internally have no problems, so I'm thinking it's something at the firewall/proxy/router stage.
Our servers run a number of *nixes: our central databasing/pos is handled by an IBM RISC box running AIX 4.3; our DHCP server runs Debian Sarge 3.1; we have a Ubuntu 8.04 LTS box running a squidproxy setup using squidguard for url filtering; firewalling is handled by a Debian 5 box running Untangle. Our ISP provides us a 4.5 Mb connection via three T1 lines that provide shared bandwidth for our digital telephone lines and internet.
Is there any web-based open source solution(web-based) for Employee's Time and Attendance ?
As i know that TimeTrex is one of the solutions , but is there any other open source software for time ,attendance and payroll other then TimeTrex , so that i can make comparison and select the the one which suits my requirements.
I have a problem that I can't seem to fix.When I try to transfer a large file lets say 700Mb or so my wireless shuts down and i have to restart my ubuntu computer the other computer is vista.ubuntu is on a wusb54gver4 and vista is going through a wrt54g tm running dd-wrt mega.I have tried every thing i know with no luck.
I purchased an AZiO BTD-V201 USB 2.0 Micro Bluetooth Adapter for my ubuntu 10.10 system and the bluetooth transfer time is very slow. I am trying to transfer files to my xoom tablet. A 157mb folder is stated to take 1 hour and 30 minutes. Is there anyway that I can speed this up. The device is less than 3 feet from my pc.
I set up a virtual bridge for a virtual machine (qemu-kvm) using a qemutap interface:
Code: # brctl show bridge2 8000.0022648a3dcc no eth5 qemutap2 I can ping and ssh to the server ... Then I try to copy (scp) a file (2.8 M) to the server and, near the end, the copy stops and the server stops responding to ping and is not able to ping nothing except itself.
"ifconfig down ; ifconfig up" and the server is on line again.