Networking :: Large FTP Upload Slows And Fails?
Feb 3, 2010
I am programmatically doing a large FTP upload (about 5 Gb's of 2-3 Mb files) from my Windows 7 machine to a ProFTPd server on my Ubuntu box. When the program is run, transfer rates are huge! but as run time continues, transfer rates drop off significantly and eventually slow to a halt resulting in a:
Quote:
Read Timed Out
error.
The rest of the uploads fail due to Socket Read Errors.
Why is the transfer failing like this?
View 2 Replies
ADVERTISEMENT
Aug 5, 2011
A few months back I performed a routine aptitude upgrade on a Squeeze installation on a DELL Vostro desktop. My eth0 upload speed is now very bad although download speed is good. I suspect that it could be related to my other problem [URL] which was caused by the OS enabling noveau driver instead of the installed NVIDIA proprietary drivers.
dmesg says:
eth0: Tigon3 [partno(BCM57788) rev 577880001] (PCI Express) MAC address 00:26:2d:23:a0:a5
eth0: attached PHY driver [Broadcom BCM57780] (mii_bus:phy_address=300:01)
eth0: RXcsums[1] LinkChgREG[0] MIrq[0] ASF[0] TSOcap[1]
eth0: dma_rwctrl[76180000] dma_mask[64-bit]
Where do I start to troubleshoot?
View 4 Replies
View Related
Nov 11, 2010
I'm having some trouble uploading large log files to our server using perl. We are required to upload files larger than 2GB (regardless of how infeasible that sounds). I have tried the same thing on two different servers:
Code:
1. Linux 2.6.32-24-generic #39-Ubuntu 10.04 i686 GNU/Linux Server version: Apache/2.2.14 (Ubuntu)
2. Linux 2.6.5-7.244-smp #1 SLES_9 x86_64 x86_64 x86_64 GNU/Linux Server version: Apache/2.0.49 Smaller files upload without issue, however when a file larger than 1048576000 bytes is sent to be uploaded, the browser immediately fails, yielding this:
Code: This web page is not available. The web page at blah might be temporarily down or it may have moved permanently to a new web address. Below is the original error message: Error 101 net::ERR_CONNECTION_RESET): Unknown error. The apache log gives some indication of the file size limit:
Code: Requested content-length of 5954683941 is larger than the configured limit of 1048576000 However, I have looked through the apache config files and can't seem to find where this setting for content-length is. Is there an absolute maximum setting for file uploads in apache? Is it also possible that this is actually caused by a Perl error?
View 1 Replies
View Related
Jul 22, 2010
I finally have my system to where I can connect to proftpd but my uploads fail. I think my problem lies in the upload folder. I do not really understand where to put it. Will someone look at this config file and tell me where to put it and what I need to do to get it working. A basic anonymous configuration, no upload directories.
[code]...
View 14 Replies
View Related
Oct 24, 2010
when uploading a couple of files via ftp, it fails with
[code]...
But when performing this I got FATAL: Module capability not found. So what I'm using is openSuSE11.2 with 2.6.31.14-0.2-default kernel. Vsftp version is 2.0.7-5.2.1 How can I introduce this capability module into the kernel? Or do I not need it?
View 1 Replies
View Related
Feb 27, 2010
I regularly check for updates via Update Manager. I have, as of today started getting errors, some updates did not upload.
View 2 Replies
View Related
Apr 25, 2010
I am running Debian Lenny 2.6.26-2-amd64 and I have the following setup:
3 Raid6-Volumes each 19TB size (md0,md1,md2)
I would like to join the three of them to one large LV (of 57TB) formatted with a jfs fs.
I installed:
jfs_mkfs version 1.1.14, 06-Apr-2009
lvm version
LVM version: 2.02.39 (2008-06-27)
Library version: 1.02.27 (2008-06-25)
Driver version: 4.13.0
Prerequisite: the md are assembled and have synched:
Code:
cat /proc/mdstat
Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5] [raid4] [raid10] .....
I used jfs_mkfs on each of the three mds and mounted the drives to run some checks and they worked without a problem. I am pretty sure the drives/raids are OK. Then I created the VG "pod" with the three drives as members: .....
Then I created a 40TB LV for testing
Code:
lvcreate -L 40T pod
which gave me this
Code:
lvscan
ACTIVE '/dev/pod/lvol0' [40.00 TB] inherit
Then I went on formatting the drive using
Code:
jfs_mkfs /dev/pod/lvol0
Still - everything fine.
When trying to check the partition with jfs_fsck I get:
Code:
ujfs_rw_diskblocks: disk_count is 0
Unrecoverable error writing M to /dev/pod/lvol0. Cannot Continue.
The really funny thing is that I don't seem to get the error if I try to run the thing with a 25TB LV everything looks fine: There is nothing in syslog that would point to the source of this error. Also - if I try to mount the 40TB partition, everything is fine - but when I try to write to it, the whole system hangs and there is no way to recover.
View 9 Replies
View Related
Oct 15, 2010
My MySQL replication slave failed,while reading a large size table from master.Thhe information from error.logError 'Unknown table engine 'InnoDB'' on query. Default database: 'test'. Query: I am sure that table is a Big size table..
View 11 Replies
View Related
Dec 8, 2009
We're load testing some of our larger servers (16GB+ RAM), and when memory starts to run low they are kicking off the oomkiller instead of swapping. I've checked swapon -s (which says we're using 0 bytes out of 16GB of swap), I've checked swappiness (60), I've tried upping the swap to 32GB, all to no avail. If we pull some RAM, and configure the box with 8GB of physical ram and 16 (or more) GB of swap, sure enough it dips into it and is more stable than a 16GB box with 16 or 32GB of swap.
View 6 Replies
View Related
Dec 12, 2010
I have a Actiontec m1000 modem from Qwest that seems to offer more speed to my brothers Windows PC then my Linux PC (same make and module) I checked the ping on all systems, and they all look fine. The only thing that seems different is the number of open sessions in the modem, Linux only uses 2, and Windows uses 80. My guess is that the modem uses sessions to control the bandwidth, but I don't know how to add sessions to Linux networking to compete for bandwidth. I did test in the same browser.
View 4 Replies
View Related
Aug 21, 2010
I'm using OpenVPN to connect to a remote system. When I run
Code:
It brings up a new tunnel interface. The problem is that once the tun interface is brought up and the VPN is established, my whole Internet connection slows to a crawl.
Here is the output from ip route show before openvpn:
Code:
And after openvpn:
Code:
View 2 Replies
View Related
May 31, 2011
I have Ubuntu 10.10 running on a Dell Latitude E6500 notebook and am using the Broadcom STA wireless driver (just in passing, same happens on Mint 10).
My problem is this:
- when the computer is plugged into a power outlet, wireless works fine, but
- when the computer is running on battery, it hardly works at all: The network strength indicator item still shows the same connection strength but data are not transmitted anymore or only extremely slowly (google.com might 2 minutes to load).
The drop in performance literally happens 1 sec after unplugging it, and once the notebook is plugged into external power again, it resumes after a few seconds. (I have tested this with big downloads where you can see Firefox's or the Update Manager's download speeds.) The BIOS doesn't seem to have power saving settings that make that happen, and I haven't found any in Ubuntu.
View 1 Replies
View Related
May 9, 2011
I'm having a weird problem that I'm hoping someone can help me with.
First some specs:
F13
NetworkManager Applet 0.8.3.998
Driver r8169
Opera 11 and Firefox 3.6.16
Recently my ISP switched to PPPoEand since then my internet connection has been giving me problems. While browsing, some websites load fine, some websites load fine after I refresh once or twice, some load really slowly and the formatting tends to be messed up and some websites won't load at all (they stop at waiting for website...). Ping for all of these sites is however fine. Also uploading and downloading either from sites like rapidshare or using torrents is also fine. The same ISP also provides a second similar connection which is connected through a wireless router (mine is connected directly - no modem or router) to two computers (one via a wired connection and one through wireless) both running Win 7 and everything works fine over there.
Things I've tried. I tried using the router changing it's setting to my connection and connecting through that but the problem remains. After googling I thought it might be an MTU issue so tried this:
[Code]...
View 5 Replies
View Related
May 7, 2011
First some specs:
F13
NetworkManager Applet 0.8.3.998
Driver r8169
Opera 11 and Firefox 3.6.16
Recently my ISP switched to PPPoEand since then my internet connection has been giving me problems. While browsing, some websites load fine, some websites load fine after I refresh once or twice, some load really slowly and the formatting tends to be messed up and some websites won't load at all (they stop at waiting for website...). Ping for all of these sites is however fine. Also uploading and downloading either from sites like rapidshare or using torrents is also fine. The same ISP also provides a second similar connection which is connected through a wireless router to two computers (one via a wired connection and one through wireless) both running Win 7 and everything works fine over there.
Things I've tried.
I tried using the router changing it's setting to my connection and connecting through that but the problem remains. After googling I thought it might be an MTU issue so tried this:
ping -M do -c 3 -s 1464 www.myce.com and got
PING myce.com (212.204.237.148) 1464(1492) bytes of data.
1472 bytes from www.myce.com (212.204.237.148): icmp_seq=1 ttl=47 time=129 ms
1472 bytes from www.myce.com (212.204.237.148): icmp_seq=2 ttl=47 time=129 ms
1472 bytes from www.myce.com (212.204.237.148): icmp_seq=3 ttl=47 time=130 ms
--- myce.com ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2133ms
rtt min/avg/max/mdev = 129.261/129.683/130.044/0.436 ms
This works for various websites whether they load or not. My MTU is set at 1492 but I've tried various lower numbers all the way down to 1300 but no luck. I tried disabling ipv6 in Firefox but no change.
View 2 Replies
View Related
Jun 13, 2010
have setup a LAMP server with ubuntu 10.04 server edition x86 for my study in VMware Workstation 7.1 For a assignment I had to make a php script that would load a file up to the server and set the name in a mysql database. According to the book the server should set the image in a cryptic folder in the /tmp/ folder.
This isn't working and i also try'd locate and find to find the image i uploaded. I checked the php.ini and file uploads were on but no folder so i set that one to /tmp/ but still no images. Can anyone help me with enabling this function?
View 3 Replies
View Related
Dec 29, 2010
i have Ubuntu10.10 (kernel-2.6.35-22-generic) installed. struct stat StatBuff;
[Code]...
I have mounted a windows share folder on /mnt. When i gave any directory within /mnt/ to stat function it fails with errorno 75. perror shows "Value too large for defined data type". Example 1 is fail but Example 2 works fine.
View 7 Replies
View Related
May 30, 2010
I have a linux box running between my router and my LAN. My connection speed is 10MB download and 1MB upload. The issue is that whenever someone starts to upload something, it is like my connection is down. No one else can open websites, read emails etc.Is it possible to place a limit for upload, maybe 50kb/s? This way, people won't use the entire upload speed available.
View 1 Replies
View Related
Jul 8, 2010
I have the following network setup:
The idea is to separate the download and the upload, namely to send the upload on Net1 and the download on Net2, completely transparent to the client. My first ideas were using simple routing rules....having the default gateway for Gateway A over Net1 and having the route to the client in Gateway B over Net2. However, if I do that, the packets arriving in Gateway B from the client, aren't forwarded anymore. The same thing happens if I don't have any route to the client in Gateway B. In order to forward the packets, does it really matter if the router knows how to route to the source and does it really mater if the packet arrives on the same interface as the routing rules point to?
View 1 Replies
View Related
Nov 23, 2010
I just uploaded JPG pics from a Win XP, through shell, on my FTP.When I downloaded them back (to a UNIX machine), they were all currupted and unreadable !After some researches, I found that Win XP's shell works by default in ASCII mode.
View 3 Replies
View Related
Feb 18, 2011
how big and widespaced the fonts on Clementine playlist are and how good they look on the appmenu (where my mouse pointer is). This is not because Clementine is QT4, I've got the same problem with Chrome, Opera etc. I've been messing with system-settings (KDE settings tool) a day before the fonts become that widespaced in order to make my KDE apps look more native on my GNOME, but I haven't touched the fonts settings there.
View 9 Replies
View Related
Nov 16, 2010
Trying to watch movies between my systems and I'm getting upload speeds of 6.5 kb/s from my system to the one connected to the tv. I'm running Ubuntu on both machines, tried with VLC and XBMC. Both are running wirelessly but I know that this issue is new, I used to get at least a meg a second on LAN.
View 9 Replies
View Related
Apr 13, 2010
from vuze(bit torrent client) it shows my total download speed to be 20.56 KB/s....while my network monitor tool shows a speed around 72.41 KB/s. Similar is the case with upload speed. In much simple words the download/upload speed that vuze shows appears to be less than that shown by the network monitor tool.I must mention that at the time vuze was running there was no other simultaneous downloads.I don't understand why this is so?Is there any tool that can give me the exact information of downloading & uploading speed or rather any tool that can give me the details of uploads/downloads presently going on.
View 2 Replies
View Related
Dec 6, 2010
I've searched on issues of multiple DHCP servers in one LAN. Just about everything is Windows or Novell based stuff. Also, the typically asked scenario is 2 or more DHCP servers for failover purpose (one goes down, the other takes over).
What I want to do with DHCP is different. My purpose would best be described as "administrative separation". Basically, if a given MAC address is configured on a specific DHCP server, that server should be the one to answer and not the other. The problem with that is that we also need a default to handle unknown MACs. So the DHCP server without the MAC configured would be answering, anyway, even if it is the only one configured to do global leasing. Timing would then be the determining factor.
The purpose is to set up a bunch of PXE network booting using program generated DHCP configuration. This server won't always be up, so it can't be used for general purpose. The DHCP server for general purpose is part of a wireless system, and it is configured by GUI and is impractical for the programmed PXE booting.
how to make these work together with everything being on the same LAN segment?
View 10 Replies
View Related
May 25, 2010
I am looking for a way to monitor my upload and download for my whole network not just my computer. I am using a laptop that is connected wirelessly to my router, i am able to monitor the upload and download for my laptop but i would like to view the statistics for for the whole network without being connected to the router.
View 6 Replies
View Related
Aug 9, 2011
I have installed libapache2-mod-bw and it works great to throttle download speeds to the clients (i.e. - the bandwidth out of the server can be controlled just peachy).However, I need to limit the bandwidth *into* the server from specific networks because my WAN links are tiny and do not have QoS or shaping of any sort (I know, I know - contracts in place - will be fixed in November - not my design).I know that there are ways to throttle this at the interface level (e.g. - wondershaper) but I'd like to allow full bandwidth to the clients that are connected locally. The server in question is for web file transfers (under apache2 on 443) and expected file sizes are up to 2GB so a per-network limit would prove helpful.
View 2 Replies
View Related
Jan 10, 2011
Loaded up Centos 5.5 final. Configured iptables to block regions of the world based on networks. An example would be:
-A INPUT -s 139.82.0.0/16 -j DROP
My /etc/sysconfig/iptables file contains about 10k entries like this. If I use this, the machine lags hardcore network wise.
View 3 Replies
View Related
Dec 1, 2009
I have a Fedora 11 system and cbq.init-v0.7.3 in it. Now I want to restrict upload speed from my ftp server to Internet (eth1). According to docs I've made a simple file /etc/sysconfig/cbq/cbq- 00.inet_upload_restrict:
DEVICE=eth1,100Mbit,10Mbit
RATE=800Kbit
WEIGHT=80Kbit
PRIO=5
RULE=:20,
So as you can see I want to limit outbound traffic on eth1 from my ftp port 20 to any to the 800Kbit/s (100Kbyte/s). Now I do cbq start, it says: find: warning: you have specified the -maxdepth option after a non-option argument (, but options are not positional (-maxdepth affects tests specified before it as well as those specified after it). Please specify options before other arguments.
find: warning: you have specified the -maxdepth option after a non-option argument (, but options are not positional (-maxdepth affects tests specified before it as well as those specified after it). Please specify options before other arguments. but it starts and works. Now I check the speed and it is...
View 3 Replies
View Related
Jan 6, 2011
my task is to store the data to a file at server sent via HTTP POST, i written suitable cgi script in C, but the PROBLEM is that i can't complete the task, I guess i require server permission to do so, how to configure server or how to get access right from server to store data to a file.
View 3 Replies
View Related
Dec 9, 2009
I have Fedora 12 (with all the latest patches, including the 2.6.31.6-162 kernel) installed on a new Supermicro SYS-5015A-H 1U Server [Intel Atom 330 (1.6GHz) CPU, Intel 945GC NB, Intel ICH7R SB, 2x Realtek RTL8111C-GR Gigabit Ethernet, Onboard GMA950 video]. This all works great until I try to transfer a large file over the network, then the computer hard locks, forcing a power-off reset.
Some info about my setup:
[root@Epsilon ~]# uname -a
Linux Epsilon 2.6.31.6-162.fc12.i686.PAE #1 SMP Fri Dec 4 00:43:59 EST 2009 i686 i686 i386 GNU/Linux
[root@Epsilon ~]# dmesg | grep r8169
r8169 Gigabit Ethernet driver 2.3LK-NAPI loaded
[code]....
I'm pretty sure this is an issue with the r8169 driver (what I'm seeing is somewhat reminiscent of the bug reported here). The computer will operate fine for days as a (low volume) web server, and is reasonably stable transferring small files, but as when as I try to transfer a large file (say during a backup to a NAS or a NFS share), the computer will hard lock (no keyboard, mouse, etc.) at some point into the transfer of the file. It doesn't seem to matter how the file is transferred (sftp, rsync to NFS share, etc.).
View 10 Replies
View Related
Feb 24, 2010
I am not fully sure if this belongs more to the networking section or the software. O hope it is related to here enough.
My problem is as the topic says.
My port 80 seems to be already taken. lighttpd fails to start reporting that it cannot bind to port cause its already taken.
The error message itself:
Code:
"Starting web server: lighttpd2010-02-21 07:01:02: (network.c.345) can't bind to port: :: 80 Address already in use failed!"
I am not able to crack this by myself. Ihve tried investigating this by
Code:
lsof -i :80
netstat -ape | grep -v unix
First doesn't show anything second anything abt port 80.
Now hints I can think of. Maybe you have more experience and ideas what I can do and where should I look for the culprit.
I am using debian (unstable) and lighttpd. I even tried rebooting; it says that the port is taken already at the boot sequence (well it starts pretty much at end anyway but the system should be clean).
It seems that it started failing after a major distro update, so maybe there are some conflicts based on ipv6/v4 or something, though I have no idea what it could be. Well my hit for that is the part of error msg "bind to port: :: 80 ". This "::" looks like ipv6 naming convention. Maybe its lighttpd internal.
View 2 Replies
View Related
