Networking :: TCP Crawler Network Not Working After Many TCP Requests?

Jun 11, 2011

I have a crawler on my VPS VMWare Server (also tried it on my dedicated server). After many requests about 200.000/6h my network is gone. I use lynx to get any website outside of local network and any site is not responding - also tried to obtain IP address instead of host name - no results. I can get every local site. For example when I am on 190.24.2.1 I can obtain a page which is placed on 190.24.2.5 but obtaining 191.54.23.34 is not possible.I tried many things such as changing TCP timeouts to less, restarting virtual machine and no results. After few hours - 4-5 hours I get network working. It is not working as fast as it should but it is ok.

I am wondering where is the problem. Have I got to configure linux? Am I missing something? Maybe some router stack is blocking my ip? (Other crawlers put on same VPS are working properly, but after 6 hours they also crashes)I also notices that I can get like 30.000 web sites per hour (some with errors, some with no response, some with timeout surely) but this number decreases hour by hour and finally reaches zero.Can you help me and suggest where may ba a problem?My system: Ubuntu 10.04 LTS Server, 1GHz, 512 MB RAM, 5 MB/s.

View 1 Replies


ADVERTISEMENT

Ubuntu Security :: Does Tor Browser Use Dns Requests From The Tor Network

Mar 1, 2011

Ok i think Tor has some way of making the dns queries anonymous by default. I did the DNS nameserver spoofablity test here at [URL] and the results i got showed about 30 different dns servers. Normally when i carry out this test on my standard isp connection or the vpn i use i just get one dns servers settings consistently.

View 1 Replies View Related

OpenSUSE Network :: Server Rejects Client Requests?

Dec 27, 2010

Background:I have a small PC104 running opensuse 11.1. I'm writing a small client/server application for debugging purposes using mono and WCF. All the client does is make a request for information every 100ms.Problem:After about 20 requests the server quits responding to the client. Even if the client is running on the same machine. I've run the exact code on another laptop running opensuse as well as a laptop running windows and everything works great. Hopefully that closes the option that it is a code, mono, or opensuse flaw.Is there a kernel option or a network option that anyone knows about that might cause this sort of behavior?

View 3 Replies View Related

OpenSUSE Network :: Block HTTP Requests From Other Computers?

May 30, 2011

My computer shares an internet connection using an ADSL router.There are other three machines.I have set up a Apache server for learning purpose and I want it to be inaccessible from anywhere else including the PCs in the network.When I enter my ip-address assigned in the network (192.168.1.1xx) from other computer,I get my ppages and I dont want that.

How can I block HTTP requests from other computers?

View 6 Replies View Related

Ubuntu :: 9.10 Unresponsive To Network Requests Every Couple Days?

Jan 7, 2010

I upgraded to Mythbuntu 9.10 from 8.10 and things went fairly well. No major problems during the upgrade. The system is just a mythbackend server. The only things that access it are for myth and for the smb mounts for mythtv. Every couple days, the system stops responding to network traffic. No myth connection, no smb, no pings even. All I have to do is wiggle the mouse on the system and everything comes back up instantly. I noticed that after it comes back up, the time is off by hours.

View 1 Replies View Related

OpenSUSE Network :: Bootpd+xinetd Setup - Server Is Not Responding To Requests?

Jan 6, 2010

I have installed bootpd-dd2 and enabled and configured it with xinetd. 1. Made sure that their is a bootptab file and it is configured. 2. Tested the bootpd is working by runing the command /usr/sbin/bootptest cmdbfs .3. tail -f the /var/log/messages and saw the requests from the test.4. rebooted a machine that is configured to pxe boot.there is no messages by bootpd when a request is made.request is picked up by network monitor on a seperate computer on the proper udp port

View 9 Replies View Related

Ubuntu Networking :: Network Card Working On 10.04 32bit But Not Working On 10.04 64bit!

Jul 25, 2011

I had an Ubuntu Server 32 bit installation and everything was working fine. Now that I installed Ubuntu Server 64bit on a new drive in the same machine, the ethernet card is not working!! This is insane cause when I put the hard disk with the 32bit installation back and booting from it, the ethernet card is working without any problems but in the 64bits installation it is not shown at all using "ifconfig -a"

lspci output:

Quote:

02:00.0 Ethernet controller: Atheros Communications AR8151 v1.0 Gigabit Ethernet (rev c0)

How can I check which module is being loaded in the 32bits installation to try to load it manually in the 64 bits installation?

View 3 Replies View Related

Networking :: Network Has An Intermittent Fault - File Share Network Stops Working

May 7, 2011

Sometimes my file share network stops working,and will then work again.I'm lost with this problem. The server pc is a Zenwalk pc.The other pc is a win7 pc. This error only occurs on Zenwalk. When i run puppy from the live cd the file shares are always visible,without fail.Under puppy i use pNethood. When the ping command is used there is no problem, and the pc name can be pinged.This is shown below:

[Code]...

View 6 Replies View Related

Ubuntu Networking :: Broadcom Corporation NetXtreme BCM5721 Network Card Randomly The Network Connection On The Server Will Stop Working?

Jan 29, 2011

I have a Broadcom Corporation NetXtreme BCM5721 network card on my server at work.Everything works fine for a few weeks, then randomly the network connection on the server will stop working. After it stops working, I will try to reconnect with the network manager, it shows a wired connection available, it shows the "connection in progress"animation, then the "connection disabled" icon.

I uninstalled the network manager and used manual configuration, but do you think the network manager was the issue? I can't have the server disconnecting randomly every few weeks with no way to know what the real problem is. Was there an issue with the network manager with 10.04?

View 4 Replies View Related

Networking :: Redirecting Ssl Requests With Squid?

Feb 24, 2010

say i have an apache server configured for ssl/non ssl virtual hosts and a proxy configured as follows (see squid.conf)the ssl on each name based virtual host is configured on its own port (only 7 of the domains need this the rest are just media and other insignificant bits of data but domains 1-7 contain forms that require specific personal information that may be technically illegal to transmit without encryption)if any additional information is needed just let me know

domain1 is port 443
domain2 is port 444
domain3 is port 445

[code]....

View 2 Replies View Related

Ubuntu Networking :: Network Is Working But Not Working?

Aug 28, 2010

OK so I set up a server yesterday and got ndiswrapper loaded on it with the appropriate driver, I edited the /etc/network/interfaces file to contact my router with it's MAC address, WEP Key, etc... So the problem is I can ping addresses like Google and Ubuntu Forums but I can't use apt-get to install or update packages. When I try sudo apt-get update I get a whole bunch of Code: W: Failed to fetch <address>Temporary Failure resolving <address>My Wireless interface is wlan0 and also I can ping my server from my other computer running Linux and my server can ping that computer too.

View 1 Replies View Related

Networking :: HTTP Requests Always Go By TCP Connect Tunnel?

Aug 14, 2010

How do Http requests and responses go from a client to the server? IS a TCP Connect Tunnel always formed or is there some different mode ?

View 4 Replies View Related

Networking :: Balance The Internet Requests From LAN Using 2 Connections?

Feb 17, 2010

I have a firewall ( a pc with debian 5) with 2 internet connections. each connected to a ethernet card (the firewall has 2 ethernet pci cards so it has one connection per card)how can i balance the internet requests from my LAN using this 2 connections?

View 3 Replies View Related

Networking :: Forward All Http/https Requests ?

May 12, 2010

I have a server (Fedora 12) setup at a client's datacenter and the network is setup to allow me ssh access into the server, but prevents me from opening any connections from the server. However, I need to make http and https request from the server. What I'd like to do is forward all http/https traffic through another machine outside the network.

I've been looking at the documentation for ssh and the various options there and have gotten so far as to enable initiating an ssh connection from the client network back to my machine, but am not sure where to take it from there.

Here are some of the commands I've used so far:

Code:

I'm attempting to bind port 80 to be forwarded through the local machine. I assume I use "ssh -R" to create a dynamic tunnel to forward requests but I must be missing something.

By the way, root login via ssh is disabled.

View 5 Replies View Related

Networking :: IPTables - Inspect / Modify DNS Requests?

May 10, 2010

I'm trying to work out a way to inspect/modify dns requests as an advertising filter. Iptables is a good place to do this, but I'm having some problems disassembling the packet. On my dev box, when a DNS reply is returned from a request made on the dev box. I use this rule to route the reply packet through a queue:

iptables -A INPUT -p udp --sport 53 -j NFQUEUE --queue-num 1

Will the rule catch the inbound udp packet with the dns reply in it? I get something in the queue, but it's unintelligible when attempting to disassemble the packet. I don't want to move onto looking at my program until I get some feedback on the rule.

Here's a primitive diagram of what I'm working towards:
host ->DNS request->iptables(no outbound rules)-> DNS Server
->DNS Answer ->iptables(queue udp 53 packets)
->inspect packet program-> Allow/Deny -> host processes allowed packets

View 1 Replies View Related

CentOS 5 Networking :: DNS Requests Go To Localhost When Made By Apache / Php

Oct 7, 2009

I'm running wordpress and have gone to the painstaking effort of setting up the ftp server on my 5.3 machine so it can do its own updates and download plugins. However, I've found that if I try to download anything, I get a "unable to resolve host..." error from the script. If I watch Iptraf while making the request, I see all the port 53 requests going to 127.0.0.1. Pings are too.

However, if I ssh in, I can ping and wget and whatever I want all day long and all the DNS requests to go the router (Clarkconnect 3.2 gateway machine). The web browser in the terminal works fine too. What is it about the php scripts that is causing them to misdirect pings and dns requests? I've never seen anything like it and can't find anything on the web about it either.

[Code]....

View 2 Replies View Related

Fedora Networking :: NetworkManager Applet Requests Keyring Password?

Apr 11, 2009

I have a FC10 installation with GNOME and NetworkManager and a wireless card. Everything works ok. However, when I try and setup gdm to do autologon I get the NetworkManager applet asking for the password for the gnome-keyring to get the wireless details. Since I want to use this machine as a sever this is unacceptable as I won't be around to type in the password. I tried the solution at [URL] but this does not work. I still get the password being requested and the keyring password is the same as the logon password. Can anyone say if there is a workaround that works to get the NetworkManager to be able to read the gnome keyring without having to prompt me for it.

View 5 Replies View Related

Ubuntu Networking :: Get Wireless Router To Forward Ftp Requests To Computer?

May 18, 2010

I'm trying to make my wireless router always give me the same ip address every boot (192.168.1.100). I do not have a static ip address from my isp.

Everything I've tried from online help has made my internet break and I'm not even sure what exactly I should be searching for on google.

Ultimately, I'm trying to get my wireless router to forward ftp requests to my computer which shares the network with an xp machine. I think this is the way to go about it.

View 8 Replies View Related

Networking :: Forward Local HTTP Requests To Remote Proxy?

May 4, 2011

How to forward local HTTP requests to remote Proxy with IPTables ?

View 1 Replies View Related

Ubuntu Networking :: 2 NICs, Server Won't Respond To Requests But Internet Works

Apr 16, 2010

I recently set up a new web/file server with 9.10 server x64 with 2 NICs and I am trying to configure eth0 to respond to my LAN for internal samba filesharing and eth1 to handle website/ftp requests on my static IP, but whenever eth0 is up the server is not accessible at 173.XX.165.65 for web or ftp but both work fine at 10.1.10.100. When eth0 is down, public IP works fine. I have set /etc/network/interfaces like this:

Code:
# The primary network interface
auto eth0
iface eth0 inet static
address 10.1.10.100

[Code].....

View 1 Replies View Related

Ubuntu Networking :: Samba Server Stops Accepting Mount Requests?

Apr 21, 2011

I'm having an issue with a Samba server running on an Ubuntu "server". Technically, it's not a server, it's just an old desktop with Ubuntu 10.04 running it..and I have a few server processes running (ProFTP, Samba, etc.)The Ubuntu server is where I store all of my important files that get backed up to a separate hard drive. I shared folders via Samba, and I use two computers to access the shares. I access the shares with an .sh file I created that uses the mount cifs command to mount to those shares.

It has been working flawlessly for a long long time, up until recently. For the past few days to a week, I will try to mount the shares with no result. In the terminal, the commands just freeze, as if the command is trying to execute, but having network issues.The only way I can get it to work is if I reboot the Ubuntu server, then it maps flawlessly. But a day later, it's back to hanging up when trying to mount.

View 4 Replies View Related

Networking :: Port Forwarding - Router - Ssh Requests Time Out - Tomato Firmware

May 18, 2010

I've managed to confirm that I can reach my home network via ssh from a remote location through my SMC Barricade when it is directly connected to the desktop machine but when the second router is put back into the chain ssh requests time out. The second router is a Linksys WRT 54GL running the Tomato firmware. The chain looks like this: ISP's router (bridged) --> Barricade -->WRT54GL-->desktop

The Barricade has port 22 forwarded to the Linksys' WAN address and it in turn forwards to the desktop address. It appears that it is a setting on the Linksys firmware that is preventing the remote connection. I've looked through the various settings many times but cannot see anything that would cause the problem.

View 4 Replies View Related

Ubuntu Networking :: 9.10 Network WAN Not Working?

Jan 13, 2010

I decided to bite the bullet & upgrade from V8 to V9.Now after doing so the WAN connection is not working

Code:
bcm@bcm-laptop:~/wireless$ sudo iwlist wlan0 scan | tee sb.lis
wlan0 Scan completed :

[code]....

View 4 Replies View Related

Networking :: SSH Not Working On Local Network?

Jul 23, 2009

Let me start off by saying everything WAS working...I have a lab environment comprised of two subnets (.1.128/25 and .2.0/25). On the .1, I have 3 Solaris 8 servers running NIS, NFS, databases, DNS, various services, etc... the network was setup on VLAN'd Layer 3 switches with the VLAN interface addresses acting as default gateways (dgw) for the two networks (on a single switch). The switch dgw was a router for outside connectivity. The servers are running ODCS OpenSSH.I was having problems with the VLANs, so I reconfigured the network so that each subnet had it's own switch as a dgw, and they route through a point-to-point static route setup as 192.168.0.1&2 on a separate VLAN between the two gateway switches.Here's where the problems start:First, ALL the services (NIS,NFS,databases,DNS,etc) are STILL WORKING. I can ping all the addresses. Traceroutes show the proper path thru the point-to-point, etc. There are NO firewalls setup, hardware or software, network or host-based... no iptables running, etc.

The three servers are on the .1 network. I can ssh to them from hosts on the .2 network no problem. However, I cannot complete an ssh login to them from any host on the .1 network. I get a password prompt, enter the pwd, and then it hangs until I receive a "Connection timed out" error message several minutes later. The next time I log in however, it shows "Last successful login" from the failed attempt.While the connection is hung, netstat on the server shows "ESTABLISHED" to the client on the proper port. nother odd indication is that I CAN sftp to the servers from hosts on the .1 network.

View 8 Replies View Related

Fedora Networking :: Network Rdp Working One Direction

Feb 15, 2010

I have laptop with Ubuntu wired to ferdora 12 server. Server RDP control to desktop is working.Laptop to server is not.See screen shots.I am thinking VNC server is not installed or configured properly on server.

View 14 Replies View Related

Fedora Networking :: F12 Network Not Working After Installation

Mar 14, 2010

I met network connection problem in my previous installation, so I tried a second time. But when I try to "enable your network interface", it gave me an error: "An error occurred trying tobring up the eth0 network interface.". I tried again and it just freezed there and won't work anymore.I use Comcast cable service, and a Apple Exteme station as router with gateway "10.0.1.1". This desktop is new HP e9150t with Gigabit Network card. Don't know why.

View 9 Replies View Related

Ubuntu Networking :: Network Only Half Working / What To Do?

Jan 22, 2010

I'm clearly missing something small. My Ubuntu machine can see the XP machines in the WORKGROUP, pull files over and even print to the printer attached to one of them. Internet sharing also works. However, the XP machines cannot find the Ubuntu system.

View 1 Replies View Related

Ubuntu Networking :: New Install Network Not Working

Mar 14, 2010

I have just done a new install and have no network (LAN) connection.My network card blinks as if there is activity but the corresponding diode on my router is not active.I have checked the ethernet cable by switching with a valid connection to a WinXP system; like this I know that all the router ports are good.The network configuration module does not indicate a wired connection.

I have also tried sudo ifdown eth0 and sudo ifup eth0 but receive error message: interface eth0 not configured Can anyone help as it is my first experience with linux systems.

View 2 Replies View Related

Ubuntu Networking :: Network Card Not Working / Get That?

Apr 21, 2011

I have BroadCom BCM4318 802.11B/G Wireless Card. When I first started Ubuntu a week ago it didn't work, but I fixed it after a day or two of googling it. However I made a mistake and uninstalled the Network Manager. I then reinstalled Ubuntu, but it wouldn't load the card again. I activated the driver, and restarted the computer, but then, since It was connected via Ethernet, it wouldn't reconize the Ethernet connection, but the wireless card it did, but wouldn't find a network that is supported.

View 6 Replies View Related

Networking :: Dhcp Not Working After Restarting Network ?

Jul 12, 2010

I installed dhcp on my Debian server and it was working fine.

untile I restart network with this :

And then dhcp was not working.

View 4 Replies View Related







Copyrights 2005-15 www.BigResource.com, All rights reserved