General :: Squid Performance Slowing For HTML Webpages
Feb 4, 2010
Is there a way to cache everything in squid except for the video files and mp3s?I had a problem before when I turned caching on and it made the performance very poor because it was trying to cache large video files.Right now, I have a problem on the server where even if iptraf lists ingoing+outgoing at 5000 kbits/sec viewing video works fine, but it takes a while for normal webpages to load and I can't figure out where the bottleneck is.
free program that can convert my webpages containing javascript and html code into a flowchart. also i dont mind if the program works on either windows or ubuntu as i have both.
I am having problems while testing out squid proxy server. I just can't get it block anything. So, I'm running Debian lenny on my Virtualbox and Squid on it. I'm having windows 7 on virtualbox too and they can ping each other and the webserver on debian (apache2) is working fine. The problem is i can't get squid to block webpages. I have the correct settings on windows proxy settings, but i'm not so sure about squid. I want to block lets say www . xxx. com for example. So I add to the main configuration file:
I am starting to get bottlenecks in the loading of webpages via squid. It is not the actual playback of video that has performance issues, this is very good. However, when a webpage is first requested, it is the initial response that takes more than a few seconds to load the page. I am wondering how to troubleshoot the issue as I don't know whether it is squid, the dns lookup, the number of users, RAM, or the bandwidth. Bandwidth seems to be the least likely since the server has a high bandwidth and video streaming appears to have no problems. I do not have caching turned on yet, which would certainly help because I do not want to cache flb, mp3, etc. files and the last time I turned on caching the performance was actually worse. The slow loading of pages has only just beguin to creep into the performance, it wasn't an issue before.
1. need to run like a daemon which will read an active squid logfile in a refresh pattern of 5 minutes
2. calculate the total number requests based on different domains that the client access
3. calculate the total of number of requests based on different domains as well as the turnaround time of these access is more than 5 sec that the client access
4. calculate percentage of item 3 over item 2
5. report the results in html format as follows:
Domain Name Total req Req > 5 sec % of req > 5 sec
This little Atom-based unit works fine with Linux, but its fan is running at full-speed all the time.So I figured maybe lm_sensors could ajust its speed dynamically, but "sensors", "fancontrol", and "pwmconfig" all fail to work, even though the modules required for this motherboard are up and running:
As mentioned in another of my recent posts, I have set up a small network for my job, in which I am utilizing 4 Servers running Ubuntu 9.04 Jaunty Jackalope Gnome GUI and Ubuntu Server running underneath (yes I need a GUI for what I am doing). However, I am having a problem when bringing Ubuntu out of "locked" state, and any time that I am required to authenticate (i.e. sudo bash). After I type in my password, everything hangs for a good 3+ minutes.
To test this, I disconnected the Ubuntu Servers from the network, and I tried to authenticate again. With the server off the network, authentication did not hang, and the GUI came up in seconds. Also, I checked my syslog and memory utilization and both are well within acceptable range that they would not be causing sluggish performance.
With all of this said, I believe that there is some kind of resolution going on when trying to authenticate while the servers are connected to the network (i.e. Kind of like how doing a traceroute in a cmd prompt in Windows without the "-d" takes forever because of name resolution checking).I should also mention that my network DOES NOT have an internet connection by design.
This little Atom-based unit works fine with Linux, but its fan is running at full-speed all the time.So I figured maybe lm_sensors could ajust its speed dynamically, but "sensors", "fancontrol", and "pwmconfig" all fail to work, even though the modules required for this motherboard are up and running:
I am using squid to controlling access to the internet all is working fine expect one of the user who is using outside organization portal to connect internet. But whenever he tries to enter in the portal by typing (EXAMPLE)url. Permission denied error from squid occur.
How can i allow this portal in squid. So squid will allow this to access.
For some reason I can't load any webpages with FF. I get this error: Firefox can't establish a connection to the server at en-us.mozilla. I can ping everything and ssh and other protocols work just fine. Here is the output of my /etc/resolv.conf file (Comcast)
# Generated by NetworkManager nameserver 68.87.71.230 nameserver 68.87.73.246
There is an AIX 5.3 Box and there are some Perl scripts that generate web pages. We use them for monitoring of logs. But the perl script, let's name it "displayLogStatus.pl", that extracts some information such as "Failed", or "Completed" from specified log files doesn't refresh the page automatically.
In PHP I know how to refresh / reload a page after a specific time interval. For example this command in a web page:
PHP Code:
header("refresh:60");
would refresh the web page every 1 minute automatically.
I have set up a dialup connection using my nokia N70 mobile.. The connection i think, is ok. but when i took a browser-epiphany or mozilla, i cannot open a webpage.. the browser tries to connect but times out.. It seems to be a problem in some settings(firewall, proxy or something) in debian, because im using the same phone to connect in windows XP.. I dont know how and where to check for the settings. code...
I used wget -r to get all the web pages that were linked from index.html. The pages listed in index.html are all chapters. After using wget -r, all the chapters are now in the same folder on my local hard drive. Is there a way to build the chapters in their proper order into a "long"/"full" web page, rather than simply having each chapter as a link/next link on a previous page?
what is the best way (i.e standard way that is supported on all browsers and probably as well followed by web crawlers).... to include an html file either locally or externally in another ? Of course , i've done the research and i also know that there are server side includes (php , asp ...you name it) at the moment , i'm using this:
Quote:
<script type="text/javascript" src="path to file/include-file.js"> </script>
however, i've been warned that this method may not show up in some browsers as some tend to ignore this tag and that crawlers like your favorite search engine wouldn't bother reading this. so , what is the best and safest way to do the job? and btw , the reason why i've ousted SSI's from the start is because of among other things:
1) the fact that the included file is static html and because the text is included pretty much everywhere
2) hoping to reduce load time as the code (if successfully recognized) would hopefully be treated like any other embedded external file (e.x like an image) , therefore it would be cached without the need to downloaded it over and over again for each new page on the site.
I just wanted to know if having my laptop set to ondemand, will this affect performance in any way? I realize it increases the clock speed to performance when the CPU is under load, but does the time it take to go from ondemand to performance affect speed? Will there be any noticeable difference between the two setups? I have a dual core intel at 2.2GHz when in performance. When ondemand is set with no load it downclocks to 800Mhz.
I have got my Fedora12 setup working just beautifully... except the mouse!
A few months ago I invested in a very nice, expensive high performance mouse with very high resolution tracking. In Fedora 12 it is just too fast for me though, and I'm already well on the way to Carpel tunnel syndrome..
I have turned the sensitivity and acceleration down as far as they go but it is still too fast. The old ways of adjusting xorg parameters are, I understand it, now null and void due to the hotplugging HAL framework.
How to turn the speed of the mouse down on Fedora if the control panel doesnt turn it down enough.
I recently got karoo broadband installed, the speed is normally 8mbps but the longer I am connected to my router the slower it gets, I have to disconnect and reconnect to the router to get back to full speed, is this due to a bad wireless driver or do I need new drivers or a better router.
I have do some research by google to find out How To I slow down the speed when playing movie! And I found this: [URL]. But I not sure how can I do it!!
When I am running Ktorrent it takes about 30 seconds for a web page to open, in stead of 1 or 2 seconds. The download speed is very slow 200B/s and the status of most of the torrents is "Stalled". If have opened TCP and UDP ports 36477 4444 6881, 7881, 8881 and added them to the port forwarding list in my router. No difference.
about every second time when I start up my Ubuntu 10.4, my hard drive starts to work heavily. While it's doing so I see in the system monitor that the gnome-settings-daemon has the status 'uninterruptible'. After about 3 minutes the hard drive calms down and the status of gnome-settings-daemon switches to 'sleeping'. so from that I guess the heavy working of the hard drive is somehow related to that process. Sometimes gnome-settings-daemon seems to crash completely so that my theme is gone.
So is there a solution to that? because it's annoying that it slows down the system for about 3 minutes after start up. On the net I've found some old threads from 2004 and 2006 which describe crashing of gnome-settings-daemon. But there didn't seem to be a solution.
when calling 'top' dbus is having load of activity ('dbus-monitor --session') outputs also a lot of action (see attachement). this has effect that my machine is slowing down and normal work takes ages.I have no clue where the activity is coming from. I also had a look at https://bugs.launchpad.net/ubuntu/+s...or/+bug/441828. But there are no unnormal devices plugged in... (just keyboard + cordless mouse).when starting the machine the cpu load is ~9%. After a while (after 1 day) it goes up to 70-80%. the started applications do not change during that time. so i guess somewhere there is a leak.
I'm moving to Vietnam soon and was wondering if anyone knows of the best native linux way to circumvent the internet censorship there without slowing it down too significantly. I used to use proxy servers to access Wikipedia in China, but they were slow and unreliable. Not to mention, it was a pain to enable/disable it.
I am having annoying problems with my fresh installation of Mandriva 2010.2. It uses the xorg-1.7.7 server for my ATI X600 mobility graphics card. (package: x11-server-xorg-1.7.7-1mdv2010.1) There are several - perhaps related, perhaps unrelated - problems:
I'm trying to dump a mysql database on a small web server without killing performance. I tried using the nice command to give the mysqldump and gzip a low priority, but gzip is still taking up 100% CPU. Pages on the web server are loading incredibly slow. Here's my command:
Code: nice -n 19 mysqldump -u USER -pPASSWORD DATABASE | nice -n 19 gzip -9 > OUTFILE.sql.gz How do I get gzip to run without taking up 100% CPU? I've attached a screenshot of top about 8 seconds into the dump.
I have a tenda wireless adaptor running on 11.04 natty. The USB id is: 148F 3070
Using the already installed drivers rt2800usb it can connect to all 13 channels but is very flaky, transfers slowing and stopping regularly. The rt2870sta driver is a lot more stable, but it will only connect to channels 1-11, but I need to use channel 13 due to massive wifi congestion on other channels...
I've tried iwpriv but it says there are no ioctls for the device.
Is there any way to get the installed driver rt2870sta to scan and connect to channel 13?
I've also tried to install the latest drivers from the ralink website: rt2870sta says it can see all 14 channels, but fails to scan. I also tried rt3070 driver but I cannot insmod as there are errors...
My squid server works fine in fedora 11 system . Is there any web like interface for admins to create,change,modify users of squid and to view their logs.
I would like to ask some help and tutorial for setting up and how to configure squid proxy server in my (Home PC Server). I am a newbie in Linux Centos. I already installed in my system the CentOS 5.5 . Now, I want to configure it as my internet server, all of my 4 system running in Windows including the laptop I want to connect through my CentOS pc with username authentication. I assign all IP address by static. see tthe attachement in my set up. [url] I just want to know what I need to change and add in my squid config file. And how can I configure properly my CentOS with 2 LAN card as internet server.
