Ubuntu Installation :: Increases RAM Usage Till 90% Then SWAP 90% Even When No Application Is Running?
Mar 9, 2011
I was trying to have a go at installing MAC on my dell alongside Ub and W7. I copied the grub2 to the first part of my sda5 so as to put the mac loader in MBR.I have since repaired grub2 back to MBR.But now my beloved Ubuntu starts up then continuosly increases RAM usage till 90% then SWAP 90% even when no application is running!!
I am running Apache 2.2.3 on a CentOS release 5.3 (Final) with 100 Sites. I've notice that Apache is making my server Swap around 200 MBs. "http://www.xxx.yyy.zzz/server-status" doesn't show me too much to, so I am looking the behavior of specific httpd process. ProcessID "18753" is the one for "http://www.xxx.yyy.zzz/server-status" in my browser.
This command show me (In KBs) how much virtual memory is that specific process using: # /etc/init.d/httpd start # grep Private_Dirty /proc/18753/smaps | awk '{ print $2 }' | xargs ruby -e 'puts ARGV.inject { |i, j| i.to_i + j.to_i }' 3012 ... Running this command a lot of times it gives me the same output, but suddenly... # grep Private_Dirty /proc/18753/smaps | awk '{ print $2 }' | xargs ruby -e 'puts ARGV.inject { |i, j| i.to_i + j.to_i }' 21708
Something make that process (and all the others httpd process too) to use a lot more memory!
Part of my httpd.conf: # Timeout 120 KeepAlive On MaxKeepAliveRequests 100 KeepAliveTimeout 3
My server is running Mysql 5.1.34, vsftpd 2.0.5, BIND 9.3.4-P1 (as slave). I couldn't found anything running in the specific time that httpd processes start to use that much memory.
As the thread states, I wonder why my RAM usage is about 56% without any application running. It turns to 58% while opening Firefox (with only one Tab/Page opened) and typing this post. Is there something wrong?
I was wondering why after a couple of days of my ubuntu server running, that it goes from starting off at 94mb of ram usage all the way up to 498mb of ram usage?
I use an ATI card with proprietary drivers and my memory usage in ideal situations when idle is around 600-700 MB. I use cairo-dock, AWN, compiz, gnome-do, and GNOME (w/o panel). My problem is, I have mysteriously increasing memory usage over time, which drops back down after I restart all my openGL applications. It can get as high as 1.5 GB. Looking in top, the weird thing is that when I sort by memory, I observe that none of the applications I am restarting, nor Xorg, use a significantly smaller percentage of system memory after being restarted. So what is going on? Does fglrx have some kind of memory leak? And is there a fix? In the last 10 minutes, my memory has for no apparent reason increased from 700 MB idle to 775 idle, and is still going up.
I have a desktop PC that I built back when I was a teenager, running Ubuntu 10.04 LTS and nothing else. I love it, but for one thing: the dang CPU usage hits at least 99% whenever any application besides Xorg is open and running. This doesn't affect performance too much, but if Windows XP Home Edition never gets close to 100% usage, then I figure there's something going on.
I've come across a really strange issue with one of my RHEL servers. The "free" command shows that 7019 MB of memory are actually in use by my system, but when summing up the actual usage (or even virtual usage like the example below) it doesn't add up - the sum is far less than what is reported by "free":
I have a netbook and one of the suggested optimizations was to reduce the use of swap.I've noticed on my desktop and conventional laptop that it is quite usual for the swap file to be used even when memory usage is low (25% of available memory).I'm looking for some advise on the best way to set up a conventional desktop or laptop as my understanding is that the use of a swap file will slow the system responsiveness down. Can I use a version of the above to improve performance and reduce swap usage?
I'm using slackware about a month now and two days ago I checked to see the usage of my RAM and I saw that there was no swap, no used, no total, nothing! (how can this be?) swap -s returned nothing, I checked fstab and there was swap there so I entered the line about swap:
I believe it' s correct. I checked after restart with "free" and the total was ok but used is 0. I copied about 5 GB to see what would happen and still nothing. RAM was nearly full but still no swap used!
We have several clusters used for high performance computing. The cluster nodes have 48GB memory and on each there is 2GB swap available. What I would like to avoid is the usage of swap as long as there is enough free memory or empty the swap as soon as there is a free memory. I thought that this could be achieved by setting the swapiness to 0, but although it helped a bit, it still didn't solve the problem completely. Even with swapiness set to 0, my memory usage looks like this:
I have Ubuntu 10.04 installed on my PC with 1GB of RAM and 3GB of Swap partition. But the machine gets hung or reboots itself when the usage is even marginally higher. This is the output of "free -m" for Swap:
Swap: 2908 11 2897
I have tried increasing the swappiness to 80, and this not made any difference. I believe the RAM is taking up all the load and none of the pages are going in to the swap. Hence the slow response and the frequent hung system. I know this is an old PC but Windows XP (installed on another HDD) runs way better on the same configuration.
No matter what I do, the SWAP usage remains zero all the time. Is there anything I am missing? In the following case (see attached screenshot) I am running make on the kernel that I downloaded. The CPU usage is understandable. But what is the use of Swap when its never used. [URL]. I am on Kubuntu natty. My partitions are as follows:
Just noticed from the "top" command that one of my least heavily used box is swapping excessivly by a program called setroubleshootd. Following is the top section of the "top" command sorted by Swap used for both boxes. Also tried checking it out to see if there's a "service setroubleshootd restart" but when I checked the status I got the following.
Code: [root]# service setroubleshootd status setroubleshootd: unrecognized service Lightly loaded box with lots of swapping
For some reason, if I leave my Linux box running for several days, the swap space and RAM slowly fill up until my system is so slow that it takes around 15 seconds just to open a new tab if Firefox (Iceweasel, specifically). I have 512GB RAM and almost a gig of swap; how on earth does it fill up so much? Even if I close all my programs, there's still over 600MB swap used and all RAM is full. I've included a screenshot of 'top' running just about two minutes after I closed all my running programs.
(Before I closed it, I had only 71MB swap free.) I know that Linux is supposed to make good usage of RAM, but isn't this over the top? Is there a way to force it to use only required memory with no or little extras kept in RAM? Just thought I'd add in the fact that I'm running Xfce as opposed to KDE or GNOME in an attempt to have a smoother running system on my old hardware. Also, what's the "VIRT" column?
My monitor tools indicate that the percentage of swap used is more than the ideal , so I want to calculate which process is consuming from the swap. I tried the following but it didn't help be 100%
#ps -eo vsz,rss,pid,args | sort -n
How to accurately calculate which process consuming from swap, just the swap no ram + swap!
On one of my servers the "free" command tells me that a lot of swap space are in use. What I'd like to do is to determine which processes have been swapped out. I tried issuing "top" and sort by the "swap" column, but this doesn't seem to provide correct values - when performing the same excersize on another server with close to no pages swapped out, the sum when adding the swap value for each process greatly exceeds the swap usage reported by "free". So how do I go about determining the swap space used for individual processes?
unable to run opencv opllications on ubuntu(10.04)error:OpenCV Error: Unspecified error (The function is not implemented. Rebuild the library with Windows, GTK+ 2.x or Carbon support. If you are on Ubuntu or Debian, install libgtk2.0-dev and pkg-config, then re-run cmake or configure script) in cvNamedWindow, file /home/p/OpenCV-2.0.0/src/highgui/window.cpp, line 100.
We are running IPmonitor to monitor the disk usage on our Linux servers. It does not seem to coincide with what is reported when running df -h. For example on a Red Hat 5.3 server - our IPmonitor shows that 85% is used on the /usr partition, however when I do a df -h on the server it shows that 91% is used. Why there would be a discrepancy? IPmonitor uses SNMP.
Nagios had alerted me that the server had a very high load average exceeding the critical level (17+), when logging onto the server I found that all 4GB of the swap was in use despite the fact that there was 15GB+ of free memory (and that's not even including memory from cache and buffers!) Because it seems all heavily used pages were being stored in swap, the I/O wait on the server became very high, and 4 kswapd daemons were taking up nearly 100% available CPU. This did coincide with an error reported by Bacula during a backup job while changing to a bad tape...
From /var/log/bacula.log: Code: 10-Dec 02:11 bacula-sd JobId 1898: End of medium on Volume "4097" Bytes=434,170,000,000 Blocks=217,084 at 10-Dec-2010 02:11. 10-Dec 02:11 bacula-sd JobId 1898: 3307 Issuing autochanger "unload slot 4097, drive 0" command. 10-Dec 02:12 bacula-sd JobId 1898: 3301 Issuing autochanger "loaded? drive 0" command. 10-Dec 02:12 bacula-sd JobId 1898: 3302 Autochanger "loaded? drive 0", result: nothing loaded. 10-Dec 02:12 bacula-sd JobId 1898: 3304 Issuing autochanger "load slot 4096, drive 0" command. 10-Dec 02:13 bacula-sd JobId 1898: 3305 Autochanger "load slot 4096, drive 0", status is OK. 10-Dec 02:13 bacula-sd JobId 1898: Volume "4096" previously written, moving to end of data. 10-Dec 03:51 bacula-sd JobId 1898: Error: Unable to position to end of data on device "Tape-1" (/dev/IBMtape0n): ERR=dev.c:1384 read e rror on "Tape-1" (/dev/IBMtape0n). ERR=Input/output error.
10-Dec 03:51 bacula-sd JobId 1898: Marking Volume "4096" in Error in Catalog. 10-Dec 03:51 bacula-sd JobId 1898: 3307 Issuing autochanger "unload slot 4096, drive 0" command. 10-Dec 03:58 bacula-sd JobId 1898: 3301 Issuing autochanger "loaded? drive 0" command. 10-Dec 03:58 bacula-sd JobId 1898: 3302 Autochanger "loaded? drive 0", result: nothing loaded. 10-Dec 03:58 bacula-sd JobId 1898: 3304 Issuing autochanger "load slot 4098, drive 0" command. 10-Dec 03:58 bacula-sd JobId 1898: 3305 Autochanger "load slot 4098, drive 0", status is OK. 10-Dec 03:59 bacula-sd JobId 1898: Wrote label to prelabeled Volume "4098" on device "Tape-1" (/dev/IBMtape0n) 10-Dec 03:59 bacula-sd JobId 1898: New volume "4098" mounted on device "Tape-1" (/dev/IBMtape0n) at 10-Dec-2010 03:59. At the same time, these messages starting occuring in /var/log/messages:
Code: Dec 10 03:51:47 07 kernel: Mem-info: Dec 10 03:51:47 07 kernel: Node 0 DMA per-cpu: Dec 10 03:51:47 07 kernel: cpu 0 hot: high 0, batch 1 used:0 Dec 10 03:51:47 07 kernel: cpu 0 cold: high 0, batch 1 used:0 Dec 10 03:51:47 07 kernel: cpu 1 hot: high 0, batch 1 used:0 Dec 10 03:51:47 07 kernel: cpu 1 cold: high 0, batch 1 used:0 Dec 10 03:51:47 07 kernel: cpu 2 hot: high 0, batch 1 used:0 Dec 10 03:51:47 07 kernel: cpu 2 cold: high 0, batch 1 used:0 Dec 10 03:51:47 07 kernel: cpu 3 hot: high 0, batch 1 used:0 Dec 10 03:51:47 07 kernel: cpu 3 cold: high 0, batch 1 used:0 Dec 10 03:51:47 07 kernel: cpu 4 hot: high 0, batch 1 used:0 Dec 10 03:51:47 07 kernel: cpu 4 cold: high 0, batch 1 used:0 Dec 10 03:51:47 07 kernel: cpu 5 hot: high 0, batch 1 used:0 Dec 10 03:51:47 07 kernel: cpu 5 cold: high 0, batch 1 used:0 Dec 10 03:51:47 07 kernel: cpu 6 hot: high 0, batch 1 used:0 Dec 10 03:51:47 07 kernel: cpu 6 cold: high 0, batch 1 used:0 Dec 10 03:51:47 07 kernel: cpu 7 hot: high 0, batch 1 used:0 Dec 10 03:51:47 07 kernel: cpu 7 cold: high 0, batch 1 used:0 Dec 10 03:51:47 07 kernel: Node 0 DMA32 per-cpu: Dec 10 03:51:47 07 kernel: cpu 0 hot: high 186, batch 31 used:162 Dec 10 03:51:47 07 kernel: cpu 0 cold: high 62, batch 15 used:48 Dec 10 03:51:47 07 kernel: cpu 1 hot: high 186, batch 31 used:0 Dec 10 03:51:47 07 kernel: cpu 1 cold: high 62, batch 15 used:0 Dec 10 03:51:47 07 kernel: cpu 2 hot: high 186, batch 31 used:0 Dec 10 03:51:47 07 kernel: cpu 2 cold: high 62, batch 15 used:0 Dec 10 03:51:47 07 kernel: cpu 3 hot: high 186, batch 31 used:18 Dec 10 03:51:47 07 kernel: cpu 3 cold: high 62, batch 15 used:0 Dec 10 03:51:47 07 kernel: cpu 4 hot: high 186, batch 31 used:159 Dec 10 03:51:47 07 kernel: cpu 4 cold: high 62, batch 15 used:56 ... Dec 10 03:51:47 07 kernel: Node 3 HighMem per-cpu: empty Dec 10 03:51:47 07 kernel: Free pages: 732052kB (0kB HighMem) Dec 10 03:51:47 07 kernel: Active:4232128 inactive:3071288 dirty:158210 writeback:0 unstable:0 free:183320 slab:256840 mapped-file:289545 mapped-anon:3805487 pagetables:13063 Dec 10 03:51:47 07 kernel: Node 0 DMA free:10796kB min:4kB low:4kB high:4kB active:0kB inactive:0kB present:10356kB pages_scanned:0 all_unreclaimable? yes Dec 10 03:51:47 07 kernel: lowmem_reserve[]: 0 3512 9067 9067 Dec 10 03:51:47 07 kernel: Node 0 DMA32 free:213332kB min:2500kB low:3124kB high:3748kB active:1794108kB inactive:1463220kB present:3596296kB pages_scanned:64 all_unreclaimable? no Dec 10 03:51:47 07 kernel: lowmem_reserve[]: 0 0 5555 5555 Dec 10 03:51:47 07 kernel: Node 0 Normal free:41028kB min:3952kB low:4940kB high:5928kB active:3409444kB inactive:1471120kB present:5688320kB pages_scanned:0 all_unreclaimable? no Dec 10 03:51:47 07 kernel: lowmem_reserve[]: 0 0 0 0 Dec 10 03:51:47 07 kernel: Node 0 HighMem free:0kB min:128kB low:128kB high:128kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no Dec 10 03:51:47 07 kernel: lowmem_reserve[]: 0 0 0 0 Dec 10 03:51:47 07 kernel: Node 1 DMA free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no ... Well to cut a long story short, I fixed the problem by disabling the swap partition with 'swapoff'. After about 30 mins all the swap was freed and the server went back to normal. I don't dare reactivate the swap partition and unfortunately as this is a live server which currently has no fail over, I can't reboot either
Server Spec: 4 * Dual-Core AMD Opteron(tm) Processor 8214 32GB DDR2 ECC RAM RHEL 5.5, 2.6.18-194.11.3.el5 SMP x86_64 Running many KVM VMs (All CentOS x64) and kksmd is used. bacula-dir Version: 5.0.0 IBM Tape Drive using lin_tape module version 1.34.0 according to modinfo
And before anybody asks # sysctl vm.swappiness vm.swappiness = 10
I recently noticed my RAM problem. When I start any application it increases RAM usage but even after I close it RAM usage doesn't go down. Instead when I restart that application RAM usage goes up again. Using ubuntu 10.10
is there any way to monitor each application network bandwidth usage ?I've used gnome-system-monitor, but unfortunately it just show the total network activity
I want an application/program whatever that can save how much I have downloaded an uploaded, so I can keep track of things. Is there something like this that I can use on Linux?
We run Jboss app server that of course is all multithreaded under one JVM. I have couple of question regarding monitoring on per thread basis:
1. Is there a way to see which thread is bound to which CPU core? 2. Is there a way to see the CPU, Memory usage per thread? Something like prstat on Sun box which is real time and gives detailed information about threads per CPU
i have a c++ application that consumes a lot of run time memory. It is a very large project with a lot of sub-modules. My target is to reduce the runtime memory usage as much as possible. Therefore i would like to know if there is a tool that i can use to profile the code (note that i am not interested in checking for memory leaks / corruptions so Valgrind is not for my purpose) I need to know which module has the most static data like large arrays or a lot of variables to know where to start reducing.
I currently have two internet interfaces installed, one is ethernet (eth0) and the second is wireless (wlan0). Many command line applications allow you to specify which interface should be used, but many gui apps don't provide this option or at least I haven't found it. I have some questions:
1. How would I tell Firefox to use only my wlan0 interface? If it's possible in Firefox, is this also possible with Google Chrome?
2. If a program doesn't provide a command line argument to support this, is there a standalone application that could help manage preferences for multiple applications?
I just wanted to use a network bandwidth usage monitoring application. Scenario: I am using an EV-DO based USB broadband modem with a limited GB plan. For additional data usage they charge per MB. Currently I use either wvdial (mostly) or pon to start the connection. So if there is any network monitoring application which could log time used and data used for the session, it would be great. Actually debian has too many different network monitoring applications, But I am not sure which one suits well for this purpose.
I am facing an high CPU Usage 800% in a(Quad CPU, RHEL 64 bit kernel) with my C++ application .
The details are below:
1)The C++ Application has been compiled in RHEL (2.6.9-42.ELsmp #1 SMP Wed Jul 12 23:27:17 EDT 2006 i686 i686 i386 GNU/Linux)32 bit server(Quad CPU 8 cpu) in Dev lab. When this application has been tested for 12 hrs in the Dev lab, the CPU usage is varying between 20% to 50% .
However, when the above C++ application deployed in production which is RHEL (2.6.9-67.ELsmp #1 SMP Wed Nov 7 13:56:44 EST 2007 x86_64 x86_64 x86_64 GNU/Linux)64 bit server the CPU usage is found to be increasing constantly to 800%.
2)When the CPU reached to 800% in Production Server, we have taken the pstack of the C++ Application process by using the command pstack p [captured thread id ] and we found that the pstack is showing the high CPU
usage (800%) in below libraries:
If there is any GLIB /pthread library/any other differences between 32 bit and 64 bit kernel. Since the application has been compiled in a 32 bit kernel and deployed in 64 bit kernel. Please provide your support on the same.