General :: Good Software To Monitor Disk Io , Memory And Cpu Use?
Jul 19, 2011
I'm developing a website. I was wondering if there are any tools out there that make it easy to log and graph usage statistics of how my cpu, memory, disk and network are used.
I need to somehow know when I need to scale up / when I'm going to get problems soon.
I found http://sebastien.godard.pagesperso-orange.fr/
(command line thingy, not so useful because I'd have to write my own graphics and logging layer on top of it..)
View 3 Replies
ADVERTISEMENT
Jul 16, 2011
i had configured the opennms but i didint able to get the disk space and memory alert by mail... and also i need a plgin gor opennms can u tell me wat plugins suit for opennmms monitoring tool ...
View 2 Replies
View Related
Jun 21, 2011
I am in the process of looking at file integrity checkers. So far I have found AIDE.
1. What are the ups and downs of AIDE?
2. Is it pretty easy to use?
3. Is there any other open source tools that are better than AIDE?
View 1 Replies
View Related
Mar 15, 2011
The more context the better. So far it does not look like it has anything to do with memory.
View 4 Replies
View Related
Nov 3, 2010
(Ubuntu Linux server, 64-bits)I was troubleshooting a problem with a file (~3.0 GB) which I had just downloaded, but it was failing the integrity test, when I discovered something really unusual.First this is the MD5 of the file after download, which didn't match the expected value:
~% md5sum media.iso
5d74facb904cc1765a468354908a8f34 media.iso
Some time passes, nothing should have changed the file during this time, but when I went to check the file again:
~% md5sum media.iso
a5b97c5016afb39bd67ccfc3fa6ca59e media.iso
This was really unexpected. Since I have a lot of RAM, I suspected this was the effect of caching and something was going awry with it. I decided to retry with the whole file from disk, for my surprise:
~% sudo sysctl -w vm.drop_caches=3 # This linux command invalidates
vm.drop_caches = 3 # everything in the memory cache.
~% md5sum media.iso
2992aa6270f6e1de9154730ed3beedc1 media.iso
I redid it and now it seems to stay consistent, although this still isn't the value I was expecting. Certainly, the contents in memory cache were different from the contents on disk.This is the big problem.To fix the download, I created a torrent on the source machine and opened it in the target machine. Five 1MB chunks out of ~3.0GB failed integrity check. I used the torrent to fix these file chunks and how the file integrity is ok.The problem now is to determine where the data got out-of-sync.
I tested the memory with memtest86+, all but the bit fading test. I was expecting to see some failing memory module, but there wasn't anything. Everything is ok.Filesystem is Ext4, over LVM2, over a 3-disk RAID5 array.Ext4 is considered stable, and if data were inconsistent between disks, mdadm would have warned. But there is nothing in the logs. S.M.A.R.T. error logs are clean, the disks are new (have less than 30 days of "power-on-hours").I'm looking for information about any data-loss bugs in my current kernel (2.6.35), but there doesn't seem to be anything, as far as I looked.what else I could check, or where exactly could be the defect/bug?It is a Ubuntu 10.10 64-bit, Core i7 930, 6 GB non-ECC RAM.
Update: I confirmed that the files are being correctly written to the disk, the pages are being altered after they are read from disk, while in memory. I did a lot more memtests (I left it doing bit fade test overnight),and still nothing. All memory modules seem ok.Some more tests:
~% md5sum media.iso
cc8bcf1ce67ff7704eadc2222650c087 media.iso
~% cp media.iso tmp[code]....(direcat is a version of cat that reads with O_DIRECT, that is, bypassing page cache)There is a clear pattern: it always happens to the 2nd byte in a 16-byte alignment. In that byte, almost always the bit 4 (LSB) flips to one, but there was one instance where bit 2 flipped to zero.
View 1 Replies
View Related
Apr 13, 2010
I have a security cam watched by a computer with Motion. on that computer i use hdparm -S 240 /dev/hdb to stop the harddrive where the pictures go from running when not used (witch is usually 2 days in a row). Now when motion is detected, the first 3 or 4 pictures are saved, and then there is a pauze for about 5 sec. before the next picture. This has to do with the hard-disk spinning up (I tried without), but I don't understand why not more pictures are held in memory until the disk is ready. how to solve this without having the disk running all days?, or what i should start reading
motion (version 3.2.9)
Debian lenny
Kernel 2.6.26-2-686
hdparm v8.9
PII with 384mb ram
[code]...
View 6 Replies
View Related
Aug 2, 2010
I am using Ubuntu and looking for a good editor to edit a file that is > 4GB. I just need to put content at the end and beginning of the file. I suppose I could use something like
cat "text to add" >> huge_file
To append to the file. Is that the route to go? What about prepending? In general, what is the best route if I wanted to edit somewhere in the middle?
I've tried VIM and it fails miserably. I assume emacs and nano would be even worse. What else is there? I assume to accomplish what I am looking for, the editor would have to be specifically designed for this by not keeping the entirety of the file's contents in memory.
View 5 Replies
View Related
Apr 6, 2010
clarify me with ulimit output and memory limit?
ulimit -a output:
core file size (blocks, -c) unlimited
data seg size (kbytes, -d) 1572864
[code]...
View 2 Replies
View Related
Oct 1, 2010
What is the best way to detect disk mounts?
I'm setting up a system to automatically detect disk mounts, so I'm looking for a file or something where disk mounting is recorded.
There are several files that look promising, but I am a LINUX novice, so I don't quite understand the exact roles each play:
Of the above files, etc/rmtab looks most promising.
View 2 Replies
View Related
Jul 2, 2010
We are graphing various system parameters using Cacti. One of our graphs shows hard drive reads and writes. A question came up: why do we need this graph?
View 3 Replies
View Related
Jan 8, 2010
What a good amount of disk space to have free? Is there a general rule of thumb? IE 70, 80 or 90%?
View 2 Replies
View Related
Mar 15, 2010
I was trying to get the status of memory usage and disk usage using sigar in windows and ubuntu. done this in windows by just copying the sigar library into jdk library. But i was unable to do so in ubuntu. I've copied the library to java-6-sun library but still can't run the program.
View 14 Replies
View Related
Jun 3, 2011
I'm searching a good suse monitoring application. I want to monitor performance(cpu,memory) also process,login to system, I want to run some automatically script when process down, send email.
View 5 Replies
View Related
Jan 24, 2011
I use linux and Unix and I want to monitor the memory usage for process. To prevent memory leakage and out of memory of the system. Any command or sytnax , have more better and presentable data than below command about memory usage of one process ?
View 3 Replies
View Related
Sep 2, 2010
How can I periodically monitor memory usage of a process in linux.Can it be dumped in some file.So that later I can see what was the process behaviour in taking memory.
View 2 Replies
View Related
Aug 20, 2010
I have a lot of RAR files and ISO. Is there a program like Winrar which could open them in Linux? Cause now it only opens zip files . Also I would like to know what the best package manager is (I mean the easiest -used to use the Software Manager in Mint 9 Xfce).At last I would like to know if there is a good program to make disk images to reset the system.
View 9 Replies
View Related
Feb 1, 2010
in this example, my memory 993.4 MiB memory is said to have 575.9 MiB of it used and 163.4MiB of my 2.8 GiB swap memory used. but in my processes tab, the most memory hogging program is 98.3 MiB, and Pidgin, 25.9 MiB, and 18.9 MiB, 14.9, 6.2,6.1,5.2,3.4,3.3,1.8,1.8,1.7, etc. I'm certain these don't add up to 575.9 MiB so where is all this extra memory usage coming from?
also, why is data measured in MiB?
View 6 Replies
View Related
May 11, 2010
I have a system with 1 GB RAM. I'm running KDE 4. I created a tab to look that the Physical Memory in the System Monitor program, which I assume appears to look at the same stats that "top" looks at. In that Physical Memory tab I have 3 tables: Used Memory, Free Memory, and Application Memory.The Used Memory table shows that the system is using .94 of .98 GiBytes. The Free Memory table shows that the system has .5 GiBytes of RAM free.
However the Application Memory shows that only 339 M-Bytes of RAM is being used.Note that "top" shows the same info.So where is the other .6 GiBytes of RAM that the Used Memory table shows as being used?If I look at the process table which is supposed to encompass all of the processes running, including the ones for the OS, then it appears to add up to the 339 M-Bytes being used in the Application Memory table. Is the rest of the memory being held in reserve by the OS to be used as needed? If so, then why when another application is opened the Free Memory goes down instead of staying constant?I also noticed this memory "black hole" when I was running 11.0 on a system with 4 GB of RAM. The OS appeared to "take up" a large chunk of memory that was NOT being used by any applications and making it "disappear" - meaning that the applications were using about 1.3 GiBytes of RAM and Free Memory was showing only .7 GiBytes instead of the over 2 GB of RAM that should be free.
View 2 Replies
View Related
Aug 3, 2011
running top shows:
Tasks: 165 total, 1 running, 164 sleeping, 0 stopped, 0 zombie
Cpu(s): 3.5%us, 2.2%sy, 0.0%ni, 93.9%id, 0.5%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 3721884k total, 3376604k used, 345280k free, 107524k buffers
Swap: 3855356k total, 40k used, 3855316k free, 2013536k cached
but System Monitor tells me that only 33.9% (1.2gb of 3.5gb) is being used. Why is the memory used difference so great?
View 3 Replies
View Related
Jul 22, 2009
Im just trying to write some script to caputre memory and cpu usage on SLES servers, I just wanna use "top |grep Mem" and "top |grep Cpu". when I ran the above command, it just keep going. i just want to get one line each for memory and cpu.
View 3 Replies
View Related
Apr 20, 2010
I am using malloc and frees a lot in my program. It shows its allocated but when i remove it doesnt show as the memory is removed(I am using the top command to view VIRT memory usage). If this continously grows what would happen to my program (Will it go out of memory?)
View 4 Replies
View Related
Mar 18, 2011
I have a computer with 16GB of ram. At the moment, top shows all the RAM is taken, (NOT by cache), but the RAM used by the various processes is very far from 16GB.I have seen this problem several times, but I don't understand what is happening.My only remedy so far has been to reboot the machine.
View 1 Replies
View Related
Jun 6, 2011
I have a simple C program that reads a 1 GB file from disk into memory.The first time I run this program, the process takes several seconds. But if I run this program again immediately after it finishes, the read happens almost instantly. What is going on here?My suspicion is that the operating system is realizing that the data I'm trying to read is still uncorrupted in memory (its been freed but not overwritten), so instead of reading it again, it just gives me the same block. I would really like to know what this process is called, or any Googleable keywords that would allow me to research it.
The reason I ask is because the size of my input data has increased. Now I need to read in a 6 GB file (my system has 12 GB of RAM), but I'm not observing the same behavior with the larger file. Each time I run the program the read takes an equally long time.
View 2 Replies
View Related
Jan 16, 2010
I'm trying to get the built-in reader on my system working. It's one of those multi-slot ones on the front of the box. The card I have is specifically a "San Disk Memory Stick PRO Duo", this sucker here: [URL]
The light on the reader will light up, but there's zip in any of the kernel logs. I tried the obvious kmods to get it working - tifm_7xx1, tifm_sd, tifm_core, via_sdmmc, mmc_core, etc but no luck.
Nothing seems to be useful in lspci or lsusb:
Code:
00:00.0 Host bridge: Advanced Micro Devices [AMD] Unknown device 9601
00:02.0 PCI bridge: Advanced Micro Devices [AMD] Unknown device 9603
00:07.0 PCI bridge: Advanced Micro Devices [AMD] Unknown device 9607
00:0a.0 PCI bridge: Advanced Micro Devices [AMD] Unknown device 9609
[Code].....
View 1 Replies
View Related
Oct 26, 2010
I have encountered this problem of memory usage is increasing as the during the my program is being run until 1Mb is left then it stays at that.A part of the program is this:
Code:
#define WRITE_BUF_SIZE (1024*1024)
void post_data(const void *data, unsigned long size)
[code]....
View 3 Replies
View Related
Mar 2, 2011
I bought a 4 gb usb memory stick for a windows 7 rescue disk for my 10' asus laptop Eee pc 1005 HAB.Can it work alternate to a CD rescue disk? It has a FAT 32 partition. Maybe I should format it?I used freeware to put Ubuntu 10.10 netbook on the same hardware kind, a Sandisk memory stick. Instead of Nero, Pendrive Linux. I can install it after I make a rescue disk, and shrink drive C.
View 4 Replies
View Related
Oct 6, 2010
I installed the latest 10.04.1 server minimal install and enabled the virtualisation option. I compiled enough X so that I could run virt-manager and I was able to create a couple of VMs and run them and manage them, but the problem is that in the graphs in manager, I can only get CPU usage, not Disk or Network IO. The options are greyed out. Am I missing something required for these graphs to work ?
View 1 Replies
View Related
Apr 2, 2010
i am having a problem that i would call a bit "important" with my server. so, from last 3 weeks the used space of my hard disk (RAID I) started growing up. i have 2 x 1 tb HDD working on RAID I and i did not install anything those weeks. the space just started changing from 90 GB till 580 GB. now the situation is stable there but i think it's not normal.
the bandwidth usage is low (like 120 gb in 2 months) and i am running 6 counter strike gameservers, a forum, a very little website and some local stuffs... a friend of mine told me that my server could have been hacked but i am afraid it did... some useful informations: when i reboot the server the used space goes down again to ~100 GB and then it starts going up again. i cant really find where all those files are located:
[Code]...
View 2 Replies
View Related
Aug 22, 2010
This is my first post in these forums. I'm still quite new to Linux (using Mint 9) so please bear with my not-very-articulate question(s)When I boot up and open up a tty terminal I get a message saying "Memory corruption detected in low memory." I've done an extensive google search about the issue and it seems not uncommon. I ran a memtest with no errors returned, so I'm sure that there's nothing really wrong with the memory; apparently it's a bug in the kernel that's causing this.
View 2 Replies
View Related
Jan 17, 2010
I found from command 'top' that 8GB memory are used. However, using command 'ps' with some options to grep the running processes and then summing up the memory used by the running processes are less than 2 GB. Where has the used memory gone ?
View 7 Replies
View Related
