Server :: Root File System At 100 Percent Capacity - Why
Jun 6, 2011
When I try to install anything recently, I was getting errors about "No Space". I noticed that the root drive (/dev/sda1) has 100% usage which I'm not sure how that suddenly happened.
Code:
tom@HouseMedia:/$ df -h
Filesystem Size Used Avail Use% Mounted on
/dev/sda1 9.0G 9.0G 0 100% /
none 1.5G 552K 1.5G 1% /dev
none 1.5G 0 1.5G 0% /dev/shm
none 1.5G 300K 1.5G 1% /var/run
none 1.5G 0 1.5G 0% /var/lock
none 1.5G 0 1.5G 0% /lib/init/rw
/dev/sdb1 294G 182G 97G 66% /mediastorage
There was a powerloss recently and I wondered if some serious corruption had occurred. Since I'm checking the root drive, I had fsck run after a restart:
Code:
sudo shutdown -F -r now
FSCK went to work, briefly, and the logs (/var/logs/checkfs and /var/logs/checkroot) remain empty. Speaking of log files, I had a look at all of them and they take up a mere 32MB, so that's not the issue...
Code:
tom@HouseMedia:/var/log$ ls -h -l
total 32M
drwxr-x--- 2 root adm 4.0K 2011-06-05 06:39 apache2
drwxr-xr-x 2 root root 4.0K 2011-01-20 10:43 apparmor
drwxr-xr-x 2 root root 4.0K 2011-06-01 06:37 apt
-rw-r--r-- 1 root root 0 2011-03-01 06:43 aptitude
-rw-r--r-- 1 root root 851 2011-02-08 10:08 aptitude.1.gz
-rw-r----- 1 syslog adm................
Using Code:
du -h
I know that:
/var uses 1.2 GB
/root uses 100 K
/usr uses 1.4 GB
/tmp is empty
/home has 35 MB
Have already ran apt-get clean. How can I figure out what is taking up so much room? How can I go about figuring out what is huge and is safe to remove?
View 12 Replies
ADVERTISEMENT
Oct 20, 2010
Our CentOS 5.5 server has an intermittent problem where kswapd0 begins using 100% CPU, driving the system load to 20-30 and higher, and eventually crashes the server. The problem seems to be triggered by an intensive Java process (Lucene indexing), but only once every month or two. Lucene reindexing normally runs every 15 minutes without a problem. When the problem happens, there is still plenty of free RAM (as measured by /usr/bin/free's "buffers/cache" value, which is 1.5GB) and free swap space. The server is running MediaWiki 1.15 with the standard CentOS Apache, PHP, MySQL. My intuition is that this is a kernel/swapper bug.
Kernel info:
$ uname -a
Linux myhost 2.6.18-194.11.1.el5 #1 SMP Tue Aug 10 19:05:06 EDT 2010 x86_64 x86_64 x86_64 GNU/Linux
Memory info:
Normal memory usage:
$ free
total used free shared buffers cached
Mem: 3090688 2769932 320756 0 258416 1531780
-/+ buffers/cache: 979736 2110952
Swap: 2097144 8212 2088932
Memory usage 30 seconds before a crash:
$ free
total used free shared buffers cached
Mem: 3090688 3050764 39924 0 113772 1309972
-/+ buffers/cache: 1627020 1463668
Swap: 2097144 179480 1917664
View 7 Replies
View Related
May 10, 2011
My requirement. We have a linux File server which was connected to SAN (IBM DS4700)now I need to increase my capacity by 50GB I've added the 50GB through the IBM storage manager to the File server, but it doesn't showing on my linux file server
bellow the detail of my drives
/dev/mapper/mpath0p6 1.6G 287M 1.2G 20% /
/dev/mapper/mpath0p7 837M 240M 554M 31% /var
/dev/mapper/mpath0p3 4.1G 2.5G 1.4G 65% /usr
/dev/mapper/mpath0p2 5.1G 1.7G 3.2G 36% /home
/dev/mapper/mpath0p1 200M 24M 166M 13% /boot
tmpfs 2.1G 0 2.1G 0% /dev/shm
/dev/mapper/mpath0p8 356G 303G 36G 90% /filesrv
I need to add the 50GB on to the "mpath0p8".
View 2 Replies
View Related
Jan 2, 2011
There isn't any separate file system for /home and we have only one (/) root file system for everything else on the system. Is there any way that we can still implement quotas for users through their home directories was mounted on (/) root file system. Do we need to have a separate file system (/home) compulsory for implementing disk quotas?
View 3 Replies
View Related
Apr 27, 2010
For my project, it's absolutely necessary to have a read-only root partition system. I have a writable /opt/project partition.But, I also need to start x server. startx This tries to write to some temporary files and fails as / is readonly. Is there any how-to on how to move this temporary files to the writable portions of the file system.
View 3 Replies
View Related
Mar 31, 2009
Centos 5.3 includes Ext4 and improved support for encrypted file systems but it appears to be aimed at laptop/desktop systems, in that a password must be entered at boot time.
Is it possible to have a server with an encrypted root file system boot up without entering a password?
Mandos will do it...
http://wiki.fukt.bsnet.se/wiki/Mandos
...by serving up the password from another server...
http://packages.debian.org/squeeze/mandos
...to a client loaded into the initial RAM disk environment...
http://packages.debian.org/squeeze/mandos-client
...but it's not available on CentOS, and is only in Debian unstable.
Is there a similar (or any) solution for CentOS?
In particular, I'm envisaging encrypted virtual machines being served passwords from their virtual host.
Alternatively, the data that *really* needs to be protected could be encrypted while the system core remains unencrypted. But then the keys to decrypt the file system must be stored in the unencrypted portion, so this is not an effective method.
View 3 Replies
View Related
Dec 31, 2010
I have assigned 4G for my "/" directory, on slacware 10.2, and have not installed the GUI either. I am not sure what files to look for that have been growing over time that has completely depleted my space. Think it would be log files, but don't know where to find them.
View 10 Replies
View Related
Jun 25, 2010
I'm new to fedora 13 and I have been through a few installs already with a 12TB raid. Fedora is installed on a separate 250GB drive. I've mounted the 12TB drive as a single share and I'm capturing large video files (12-90GB each) to the raid in a Samba Share across the network. The system runs great for about three days and then I start getting warning messages that "the volume filesystem root has only 1.9GB of disk space remaining" then another later 205MB etc until it eventually fills to 100% and then locks the machine. If I reboot I get a Gnome error and can't login. The only solution has been to reinstall fedora again from scratch.
Each time I allocate more space for root. My current partition is 65G in size. The raid shows only 5.1TB of space used and it shows 7.2TB of free space. The raid share shows as being mounted in /media. Root shows that it will be full at 5.2TB, and I'm almost there, so I'm probably looking at another install in just a short while when it freezes again. I've read reinstall and make a larger root partition, but I'm not sure how big that must be to avoid this problem in the future. Also, is there a limitation on the size that root can be? my question stems from the fact that I have over 7TB of free space but somehow the root is reporting as 100% full at only to 5.1TB.
View 11 Replies
View Related
Apr 15, 2011
I would like to increase my "/" filesystem, as you can see, it has 81% occupied, and i would like to decrease the capacity of "/home" and pass it to the /Is this possible?
MY-SERVER:#df -h
Filesystem Size Used Avail Use% Mounted on
/dev/sda2 3.8G 2.9G 707M 81% /
[code]...
View 3 Replies
View Related
Jun 17, 2011
The last days I try to find a good and easy solution to keep new installed Servers with same basic configuration. For example every new Installed Server should have:
- phpmyadmin installed and configured
- munin installed and configured
- mysql server with some predefined users and passwords
- same users created with existing ssh keys. also ~/.ssh/authorized_keys file with pub key inside
At the moment I use some bash script to create the users and sync the keys. Basically I need to install predefined packages and remove some other packages configure some config files (or copy working configs). I have looked at cfengine and puppet Server. And I am asking my self if this tools are overkill for this task.
View 2 Replies
View Related
Nov 3, 2010
I work for a company that makes portable devices running Linux and I was recently asked to make the underlying file system read-only for "security" purposes. Since the distribution is based on LinuxFromScratch, I know that very little writing happens at run time. So, even if the device runs on a usb flash device, I doubt that putting the root file system RO will be that beneficial. I am actually more concerned about a process actually breaking because it cannot open a file in RW mode than a process going rogue and filling the root file system with log files, etc. I'd really like to ear what kind of advantages disadvantages there really is with read-only file-systems.
View 6 Replies
View Related
Apr 16, 2010
After about 14 hours of running constantly, top shows that MyDNS is using 99 to 100% CPU. This is insane. There isn't any hints of why this is happening in the deamon logs.
Code:
my:/home/dingle# ps aux |grep mydns
nobody 24157 0.0 0.0 27364 1596 ? Ss Apr15 0:00 /usr/local/sbin/mydns -b
nobody 24158 83.1 0.1 29120 3344 ? R Apr15 1146:34 /usr/local/sbin/mydns -b
root 25565 0.0 0.0 5160 784 pts/0 R+ 17:25 0:00 grep mydns
my:/home/dingle#
Code:
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
24158 nobody 20 0 29120 3344 788 R 99 0.2 1148:24 mydns
Heck, it only has 11 domains to handle.
View 5 Replies
View Related
Jul 18, 2011
bash-3.00$ df -h Filesystem size used avail capacity Mounted on /dev/md/dsk/d5 44G 40G 3.1G 93% /u01 but bash-3.00$ du -sh /u01 9.7G /u01 My question is: Why the fist command tell me 40G used but the second command tell me different result? My system info: SunOS INSP-DB1 5.10 Generic_142909-17 sun4u sparc SUNW,SPARC-Enterprise
View 3 Replies
View Related
May 5, 2010
I am using Redhat Linux 4 as I checked space and foud that / is 100% full. Like below:
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/hda3 2316536 2179008 19852 100% /
/dev/hda2 101107 9324 86562 10% /boot
/dev/hda6 1683960 70256 1528160 5% /home
none 192012 0 192012 0% /dev/shm
How to create more space on / directory? or decrease size in / directory.
View 2 Replies
View Related
Oct 11, 2009
well i was messing with the Gparted live disk and i deleted a small partition of about 6 megs (yes megs). trying to be efficient doing some cleanup of course. but when i rebooted my Fedora 10 i get the black screen saying," could not find the file system. /dev/root". ok, i am useing the fedora 10 live cd now. can i copy that file to my hard drive from the cd? or do i need to reinstall Fedora?
View 1 Replies
View Related
May 22, 2011
I have worked in linux for a long time but never managed the system until I got my own server, which is running Fedora 14. I have a 3 TB Drive and apparently can only handle 2 TB. At least the Disk Analyzer is telling me that 2TB is 100% max capacity. Also viewing disk analyzer, I am only using 50GB of my 2TB but I am out of memory in the Root file system. If I run df -h, I get he following:
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/vg_dev1-lv_root
50G 40G 7.2G 85% /
[code]....
View 4 Replies
View Related
Feb 6, 2010
Trying to install from netbootin...gives me that error.
View 4 Replies
View Related
May 18, 2010
I have been using Ubuntu 9.10 Desktop version for around 1 month then i stoped using after installing windows 7, as I knew that there were the 10.04 version coming. So when it was released i went to torrent download the file and burned it on a cd. After that i insert the cd and use the wubi installer in there as i want to install them side by side. so after installing ubuntu i restarted the system and got into it. After a few minutes it appeared this error message "Not root file system is defined. Please correct this from the partitioning menu." So i was expecting it to be downloading problems. I went on to ubuntu website requested for a CD and it came today. So i inserted the cd did the same thing again.
View 9 Replies
View Related
Sep 19, 2010
Is it possible to run fsck on the root file system?
My Ubuntu 10.04 seems to be checking it's fs at boot...
It shows that the file system is in use and can get severely damaged!
Or the only possibility is to run it from a live CD?
View 2 Replies
View Related
Dec 16, 2010
My current installation setup has a separate partition for /, /boot, /home, /tmp, /usr, and /var. The problem I have is the root partition / is 98% full (4.3GB full). Cleaning temp files and log files won't help since they are on their own partition (and clean). I've removed all but two linux-images. Linux images seem to run at a size of roughly 105M. My root partition is 4.6GB. I can't seem to find any other options for cleaning up space on this partition. I have no idea what is taking up 4.6GB of space.
Disk Usage Analyzer has not been helpful since I have not been able to reconcile 4.6GB of memory with what it claims the total size of the remaining directories occupy. I've tried localepurge, gtkorphan, apt-get clean, apt-get autoclean, apt-get autoremove. I've removed all packages listed under Status -> Not Installed in the package manager. My root file system is still 98% full (4.3GB full).
View 7 Replies
View Related
May 11, 2011
Classic partition problem apparently. What do I do? the 11.04 wubi doesn't give a lot of installation options, so i just selected C drive, and gave it 10GB of space. instilled it, and when it goes to the desktop menu, that pop up appears saying No root file system is defined. Please correct this from the partitioning menu
In dual booting with XP. what do I do?
View 1 Replies
View Related
Aug 6, 2011
I'm trying to install 11.04 and get the error warning in the title. It says "Please correct this from the partitioning menu."How do I do that?I don't see any options for that.Puppy will already boot from that device and has grub installed.
View 9 Replies
View Related
Jul 12, 2010
I try to encrypt root file system on Opensuse 11.1 and I have found up to two possibilities.
1. [url]
2. [url]
In the first case, i have a Problem with entering password, for each partition on encrypted disk, i must enter my password.(For 3 partition 3 times)
And in the second version to get i nowhere.
Code:
View 5 Replies
View Related
Apr 6, 2011
I am getting an error while booting my linux system: Can't mount root file system.Boot has failed, sleeping forever.OS is Red hat enterprise linux 6, With Intel P4, 1 GB Ram, 120 GB IDE hdd seagate. it was working fine from last 4 days. from today morning this is giving error. only mysql & apache is installed in it.
please suggest is there any way to repair the root & boot volumes. waiting for valuable reply.
View 2 Replies
View Related
Sep 16, 2010
Is it possible to encrypt the Entire root file system using LUKS.I am currently using Ubuntu 10.4 LUCID.After several hours of Google ,most of the articles were focusing to "Encrypting a drive/removable media ".. My aim is to encrypt whole File system which is currently using.
My Concerns, How to Encrypt a running file system? Will it lead to data loss?
View 1 Replies
View Related
Feb 4, 2010
im trying to prepare my partitions for fresh installation. The partition manager didnt list anything with an error message that said:Quote:No root file system is defined. Please correct this from the partitioning menu?This is what Gparted displays Quote:
/dev/sda1 ext3 /tmp/boot
/dev/sda2 unknown
/dev/sda3 ext3 /tmp/opsys
View 14 Replies
View Related
Sep 22, 2010
I would like to know if there is a way to do an unattended check on the root file system on my servers, *and* send emails in case of errors.
I know you can schedule a root file system fsck during boot time - but the root file system will be mounted read-only - so if fsck finds any problems - it can't email away a warning, or write the result to a file - or can it?
Essentially I would like my servers to do a self-check of the root file system periodically - and to email me if it fails. I just can't think of a way to get it done.
View 2 Replies
View Related
Jan 31, 2010
I have a problem that is probably simple, but have not yet found the answer on any forums or by Googling. First my system specs:Tyan 2610 motherboard w/ 2 x PIII 9334 gig PC133 SDRAM
1 x 5 gig hd (system)4 x 500 gig hds w/ 3Ware 7500 controller set to RAID 5, (1.5 TB) mounted as /homeCentOS 5.3 running my smb and nfs mountsMy problem is that I have run out of space on my / (root) file system, (the 5 gig). Since I am planing to rebuild my file server with larger hard drives, (2 x's 60 gig SATA's set to RAID 1, 6 x's 1.5 TB at RAID 5), within the next 2 months, I would like to try to clean out any unneeded crap rather than adding a hard drive and expanding my root file system. I have done the following:
Removed old unused kernels
cleaned up /var/log/
cleaned up /tmp
[code]....
View 8 Replies
View Related
Dec 10, 2010
Nagios had alerted me that the server had a very high load average exceeding the critical level (17+), when logging onto the server I found that all 4GB of the swap was in use despite the fact that there was 15GB+ of free memory (and that's not even including memory from cache and buffers!) Because it seems all heavily used pages were being stored in swap, the I/O wait on the server became very high, and 4 kswapd daemons were taking up nearly 100% available CPU. This did coincide with an error reported by Bacula during a backup job while changing to a bad tape...
From /var/log/bacula.log:
Code:
10-Dec 02:11 bacula-sd JobId 1898: End of medium on Volume "4097" Bytes=434,170,000,000 Blocks=217,084 at 10-Dec-2010 02:11.
10-Dec 02:11 bacula-sd JobId 1898: 3307 Issuing autochanger "unload slot 4097, drive 0" command.
10-Dec 02:12 bacula-sd JobId 1898: 3301 Issuing autochanger "loaded? drive 0" command.
10-Dec 02:12 bacula-sd JobId 1898: 3302 Autochanger "loaded? drive 0", result: nothing loaded.
10-Dec 02:12 bacula-sd JobId 1898: 3304 Issuing autochanger "load slot 4096, drive 0" command.
10-Dec 02:13 bacula-sd JobId 1898: 3305 Autochanger "load slot 4096, drive 0", status is OK.
10-Dec 02:13 bacula-sd JobId 1898: Volume "4096" previously written, moving to end of data.
10-Dec 03:51 bacula-sd JobId 1898: Error: Unable to position to end of data on device "Tape-1" (/dev/IBMtape0n): ERR=dev.c:1384 read e
rror on "Tape-1" (/dev/IBMtape0n). ERR=Input/output error.
10-Dec 03:51 bacula-sd JobId 1898: Marking Volume "4096" in Error in Catalog.
10-Dec 03:51 bacula-sd JobId 1898: 3307 Issuing autochanger "unload slot 4096, drive 0" command.
10-Dec 03:58 bacula-sd JobId 1898: 3301 Issuing autochanger "loaded? drive 0" command.
10-Dec 03:58 bacula-sd JobId 1898: 3302 Autochanger "loaded? drive 0", result: nothing loaded.
10-Dec 03:58 bacula-sd JobId 1898: 3304 Issuing autochanger "load slot 4098, drive 0" command.
10-Dec 03:58 bacula-sd JobId 1898: 3305 Autochanger "load slot 4098, drive 0", status is OK.
10-Dec 03:59 bacula-sd JobId 1898: Wrote label to prelabeled Volume "4098" on device "Tape-1" (/dev/IBMtape0n)
10-Dec 03:59 bacula-sd JobId 1898: New volume "4098" mounted on device "Tape-1" (/dev/IBMtape0n) at 10-Dec-2010 03:59.
At the same time, these messages starting occuring in /var/log/messages:
Code:
Dec 10 03:51:47 07 kernel: Mem-info:
Dec 10 03:51:47 07 kernel: Node 0 DMA per-cpu:
Dec 10 03:51:47 07 kernel: cpu 0 hot: high 0, batch 1 used:0
Dec 10 03:51:47 07 kernel: cpu 0 cold: high 0, batch 1 used:0
Dec 10 03:51:47 07 kernel: cpu 1 hot: high 0, batch 1 used:0
Dec 10 03:51:47 07 kernel: cpu 1 cold: high 0, batch 1 used:0
Dec 10 03:51:47 07 kernel: cpu 2 hot: high 0, batch 1 used:0
Dec 10 03:51:47 07 kernel: cpu 2 cold: high 0, batch 1 used:0
Dec 10 03:51:47 07 kernel: cpu 3 hot: high 0, batch 1 used:0
Dec 10 03:51:47 07 kernel: cpu 3 cold: high 0, batch 1 used:0
Dec 10 03:51:47 07 kernel: cpu 4 hot: high 0, batch 1 used:0
Dec 10 03:51:47 07 kernel: cpu 4 cold: high 0, batch 1 used:0
Dec 10 03:51:47 07 kernel: cpu 5 hot: high 0, batch 1 used:0
Dec 10 03:51:47 07 kernel: cpu 5 cold: high 0, batch 1 used:0
Dec 10 03:51:47 07 kernel: cpu 6 hot: high 0, batch 1 used:0
Dec 10 03:51:47 07 kernel: cpu 6 cold: high 0, batch 1 used:0
Dec 10 03:51:47 07 kernel: cpu 7 hot: high 0, batch 1 used:0
Dec 10 03:51:47 07 kernel: cpu 7 cold: high 0, batch 1 used:0
Dec 10 03:51:47 07 kernel: Node 0 DMA32 per-cpu:
Dec 10 03:51:47 07 kernel: cpu 0 hot: high 186, batch 31 used:162
Dec 10 03:51:47 07 kernel: cpu 0 cold: high 62, batch 15 used:48
Dec 10 03:51:47 07 kernel: cpu 1 hot: high 186, batch 31 used:0
Dec 10 03:51:47 07 kernel: cpu 1 cold: high 62, batch 15 used:0
Dec 10 03:51:47 07 kernel: cpu 2 hot: high 186, batch 31 used:0
Dec 10 03:51:47 07 kernel: cpu 2 cold: high 62, batch 15 used:0
Dec 10 03:51:47 07 kernel: cpu 3 hot: high 186, batch 31 used:18
Dec 10 03:51:47 07 kernel: cpu 3 cold: high 62, batch 15 used:0
Dec 10 03:51:47 07 kernel: cpu 4 hot: high 186, batch 31 used:159
Dec 10 03:51:47 07 kernel: cpu 4 cold: high 62, batch 15 used:56
...
Dec 10 03:51:47 07 kernel: Node 3 HighMem per-cpu: empty
Dec 10 03:51:47 07 kernel: Free pages: 732052kB (0kB HighMem)
Dec 10 03:51:47 07 kernel: Active:4232128 inactive:3071288 dirty:158210 writeback:0 unstable:0 free:183320 slab:256840 mapped-file:289545 mapped-anon:3805487 pagetables:13063
Dec 10 03:51:47 07 kernel: Node 0 DMA free:10796kB min:4kB low:4kB high:4kB active:0kB inactive:0kB present:10356kB pages_scanned:0 all_unreclaimable? yes
Dec 10 03:51:47 07 kernel: lowmem_reserve[]: 0 3512 9067 9067
Dec 10 03:51:47 07 kernel: Node 0 DMA32 free:213332kB min:2500kB low:3124kB high:3748kB active:1794108kB inactive:1463220kB present:3596296kB pages_scanned:64 all_unreclaimable? no
Dec 10 03:51:47 07 kernel: lowmem_reserve[]: 0 0 5555 5555
Dec 10 03:51:47 07 kernel: Node 0 Normal free:41028kB min:3952kB low:4940kB high:5928kB active:3409444kB inactive:1471120kB present:5688320kB pages_scanned:0 all_unreclaimable? no
Dec 10 03:51:47 07 kernel: lowmem_reserve[]: 0 0 0 0
Dec 10 03:51:47 07 kernel: Node 0 HighMem free:0kB min:128kB low:128kB high:128kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
Dec 10 03:51:47 07 kernel: lowmem_reserve[]: 0 0 0 0
Dec 10 03:51:47 07 kernel: Node 1 DMA free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
...
Well to cut a long story short, I fixed the problem by disabling the swap partition with 'swapoff'. After about 30 mins all the swap was freed and the server went back to normal. I don't dare reactivate the swap partition and unfortunately as this is a live server which currently has no fail over, I can't reboot either
Server Spec:
4 * Dual-Core AMD Opteron(tm) Processor 8214
32GB DDR2 ECC RAM
RHEL 5.5, 2.6.18-194.11.3.el5 SMP x86_64
Running many KVM VMs (All CentOS x64) and kksmd is used.
bacula-dir Version: 5.0.0
IBM Tape Drive using lin_tape module version 1.34.0 according to modinfo
And before anybody asks
# sysctl vm.swappiness
vm.swappiness = 10
View 5 Replies
View Related
Feb 16, 2011
We had to reboot a server in the middle of a production day due to 99% iowait (lots of processes in deep sleep waiting for disk iops). That's never happened to us before. It had been 363 days since the last fsck, so it started automatically on reboot. It hung at 4.8% on a 2TB LVM2 volume for about an hour. I killed the fsck and rebooted the server. The second time, it went past that point and is currently at about 62%. First, what causes e2fsck to hang like that? Second, is there any danger in killing e2fsck, rebooting, and starting it again?
View 1 Replies
View Related