Server :: Extremely Large Metadata Size For Directory On An Ext4 Filesystem?
Jun 24, 2011
I am running CentOS 5.5 with a 14T ext4 volume. We are sharing out a few sub-directories via NFS. Our customer was doing some penetration testing with our web app that writes to one of those NFS shares. We are not sure if they did something to cause the metadata to grow so large or if it is corrupt. Here is the listing:drwxrwxr-x 1 owner owner 470M Jun 24 18:15 temp.badI guess the metadata could actually be that large, however we have been unable to perform any operations on that directory to determine if the directory is just loaded with files or corrupted. We have not run an fsck on the volume because we would need to schedule downtime for out customers to do so. Has anyone come across this before
I m having a RHEL-5 sever.ABC directory size is 57GB after taking backup in the same disk with name ABC.bkp showing 56GB. i used below command to copy/backup. # cp -r ABC ABC.bkp (different sizes after copying)..I checked both the directory sizes by #du -sh <ABC> and du -ks <ABC.bkp>In both GB and KB there is lots of difference (200mb). why this will happen in copying? what is the solution for above question? what is the correct way of copying 1dir to newdir exactly?
I'm new to setting up Linux Servers. I've setup a Ubuntu 10.10 Server along with CUPS and I'm using Webmin to talk to the server. I have a HP PSC 1315 Multifunction printer connected via usb to the server. Using the CUPS web interface I am able to get the server to detect the connected printer and it identified the HP PSC 1310 Series drivers.
When I printer a test page from the server's screen the print job goes through ok and the size was about 5k.
I then setup a samba share to allow my Windows 7 machine to share the printer. Windows 7 is able to pick up the shared printer correctly and I used the default HP 1310 Series drivers. When I tried to send a test page to the printer, that single page ended up being 3887kb and I also tried printing out a single paged word document which ended up being over 7MB.
I think I am having a problem due to an NFS server file size limit. Is it possible I am missing a parameter on the RHEL NFS setup to handle large files? I am running an NFS server on a RHEL 5.1 machine and the HP-UX 11.0 machine does an NFS mount to that file system. The HP-UX executes a program that resides on the HP-UX machine to process a large 35 GB data file that resides on the NFS server machine. The program on the HP-UX can only read/process the first portion of the file until an "RPC: Authentication error" is returned multiple times until the program prematurely decides that it has reached the end of file.
I tried recompiling the same program to run on the RHEL 5.1 NFS server to access the 35 GB file locally (on the NFS server instead on HP-UX) and the program completed successfully, processing the whole file (about 7 hours of processing) with no "RPC: Authentication error." In addition, I have been running the nfs mount with the same machines for quite some time, but not with such large files sizes.
Summary of issue: EXT4 filesystem won't mount--with error = mount: unknown filesystem type 'ext4'. Is no ext4 in kernel the issue? Or is something corrupted?Really perplexed by this. I updated Centos 5.5 to 5.6 to get ext4 (5.6 is supposed to have full support of ext4). I built several arrays and put the ext4 filesystem on them. All went well until I tried to mount them. BTW, this array (below) is set up as a RAID6 using partition 1 of #8 2TB drives.Bear with me here; just trying to be complete and not waste your time.
Attempting to mount give this:[root]# mount -v /dev/md1 /asc/array1mount: unknown filesystem type 'ext4'Note: it does "fake" mount with ption (which apparently does everything except the system call):[root]# mount -f -v /dev/md1/dev/md1 on /asc/array1 type ext4 (rw,grpquota,usrquote)e2fsprogs:Package e2fsprogs-1.39-23.el5_5.1.x86_64 already installed and latest version (for Centos 5.6; CentOS 6x uses the 1.41...)
Just wanted to see if any one had this experience? I just did a fresh install of the recent LTS and saw it made a whopping 8 1/2 gig swap on a new pc I have 3 gigs of ram in? Im a try to resize as I have already done my customizing to it.
Well I was looking into backing up my system and with some excellent help from remeeraz in another post just realized how big the filesytem for fedora was. On my system at least its showing 10GB of used space. Now im not sure if that includes the swap file aswell but as explained in another post I have the 210MB filesystem location and the the 320GB LVM2. From my limited understanding it seems the lvm2 location ecompasses the swap and the filesystem but does not explicitly show the swap location and in any event shows the full size of the drive.
once i have backed this core system up so I dont have to worry about ballzing it again how can i strip the installation to a more managable size like to fit on a DVD, im not talking about saving pictures or movies just the base install as thats all i have right now anyway.
I am running Debian under virtual container. I need to set max size of directory for each of vsftpd virtual users - because they are virtual, I cannot use user quotas. I was wondering, if I could create images with filesystem and mount them, but I cannot access /dev/loop device from container. Is there any other way, how to set max directory size in virtual container
Is there a way that I can use my Linux ext4 file system, as such and then use it on some other computer.I have a dual-boot of Windows 7 and Ubuntu 10.04 and my partition table looks like this:My question might not be clear, so explaining it with an example.Can I copy my Linux partition on a flash drive and then use it on a different PC, with or without any need to install Ubuntu on new PC, by simply booting from the copied ext4 partition.This way, I can easily port my Ubuntu packages and other applications, settings etc. from one PC to other
am having issues with a corrupted ext4 filesystem. My machine has run flawlessly for weeks, then all of a sudden I am getting messages that I can't access various directories, and on reboot fsck dumps to a command line. So far I have been able to fix the problem by manually running fsck. However, this is the second time that I have run into this problem; the previous time I ended up throwing out my hard drive and doing a clean install.I am running a clean install of Karmic Koala, software RAID, 4 Gb RAM, two 500 Gb Western Digital SATA drives, with an Intel E7200 2.53 Ghz dual core processor.Among other applications, I run VMware 7.0 for the occasional task for which I need a Windows program.
I run an upgrade and an update on a lucid lynx beta 2. --- got no problems. but about the filesystems i have some questions because it seems for me that at every system boot the system will run an fsck. somtimes it's shown up, somtimes not. but in /var/log/messages and in syslog
I have always following messages ( occured in beta 2 too ).
But first before i continue - here my disk layout:
And here my filesystem types:
This is my problem because those values are seems to be static ! ( note: this partiton is mounted but not in use ) and last not least: the drive is an external usb scsi disk. but on the other side lucid lynx is running fine on my box.
During the installation of Ubuntu 10.04 the partitioner was wrongfully configured to see a functioning btrfs partition as ext4 (without reformatting it). Thus the installation process got stuck at 5%.Installer was run again ignoring the btrfs partition.btrfs-tools was added to the new 10.04, but the btrfs partition is now recognized ast4 with lost+found folder on it.Tried to add the btrfs to etc/fstab as btrfs but t won't mount.Can the partition/filesystem type be changed so that this is actually recognized and mounted as btrfs, hoping my data is still on it somehow?
I have recently updated my ubuntu 9.10 install to 10.04. And with that I've tried to install snow leopard on my computer so i can dual boot between them.the install was successful, but grub2 (that worked fine) wouldn't see the OS X install on its own partition. so i tried reinstalling it, like you do after you install windows and it would remove grub as the bootloader.That didn't work and i got a lot of messages that it wouldnt work because my partitioning (or something like that) is GPT. by the end of it i didn't have grub installed at all!so i started playing around with GParted, and while doing that i also put a bios_grub flag on my main ubuntu install partition, thinking that it would force grub to load from that partition. But that just gave me the GRUB Rescue prompt when trying to boot.
So i unchecked the bios_grub flag. and now it doesn't boot to anywhere and when inserting the ubuntu live cd i cant even see the ubuntu ext4 partition and mount it.Gparted says that its a partition that its File System is undetectable and unknown.Is there any solution that will allow me just to mount that partition and copy files from it? (unfortunatelly my backups are a little older than i would like them to be)Heres what boot info script gives me: (the partition that i need is sda1)
Code: Boot Info Script 0.55 dated February 15th, 2010 ============================= Boot Info Summary: ==============================
I want to install 11.04 next to my working 10.04 system. First I need to make room for the new system so I have booted from a live cd and started GParted. In GParted the partition with the 10.04 system on it, /dev/sda1, has a red circle with an exclamation mark in it and I cannot resize it. When I doubleclick on /dev/sda1 there is the following warning
Quote:
Failed to change to directory '.'(Stale NFS file handle) Failed to change to directory '.'(Stale NFS file handle) Unable to read the contents of this file system! Because of this some operations may be unavailable.
The following list of software packages is required for ext4 file system support: e2fsprogs v1.41+.
The 10.04 system is working and has worked like a dream for a couple of years and the machine has never had any other system on it. Why would the live CD not be able to read ext4 fs?
I was just copying a large (50GB) file from one mounted partition to another mounted partition (a USB drive), but before the operation completed, my root filesystem, on a separate partition, filled up.Because it filled up I also couldn't get past the login when I rebooted. I think this is because there is no room to load temporary files. I'm expanding the root partition to temporarily fix this. how can I avoid my root file system filling up when copying a massive file between mounted partitions? the file is being cached in root during the transfer.
I'm wondering if anyone knows what will be Squeeze's default filesystem. Will it be the proven ext3 or the newer (sometimes faster, sometimes slower) ext4?
I currently have ext4 and I have nothing to complain about. In fact, my overall experience has been very positive. Ext4 is definitely faster when fsck runs during boot.
What would be the cons of having ext4 as default in Squeeze?
On my drive I had 2 partitions for an Ubuntu 9.04 (swap, /) and one partition for Windows. I figured out that I should upgrade my Ubuntu, so I deleted the "/" partition and in its place created 2 new partitions (/, /home) .
After installing the latest Ubuntu 11.04, I realised that although I had backuped everything I needed in a 2nd disk and I could access those folders and their data from my Ubuntu 9.04, both my Windows and the 11.04 can locate neither the folders nor the data now. I have no idea why this happened (perhaps some issue with the mounting?) I have tried the trial version of Stellar Phoenix linux data recovery tool, but it cannot locate the old partitions.
I'm resizing an ext4 partition from 100gb to 40gb (I only used 20gb of it or so). Lets say partition is at /dev/sda1. I used Code: efsck -f /dev/sda1 to check it
Then I did Code: resize2fs -p /dev/sda1 40G to resize it When I check fdisk -l, the partition is still 100gb. I have a feeling I resized ONLY the filesystem to 40, but the partition is still 100gb. How do I finish this?
I have installed ubuntu to my pc. i made 3 partitions. one for system, one for data and one for swap. two of them were ext4. after some time i have reinstalled ubuntu again. but this time i didn't put to format the second partition, but just mount it using ext4. after that i cannot open my files. checked with gparted shows that 2GB used, but with df 188MB. and in properties writes ext3/ext4 filesystem. i used chown, chgrp but didn't help. please help, these data are ver important. i cannot lose them.
I've just bought a new SSD hard drive:Kingston SSDNow V-Series SNV125-S2/128GB 2.5'' 128GB SATA/300The question is which filesystem whould you recommand and why?BTRFS vs NILFS2 or EXT4?If you choose ext4 would you enable jurnalling?I'm very close to choose Btrfs.Any experience with running any of these on your SSD?
I have a 6x1TB RAID5 set up for testing on ubuntu created with mdadm and formatted with an ext4 fs.
This is being shared over CIFS for windows clients. When looking at the fs from both the file box and the clients, it says 4.47TiB total capacity, and 4.24TiB free space. The only folder is Lost+Found which is empty.
I don't have much experience in Linux filesystems as of yet and I don't understand where this 300 gigs has gone!
I am new to Fedora, and I noticed when I opened my home folder that I only had 54GB. My HD is 120, and when I used the disk utility, I noticed that 64GB are in ext4! What?! This was not a problem in Ubuntu, so why has it happened now? Is there anyway I can decrease the size of ext4 and give some of it to Fedora?
Is that possible, I mean when I upgrade F10 to F11 with yum upgrade is there a way to 'upgrade' the filesystem to ext4 for example (with the exception of boot partition)? Or I have to reinstall fedora like new?
While changing the filesystem can I do it by parts? what I mean is for example: I have 2 partitions like '/' and '/home' with ext3, so I backup data in '/home', change '/' to ext4 then mv files from '/home' to '/' and change '/home' to ext4 and finally mv those files from '/' to '/home'. Is that possible?
I need to examine a hard drive that came from another system running Ubunut Server (not sure what version). I know the drive has LVM on it, so as far as I understand that means the drive will be treated as EXT4 for mounting. I can't boot from the actual disk, but I have used a IDE to USB connector to make a binary copy of the drive, which I've mounted as a loopback device. However, when I try to mount the loopback device properly, I get this:
root@~je:/# mount -o ro -t ext4 /dev/loop0 /mnt mount: wrong fs type, bad option, bad superblock on /dev/loop0, missing codepage or helper program, or other error In some cases useful info is found in syslog - try dmesg | tail or so
I tried using -t ext4dev too, but that just gives an unknown filesystem error. The file I've got mounting in /dev/loop0 is a .dd file, created by imaging the drive using dcfldd on the server drive while it was mounted (as /dev/sdb). System I'm working on is running Ubuntu 9.10. All I need is to be able to mount the server drive so I can traverse the file directories, there's a few things I need to check on it. If needed I can dispense with the whole loopback setup and just directly connect the server hard drive again using the IDE to USB cable, but I'd rather not do that; it's imperative that the drive doesn't get altered, or at least as little as possible.
I need to backup my home folder (and a few other folders) on an organizational Linux NFS system where my account will be expiring soon, onto a personal hard drive (which is not using a Linux filesystem). I access the account through SSH and SFTP. I want to backup all metadata for these files and directories and everything in them, including dates, owners, groups, UID/GID numbers, CHMOD permissions, etc. How can I go about doing this? Do I need to run the LS command recursively on the directory with certain settings of what information to display, and pipe the results to a file so that the information will be in a file regardless of which filesystem I move it to? Or is there a way to save all the metadata using something like TAR/GZ? If it's with TAR/GZ, then how do I view this metadata on other filesystems that I move the archive to, and will the users/groups stored remain intact as long as it's not extracted?
In addition, do you know how to do this for SELinux metadata and AFS (Andrew File System) metadata too? (These will be for another filesystem later on, but if don't know the answer to either of these, please still answer the above.)
I am trying to burn mac osx 10.5 install disk from from a 6.7gb dmg disk image. I thought I would be using 2 DVD-R 4.7GB discsfor this burn, I was hoping when the first was full it would ask for another to finish the burn. Instead it get the message that the DVD will not hold the choosen DMG. file.
Can I do anything besides buy a dual layer DVD that would hold the whole file?
