General :: Filesystems - Mirror A Directory And Back Up All Metadata?

Aug 20, 2011

I need to backup my home folder (and a few other folders) on an organizational Linux NFS system where my account will be expiring soon, onto a personal hard drive (which is not using a Linux filesystem). I access the account through SSH and SFTP. I want to backup all metadata for these files and directories and everything in them, including dates, owners, groups, UID/GID numbers, CHMOD permissions, etc. How can I go about doing this? Do I need to run the LS command recursively on the directory with certain settings of what information to display, and pipe the results to a file so that the information will be in a file regardless of which filesystem I move it to? Or is there a way to save all the metadata using something like TAR/GZ? If it's with TAR/GZ, then how do I view this metadata on other filesystems that I move the archive to, and will the users/groups stored remain intact as long as it's not extracted?

In addition, do you know how to do this for SELinux metadata and AFS (Andrew File System) metadata too? (These will be for another filesystem later on, but if don't know the answer to either of these, please still answer the above.)

View 1 Replies


ADVERTISEMENT

General :: Filesystems - Software RAID 1 Without Metadata On The Drives?

Mar 30, 2011

I know I can simply create a degraded raid array and copy the data to the other drive like this: mdadm --create /dev/md0 --level=1 --raid-devices=2 missing /dev/sdb1

But I want the specific disk to keep the raw ext3 filesystem so I can still use it from FreeBSD. When using the command above the disk will be a raid disk and I can't do a mount /dev/sdb1 anymore. A little background info. The drives in question are used as backup drives for a couple of Linux and FreeBSD servers. I am using the Ext3 filesystem to make sure I can quickly recover the data since both FreeBSD and Linux can read from that without problems. If someone has a different solution for that (2 drives in raid 1 that are readable by FreeBSD and writeable by Linux),

View 1 Replies View Related

General :: Filesystems On Dev Directory?

Dec 25, 2010

I want to know what file system there are for "/dev" directory??apparently different types was developed for managing devices on Linux.because I am a little confused about all file system on this directory.Another question is,which is file system sufficient for managing devices on Embedded Linux ?of course on our embedded system we do not have many pluggable device,so this directory can be static

View 2 Replies View Related

Fedora :: Back Up Filesystems Without System Dying?

Jun 7, 2010

I have a 2TB USB drive which I use as a backup device - I dump two filesystems onto it, totalling around 1TB. However, doing the dump trashes my F11 system, making it basically unusable, not only during the dump but also afterwards. I have 8GB of RAM, all of which is needed and normally in use, but when dumping, the system starts hogging huge amounts of it as buffer space - up to 1GB of RAM is reported to be allocated. And rather than using free memory for buffer space, it seems to aggressively swap processes out to get it. The system tends to melt down as a result, and just switching virtual desktops can take 5 minutes.

But after the dumps finish, the problems continue - the system is currently trying to keep around 700-800MB free, and continually swapping out processes to do so, even after the buffer space in use has gone back to about 100MB. This seems like strange behaviour for a fairly common type of activity. Presumably a lot of the buffer space is used to store what is being read from the filesystem (which will never be needed again), and some is used to cache the writes to the USB drive which is slower than the internal hard drives.

I have spent a lot of time trying changes to some of the kernel parameters, after reading articles about them. Of all the ones I've tried, setting vm.dirty_ratio to 1 instead of 5 helps a bit, and setting vm.dirty_background_ratio to 5 instead of 20 makes some improvement I think. Setting vm.swappiness to 0 doesn't seem to help at all.

So my question (at last!) is - how can I back up my filesystems without my system dying? In particular, can I limit the space used for buffers somehow, or turn off buffering for the dump process? And why does dumping result in the system artificially keeping huge amounts of space free afterwards, so I have to reboot to make the system usuable again?

View 5 Replies View Related

General :: File Management - Create Mirror Of Directory But Ignore Deletions?

Feb 7, 2011

I would like to create a directory public_html/archive that is a mirror of public_html/images, except that deletions in the images directory don't cause corresponding deletions in archive.

I was going to manage all of this in code, but then I figured, maybe the system can handle it for me in a robust way.

Note that the website will reference archive in real time, so it has to be an instant mirror and not something done nightly, etc.

View 2 Replies View Related

Debian :: Creating Mirror Back-up Hot Swap Server?

Mar 20, 2011

I am currently running Debian on a system with 3 scsi hard drives with Raid and have an identical back up server. I want to schedule a daily "mirror" copy of the server operating system and data so that if the primary server drops I can move the network plug to the next server and be back in business. Can someone let me know what would be the best solutions for this? I am new to linux so this may be an obvious question so if it is I applogize but I have been searching through the forums and have not found an adeqate solution.

View 1 Replies View Related

Ubuntu :: General Error Mounting Filesystems - Error "No Such File Or Directory Fsck From Util-linux-ng 2.16"

Apr 1, 2010

My ubuntu stops when mounting system hdd. The screen display the following messages :

mountall:/etc/fstab: No such file or directory fsck from util-linux-ng 2.16 WARNING: couldn't open /etc/fstab: No such file or directory init: mountall main process (545) terminated with status 1 General error mounting filesystems. A maintenance shell will now be started. CONTROL-D will terminate this shell and re-try. udevd[560]: can not read '/etc/udev/rules.d/z80_user.rules. Ubuntu: clean, 474879/24231936 files/28016581/96898047 blocks root@i7:~# exit_

I suspect the disk manager pysdm that i had just installed today and it had crash during the previous session. The /etc/fstab file does not exist anymore and i cant rename the fstab.bak because the disk is read-only even for my root user

View 1 Replies View Related

Ubuntu Multimedia :: Rhythmbox Metadata Loss After Directory Rename

Jan 29, 2011

Rhythmbox seems unable to handle a directory rename. My problem is the following:

1. Create a playlist in Rhythmbox with some songs in it.
2. Close Rhythmbox.
3. Rename the directory with the songs in it.
4. Open Rhythmbox.
5. The songs are gone from Rhythmbox' index and can be found under "Missing Files". New versions of the songs show up, but this is not very helpful, as the playlist is empty.

I searched the web and found a known bug which occurs if step 2 is left out (that is, a directory rename with Rhythmbox open). However, in my case, even changing a directory name without Rhythmbox running breaks its file index.

View 1 Replies View Related

Server :: Extremely Large Metadata Size For Directory On An Ext4 Filesystem?

Jun 24, 2011

I am running CentOS 5.5 with a 14T ext4 volume. We are sharing out a few sub-directories via NFS. Our customer was doing some penetration testing with our web app that writes to one of those NFS shares. We are not sure if they did something to cause the metadata to grow so large or if it is corrupt. Here is the listing:drwxrwxr-x 1 owner owner 470M Jun 24 18:15 temp.badI guess the metadata could actually be that large, however we have been unable to perform any operations on that directory to determine if the directory is just loaded with files or corrupted. We have not run an fsck on the volume because we would need to schedule downtime for out customers to do so. Has anyone come across this before

View 2 Replies View Related

Ubuntu Servers :: Mirror A Windows Directory To An External Server?

Jan 13, 2010

I am looking for a solution to mirror a directory on my companys computer that runs in windows to an external ubuntu server on the internet.

View 7 Replies View Related

Ubuntu Servers :: Accidentally Rm -rf'ed /etc From Raid1 Mirror - Recover The Directory?

Apr 10, 2011

I accidentally rm -rf 'ed /etc directory from the main server. The server has raid1 soft-raid. Is there a way to recover the directory.

View 4 Replies View Related

Fedora Installation :: Cannot Find Any Info On The Description Of The Mirror Release Directory Structure

Jun 29, 2010

I have searched all over. I cannot find any info on the description of the Fedora mirror release directory structure and the reason for having a "Fedora" and "Everything" directory? Yes I looked at [URL] I mostly work with the Red Hat 5.x. The Fedora release software is kept on a mirror and the DVD release as, (using i386 release):

[Code]....

View 3 Replies View Related

General :: Finding A Command For Going Back A Number Of Steps In A Directory Without Using Cd?

May 10, 2011

I'm constantly going 'cd ../../../../'. Is there a command/alias that could let me go 'cmd 4' and I'd be taken back 4 directories?

View 8 Replies View Related

Debian Configuration :: Fstab Configuration - Failed To Open /proc/filesystems: No Such File Or Directory

Aug 23, 2011

I have some errors when run the mount -all command: mount: wrong fs type, bad option, bad superblock on /dev/sdc5, missing codepage or helper program, or other error In some cases useful info is found in syslog - try dmesg | tail  or so Failed to open /proc/filesystems: No such file or directory

[Code]..

View 14 Replies View Related

General :: Create A Backup Directory And 3 Directories Within That And Some Files Within The 3 Directories And Then Back Them Up Ot Restore Them?

Dec 19, 2009

i am in need of linux help. iam at college and i need this back/restore script to pass this final part of an assessment. i require a backup script that will not only backup but also restore files to the relevent directories. e.g. users are instructed to store all wordprocessor files in a directory named wp. so i am needing to create a backup directory and 3 directories within that and some files within the 3 directories and then back them up ot restore them. l know i should/have to do this myself by been trying to get/understand info for the last few days and came up with zero.

View 14 Replies View Related

General :: Restore A Backup On Different Filesystems?

Sep 30, 2010

I'm now using Ubuntu 10.04 with ext4 and for the second time in my life I experienced data loss (not for real: I got backups) and I'm assuming problems with the recent ext4 fs.

I want to restore all of my configurations (/etc and the like), data and home on reiserFS: is this possible? What to do in order to accomplish that?

View 2 Replies View Related

General :: Finding Alternative Filesystems For SSD?

Feb 14, 2011

I am tired of watching fsck check my filesystem when my eeepc 901 shuts down abruptly due to a crash. I know that with a journaling filesystem, I won't have to wait for a check. However, I am well aware of the poor I/O performance of the SSD, so I can imagine using a journaling filesystem being even more frustrating, since there will be constant writes to the journal? I will buy a new laptop without such a crummy ssd someday but, is there anything I can do now, on the software side of things?

View 3 Replies View Related

General :: Rsync 8 Different Filesystems Into One New Filesystem?

Dec 27, 2010

I need to combine 6 different filesystems into one filesystem using rsync. I am so confused as to which parameters I need to use. The 6 fileystems are:

/mnt/tkpkgc1a/vol/mn_pkg_08_02/
/mnt/tkpkgc1a/vol/mn_pkg_08_01/
/mnt/tkpkgc1a/vol/mn_pkg_06_09/

[code]....

View 1 Replies View Related

General :: Unmounted Filesystems Accidentally

Jul 5, 2011

I accidentally unmounted filesystems using umount -a command.How to recover from this.

View 4 Replies View Related

General :: Filesystems - Changing Device Names In /dev

Apr 25, 2011

I have many disks and volumes in my system. Some of disks IDE, some SATA.

Volumes on SATA disks cause me problems - I have them listed in etc/fstab, but on every boot, they have different name:

/dev/sdd* becomes /dev/sdb*
/dev/sde* becomes /dev/sdc*

etc. on every boot.

1) Why is this happening?

2) How can I prevent it?

3) If I can't, is there a workaround?

View 2 Replies View Related

Ubuntu :: Get The 'General Error Mounting Filesystems?

Aug 29, 2010

When I try to start up 9.10 I can get past GRUB but not fsck. A file check will be started but no progress will be made and finally I get the 'General error mounting filesystems'.Trying in recovery mode I get this just before the fsck check

Quote:
fsck from util-linux-ng 2.16
[8.016378] ACPI: I/O resource piix4_smbs [0xb00-0xb07] conflicts with ACPI region SOR 1 [0x0b00-0xb0f]
/dev/sda1 goes fine
Quote:
/dev/sda3 has been mounted 34 times without being checked, check forced
mountall: canceled

[Code]...

This seems to be slightly different than the other threads I've seen discussing this issue. It just all of a sudden happened, I didn't upgrade anything or have any crashes immediately prior.

View 2 Replies View Related

General :: Fsck And Manually Mounted Filesystems?

Nov 12, 2010

I want the filesystem of my external drive to be checked periodically after a numer of mounts. I put 2 in the sixth colums of fstab for this partition

Code:
/dev/sdb1/mnt/hdext3rw,dev,sync,user,noauto,exec,suid02
and I use the tune2fs to set the maximum mount count to 32.
Code:
tune2fs -c 32 /dev/sdb

now the mount count is 34 and the date of the last check is not recent, so apparently the auto fsck has not been performed. Probably because this partition is not mounted at start-up but I usually mount it manually.

View 3 Replies View Related

General :: List Filesystems That Are Using LVM Logical Volumes?

Jun 23, 2011

I've read the first 40% of the RHEL 5 Logical Volume Manager Administrator's Guide, but still have one outstanding, burning question.

During the installation of Centos 5.6, I set up LVM physical volumes, volume groups and logical volumes. I can list these using pvdisplay, vgdisplay and lvdisplay commands.

How would I list what filesystems I have that are using my logical volumes?

View 2 Replies View Related

General :: Installing Additional Filesystems In RHEL?

Jul 12, 2011

We are about to install some RHEL5 servers for DB and web and Application servers. I've been asked to test which file systems of the following work better for disk I/O.EXT3 EXT4 JFS BtrFS and any other ones that I can find that work under RHEL the out-of-box install I have done allows me to format my volumes with EXT2/3 but not ext4 or any others. Is it possible to "install" other filesystems for use, if so how?

View 4 Replies View Related

General :: Filesystems - File System For Removable Storage?

Apr 7, 2011

I have a 500GB external drive I want to use on a couple of Linux systems, and looking for a filesystem for it. External drives are frequently formatted in FAT32, but I don't need to interoperate with Windows and would rather avoid the ugly limited kludge that is FAT.

Since I only need to use it on Linux, I would use ext4 or XFS, but they store ownership information. Ideally, I'd use a proper Unix file system that doesn't track ownership (files are owned by whoever mounts the device, like they are when mounting a FAT32 partition), but I do not know of any file system that does that.What would be a good file system for this disk?

View 2 Replies View Related

General :: Filesystems - How To Find Which Process Had Created Any File

May 16, 2011

Is there any way to know which process had created any file in Linux Red Hat/CentOS 5?

View 2 Replies View Related

General :: Filesystems - Totally Clear The Filesytem's Cache?

Aug 4, 2011

In a performance test, I want to bypass the influence of cache of linux system (including page cache/inode cache and so on). I have tried O_DIRECT flag, but it's turned out that direct I/O is still "enjoy" the effect of some cache.Is there a thorough way to close the effect of system cache?

View 2 Replies View Related

General :: Filesystems - Write Files To HFS+ Drive From System?

Aug 22, 2011

Is it possible to write/edit files on HFS+ drive from Linux? Yes I need to disable journaling but how can I disable journaling from Linux? I dont have access to mac.

Or any tool available for doing this?

View 2 Replies View Related

General :: Filesystems - Format Does A Partition Have To Be In Order To Boot Off Of It?

Sep 19, 2011

I am using disk utility to partition an external hard disk. My intention is to boot linux off of the partition. However, I am unsure of which format to make the partition. Disk Utility in OS X only allows Mac OS X Journaled, Mac OS X, FAT, exFAT, and free space. Which one should I use?

View 2 Replies View Related

General :: Root File System Partitioning - Filesystems ?

Feb 12, 2010

I've been using *Unix systems for many years now, and I've always been led to believe that its best to partition certain dirs into separate FileSystems, off the main root FS.

For instance, /tmp /var /usr etc

Leaving as little as possible on the main / system.

Its so that you don't fill up the root system be accident, by some user putting in too bigger files in /tmp, for example.

I would presume that filling the / system would not be too good for Linux, as it would not be able to write logs and possibly other things that it needs to.

I believe that if root gets full, then there is something like a 5% amount saved for just 'root' to write to, so that it can do its stuff.

However, eventually, / will become full, and writes will fail.

On top of this, certain scripting tools, such as awk, use the /tmp/ system to store temp files in, and awk wont be able to write to /tmp/ as its full, so awk will fail.

However, I'm being advised that there is no need to put /tmp /var etc onto separate FSs, as there is no problem nowerdays with / filling up. So, /tmp /var /usr are all on the root FS.

I'm talking about large systems, with TBs of data (which is on a separate FS), and with a user populations of around 800-1000 users, and 24/7 system access.

View 2 Replies View Related







Copyrights 2005-15 www.BigResource.com, All rights reserved