Fedora :: Backup A Growing File?
Jun 8, 2010I have this little problem. I wanna backup a big file that is constantly growing. Is there any way to make one backup and then have some way to take incremental backup of it?
View 2 RepliesI have this little problem. I wanna backup a big file that is constantly growing. Is there any way to make one backup and then have some way to take incremental backup of it?
View 2 RepliesI am new to Linux. I am using tar to backup my emails to a server. I would like to automate this process to routinely backup my emails periodicly, however, i keep running into a problem: I start in the dir I would like to create the tar file (dir size = 240MB). I enter the following command
tar cf bup.mail.llc.tar "/Users/d/Library/Mail/INBOX.mbox/Messages"
file size = 234MB
When I would like to backup my emails into the previously created tar file I use the following command:
tar uf bup.mail.llc.tar "/Users/d/Library/Mail/INBOX.mbox/Messages"file size = 462MB The backup command works, except the size of the original tar file grows, around twice the size. When I extract the updated tar file (file size = 462MB), the unarchived file is 240MB the same size as the original directory.
Why does the size of the tar keep growing each time i perform 'tar uf'?? I don't understand this
Currently running 10.04 and Cacti latest version and although my RAM is only just over 3/4 used my swap file is growing. If I leave the box running for about a week the swap fills and the system grinds to a halt.Is there some way of seeing what's in the swap so I can debug the problem and get my system more stable again?
View 5 Replies View RelatedI've already asked this in the mythbuntu and didn't get an answer there so I'm trying here. OK just added another 2Tb WD drive to my mdadm controled RAID5 array, and the reshape is finished:-
Code:
Code:
Mar 28 18:28:36 alpha2 kernel: [104357.343421] md: md1: reshape done.
Mar 28 18:28:36 alpha2 kernel: [104357.525114] RAID5 conf printout:
Mar 28 18:28:36 alpha2 kernel: [104357.525119] --- rd:4 wd:4
Mar 28 18:28:36 alpha2 kernel: [104357.525122] disk 0, o:1, dev:sda2
[code]...
How to find continuously growing files in the file system?
View 11 Replies View RelatedI am trying to build a media server for my home and still in the process of evaluating my OS options (Ubuntu Server, Fedora Core, or Win Server). I am planning to use four 1TB drives initially for the RAID5 array. Once it fill up i will add more 1TB drives.
My question is can Fedora Core create a RAID5 array and grow latter without having to back up data to external hard drive and re-create the array? I am looking for something that is easy to use and manage. If Fedora Core doesnt have this option, can you recommend other distributions that can do this?
I am trying to build a media server for my home and still in the process of evaluating my OS options (Ubuntu Server, Fedora Core, or Win Server). I am planning to use four 1TB drives initially for the RAID5 array. Once it fill up i will add more 1TB drives.
My question is can Fedora Core create a RAID5 array and grow latter without having to back up data to external hard drive and re-create the array? I am looking for something that is easy to use and manage. If Fedora Core doesnt have this option, can you recommend other distributions that can do this?
Have the following partitions, I've grown md1 from 3 drives to 4 drives with mdadm. It is now the size below of 531899712 from 354599292.
[Code].....
As you can see above however, the filesystem is not growing. What am I missing. I don't believe I need to do anything with the partitions. I should just resize my array as I have and xfs_grow and be finished.
I wanted to shrink my Windows NTFS partition to allow me to grow my extended partition which contains my Linux partitions, namely to grow my swap space and home directory some however it just fails at enlarging the extended partition. Is this a known problem because I know there were rewrites to the storeage backend of Anaconda.
View 4 Replies View RelatedThis script simply deletes files older than a certain age (in this case 7 days) from a certain location; I use it to purge old backups nightly, and it works as expected:
# delete backups older than 7 days
find /mnt/backup/* -mtime +7 -exec rm -Rf {} ;
The problem is, every morning I get an email with an error message something like this:
find: `/mnt/backup/subfolder': No such file or directory
Can some one give me a sample of a crontab for backing a directory please, System is Ubuntu 9.04Quote:
#!/bin/bash
# this file is an automated backup script, backup.sh.
# this backs up my domain site.
[code]....
I would like to make a backup file from my fedora 12, in case if I have any problem with it, I could restore all my programs and settings from OS, I used do this with northon ghost in windows, but now in linux I don't know for sure. Yesterday I made a backup, in the end it was 34gb of his size, I wanna backup only what is used, how I do this?
View 7 Replies View RelatedAttempting to create a backup script to copy files from one file system to a remote file system.
When I try this I get:
Quote:
# tar -cf - /mnt/raid_md1 | gzip -c | ssh -i ~/.ssh/key -l user@192.168.1.1 "cat > /mnt/backup/fileserver.md1.tar.gz"
tar: Removing leading `/' from member names
Pseudo-terminal will not be allocated because stdin is not a terminal.
ssh: Could not resolve hostname cat > /mnt/backup/fileserver.md1.tar.gz: Name or service not known
[Code].....
I know that the remote file system dir is RW and the access is working fine. I am stumped...
I have installed an application manager(monitoring application) on my linux server. Now, i need to have backup schedule for my application. The application itself has executive file to backup database.But when i put this file in my crontab to schedule the backup program it wont run!50 09 * * * root /opt/ME/AppManager9/bin/BackupMysqlDB.sh
View 1 Replies View RelatedI want to make a backup from my Email and my Favorites from Mozilla.
But which folders I have to make a backup from.
I want to back up an entire Linux system on a 3Tb external Western DIgital USB3 drive.
I do not want to reformat it from what it is, apparemtly NTFS.
Is there a utility that can act like a file manager like mc, that will permit me to create an ever expanding (to 320Gb) TAR file that will retain all the original file permissions. I have had nothing but disappointment with Linux backup utils with a FAT32 external drive, and I am concerned if I just try an tar the entire drive at once, with around 3 million files, I might run out of memory.
Does webilder just keep growing the collection? Or does it ever get rid of old photos? It seems to me an ideal webilder I could set max 100k, it would delete oldest photos to make room for new. Or, like flickrwall (windows), it would just pull one flickr photo per hour, over writing last photo.
View 1 Replies View RelatedI was growing a 3 disk raid 5 to a 4 disk raid 6.I used mdadm --grow /dev/md0 --level=6 --raid-devices=4 backup- file=/home/user/Desktop/md0.backup for the grow.The drive I added was /dev/sde1. Well it was going strong for like 2-3 days and last time I checked it was at 73% rebuild.Well the frikin power went out on me and when I came back home I can't get the array assembled.
I just have a fear that i lost my superblocks but I'm also a moron when it comes to this stuff.. I would like to think not, but I'm sure there are much smarter people than I on this issue. Any help would help cause of course I have a lot of stuff on my raid with 3 2tb drives.. the irony is I was converting to raid 6 to make sure I had really good safety net.
I installed a raid1 on a debian lenny box with only 1 drive "--raid-devices=1" because I didn't have the other drive yet. When I got the other drive, I used "mdadm --grow /dev/md0 --raid-devices=2" and "mdadm --manage /dev/md0 --add /dev/sdb1" The original drive is sda1. I watched /proc/mdstat until it was completely synced, and after a reboot, the system will not reassamble the raid. It fails with "mdadm: no devices found for /dev/md0" This is where root is, therefore, I get nowhere. From a rescue cd I can disable the other drive and shrink back down to 1 device and it boots fine.
View 1 Replies View RelatedSo, I recently installed a server with several software RAID partitions over three drives. After installation, I pulled out the CD-ROM and added a fourth drive.
I believe I successfully grew all the arrays (RAID1 for /boot, RAID5 for /, and RAID1 for swap), but I'm not seeing that growth in my filesystem.
The root partition is no larger than it previously was, even though the specific array that is mounted to it has grown to the proper size.
$ df -h
Code:
Filesystem Size Used Avail Use% Mounted on
/dev/md2 292G 6.8G 271G 3% /
none 118M 292K 118M 1% /dev
none 123M 0 123M 0% /dev/shm
[Code]....
I'm sure I'm missing something quite simple here, but how can I resize my root partition to the full size of /dev/md2?
I should note that even though I ripped out the CD-ROM in favor of an additional HDD, I can probably run a live session from a USB stick (although I've been unable to thus far- any solution that can avoid doing so is preferable).
My fileserver initially had 3 1TB drives in RAID 5 configured with mdadm as /dev/md1. (System root is a mirrored raid on /dev/md0) I went to go add a 4th 1TB drive to /dev/md1 and grow the raid 5 accordingly. I was initially following this guide: [URL] but ran into issues on the 3rd and 4th commands. I've been trying a few things to remedy the issue since, but no luck. The drive seems to have been added to /dev/md1 properly, but I can't get the filesystem to resize to 3TB. I also am not entirely sure how /dev/md1p1 got created, but it appears to be the primary partition on the logical device /dev/md1.
Relevent information:
Code:
fdisk -l /dev/md1
Disk /dev/md1: 3000.6 GB, 3000606523392 bytes
2 heads, 4 sectors/track, 732569952 cylinders
Units = cylinders of 8 * 512 = 4096 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 65536 bytes / 196608 bytes
Disk identifier: 0xda4939fa .....
The filesystem originated as ext3, I believe its showing up as ext2 in some of these results because I disabled the journal when doing some initial troubleshooting. Not sure what the issue is, but I didn't want to blindly perform operations on the filesystem and risk losing my data.
I was wondering if it is possible to create a growing image for a loopback device. Like a file that you create that will grow with the data that is placed on it instead of a file that has to be the size of the entire file system?
View 4 Replies View Relatedcurrently my disk-space is growing very-very fast and in the same time I have a very limited amount of it.Last time I had this kind of problem, I had MySql persistence replication is on and disabling the feature fix the problem. I don't know what happened between now and then, the space is shrinking rapidly (600Meg in couple of days) and I only downloaded files for less than 10Meg in the same period.
Could anybody give me a pointer to a tool that can oversee growing directories or files or maybe a script that able to do this (possibly involving Cron). I try using "Find" but I cannot find any files that are suspiciously growing. I suspect it's a directory that is growing, but I don't know.
I currently have two hard drives, with my root partition configured in RAID0. I'd like to add two additional hard drives, and include them in my RAID0 array. I need to recreate the array to do this, so I'd like to copy everything off of the existing array, add the drives, build the new array, and copy everything back. I have an external hard drive with four times the capacity of my current array. What would be the best way to copy this data so that nothing is missed, so I can just copy everything back and boot back up? dd, image the entire root partition, mount it after creating the new array, copy everything back (at the filesystem level) dd, image the entire root partition, write it back out to the new array, I'm not sure how this would work, because the partition will be the wrong size, I don't know much about dd. rsync, just rsync everything on root over to the external something else? I plan on booting to a live CD and mounting my current array there, so I won't be working on a live filesystem.
View 1 Replies View RelatedI want to setup sendmail to alert for Nagios, OSSEC, redmine, ...
I configure sendmail to work with Gmail smtp follow this guide. I disable local delivery in sendmail by adding the following lines in sendmail.mc:
Code:
define(`MAIL_HUB', `xx.localdomain.')dnl
define(`LOCAL_RELAY', `xx.localdomain.')dnl
it works but this messages seems to be stuck in sendmail queue:
Code:
sendmail -bp
...
[Code].....
An external service I dont manage pushes mediafiles into a shared directory on my server. I need to move these files into their correct directories automatically. The problem is that if I run my script as a cronjob once every 3 minutes, I notice that the script copies files which are still on their way into my server. So I need to figure out how to have the script check that the files are complete (done downloading) before the script moves the files. This is what I got so far:
Code:
#!/bin/sh
# Script by proximity 280709.
# Locate correct directory
[code]....
I have a couple of Lenny LAMP servers, and a backup server. (virtual testing environment)
1. What is the best way to perform a backup? (system state as well as individual files) Although system state can also be accomplished through the hypervisor.
2. Between Windows computers, I access shared directories simply by \hostnamesharedmap or \host_IPsharedmap. Between Windows and linux i use SAMBA. But there must be a simple way to copy 2 files between linux hosts?
3. I've searched a lot, and only found people with the same question without a good answer: is there a linux equivalent for robocopy?
basically want i want to do is copy my whole file system to a different hard drive, then reconfigure my partitions and copy it back. then reconfigure grub.
the reason i want to do this is when on dual boot i gave it only 70gb of space and now i want to add 300 more. and since the 300gb of space is a primary partition and this is a secondary i cant extend them or combine them.
so what i want to do is. sudo cp -rP / /home/me/sshfs-folder
also i have raid 0
There's so much software for backups I don't know where to start. I figured it'd be easier to ask other ubuntusers.what would be best based on these particulars ?
1. An entire "tree" hierarchy of dirs and files to be backed up every so often on external HDDs (manually as I see fit).
2. As one HDD fills up, I can grab a new one to use as my backup medium, and the software will simply re-build the file system (tree) as necessary, only copying new/updated files and creating the directories to store them.
3. Backup software tracks which&where already-backed-up files were copied in some sort of spread/db/log, i.e. so that I may search and easily see which ex hdd I need to grab.
I'm using ubuntu for a few weeks now and i created a backup script that can copy some folders into a .tgz file. Now i want to place back the folders to where they come from and overwrite the original folder. like the /home folder in the .tgz file overwrite the /home folder on my harddrive. I already tried to do this with: tar xvpfz filename.tgz. But after that the folders came in the same folders as the backupfile stands.
How can i do this the right way?