Ubuntu Servers :: New RAID - Recommended Maintenance And Backups
Feb 22, 2011
I decided to create a file server for my family. I have set up a RAID 6 (4 disk) array. My thoughts were to back up the array to a hard drive monthly. Store the drive in a WiebeTech Drivebox, off site, in a "fire proof" box. (The kind for papers sold at Staples or Office Depot. After a year, I would have 12 back-ups. I would then overwrite the previous hard drive. (i.e. HDD from March 2011 would be overwritten on March 2012.)
Additionally, I was wondering if there was recommended maintenance to verify the array is working properly. Right now, I am moving data to the array so quickly that I am backing up every few days between three hard drives. (Back-up #4 was written to Drive #1 after Drive #1 was reformatted.) I am aware that I could use rsync. (Which I currently use for backing up my portable USB HDD to the RAID array.)
View 1 Replies
ADVERTISEMENT
May 9, 2011
So I am using rsync (3.0.7 on MAC OSX) to backup one hard drive to a folder on another one. The is USB drive to USB drive and I have done the initial backup from one drive to a new formatted other drive with the following command:
Code:
rsync -avX --progress /Volumes/Source /Volumes/Destination
This all appears to be going smoothly as I type. I am going to write a script to do subsequent backups in the
[code]....
View 2 Replies
View Related
Feb 1, 2011
Could any RAID gurus kindly assist me on the following RAID-5 issue?I have an mdadm-created RAID5 array consisting of 4 discs. One of the discs was dropping out, so I decided to replace it. Somehow, this went terribly wrong and I succeeded in marking two of the drives as faulty, and the re-adding them as spare.
Now the array is (logically) no longer able to start:
mdadm: Not enough devices to start the array.Degraded and can't create RAID ,auto stop RAID [md1]
I was able to examine the disks though:
Code:
root@127.0.0.1:/etc# mdadm --examine /dev/sdb2
/dev/sdb2:
Magic : a92b4efc
Version : 00.90.00
code....
Code:
mdadm --create --assume-clean --level=5 --raid-devices=4 /dev/sda2 /dev/sdb2 /dev/sdc2 /dev/sdd2
As I don't want to ruin the maybe small chance I have left to rescue my data, I would like to hear the input of this wise community.
View 4 Replies
View Related
May 4, 2010
I notice when Linux boots in maintenance mode the filesystem is read-only.
Is there a way to change this, perhaps remounting as writable?
An example of this being a problem is that I was unable to open vi because there were too many session files....
Not to mention it would be nice to actually fix problems....
What are you meant to be able to do if you can't make any changes to the filesystem? What kind of maintenance can be expected?
View 1 Replies
View Related
Mar 19, 2010
We're about to upgrade our Ubuntu server and are looking for a complete package set that includes a firewall, some kind of snoopy, and whatever else we "must have" or that would just be extremely useful. What do you guys find the most absolutely necessary and needed packages for running a linux server in regards to security and performance.
View 3 Replies
View Related
Mar 23, 2010
I have a server setup with all my web development stuff in /var/www and in several sub-folders within that. (each project having it's own folder)It works great with one FTP account. But recently I've been getting help on a projects from a buddy of mine that freelances, and have made him an FTP user account as well. All is fine, except for when he tries to edit a file and gets a permissions error.
Here's the issue, I don't want us to have the same FTP login, but all the files are currently owned by my user name. So, when he logs in to edit a file, he can't because I'm the owner, and the files are set to 744. Will I cause any harm by adding both users to the same group (www-data) and chmod'ing the files to 775 so that we can both access and modify the files?
View 2 Replies
View Related
Mar 27, 2009
I am building an email server in what I consider to be a 'small business'. I would say my Postfix mail server will house 300 mailboxes (Max). I have a decent server with enough RAM / disk space to run this email server however I don't know what the best way is to manage / configure the users mail boxes.
how to create a new user on the Linux server using 'adduser / useradd' and then setting their shell to /bin/nologin. This is because the mail user will never need to log into the shell of the mail server directly and can still populate email from their mailbox which is located in their /home/$user directory. Now many people I spoke with have advised me that this is a bad and cumbersome method of account administration.
I am running:
Postfix 2.5
Clamav v0.94.2
Amavisd-new 2.5.4
Dovecot 1.0.7
Spamassassin 3.2.5
View 3 Replies
View Related
Feb 3, 2011
I've been a DOS/Windows guy for 20 years, and recently became a SW test lab helper. My company uses CentOS for a lot, so I've become familiar with it, but obviously not as comfortable as I am with Windows.
Here's what I have planned:
machine: Core 2 Duo E8400, 8GB DDR2, 60GB SSD OS drive, ATI 4650 video card, other storage is flexible (I have 3 1TB drives and 4 750GB drives around that can be used in this machine.)
uses: HTPC, Network Storage, VMWare server host: SMTP, FTP server, and Web server virtual machines
I've figured out how to do much of this, but I haven't figured out how to do backups in Linux. I've been spoiled with Windows, with the built in backup system so simple to use. I find myself overwhelmed with the array of backup software, and unable to determine which to use. none of them seem to do everything I need them to do, but some come close, I think. I'm hoping someone here can help me out in figuring out which program to use and how to use it.
Here is what I need the backup software to do:
1. scheduled unattended backups, with alerts if the backups fail
2. a weekly full backup with incremental every 12 hours
3. removing the old backups when the new full backup runs, I would prefer to keep 2 weeks of backups, but that's not necessary
4. a GUI would be preferable, since my arthritic fingers don't always do as I want them to do. I typo things a lot, and the label worn off my backspace can attest to that.
View 7 Replies
View Related
Oct 9, 2010
I want to build a NAS like mini pc to be used as a simple tomcat server (for running Jira and perhaps experimenting a bit) and as a GIT server. What kind of system requirements would I have?
Would something like this:[URL]../nas/n...sed-nas-part-2 be sufficient? And if I'd virtualized everything via VMWares would that make a lot of difference?
View 2 Replies
View Related
Jul 20, 2011
I created a cron and a shell script but I'm not sure how to automatically handle the mysql password prompt. I'm sure it's simple but having trouble figuring it out
View 6 Replies
View Related
Nov 12, 2009
How do you get Rsync to do incremental backups rather than full backups? At the moment I have a script that will create a backup folder (if it doesnt already exist) then copy the source files into the backup directory with the command
rsync $VERBOSE --exclude=$TARGET/ $EXCLUDE --exclude '/Ls-wtgl1c8/**' -rt --delete $source/ $TARGET/$source/ >> $LOG_FILE
Target is where the files will be backed up to Sources is the dir(s) to be backed up Exclude files is the list of files not to backup
log file is where the output will be saved to. At the moment it only does full backups, but I would only like to do incremental, how would this be achieved? Am I missing out an option in the Rsync that is required.
View 9 Replies
View Related
May 1, 2011
I'm trying to follow various ways to setup a Time Machine drive on my Ubuntu 'natty' server. I am at the stage now though where I can't seem to find the external USB HDD anywhere. I have it partitioned into two and cannot find anything to do with it. When I check ot doesn't show up in the memory either. Is there a way to mount it or find it?
View 3 Replies
View Related
Jan 16, 2010
I have three WD 1.5 GB harddrives. 2 of them already in a linear RAID also called Concatenated i think. (the same as JBOD). Can i add the third drive to the RAID without losing data? Update "Using mdadm software raid."
View 7 Replies
View Related
Jan 26, 2010
I have two drive on my Ubuntu server. I have a 40GB IDE 5400RPM and an 80GB SATA 7200RPM.
Is it at all possible to RAID 0 the two of these drive? I know it's pretty unorthodox, but it's what I've got without having to buy anything.
If so, what are the limits, cons, and/or potential pros of doing a RAID of these two?
View 9 Replies
View Related
Mar 4, 2011
I am attempting to run Ubuntu 10.04 Server on RAID 1 and am consistently hitting the same issue when trying to boot the system for the first time (after what seems to be a successful install of the OS). I am creating the RAID 1 using the directions found in the Ubuntu Server Guide. The error I receive when trying to boot the system for the first time is...
Code:
mount: mounting /dev/disk/by-uuid/f35415ee-4c14-4eb1-995f-f19fbcd760c7 on /root
failed: Invalid argument
mount: mounting /dev on /root/dev failed: No such file or directory
mount: mounting /sys on /root/sys failed: No such file or directory
[code]....
View 2 Replies
View Related
Jul 26, 2011
I've had this server for a while and I've periodically received similar errors, but it's been worse lately. I'm trying to diagnose and similar posts have left me with 2, maybe 3, ideas about what could be wrong. Here is the setup: Ubuntu Server 10.10 maverick kernel 2.6.35-30-server Sans Digital TR8 8 bay raid - 2 port multipliers to esata outputs 8 1TB WD Caviar Black Syba PCI-e card with Sil3124 chipset - 2 external esata inputs I do not use the RocketRaid 622 card that came w/the enclosure because I had problems with drivers and configuration so I went with the SI chipset. The raid is configured with mdadm, level 10, running ext3 file system:
Code:
root@i5server:~# cat /proc/mdstat
Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5] [raid4] [raid10]
md0 : active raid10 sdb1[5] sdg1[2] sdd1[7] sdh1[3] sdf1[1] sde1[0] sdc1[6] sda1[4]
3906721792 blocks 256K chunks 2 far-copies [8/8] [UUUUUUUU]
[Code].....
What's odd is that the raid dropped out and completely locked up the computer multiple times, then marked one of the drives as failed. I did a readd on the drive and it rebuilt witout issue. Ran e2fsck -f to clean up the problems it had when it crashed, but as soon as I do heavy read/writes the errors start showing up again. This is primarily a media server for music and movies, but also for backups and printing. Heavy read/writes are generally transcoding movies and music which is what I was doing when it failed.
View 7 Replies
View Related
May 17, 2010
I have a problem installing Ubuntu on an HP Proliant ML115. This server has a 1TB mirrored RAID setup (and 1 250GB drive), problem is, Ubuntu apparently doesnt like it, it detects the RAID but fails to partition the hard drives and the installation cant continue. I tried the guided partitioning using the whole disk (detected RAID array). Here is what syslog gives me:
May 17 22:32:30 main-menu[504]: INFO: Menu item 'disk-detect' selected
May 17 22:32:30 net/hw-detect.hotplug: Detected hotpluggable network interface eth0
May 17 22:32:30 net/hw-detect.hotplug: Detected hotpluggable network interface lo
May 17 22:32:31 hw-detect: Loading PCMCIA bridge driver module: i82365
May 17 22:32:31 hw-detect: FATAL: Module i82365 not found.
[Code]...
PS: Im very noob regarding this kind of stuff so detailed instructions please, also feel free to give configuration tips
View 6 Replies
View Related
Jun 3, 2010
I'm having a problem with the installation of Ubuntu Server 10.04 64bit on my IBM xSeries 346 Type 8840. During the installation the system won't recognize any disk, so it's asking which driver it should use for the RAID controller. There's a list of options, but nothing seems to work. I've been searching the IBM website for an appropriate driver, but there is no Ubuntu version (there is Red Hat, SUSE, etc). I was thinking about downloading the correct driver onto a floppy disk to finalize the installation, but apparently no 'general' Linux driver to solve the problem here.
View 1 Replies
View Related
Jun 15, 2010
I've recently completed a fresh install of 10.04 on a home file server and upgraded the hard drives in my storage array. My PREVIOUS hardware was:
Old version of Ubuntu (I forget which one exactly, but I know I had missed a few upgrade cycles)
3X 500 GB Seagate Baracuda's (for the array)
Areca 1220 Hardware RAID controller
Intel Core 2 Duo 6600
320 GB Seagate for the boot drive
I was running that hardware for about five years or so and it was rock solid. After the upgrade the hardware specs are:
Ubuntu 10.04
Areca 1220 hardware RAID controller
4x 1000GB Samsung
Intel Core 2 Duo 6600
320 GB Seagate for the boot drive.
The fresh install of Ubuntu 10.04 went remarkably well. The drivers for that raid controller are in the kernel, which is great. I was able to access the old array after upgrading Ubuntu. Now I am trying to create a new array with the four 1000 GB drives in a RAID 5. Obviously that gives a maximum storage capacity of 3 TB, greater than the 2 TB threshold that seems to be so important. I've been doing some digging and here is where my questions start:
it appears as though gparted doesn't support file partitions greater than 2 TB, correct?
it also doesn't seem as though parted supports ext3 or ext4, is that correct?
If this is the case, how do I create a partition with ext4 that is greater than 2 TB?
I can see the array volume in gparted (which is a relief) but it lists the size as 2.73 TiB, which I find curious because that is over 2 TB, but not the full capacity of the volume. I can also get to the volume in parted. But I see in the parted documentation that using the makepartfs command is discouraged and instead, one should use the command mkpart to create an empty partition, and then use external tools like mke2fs ( to create the filesystem.
how to proceed from here. What does the community think is the best course of action to create a partition of 3TB in ext4? Then I need to change fdisk to automatically mount the array at every log in, right?
View 8 Replies
View Related
Jul 12, 2010
I'm setting up a web server but I have no experience with RAID. I would like to try this configuration if possible:
2 x HDD 500GB RAID1
1 x HDD 20GB (logs and tmp)
The old 20GB drive I would like to use it to store logs and temporally files (mounted in /var/log and /tmp respectively). With this I'm trying to reduce some disk usage in the RAID drives. In my idea, it would be better to write the access/error logs of the web server in a separated drive to the one serving the files which may increase speed... sounds crazy?
One problem is that during the installation, If I set the RAID automatically it will try to use my 20GB HDD as well in the RAID... Does it will work if I set the RAID first (removing the 20GB HDD) and then set the mount points in it after the installation?
View 4 Replies
View Related
Aug 1, 2010
I'm in the process of setting up my very first ubuntu server.
Using 10.04 and has 2gb ram
I am using Ubuntu's software raid (mdadm)
It will be a file server, with 4 hard drives (3 in RAID5 and 1 as a spare)
All 4 drives have 2 partitions:
Partition 1 - 100mb
Partition 2 - The remaining drive space
I setup the first 3 drives' partition 1's to be RAID1 with the 4th drive's partition 1 as a spare. This is where I'm mounting "/boot" (it's my understanding that /boot cannot be on a RAID5). I setup the first 3 drives' partition 2's to be RAID5 with the 4th drive's partition 2 as a spare. This its where I'm mounting. I believe so far I'm setup correctly to be able to deal with a drive failure and the system should operate just fine. What I don't know what to do is with the /swap. I want to retain the ability to be able to operate with a drive going down. But I have also read warnings about putting /swap on a raid. How would you setup /swap?
View 6 Replies
View Related
Dec 16, 2010
I am trying to build a storage server using software RAID. After getting writing RAID information to what I thought was the drives, I realized the configuration was not going to work. Since that time I have modified the RAID configuration more than once plus this is a project that was started a few months back. Between the time delays and currently written configuration, things are a confusing mess.
What I would like to do is wipe out all software RAID and start all over again. The problem is that I am unable to figure out how to get rid of it. I used DBAN to wipe out all four of my 1 TB drives which took a while. But still, the RAID configuration pulls up when I try to do a new install. Where is the RAID configuration data stored at if not on the HD? How can I scrub that information off so I can start all over again?
View 8 Replies
View Related
Jan 11, 2011
I'm using a Intel mac pro running Ubuntu Server 10.4 64bit, and I have it working. Currently, I'm just using Ubuntu using bootcamp, and not using EFI. The OS drive is 250gb which I know is more than enough, but it was what I had free at the time. I added 3 1tb drives to the computer, but not sure how to create a raid with them. I've done some searching, but still haven't been able to get it done successfully.
View 3 Replies
View Related
Mar 26, 2011
I have an Areca hardware RAID array that I'm trying to format & partition on a fresh Ubuntu 10.04 LTS installation. The OS drive is not on the RAID card, it's entirely separate. The RAID is a 6TB volume so I realize I have to use parted to format it, not fdisk (which I've always relied on).
My problem is that I can't figure out how to get parted to like my settings. It seems like everything I try gives me the warning "Warning: The resulting partition is not properly aligned for best performance." Here's what I'm doing:
Code:
(parted) p
Model: Areca ARC-1280-VOL#00 (scsi)[code].....
What start/end settings should I use to get a properly aligned partition? How do I know?I have tried a mix and match of 0, 0s, 1, 1s, -0, -0s, -1, -1s, 100% for my start/end with no success.
View 8 Replies
View Related
May 13, 2011
I am trying to grow my array to make full use of my drives. I have a raid 6 using mdadm on my home server. The array used to consist of 6 1.5TB drives when it was created. Since then I've been replacing the 1.5TB drives with new 2TB drives. And now I have replaced the last 2 drives.
When I added the first 3 disks I did not use the whole disk for the raid partition but rather made it the same size as the 1.5 partitions. As it turns out this may have been a bad idea. (But it gave me another 3 partitions of 500GB that I turned into 1 disk using mhddfs.)
Now I'm trying to grow the array. I've been testing in a virtual enviroment on how to do it but I cannot find another method than this :
1) fail 1 disk.
2) re-partition the disk with the size of the whole disk.
3) re-add the drive as a spare.
4) start the now degraded array to let it resync.
5) wait quite a while. (aprox 5 hours)
6) start again from step 1 for the other disks.
7) use mdadm with grow command to enlarge the array
use resize2fs to fill array to max size
Now although since this is a raid 6, I keep some redundancy but I still worry about degrading the array so manny times and rebuilding the whole thing. I mean I read the thing out 3 or 4 times over doing this.
View 5 Replies
View Related
Jun 4, 2011
I have installed ubuntu server LTS 10.4 on a HP MediasmartServer.It has four disks. On the first one I have the original HPFS/NTFFS partition (left untouched), a Linux ext4 partition for / a Linux SWAP partition and the rest of this first disk (sda) is part of a RAID 5 with the three other disks.I now have this first ext4 partion shown as full. Is there an easy way to give it more space without loosing the whole setup?I have 2TB of data on this server and everything is so fine.
View 7 Replies
View Related
Jul 6, 2011
I've been running my dedicated server on Ubuntu 10.04 for 300 days non-stop so far (touch wood). I'm planning to purchase a dedicated server to host many large sites. The specs are Sandybridge Xeon with 16 bay x 2TB storage using RAID5 (Adaptec RAID 51645).I don't have experience with RAID, but I read that ext4 can only support filesystem up to 16TB, my plan for the system is to have 32TB of storage. How can I make Ubuntu run this configuration?
Also, can Ubuntu 10.04 recognize the Adaptec card? Going through Adaptec website there is no mention of drivers for Ubuntu (although many other distros are available).
View 6 Replies
View Related
Jul 6, 2011
I'm looking at building a small NAS setup for my home to hold all my media (DVD's, pictures, music etc..). I'm not too concerned with backups of it at this point as I have all the data elsewhere as it is, but would like one central spot to access it.
A friend of mine turned me on to Ubuntu to do this with but he's never tried it, so I'm looking to see if anyone else has done this or if there issues with it. I've used linux off and on for several years, but this would be my first Ubuntu install.
I'm looking at either using some older hardware I have sitting around, or something cheap like a small dell server (T310 or something). I'd get 4 2TB drives and just use them in a software raid 5 array. It would be accessed with a few different samba shares I'm thinking.
View 9 Replies
View Related
Sep 1, 2011
Quote:
EFI GUID Partition support works on both 32bit and 64bit platforms. You must include GPT support in kernel in order to use GPT. If you don't include GPT support in Linux kernel, after rebooting the server, the file system will no longer be mountable or the GPT table will get corrupted. By default Redhat Enterprise Linux / CentOS comes with GPT kernel support. However, *******if you are using Debian or Ubuntu Linux,******** you need to recompile the kernel. Set CONFIG_EFI_PARTITION to y to compile this feature.
Is this true? Ubuntu has no GPT support native to the server install? Never compiled a kernel. Is that of itself going to be a mind bender? How much doo doo am I going to get into if I haven't done it a few times? Trust me when I tell you its no thrill formatting and reformatting a 8tb raid drive or the individual disks if it screws up. Been on that ride way too long already. Need things to go smoothly. This is not a play toy server, but will be used in a business.
View 2 Replies
View Related
May 15, 2010
I was having this issue with my server when I tried upgrading (fresh install) to 10.04 from 9.04. But to test it out after going back to 9.04 I installed 10.04 server in a virtual machine and found the same issues. I was using the AMD64 version for everything. In the virtual machine I chose openssh and samba server in the initial configuration. After the install I ran a dist-upgrade and installed mdadm. I then created an fd partition on 3 virtual disks and created a RAID5 array using the following command:
Code: sudo mdadm --create --verbose /dev/md0 --level=5 --raid-devices=3 /dev/sd[b-d]1
This is the same command I ran on my physical RAID5 quite a while ago which has been working fine ever since. After running a --detail --scan >> mdadm.conf (and changing the metadata from 00.90 to 0.90) I rebooted and found that the array was running with only one drive which was marked as a spare. On the physical server I kept having this issue with one drive which would always be left out when I assembled the array and would work fine after resyncing until I rebooted. After I rebooted the array would show the remaining 6 drives (of 7) as spares.
I updated mdadm to 3.1.1 using a deb from debian experimental and the RAID was working fine afterward. But then the boot problems started again. As soon as I added /dev/md0 to the fstab the system would hang on boot displaying the following before hanging:
[Code]....
View 7 Replies
View Related
