Ubuntu :: Building NAS - Disk And Data Management
Jul 17, 2011
I currently have a 2TB qnap nas which will be relegated to mirroring important files from my new nas. I am building up a HP Microserver with 2*2TB and want to look at the best way to manage the data, disks and backups.
My wish list: Power down unused drives
I want all the disks to appear as one.
I want to be able to easily add an extra drive and add to the available space
I want to be able to replace a disk with a larger one and add to the available space (It's ok if I have to manually copy the data from the old drive to the new drive)
If a disk dies I want the remaining disks to still function with whatever data they have left on them.
Email me if a drive dies
If the server blows up then I can plug any drive from the server into another pc and copy the available data off the disk
Mhddfs - anyone use this much? What's the speed like? Do individual drives get spun down if not used? How is it decided which drive gets the data? No one talks about mhddfs much. It all seems to be about mdadm and raid and LVM which I don't think is suitable for my current purpose. I have a existing qnap nas with a total of 2tb that will rsync changed files from the server nightly. To restore missing files would I use rsync in reverse?
View 4 Replies
ADVERTISEMENT
Mar 31, 2010
I want to ensure I have done all I can to configure a system's disks for serious database use. The three areas I know of (any others?) to be concerned about are: I/O size: The database engine and disk's native size should either match, or the database's native I/O size should be a multiple of the disk's native I/O size. DMA: Disks that are capable of Direct Memory Access (eg. IDE) should be configured for it.
Write-caching: When a disk says it has written data persistently, it must be so! No keeping it in cache and lying about it.
I have been looking for information on how to ensure these are so for CentOS and Ubuntu, but can't seem to find anything at all. I want to be able to check these things and change them if needed. The actual hardware involved is very modest. The point is to get the most out of what hardware we do have, even though it's "not very serious hardware" from a broader perspective.
View 1 Replies
View Related
Jul 6, 2010
I am trying to do my graduation project, it's labeled under "linux secure router", and I should build a linux based router equipped with firewall and ACL management...Some people advice me to use linux ubuntu distribution todo this I try to do that but I don't know where to start form
View 3 Replies
View Related
Oct 10, 2010
I have a 2 TB disk in an external SATA dock, formatted with a single ext3 (Linux) partition, which doesn't show up in the Windows 7 Computer Management->Disk Management utility, even as a raw/blank disk. I've verified that there's nothing wrong with the disk by connecting it to my Linux machine and mounting it, and I've verified that the dock is functioning properly by connecting a different FAT32-formatted disk, which mounts flawlessly as expected.I realize that I can't actually read the ext3 partition without additional software (e.g., Ext3IFS), but why doesn't the disk show up at all? Is there some sort of stupid anti-Linux filter built in? Is there any way to force Windows to recognize the disk, so that I can at the very least use direct block access with it?
Background: I want to clone an identical 2 TB disk onto this one. Due to my hardware layout, it's much easier to have the source disk attached to one machine and the destination disk connected to another, and do the clone over the network (the network is not a bottleneck with switched gigabit ethernet), than it is to hook them both up to one machine.(1) I did this once before when both machines were running Linux, but I've since upgraded the destination machine and decided to switch back to Windows for regular desktop use. I've got Cygwin installed, and have verified that the same basic method (dd + nc) will work, but I can't do anything if Windows doesn't even consider the destination disk to exist.I only have one eSATA port on each machine. Opening them up just to do this clone is a rather large annoyance. Also, since this is my backup disk, I'd like to eventually automate the cloning from the active disk to another one that I regularly swap with a third disk that I store off-site.
View 1 Replies
View Related
Jan 18, 2010
I need some advice or tips or maybe your own experiences about building a home data storage or NAS.Here's some thoughts / requirements I think it should have:It should expandable. I'll stick a couple of 1TB HDDs and a little later I'll stick some moreIt should easily integrated to both Ubuntu and Windows 7. Ideally it'll be an integrated part of the filesystem.I'm thinking some sort of RAID as a backing up my data. RAID 1 seems like a such a waste but then again, these days, HDDs are cheap.And when I do add more HDDs, I'd like them to appear as one big storage unit instead of separate drives.Any suggestions and tips on how to go about this is welcome. Questions are plenty: should I go with server hardware or is bigger ATX case and standard hardware enough? I'll need some pointers so keep 'em coming
View 9 Replies
View Related
Aug 20, 2010
Is there a decent hard disk management apt . you see when i started using ubuntu i specified 2 gigs for ext filesystem drive because at that time windows was my basic OS . but now ubuntu became almost my only OS , so i wanna cut out like 20 gigs of the ntfs windows drive and add them to ubuntu's filesystem without removing or formating neither OS's or drives is there a software that can do that ?
View 3 Replies
View Related
Jan 25, 2010
I have installed Ubuntu Server x64 in a VM (VMWare workstation) but have limited knowledge. Does anyone have steps on installing and configuring NDMP (Network Data Management Protocol) on an Ubuntu server? I would like to set this VM up like a NAS box so I can do some NDMP backup testing.
View 2 Replies
View Related
Nov 19, 2008
Is there a open-source data protection management tool that anyone knows about and/or can recommend?
View 1 Replies
View Related
Aug 24, 2009
There is a disk 500 gb, it is broken on /boot and on /root and on /dev/sda1 and /dev/sda2. Whether prompt it is possible to redistribute a disk without loss of data namely it is necessary to make/boot and two equivalent on disk volume.
View 3 Replies
View Related
Mar 30, 2010
OS: LINUX RHEL5
I want to resize the partition
for example..
my
/u01 is 50 gb.
/u02 is 30 gb.
i need to risize /u02 to 100gb( i have space left of around 60 gb and I need to take 10gb from /u01)
View 1 Replies
View Related
Oct 11, 2010
Can I delete the ext and swap partitions from disk management on windows 7 ? Because I want to install a fresh new copy of ubuntu 10.10 . I know it would affect windows 7 boot up.I can handle it by system restore Anyway can I do it or not ?
View 5 Replies
View Related
Feb 13, 2011
Does anybody know details about the integrated benchmark which comes with the disk management utility "palimpsest"? How does it perform the read/write benchmark?
View 3 Replies
View Related
Feb 19, 2010
I am trying to figure out where the harddisk power management can be found in Squeeze. Before it was in the scripts under /etc/acpi, but in Squeeze it's not. I'd like to be able to change the hdparm -B value from 128 to 200 when using battery.
View 3 Replies
View Related
Jan 14, 2011
I can't burn a data disk through Ubuntu.I tried using the built-in disk creator, It had some kind of error saying the disk cannot be mounted.So I used Brasero instead and I got essentially the same error. When I tried to open both CD's the files appeared to be present but were all corrupt.Braso works fine for burning music CD's but I can't get it to work for data.here is the error log from Brasero:
BraseroReadom stderr: Time total: 131.474sec
BraseroReadom stderr: Read 666760.00 kB at 5071.4 kB/sec.
BraseroReadom stderr: HUP
BraseroReadom process finished with status 0
Session error : Some files may be corrupted on the disc (brasero_burn_record brasero-burn.c:2862)
View 3 Replies
View Related
Mar 22, 2010
A while ago my harddrive kinda failed. I didnt notice untill I got "Grub error 17" one time when I was trying to boot my computer. The problem is not really that I couldnt log on to my computer, but rather that I have alot of important information on the computer I would hate to lose. At the time I used Ubuntu 8.04 and had reiserfs filesystem on the computer. I bought a new computer and decided to wait untill I could rescue the data before doing to much dmg to it. But I dont really remember if I tried something to fix it before I realised that it was the harddrive and bad sectors that made me get gruberror 17. Hopefully I didnt do anything.
Anyway. Now today I had some extra time, so I decided to dive in. I booted from a linux mint disk and used ddrescue to transfer all the rawdata over the network to an image file laying on an ext4 drive. Once there I used reiserfsck to try and repair the filesystem. After that i mounted the image file and tried to access the files. Thats where the probelms started. I could see the whole treestructure of the harddrive and everything seemed ok, but when i tried to open the files, none of the pictures, documents and so on could be opend, and when I tried to open stuff like MP3 files they played quite strange. Videofiles was really messy, kept changing resolution and was almost always just gray and green squares on the screen. I decided to use ddrescue and move the files from the image file and on to a clean disk. So when I was done I could mount the filesystem on the new disk, but with the same resault, so I did reiserfsck again, and when that didnt help I did a buildtree also. Still with the same resault. So I decided to investigate the data abit. Opening files at random trying to understand what had hapend. And I saw that some MP3 files (the easiest to open) was some kind of mixing between several difrent mp3 files. Some files wasnt even in the same folder, so it was probably just that the file pointer was pointing at the wrong data on the disk. I dont know how that works really, so I dont know how to go on.
So now to the question. How do I get the data back? Have I done something wrong, can I redo somethig? I still have the broken disk and can take data from it once again, but I want to wait to do that untill I really know what to do. I also still have the image file, and the disk with the copied data. I have a ubuntu 9.10 system at my disposal atm.
View 5 Replies
View Related
Sep 27, 2010
I've occasionally changed HDD filesystem type in Disk Utility from NTFS to Linux Extended . It created an extended partition containing some other partitions instead of NTFS.
View 3 Replies
View Related
Jan 14, 2011
I can't burn a data disk through Ubuntu.I tried using the built-in disk creator, It had some kind of error saying the disk cannot be mounted. So I used Brasero instead and I got essentially the same error. When I tried to open both CD's the files appeared to be present but were all corrupt. Braso works fine for burning music CD's but I can't get it to work for data. here is the error log from Brasero:
BraseroReadom stderr: Time total: 131.474sec
BraseroReadom stderr: Read 666760.00 kB at 5071.4 kB/sec.
BraseroReadom stderr: HUP
Session error : Some files may be corrupted on the disc (brasero_burn_record brasero-burn.c:2862)
View 1 Replies
View Related
May 30, 2011
I was dual booting Ubuntu 8.10 and Windows Vista on a Acer Aspire 5920. My laptop went for service and the company said they will give me a fresh laptop instead of the one I am using now for they cannot set it right.
When I plugged in my hard disk through an external cable onto a windows machine it detected only the data present (which is almost negligible in my case) in the vista partition. I would like to transfer all the data I have from hard disk at least the one in the Ubuntu 8.10 to my new laptop on which I plan to run Ubuntu. Can someone guide me on how to go about doing it? Also is it possible to transfer all the installed softwares so that they start running in the new laptop without any extra effort?
View 9 Replies
View Related
Jun 6, 2011
I have a simple C program that reads a 1 GB file from disk into memory.The first time I run this program, the process takes several seconds. But if I run this program again immediately after it finishes, the read happens almost instantly. What is going on here?My suspicion is that the operating system is realizing that the data I'm trying to read is still uncorrupted in memory (its been freed but not overwritten), so instead of reading it again, it just gives me the same block. I would really like to know what this process is called, or any Googleable keywords that would allow me to research it.
The reason I ask is because the size of my input data has increased. Now I need to read in a 6 GB file (my system has 12 GB of RAM), but I'm not observing the same behavior with the larger file. Each time I run the program the read takes an equally long time.
View 2 Replies
View Related
Nov 24, 2010
i have a portable hdd with ntfs partition, i use it both in ubuntu and in windows.
recently it began giving me problems, and now it wont mount. gparted tolled me to run "chkdsk /f" (under windows of course)
chkdsk shows that it fixes some file and on other files it says: "insufficient disk space to recover data" strange thing is the hdd has 150 GB free
View 4 Replies
View Related
Apr 28, 2011
I am trying to burn mac osx 10.5 install disk from from a 6.7gb dmg disk image. I thought I would be using 2 DVD-R 4.7GB discsfor this burn, I was hoping when the first was full it would ask for another to finish the burn. Instead it get the message that the DVD will not hold the choosen DMG. file.
Can I do anything besides buy a dual layer DVD that would hold the whole file?
View 1 Replies
View Related
Mar 2, 2011
It would seem that my cds/dvds that I've created under Microsoft vista home premium can't be read/written on (formatted as data disks. Is there a program to be downloaded or an app, that would allow me to read, download or add data to these dcs/dvds. Using ubuntu-10.10 and debian.
View 1 Replies
View Related
Jul 24, 2010
I'm having trouble burning a data disk. When I burn it ejects the DVD, then saves a log. Here's the last few lines of its contents:
BraseroGenisoimage stderr: /usr/bin/genisoimage: Warning: Directory loop (/home/robert/Desktop/Mount_Directory/var/at/spool dev: 700 ino: 13323).
BraseroGenisoimage stderr: /usr/bin/genisoimage: Warning: Directory loop (/home/robert/Desktop/Mount_Directory/var/spool/postfix dev: 700 ino: 13200).
BraseroGenisoimage stderr: /usr/bin/genisoimage: Warning: Directory loop (/home/robert/Desktop/Mount_Directory/var/spool/postfix/pid dev: 700 ino: 13210).
BraseroGenisoimage stderr: /usr/bin/genisoimage: Warning: Directory loop (/home/robert/Desktop/Mount_Directory/var/spool/samba dev: 700 ino: 13247).
BraseroGenisoimage stderr: /usr/bin/genisoimage: No such file or directory. Non-existent or inaccessible: /home/robert/Desktop/Mount_Directory/Read Before You Install.app/Contents/Resources/ko.lproj/설치 전에 읽어보기.pdf
BraseroGenisoimage stderr: /usr/bin/genisoimage: Warning: Directory loop (/home/robert/Desktop/Mount_Directory/var/cron/tabs dev: 700 ino: 12670).
BraseroGenisoimage stderr: /usr/bin/genisoimage: Error: '/home/robert/Desktop/Mount_Directory/private/var/log/wtmp' and '/home/robert/Desktop/Mount_Directory/var/log/wtmp' have the same Rock Ridge name 'wtmp'.
BraseroGenisoimage stderr: Unable to sort directory var/log
BraseroGenisoimage called brasero_job_error
BraseroGenisoimage finished with an error
BraseroGenisoimage asked to stop because of an error
error= 16
message= "An image could not be created"
BraseroGenisoimage stopping
BraseroGenisoimage got killed
Session error : An image could not be created (brasero_burn_record brasero-burn.c:2839)
Quite a bit of stuff. You can download its full contents. I have no idea what this means and I really would like to make this disk.
View 2 Replies
View Related
Sep 29, 2010
My primary drive is 250GB and has the root, home and var (I'd read it's good to put var on a separate partition for MythTV which I'm planning on doing) on separate partitions. I have a second 1TB drive that I'll be using to backup the 250GB drive and also host less critical data. I've created two partitions on this drive, one 250GB and the other covering the rest of the drive. I'd like to move the Videos directory out of Home on the 250GB onto the 1TB drive but can't find a definitive way of doing this. Should I just follow this guide for moving the home folder to a new partition? Next question is when performing a backup of the 250GB drive how do I make sure it's going to the 250GB partition on the 1TB drive? Can the different partitions be mounted separately?
View 2 Replies
View Related
Jan 23, 2011
I deleted my hd from an ubuntu 10.10 liveCD system by trying to create a new partition table with gparted. I just wanted to restore the partition table and clicked on "create partition table"apply.Now the hole hd is an unallocated file system, so without any partitions. There had been 3 ext4 partitions.
Because I did it from an liveCD, all data should be save? Is there a way to search for partitions on the hard disk and get a new old partition table and write it to the mbr?I searched a lot already (with a very slow mobile internet connection)..
View 6 Replies
View Related
Mar 16, 2011
I have a directory /var/log/data its about 80 GB,It filling up quit rapidly.I don't have much space left in the system them So i will attaching another External HDD.My question is that i need to mount /var/log/data to new HDD.So i have old data and pulse new coming up.I don't want to copy data from /var/log/data then mount new HDD to /var/log/data you know what i am taking about is there a simple way like linking or any other.
View 4 Replies
View Related
Jul 1, 2010
When we copy a sector to a file like using dd command, the data in the file is of which format? and of which type of conversion is nesessary to see the data in read able formate. i have tryed the ASCII conversion in dd command but still the data is in un-readable format. and also tell that if i access hard disk sector's data using c language program and copy data to a file then which type of conversion should i do ?
View 7 Replies
View Related
Jan 14, 2011
I went and fdisk'd a USB disk and put the Fat32 filesystem onto it. Then I thought I ran dosfsck over it which I thort formatted the disk - apparently not. Then I copied a bunch of files and directories to it. Now I am unable to recover the files and data. In the rare instances when I perform a sloppy mount I see directories named 001, 002, 003 and 004. These directories variously contain files named 001, 002, 004 (no 003) etc.
Fdisk gives me:
I don't know enough to use dd, kpartx, parted, partmon, partprobe, partx et al
View 1 Replies
View Related
Jan 19, 2011
I have 2 RAID1 hard drives with possibly hardware errors, (when I tried to mount them in a degraded array, they won't start, throwing some Buffer I/O errors) So I used ddrescue to make a disk image out of one drive, ran losetup to use the image file as loopback device:
Code:
losetup /dev/loop0 imagefile.img
but when I tried to assemble a raid array including the /dev/loop0 device like:
Code:
mdadm --assemble /dev/md0 --force /dev/loop0
it will complain that no superblock is found on /dev/loop0 device. With desperation, I tried to create a legacy raid array with following command, of course, including one of the bad drives:
Code:
mdadm -B /dev/md0 --level=1 -n2 /dev/sdb1(bootable partition on the bad drive) /dev/loop0
I successfully created a new RAID1 array, but when I tried to mount it
[Code]....
Now the only thing I haven't tried is to clean the superblock by doing --zero-superblock, and not sure if that will solve the problem. Should I get a second drive to hold my broken drive image so that I might be able to assemble a good RAID1 array or should I continue working on the only disk image file I recovered from one of the broken drives?
View 5 Replies
View Related
Jan 26, 2010
I've got a CentOS 5.4 box and the following disks connected:
# parted /dev/sda print
Model: ATA WDC WD1600BEKT-0 (scsi)
Disk /dev/sda: 160GB
Sector size (logical/physical): 512B/512B
Partition Table: msdos
Number Start End Size Type File system Flags
1 32.3kB 107MB 107MB primary ext3 boot
2 107MB 160GB 160GB primary lvm
# parted /dev/sdb print
Model: ATA WDC WD1200BEVT-0 (scsi)
Disk /dev/sdb: 120GB
Sector size (logical/physical): 512B/512B
Partition Table: msdos
Number Start End Size Type File system Flags
1 32.3kB 107MB 107MB primary ext3 boot
2 107MB 120GB 120GB primary ext3 lvm
the OS, data and programs are on /dev/sda.
I'd like to copy the full directories and files to the newly added /dev/sdb wich has, as you can see, less space. Also note that /dev/sda has only about 3.6Gigs uses, so it will no doubt easily go into /dev/sdb. How can I do the full copy, and yet make /dev/sdb bootable just like /dev/sda (just as if it was cloned by Ghost)? I've checked dd, but AFAIK, it needs that both source and target devices be the same in size.
View 1 Replies
View Related
