Server :: How To Best Configure Storage Space
Mar 25, 2010
I'm building an Ubuntu 9.10 home server to essentially backup all my PCs to, serve media, and store other large data (I record music and film). Here's what I have as far as storage goes:
4GB CompactFlash: for OS
2x 500GB WD drives: intended for RAID-1 for backup (which I will in turn back to external drive on a weekly basis)
3x TB Hitachi drives: intended for RAID-5 for media and storage
Both RAIDs will be software-driven. Now, a few questions:
From what I've read, I can benefit from using LVM on top of the RAID. Is this true, and besides the complexity and potential difficulties in recovery in case of disaster, is there a downside to LVM?
Would I benefit at all from using smaller logical volumes on the RAID-5, or should I just make one at the full size of the drive?
Also from what I've read, it seems that XFS may be the best filesystem to use, from a stability and performance standpoint. Should I go that route, then? I suppose that if it IS beneficial to have multiple smaller logical volumes, then there may come a point that I need to shrink and grow these logical volumes, and if that's the case, it appears XFS is out of the question. What's the runner-up; Reiser? I currently have /swap and /home partitions on the CF card. I'd at the very least like to remove the /swap partition and just create a swap file on the RAID-5. Should I move my /home partition to the RAID-5 as well?
View 1 Replies
ADVERTISEMENT
Feb 8, 2010
Cost effective (the people want cheap) solution to increase server storage space with as little impact on throughput (what I want) as possible. I have a server that sends instructions to 20 clients to perform certain tasks. The clients send gigs of data back to the server for storage.
BACKGROUND INFORMATION
Network: Gigabit Ethernet
Clients: (20) HP, Solaris, Linux
Linux Server: Dell R805 PowerEdge (QUAD Core Athlons 16 gigs of ram, 4 gigabit ports.
Selected directories are mounted (NFS) by clients. One directory to be mounted by the clients contains executable files. Mount commands are sent from the server (rsh) to the clients. Yes I know (ssh) but this is how the software was originally written so let's go with it.
The clients then receive commands to execute the binaries contained within the mounted directory. The binaries basically create an image of the clients filesystem including special applications. The client then sends the files and directories to the server which stores this �image�. This process can be reversed to restore a client to the initial baseline image.
In a nut shell, 20 clients are sending gigs of data to the server for storage. I need to attach a NAS (gigabit) to extend the storage capability of the server. The server would mount (NFS) to the hard drives on the NAS. The NAS, configured as a �direct attached storage� device (DAS), means the storage device is connected directly to the server and not the network (which makes it a DAS). This would provide direct storage expansion for the server. However, this configuration cannot be a bottleneck that significantly hinders performance.
Clients <---data---->Server<----storage---->DAS/NAS
1) Will a low end NAS (gigabit port) work? (NetGear 1TB ReadyNAS Duo, RND2110-100NAS) or something with a higher rated throughput (QNAP TS-239 Pro II)
2) Low end won't work, go with �?
3) Does the processor on the NAS play any role that would determine the performance of this configuration given that the server would mount directly to a directory on this device (DAS/NAS)?
View 7 Replies
View Related
Apr 28, 2010
I created a dual boot on my computer with windows vista and ubuntu using the wubi ubuntu installer for windows, and my ubuntu boot is limited to 15gb of hard drive space. My hard drive in actuality has about 150gb left on it. How do I expand the amount of storage ubuntu is allowed to use?
View 6 Replies
View Related
Dec 18, 2010
I'm about to do a clean wipe of my laptop, to try out Ubuntu. I've read quite a bit about dual-booting WIn7 and Ubuntu, but not alot about the process of installing. I'd like to install Win7 and Ubuntu on 2 small drives, and leave the rest for a Storage partition. But when should I partition that Storage Drive? Should I do it while I'm installing Win7? Or should I partition the amount of space to Storage after I've installed Ubuntu?
View 3 Replies
View Related
Sep 16, 2010
I have an Ubuntu 10.04 machine, and I would like it to host a folder over the Internet so if I am on another network (with a windows computer) I can log into it's folder and share and edit files among other users.
View 1 Replies
View Related
Feb 3, 2011
I have a Fedora NAS (not built by me) there is a 1 Tera of storage 2x 500 set at raid 0. The server runs Fedora 7/8 I believe which, runs flawlessly. Sadly, I am running out of storage space and would like to add more. Can I just put another drive in the box? If so, what do I need to do and what impact does it have on the existing raid 0 setup. Ideally I would like to put two additional in but I am not confident how to configure them. Is this just a case of mapping them in Windows 7.
View 2 Replies
View Related
May 6, 2011
I am running a dual boot system with Win7 on /dev/sda and Ubuntu 10.10 on /dev/sdb
I also have a 250 GB disk I use for storing backup data, /dev/sdc
The two logical partitions on /dev/sdc (/dev/sdc2 and /dev/sdc5) each take up 2.86 GB and I would like to free up that space if possible.
Since the filesystem on /dev/sdc doesn't have an OS on it, does it still require that those two logical partitions exist?
View 8 Replies
View Related
Jun 8, 2010
I am trying to do the cluster storage with the Rock Cluster storage operating system . I have install the rock cluster on the main server . and I want to connect the client with the PXE boot . when I starting the client then it boot from the PXE boot into the mode of compute node. but it ask the where is to be stored the I have give the path..then server says that not able to find the directory path.
Steps:-
1) insert-ethers
2) client is started with the PXE boot.
3) it detects the dhcp .
4) At last it demand where is to be started by cd-rom, harddisk ,nfs etc.
then I started with the nfs and I have given the lanIp of server.and server is detecting the client but client is not finding the filesystem directory. into export partition directory but it is not taking path.
PATH:-
/export/rock/install it is not finding this path then it is not able to start the o/s from PXE boot..Is there any solution and manual of rock or anyother solution then u can reply to me...
View 3 Replies
View Related
Mar 18, 2011
I have a Linux application(ProMAX 5000) running in a virtual Machine on my windows OS. I am using an external Hard drive of 250G in ext2 file system as my device for large data read, write & execute file system. I have already mounted the device from /etc/fstab. But i want my application to access this device as a Primary data storage device OR Secondary storage device. What command will i invoke to partition this 250G drive as my primary or secondary storage device.
View 1 Replies
View Related
Sep 10, 2010
I am configuring my Apache Server to enable checking CA Revocation List, and my Configuration lists as following :
Code:
SSLCARevocationFile /etc/httpd/confi.d/ssl.crt/CRL1.crl
But the server can not start, and the log says:
Code:
Unable to configure X.509 Storage for certificate
If I try this command to view content of my CRL file :
Code:
openssl crl -text -in CRL1.crl -noout
the console shows :
Code:
error:0906D06C:PEM routines:PEM_read_bio:no start line:pem_lib:647:Expecting: X509 CRL
I think there is something wrong with my CRL file, such as the file format.Is there any requirement to the CRL file? What can I do to enable this CRL file checking?
View 2 Replies
View Related
Mar 10, 2010
I have a 300 Gb Hard drive, I used to have windows xp on it but decided to install ubuntu, so what I did (after some suggestions) was to create 3 partitions, one of 30 Gb for windows (I use Adobe software), one of 10 Gb for Ubuntu 9.10 and the rest as a common partition used for storage. Started ok, but I really got hooked with ubuntu and now my partition is full!. My question is ( and here is where I show my deep ignorance and shame): can I "expand" the ubuntu partition gaining space from the storage one? If not, how many Gb would you recommend for an Ubuntu partition? I'm using a lot of music/video/graphics production software.
View 9 Replies
View Related
Apr 20, 2011
using onboard windows disk management i have made 75gb unallocated to add to the aforementioned ntfs data partition. but, after resizing extended partition, will i need to fix grub even though i will be adding the unallocated space to a storage partition and not the ubuntu boot partition?
View 4 Replies
View Related
Jan 15, 2011
I have 2 servers each one with a RAID and I want them mirror they data so if one of them goes down the other one take the job with out disruption. I've heard of multipath by I want to know it in detail or learn of more options.
View 2 Replies
View Related
Mar 11, 2011
I'm interested in buying a new hardware for my company. The old server (now 10 years old) should be replaced with a new one. Till now, I was looking on different hardware suppliers, boards and different other places. I found a Tyan board [URL]. The hardware spec is quite interesting and the board would fullfill our claims.
how both storage devices will be supported by Ubuntu or Debian??
- SATA-Controller: AMD SP5100
- SAS-Controller: LSI 1068E
View 4 Replies
View Related
Jun 2, 2010
HPDL385 with dual raid controllers (8 disks each). During the install of the ISO, it sees the raid controllers individually. I tried "One Generic Drive" but it still only partitions one of the raid controllers.Is it possible after the OS is installed to configure the space as one logical volume?
View 3 Replies
View Related
Aug 2, 2011
Setup1: Two rack mounted servers with a common storage device serving as the home directories for users on the servers. The storage device is a gfs partition mounted on the servers as the home directory using SAS cables. These servers have RHEL 5.4 as the installed operating system.
Setup2: A standard tower server with Debian 6 as the operating system used for tape backups. This has a tape drive connected to it.
Question: How to mount the storage device of setup1 using NFS on the server in setup2.
View 1 Replies
View Related
May 15, 2011
I am trying to figure out the best server configuration for the following:Low power (I want to plug the server in and forget about it)High redundancy of data (I don't want to loose my music and documents!)The ability to stream music + movies to laptop (maybe subsonic or Jinzora)VPN server with IPsec or OpenVPN NAS $800 budget 2TB with ability to add more drives :Unix Server with software RAID (maybe RAID6)
VPN setup on virtual OS via VirtualBox
NAS setup on virtual OS via VirtualBox
My Questions:What would be the best raid configuration if I wanted at least 2TB of data and the ability to add more disks when the space begins to add up?What would be the best OS to use for setting up a software RAID (is a FakeRAID a better solution)?Does it make more sense to separate the VPN and NAS with different OS's?My goal will be to access my data from any computer from anywhere but mostly just my Laptop from work.
View 4 Replies
View Related
Jul 8, 2011
In our environment we are using EMC for storage. We are using Qlogic provided drivers and PowerPath and the OS is RHEL5.3. Currently we have 2 Luns connected in one of our server (emcpowera & emcpowerb) and storage team has allocated another 100Gb Lun to that system, my doubt is if I execute "ql-dynamic-tgt-lun-disc.sh" script that would be enough to detect the Lun and see the device under /dev/ as emcpowerc or I need to execute "powermt config" and "powermt save" commands also.
View 3 Replies
View Related
Feb 20, 2011
I hope this post is in the right area of the forum.I am searching for the right operating system and application(s) to build a cloud data storage server business like Backblaze.Backblaze uses Debian but uses their own custom application to manage the data, uploads, accounts, encryption, etc... So my real question here is: does anyone have any recommendations for existing application(s) I could use on top of Debian to handle this stuff?
View 1 Replies
View Related
Jul 1, 2011
I am looking for the best/cheapest way to build a ubuntu server with 8tb of storage hanging off of it.
I don't feel it needs to be hardware raid, so more software raiding swap in and out failed disk drives.
The server itself normal duo core CPU with 2Gb of memory and i would like to have the internal drive of the O/S only.
View 8 Replies
View Related
Jun 2, 2010
i have a spare computer and 4 hds and was planning to make this computer a storage server with a media place aswell... i do have some linux knowledge but never used it for this and am not sure how good it will be initially the media files are in an HD with ntfs format which i want to keep as is... but i was wondering what options i had to make a media folder over network where i could browse and watch from any computer in my network ? is it samba my only options or is there a more media like solution for this ? There will aswell other features i was planning to use on it which made me think of linux, for example, svn server, websever with mysql to testing my applications, connection manager, all these i am sure on how to make and setup... but i am not very familiar with samba hence i am not sure if it is the best options for file sharing aswell as media sharing and/or my only option.i also heard that ntfs might be trouble some for linux in some cases
View 9 Replies
View Related
Feb 4, 2010
The /var directory is 97% full on my dedicated server:
I would like to know if it is safe to clear it and how to clear it (assuming it will not disrupt/kill server services to do so).
I have Matrix control panel so i can view the storage etc but it does not have an way of clearing the /Var directory.
I have Putty Access to root but do not know which command to use.
I found a few threads but the information is not clear to me as there seems to be an assumption of basic knowledge I don't yet have.
My linux/ubuntu support that usually does this kind of thing for me is away and not contactable and my server is grinding to a halt and unable to store/send email.
I have only a very basic understanding of command line but really need to get this sorted ASAP.
View 3 Replies
View Related
Apr 10, 2011
We have near about 90 RHEL servers. I want to find out which servers are connected to SAN [HP-SAN] storage???? Because many of them are having local hard disks.
View 2 Replies
View Related
Sep 25, 2010
What I am trying to to is set up a cluster as follows:
- There are four nodes
- Nodes three and four have large amounts of storage that will be used for storing user data.
- Nodes one and two will be running a couple of network services.
I'd like have nodes one and two to have a clustered filesystem just between them to store data for the services run only by them.is it possible to share one filesystem between two nodes and another filesystem between two other nodes? The cluster seems to try to make the storage changes across all nodes. They will not be able to spend the extra money to get the same storage in all four nodes. Here is what I have done. I am using CentOS 5.5. After installing CentOS, I did this:
On all nodes:
Code:
[root@node1 ~]# yum groupinstall "Clustering"
[root@node1 ~]# yum groupinstall "Cluster Storage"
[root@node1 ~]# chkconfig ricci on
[code].....
...which I think makes sense because the cluster was supposed to create the PV and the volume group, but did not. I don't even think it tries. The first time it tries to do anything to another node is when I create a logical volume.
View 1 Replies
View Related
Oct 8, 2010
i want to run a homeserver here for centralized data storage and more...features required:
client compatibility with most Linux distributions, MS Windows 2000, XP, Vista, 7, XBOX!
harddisk shutdown if not in use (got some real noisy ones)
easy administration?! (maybe web-based?)
security! no files or folders over the internet (yet)
[code]....
View 1 Replies
View Related
Dec 2, 2009
I'm trying to find a program that will allow me to run my own server for secure storage. Ideally, this server will allow me to set up separate users. I've heard of solutions that will automatically email the user when a file is placed in their folder, and the email will contain a link with a session ID that expires after a preset time.
Security is a big deal here as well. Something above and beyond SSL would be ideal, like GPG or PGP, so nothing is ever transmitted in plain text.
This would be a server that is accessible from the internet, and would probably be running on a CentOS system.
A vague description, I know. I'm going off of what others have told me they've seen/used in the past. Now I have a boss that wants to use something similar, but trying to find anything that sounds like this has proven quite difficult. I'm hoping someone here knows of something that might work.
View 1 Replies
View Related
Jun 21, 2011
We new have server with VmWare ESXi4.1 and we created virtual machine with CentOS5.6.This CentOS5.6 virtual machine will be used as webserver. We need to backup all files and have access to these files. We are going to keep all websites, databases, backups on data storage (NetApp FAS2000 series).
We have two options to how to use this storage:
1: We can mount storage volume directly to CentOS5.6 by NFS.
2: We can add storage via NFS to VmWare and then add new virtual disks to CentOS5.6 by VmWare vSphere client.
What option would you recommend to use? Which option is better, faster and more secure? My thoughts:If we mount storage volume directly to CentOS5.6 so we can access .snapshot directory there is all snapshots. So it's easy to access all backed up files. NetApp has snapshot system and we can schedule to make snapshots automatically, so we don't need to setup any additional backup utilities in CentOS5.6. But we don't have any NetApp snapshot restoring software license so copy/paste from .snapshot directory is only option.
If we add storage to VmWare firstly (by NFS) and then add new virtual hard disks to CentOS5.6 by VmWare vSphere client so we have to setup rsnapshot(or any similar utility) to make backups in CentOS5.6. But NetApp will also make backups of .vmdk files. So it's like double backups, lol :) If storage crashes so we screwed in both ways, I think.
View 2 Replies
View Related
Jan 4, 2010
Logical Memory Space of 4GB is divided in to 3GB User Space and 1GB Kernel Space. Always. Correct?
1. How can we change it? (just changing value of PAGE_OFFSET is okay?)
2. If system have only 256MB of memory (embedded system) and suppose Kernel Modules eat away all the memory during boot. User space will be left will no memory. Is this case possible?
View 2 Replies
View Related
May 31, 2011
I am trying to install a file and print server for backup and storage using an opensuse 11.3 live CD but the CD loaded the complete desktop. How do i pare this down to a server install? Do I need to reinstall? I have a mixed network of opensuse, Ubuntu, and Windows 7.
View 5 Replies
View Related
May 8, 2010
I set up a nfs server that is working locally only, on remote I get this:
root@poc ~]# mount -t nfs storage:/var/ftp/pub /net
mount.nfs: access denied by server while mounting storage:/var/ftp/pub
This is my exports file:
/var/ftp/pub/downloads 192.168.1.23(rw,sync)
/var/ftp/pub 192.168.1.23(ro,sync)
this is my rpcinfo -p
program vers proto port service
100000 4 tcp 111 portmapper
100000 3 tcp 111 portmapper
100000 2 tcp 111 portmapper
100000 4 udp 111 portmapper
100000 3 udp 111 portmapper
100000 2 udp 111 portmapper
100011 1 udp 875 rquotad .....
Firewall has 2049 open only. Other services suck as nfs or status, lockd have random ports, so firewalled.
View 1 Replies
View Related
