Server :: Unioning And Mirroring File System Over The Internet?
Apr 6, 2010
Blue sky thinking at the moment:I have a number of file servers, each at different sites. I would like to be able to make these appear as one, so that files on any server can be accessed from any site, and the user doesn't even see there are multiple servers.Obviously, the internet is slow, especially the upload speeds. So when a file is written the write ought to go to the server on the client's LAN - even if it was previously on another of the servers.However, for robustness, some sort of background mirroring is also wanted. If all the servers were left on and connected, they eventually end up all in sync. But this mirroring needs to be mindful of bandwidth usage; if someone writes a big file to their local server, copying that to the other servers can't interfere with normal internet usage.I think UnionFS or similar might be able to handle the unioning side, but not the mirroring stuff.
View 2 Replies
ADVERTISEMENT
Apr 8, 2010
I have two web servers. One is active and one is in reserve. I keep the user data (web pages) in sync by running rsync every 10 minutes or so. This copies any changes from the active machine to the reserve machine. But, it's slow, only gets changes every 10 minutes, bogs down the disk, does strange things to files that are changing during the rsync process etc...
I want something that will automatically copy any changes from the active server to the reserve server as they are made. IE I hit 'save' on the active server, it copies the file to the reserve server. Simple!
I've been looking around and I see GFS which is really vastly more complicated than I need. I'm happy with read-only access on the reserve host, so I don't need distributed lock management.
I could theoretically implement this by setting inotify watchers on every file and running an SCP or rsync command when a file gets saved. So, it can't be that hard.
I do not need a true networked file system, as in something I mount over the network. I just want something to keep my disks in sync.
View 3 Replies
View Related
Nov 5, 2010
Is there any software that will do full mirroring between a local and a remote file system. I have a server (9.04) and a laptop (9.10). Each user has shared a shared directory on the server, and on the laptop. Updates to files may be done on either system. I want to keep both copies syncronised. Currently I use a script based on rsync (scheduled by cron) to keep the local and remote copies in sync.
The problem with this approach is that rsync only seems to be able to handle deletion of files if one file system is the master, which is not the case in my set-up. If I move a file to a different directory, rsync will reinstate the old file as well as copying the new one. I was hoping there was some software that could do proper mirroring between the 2 systems, but6 so far I cannot find anything.
View 3 Replies
View Related
Sep 7, 2010
I'm trying to mirror an apt-cacher-ng cache between two computers. I have apt-cacher-ng installed on my laptop, and I have another machine running apt-cacher-ng. In order to keep them both up to date with each other and to make sure all the computers have all the updates, I've been trying to find effective ways to keep them matched.
- Unison looks like what I want, it would delete files that are deleted, and it would add files that are added. (the assumption is if they're deleted from one, they'd be deleted from others).
- Rsync seemed quite a bit easier, especially with the advanced permissions issues. Apt-cacher-ng uses a user called apt-cacher-ng.
Instead of giving root an ssh password, I wanted to just ssh as apt-cacher-ng. Then I can still get the files over the network, but without the root account being open.
So I ran:
passwd apt-cacher-ng
and when I sshed, it looked like it was working until it logged me out (almost immediately). So that's not working. What am I missing? Maybe there's a better tool then rsync for this?
View 2 Replies
View Related
Mar 30, 2011
I believe it was rsync was the tool. I have a box running CentOS 5. It has a 250GB HD in it. I have another drive with the exact model. Currently it has a as a said a 250GB IDE drive. I want to shutdown the machine, install this other hard drive and set up a cron job that will backup my main drive at times that I set. This way if the main drive fails, I do not loose all the data and have to rebuild the server from scratch as I have been custom configuring it for years. I can't remember if there was an issue with the main drive being mounted to back it up or not. I have looked at some of the how's on rsync but they seem to only talk about using another server for this. If I shit down the box, install the new drive, and the box boots back up, is it going to ask about that drive or what do I need to do to get rsync going and does it partition the drive as such? And can I do it this way. This way if the main drive fails, I can just swap the drive and be on my marry way.
View 2 Replies
View Related
Jul 3, 2010
pls suggest me how to mirroring two hard disk drive in rhel9 server.i can do raid on those hard drive but user requer mirroring.so pls help how could i do this, mirror two hard drive.
View 2 Replies
View Related
Feb 11, 2010
I'm going to be using LVM2 to mirror 2 250GB drives for redundancy and fault-tolerance. As per the best docs I have found on mirroring [URL], I am going to keep the log file on a separate physical volume, however I can't seem to find anywhere a good reference for how much size I need to save for the log file. Everything says "small," but "small" doesn't really help in the real world :-).
I have plenty of space on the 3rd pv but want to leave as much of it as possible for other stuff. Should I leave 32MB ? 500MB ? 1GB?
View 1 Replies
View Related
Feb 11, 2010
I have a mail server on Fedora 8. I would like to have a mirror to this server so that it takes over in case my server goes down.I dont know how to go about it.
View 1 Replies
View Related
Dec 27, 2010
I want to mirror root hard disk in SUSE LINUX 10.1.I have two 80G hard disks, I searched in google but I did not find any good link to describe this.
Code:
Server1:~ # df -h
Filesystem Size Used Avail Use% Mounted on
/dev/sda6 16G 1.2G 14G 8% /
udev 1.3G 140K 1.3G 1% /dev
[code]....
View 8 Replies
View Related
Jan 20, 2010
Is root mirroring is supported in RHEL /RHAS operating systems? If so, how to find out whether the root mirroring is enabled or not?
View 4 Replies
View Related
Feb 11, 2010
I have a mail server on Fedora 8. I would like to have a mirror to this server so that it takes over in case my server goes down
View 3 Replies
View Related
Jul 29, 2011
I'm setting up two media servers - one will be primary and the second will be the failover box if the first one dies. My original plan was to use Heartbeat and DRBD to replicate the first to the second, but it turns out DRBD has a limitation of 16TB per volume, and my RAID 6 is 30TB in size. I'm trying to figure out some options.
One is to split the partition into two, so it's under the 16TB limit of DRBD, share both partitions, and then use LVM to join them as a single volume at the OS level. I'm not sure what kind of performance hit that will make on read/write access since now it will need to go through LVM *and* DRBD.
Two is to use something like GlusterFS or XtreemFS. However, I am wary of both of those as the first is a FUSE-based system and isn't really tuned for performance, and XtreemFS is still kind of beta-ish.
Three is good old rsync, but that is a bit too asynchronous in my opinion. I'd like to be able to fail over virtually instantly and not lose any content.This is a production system and performance of the disk systems are paramount, followed by reliability.
View 2 Replies
View Related
Jan 7, 2011
I'm planning to add 1tb sata disk to my lovely file-server under ubuntu 10.10,what i want is use this disk as additional storage for network user,indows and ubuntu?I mean when my ubuntu server down (worse case) I can easily take out the disk from ubuntu machine and plug in on windows machine
View 2 Replies
View Related
Jan 28, 2011
Can windows read files from a home file server with an ext4 file system? or do I have to partition the drive with the server (ext4) and an ntfs partition with the files on?
View 4 Replies
View Related
Mar 23, 2010
I am kinda stuck while providing solution for the above problem. I have achieved the fail over using keepalived but not sure how can we replicate the data from one server to other seamlessly and have them in sync with each other. My prime requirement for this project is end user should not notice the fail over and replicated copy of data should be available on the secondary as well.
View 3 Replies
View Related
Feb 25, 2009
I have a weird performance issue with a centos 5 running a nfs server and a rh8 client. I think the fact that it is rh8 client should be downplayed. It is just that with rh8 client the performance degradation seems more clear. See test details below OS in server is Centos 5 x86_64 kernel 2.6.18-92.1.22.el5
1Gb connection between machines File to test over NFS is a 1GB file. First of all I wanted to measure how the network alone performs while using NFS. So in the server side I run a "cat" command on the 1GB file to /dev/null. Please note that the disk read speed is about 98MBs. At this point the file system has the 1GB file cached in memory. In the client side a "cat" on the same file gives me a speed of about 113MBs. It seems then that the bottleneck in this instance is the network and it is very close to nominal speed. So the network performance is really good. (BTW I know that the server got that file from cache because a vmstat or iostat shows no disk activity.)
The second test is reading from disk with no caching involve. In the server I flushed the 1GB file from the memory. For instance by reading another 5GB file and I repeat the same thing as above in the client (a cat on the 1GB file). Now, the server has to go to disk.(vmstat or iostat shows the disk activity). However the performance, now, is about 20MBs, I was expecting something closer so 90MBs. (since the reading speed in the server in the first test showed 98MBs).
This second test was repeated for ext2, ext3, xfs with no significant differences. A similar test using a RH8 NFS server and client gets me close to 60MBs for a 1GB file not cache by the file system in the serverSince network speeds and disk read speeds are not the bottlenecks ... what or where is the limiting factor then?
View 4 Replies
View Related
Jan 27, 2010
I have a very simple php web application deployed on linux (centOS4) machine. It creates a file and stores the file in /tmp folder on my linux machine. The path for this file is specified in the href attribute of the link. Ideally when we click this link the download manager should pop up so that the file can be downloaded on client machine.
When i access this website remotely from my window xp machine on firefox it downloads the file properly but when i run on internet explorer (i have IE7 on my windows XP) and click the link, the download manager does'nt pop's up. even when i right-click that link and select save as, an error message pop's up saying "file path not found". possibly IE is not able to determine the linux file path .so how do i work around this. is there some specific way for specifying the linux file paths to be downloaded by IE?
View 7 Replies
View Related
Feb 8, 2010
We are trying to define an appliance for an application server so I would like to know which should be the best file system type for this kind of use, basically our web applications uses libraries of 50 KB and our web apps.creates temp and logs files not bigger than 3 MB.
View 1 Replies
View Related
Mar 16, 2010
I have installed fedora-ds-1.0.4-1.FC6.x86_64.opt.rpm on RHEL 5 Enterprise, which I use for Oracle BIEE. Now I need to install the FDS in another RHEL 5 and mirror only the FDS.
configure the mirroring part for the Fedora Directory Server.
View 3 Replies
View Related
Jan 2, 2010
I'm looking for a most possible, secure solution to transfer data using rsync over Internet between 2 linux server.
I have 3 option: SSH, IPSEC and Kerberos.
Which one in your opinion should be most secure solution?
View 3 Replies
View Related
Aug 23, 2010
I'd like to set up my home network with an Ubuntu file/internet server. In addition, I would use this server to monitor internet traffic. What hardware/software would be required?
My current network is as follows:
Laptop 1 Ubuntu 9.1
Laptop 2 Vista
Laptop 3 XP
Desktop Ubuntu 9.04 (would be used as server)
All connected thru linksys wireless router to cable modem.
View 2 Replies
View Related
Dec 16, 2010
my laptop seems to have a bad HDD, and I was thinking of trying to make it a "thin client." However since it is a laptop obviously I want to take it places. Is it possible to make a terminal server and "thin client" connect through the internet and not just LAN?The reason I quote thin client is because in my mind I am still going to need to use some HDD so I can connect to the internet and find my server.
To make things easier to read refer to the above as "question 1" and the velow as "question2" Thank you. And sorry for the inconvience. These topics I felt were to similar to make separate topics.I also have another question, the files I have on my server can be accessed by anyone on the network(added a second HDD and network shared it) how can I make it so that the LAN clients have to "login" (or it uses their computers login info to send them to only their files? And if that is possible can we expand it to allow me to use those logins through the internet?
View 1 Replies
View Related
Mar 30, 2011
I just received a 2 tb drive for my server to be. The pc is a P4 3.06 ghz with 4 gb of ram. I have found a number of posts on this forum, as well as on the net in general, about setting up a file/print server at home. What I want to be able to do is to access my server through the internet from my office computer (windows 2000) How can I do that? I have not yet spent much time trying to decide which distro I will use. It seems that a number of them are suitable for this purpose, so I just plan to try several from a live cd and then choose one.
View 1 Replies
View Related
Dec 30, 2010
I have install 5.5 kernel in rhel and after rebooting got the error to control+d to continue or rootpassword. I have done the same but df -h not showing the lvm filesystem.I have tried to remounnt but showing resource busy.I have rebooted on the previous kernel but getting the same issue.Its a VM.df -h showing only/dev/ mapper/ vg_osdata-lv_root /
View 10 Replies
View Related
Jun 7, 2011
I have a question regarding extending file system. We are using RedHat 4 with update 8.Is it possible to extend an file system with GFS file system type while at the same time the same file system that need to be extended is used as an NFS file system? Is it necessary to stop the nfs daemon before extending the GFS file system? If it is necessary to stop nfs daemon, what can happen if it is not stopped prior extending?
View 1 Replies
View Related
Jun 22, 2010
When i boot my node-machines they are stuck in (initramfs) after showing the following error:
Gave up waiting for root devices.Common problems:
- Boot args (cat /proc/cmdline)
- Check root delay (did the system wait long enough)
[code]...
View 1 Replies
View Related
Sep 16, 2009
I have a remote ftp serwer, witch many of disks, something SATA, some IDE... There are ext3 filesystems. And a lot of files and direcotories/subdirectories. Tell me, which filesystem is the best for serwer like this? I'm not interesting on efficiency... The most important thing is failure-free. On ext3 sometimes is problem witch 'dirty' filesystem, in that case I must handy run e2fsck to fix this. Is any option to automate this, or any power-down proof filesystem?
View 2 Replies
View Related
May 2, 2010
I bought a new SD card which I intend to put some MP3s on - except that I can't write to it because it tells me the destination is Read Only. No-probs thinks I: I'll just reformat it.
"Error creating file system: helper exited with exit code 1: cannot open /dev/mmcblk0p1: Read-only file system"
Various chmod commands all result in Read-only file system. I tried umount then mount commands, but it couldn't find it to mount once I'd unmounted it using the same /media/ file path (I assume it's the only one).
View 9 Replies
View Related
Jul 12, 2010
My Redhat Enterprise Linux 4 with 6x partitions (/, /boot,/home, /usr, /var, /tmp) of 6.0 GB IDE Hardisk was working quite fine. I decided to create LVM on /home and /var partitions but due to some errors occured and I delete the /home partitions. That's why partition table altered. I then delete 4,5,and 6th partitions (/home, /var, /tmp) partitions and now try to create one by one but following error is coming:-
[Code]....
The Super block could not be read or do not describe a clear ext2 file system. E2fsck b 8193 <device> I have tried following commands,but could not successful:- e2fsck -p /dev/hda7 (where hda7 was created but afterthat it was deleted) e2fsck -a /dev/hda7
View 2 Replies
View Related
Sep 30, 2009
I have lost the data of my drive having file system ext3, please tell me the most reliable softwares for data recovery, please try to tell also GUI software.
View 1 Replies
View Related
