Server :: Distributed Rsync Over Mesh Network?

Jul 9, 2010

A bunch of hosts all connected to each other.I'd like to have a directory where a group of hosts can dump files and all access, synchronising with each other their changes automatically and transparent to the user.How can I have it so that rsync updates both ways?

* host A asks host B for a list of files, modification dates, checksums

* then applies the rules to select which files it will fetch from B

--> if A owns the file then do not get modifications from B
--> files differ, then select newer file

* then fetches them

* and so on for each host...

View 1 Replies


ADVERTISEMENT

Networking :: Simulating Wireless Mesh Network In NS 2?

Aug 30, 2010

I am doing my thesis on Wireless mesh Networks and I am new to Ns2 to ....trying to learn how it works at the moment. Has any body worked on wireless mesh Networks in Ns2.

View 1 Replies View Related

General :: Hwmp Protocol Of Wireless Mesh Network?

Jan 24, 2011

i need hwmp protocol of wireless mesh network.

View 13 Replies View Related

Security :: Implementation Of Distributed Firewall In A Local Area Network?

Apr 6, 2011

I want to know the details about the implementation of distributed firewall in a local area network

View 5 Replies View Related

OpenSUSE Network :: Max Planck Institute Rsync Server Down?

Aug 7, 2010

Does anyone have any info on the status of the Max Planck Institute server ftp5.gwdg.de? I maintain selected local copies of openSUSE updates and KDE etc. using an rsync:/ connection to this server but it seems to have been unavailable for the last couple of days at least - it may have been longer but I've had hardware problems on my home server recently.

View 9 Replies View Related

Server :: Install Centos Distributed For Server?

Apr 13, 2011

I have install centos distributed for server ..

linuxmans@yahoo.com

View 2 Replies View Related

Server :: Distributed File Storage With RAID5 Alike Features?

Oct 6, 2009

is there a way to set-up a file system, where you have multiple nodes (PC's) linked to one storage pool? ZFS seems to support this idea with multiple disks on one node, but could you connect multiple nodes in this manner?

View 3 Replies View Related

Server :: Finding A Distributed File System With RAID5 Like Features?

Jun 17, 2011

I am currently looking for a file system that needs to be distributed over several nodes and need redundancy, like RAID5, and the ability to grow if needed, like LVM. Also not all nodes are going to be located in the same data center, but I guess that's not that important as long as the connection between DCs is sufficiently fast. I am currently looking at AFS, Coda, GFS and OCFS to see if they have what I need.

Edit: I just figured that it may be better to have the RAID5-like setup within one location, and have RAID1-like mirroring between the locations. That would probably better for performance, right?

View 2 Replies View Related

Server :: Rsync Execution - With Crontab - Have Given Full Path To Rsync Too

Apr 12, 2011

I have a tiny shell script to rsync files between two servers and remove the source files.

This script works fine, when it has been initiated manually or even when the rsync command is executed on the command line.

But the same script doesn't work, when I try to automate it through crontab.

I am using 'abc' user to execute this rsync, instead of root, as root login to servers are restricted in all of our servers, by us.

As I mentioned earlier, manual execution works like charm!

When this rsync.sh is initiated through crontab, it runs the first command(chown abc.abc ...) perfectly without any issues. But the second line is not at all executed, and there is no log entry i can find at /mnt/xyz/folder/rsync.log.

View 6 Replies View Related

Software :: Run Rsync To Download Files From A Server Without Rsync Daemon?

Sep 18, 2009

I just tried to sync files from one server to another. After the sync process, I found the files are bigger than original ones.

I looked up the web and found someone mentions the rsync daemon. So I have to run the daemon on one server before I run the rsync?

The command I used is rsync --partial --progress -r source destination

View 1 Replies View Related

Server :: Rsync Can Not Rsync Files With Include Filter

Jul 21, 2010

use rsync to cp such files and dirs under /var/www/html/mydir directory but these two files(/dir4/1.html /dir4/2.html) cant rsync to dest mechine.

rsync configure file,below...

View 2 Replies View Related

Server :: Rsync Fails In Cron - Ssh Key - For Rsync?

Dec 8, 2010

I'm using Ubuntu 10.04 LTS server and Postgresql 8.4. I have a .sh script that is run by cron every other hour. That works fine. The .sh script includes an rsync command that copies a postgresql dump .tar file to a remote archive location via ssh. That fails when run by cron; I think because it is (quietly) asking for the remote user's password (and not getting it). I set up the public/private ssh key arrangement. The script succeeds when run manually as the same user that the cron job uses, and does not ask for the password. I am able to ssh to the remote server from the source server (using the same username) and not get the password prompt (both directions), so why doesn't rsync work? I even put a .pgpass file in the root of that user's directory with that user's password, and the user/password are identical on both servers.

I think the problem is rsync is not able to use the ssh key correctly. I tried adding this to my script but it didn't help.

Code:

Here is the rsync command embedding in the .sh script.

Code:

Here is the cron entry:

Code:

View 6 Replies View Related

Programming :: Optimizing The Spacing Of A Mesh Containing A Given Set Of Points?

Jan 15, 2011

I tried to summarize the this as best as possible in the title. I am writing an initial value problem solver in the most general way possible. I start with an arbitrary number of initial values at arbitrary locations (inside a boundary.) The first part of my program creates a mesh/grid (I am not sure which is the correct nuance), with N points total, that contains all the initial values. My goal is to optimize the mesh such that the spacing is as uniform as possible. My solver seems to work half decently (it needs some more obscure debugging that is not relevant here.)

I am starting with one dimension. I intend to generalize the algorithm to an arbitrary number of dimensions once I get it working consistently. I am writing my code in fortran, but feel free to reply with pseudocode or the language of your choice.Allow me to elaborate with an example:Say I am working on a closed interval [1,10]

xmin=1
xmax=10

Say I have 3 initial points: xmin, 5 and xmax

num_ivc=3
known(num_ivc)=[xmin,5,xmax] //my arrays start at 1. Assume "known" starts sorted

I store my mesh/grid points in an array called coord. Say I want 10 points total in my mesh/grid.

N=10
coord(10)

Remember, all this is arbitrary--except the variable names of course. The algorithm should set coord to {1,2,3,4,5,6,7,8,9,10} Now for a less trivial example:

num_ivc=3
known(num_ivc)=[xmin,5.5,xmax
or just
num_ivc=1
known(num_ivc)=[5.5]

Now, would you have 5 evenly spaced points on the interval [1, 5.5] and 5 evenly spaced points on the interval (5.5, 10]? But there is more space between 1 and 5.5 than between 5.5 and 10. So would you have 6 points on [1, 5.5] followed by 4 on (5.5 to 10]. The key is to minimize the difference in spacing.I have been working on this for 2 days straight and I can assure you it is a lot trickier than it sounds. I have written code that

only works if N is large
only works if N is small
only works if it the known points are close together

[code]....

So as you can see, I have coded the gamut of almost-solutions. I cannot figure out a way to get it to perform equally well in all possible scenarios (that is, create the optimum spacing.)

View 3 Replies View Related

Server :: Sync File Server Data Into Backup Server Machine By Command- Rsync -avu?

Jun 21, 2011

iam trying to sync file server data into backup server machine by command- rsync -avu path/of/data ipaddress-of-backup-server:/path/where/to/save after running it ask for root password and manually it is successful.but i want to make it automatic.for that i also tried cronjob and also generated authentication key but iam not successful in login automatically..anybody know how to authenticate root to login for storing data in backup server.

View 14 Replies View Related

OpenSUSE Network :: Repository Not In The Rsync?

Feb 24, 2011

Just tried to rsync /repositories/server:/monitoring for SLE 11.1 which is visible through http [URL], but when I browse through [URL] the SLE_11.1 directory isn't there.

View 3 Replies View Related

General :: Rsync -z Vs Scp ... Which One Is Faster Over Network

Dec 3, 2010

I often have to transfer huge data over our LAN from one computer to another. The size of the files varies and can be somewhere from 2 GB to 50GB or more! The only accepted connection protocol between machines are ssh; and rsync and scp are the only options available for copying over network (unison is not installed). I usually use rsync with "-z" option to copy over network. if "rsync -z" is faster than "scp" for data transfer?

View 5 Replies View Related

Server :: Rsync Files And Directories From A RedHat Host To A Windows Server 2003R2?

Jun 9, 2011

I'm trying to rsync files and directories from a RedHat linux host(v 4.5 & 4.7) to a Windows server 2003R2 Standard Edition with cygwin running. I'm executing the rsync command from the cygwin shell. The transfer involves rsync'ing approximately 1 TB of data from the linux server to the windows server. After about 280+GB of data transfer, the transfer just dies.

There seems to be no particular file or directory that the transfer stops at. I'm able to rsync GB's of data from other linux hosts to this cygwin server with no problem. Files and directories rsync fine.The network infrastructure is essentially the same regardless of the server being rsync'ed in that it is GB Ethernet running through Cisco GB switches. There appear to be no glitches or hiccups across the network path.

I've asked the folks at rsync.samba.org if they know of any problems or issues. Their response has been neutral in that if the version of rsync that cygwin has ported is within standards then there is no rsync reason this problem should happen.I've asked the cygwin support site if they know of any issues and they have yet to reply. So, my question is whether the version of rsync that is ported to cygwin is standard. If so, is there any reason cygwin & rsync keep failing like this?

I've asked the local rsync on linux guru's and they can't see any reason this should fail from a linux perspective. Apparently I am our company cygwin knowledge base by default.

View 3 Replies View Related

General :: Run Rsync On Server A To Copy All Files From Server B When They Are Newer Than 7 Days

Jun 14, 2011

I want to run rsync on server A to copy all files from Server B when they are newer than 7 days.(find . -mtime -7) I don't want to delete the files on Server B.

View 2 Replies View Related

Server :: SUA On Win2k3R2 Server Rsync Pull From Linux Host

Jun 10, 2011

Has anyone had any experience on using SUA(Services for UNIX Applications) rsync to "pull" files down to the Win2k3R2 server from a linux rsync host?I was trying to use cygwin rsync before until I found out from cygwin that the cygwin port of rsync was "flakey" and would fail intermittently for no apparent reason. cygwin suggested I use SUA or SFU for rsync services.

I've looked for/ am looking for any experience using SUA rsync to copy files down from a linux rsync host to the Windows host via rsync on the Windows host. Also, if you have done this successfully, do you have any pointers/caveats you can share on how you got it working? What I am basically looking to do is copy files and subdirectories of files from a linux host using rsync to some static location on a Windows server on a scheduled basis so that I can backup the windows server to tape using Symantec's Backup Exec application.

I'm doing it this way to avoid deploying the Remote Agents for either linux or Windows on the target hosts. As an alternative I've seen reference to a product called DeltaCopy that uses a native Windows rsync port with the native linux port of rsync to do what I need also.I realize this is not a strictly linux question, but more of a hybrid as I'm moving data to and from Windows and linux hosts. So, if this is too Windows-y a question, please say so and I'll withdraw my question.

View 2 Replies View Related

Ubuntu :: Copy Over Network (rsync,scp) Slows Down System

May 27, 2010

I have a newly installed Dell Optiplex 755 with Ubuntu 10.04 (64-bit) and I am having serious issues with network copying. Whenever I start rsync och scp with larger amounts of data my system becomes practically unresponsive (all types of apps grey out) until those processes are completed. Cpu stays at below 10% and I have lots of free memory and such .

View 3 Replies View Related

General :: FTP Or Rsync Transfer Drops Network Connection

Apr 23, 2011

I'm using Scientific Linux on a laptop, connecting to a debian server on my LAN via a basic BT HomeHub router. When starting a file transfer with ftp or rsync from the laptop my connection is dropped, every time, after a couple of seconds. I have to reset my network adaptor and restart my network manager (wicd in this case) in order to get network connectivity back. I had a very similar problem before - [URL]. On this occasion my workaround was to replace NetworkManager with yast. I am now using SL though so no yast available, and I am not using NetworkManager any more anyway.

View 3 Replies View Related

General :: Rsync - Mounting Network Drives And The DLink DNS-321?

Jan 27, 2010

I recently built a small Intel Atom 330 based server for my home. I'm using the Vortexbox Fedora-based OS to run the server (primarily used as a media server). So far everything is working great. In addition to my media server, I've got a DLink DNS-321 NAS. I would like to setup a scheduled, incremental backup of my main server to the DLink NAS. I understand rsync is an excellent option, and am willing to undertake the task of setting it up on my server, but I am uncertain how to make it all happen with the DLink NAS. The NAS is very barebones, and I don't know if I can even install rsync on it. I don't even know if I can get to any kind of command line on the NAS box. 1. Can I mount the NAS drive on my main Linux server and then just run rsync on the server?

View 7 Replies View Related

Networking :: Distributed File Systems

Jan 21, 2010

Last year I was looking into fault-tolerant distributed file systems and I recall one kernel-based system that required a physical partition on each machine in the cluster, but would treat it as a single volume - ie. a write on one server would appear on the disk on all the servers.Unfortunately I didn't bookmark the specific system I was looking at, and now a year later I can't remember the details.What I don't want is NFS - a single file server with a file system mounted on various machines. What I do want is mirroring - one disk shared among multiple servers, so that if one server dies, it doesn't make any difference to the rest of them.

A bit of investigation turned up Red Hat's GFS, which kind of looks like what I want, but looks more and more like an NFS model to me. I was wondering what everyone's opinion of the various options out there were.

View 3 Replies View Related

Networking :: Get The Information To Be Distributed Across The Internet?

Aug 25, 2010

I have gotten my DNS servers up and running, and query against them using dig returns the proper information. How do I get the information to be distributed across the Internet now?

View 1 Replies View Related

OpenSUSE Network :: Rsync Freezes Whole Computer Without Error Messages

Feb 26, 2011

I am currently facing a problem with rsync (or maybe ssh, I don't know yet). I have daily backups that are done via cron using rsync from my computer (client) to a NAS. And systematically during these backups my computer completely freezes (no remote login possible, nothing), so I have to hard reboot. As you might imagine, I cannot do this every day. In /var/log/messages there is just a line like that :

Feb 26 17:23:53 eggplant rsyslogd: -- MARK --

right before the hang. The rsync worked well before and I don't really know what changed in my system config. In /var/log/rsyncd.log I sometimes (but not every time) I get :

2011/02/26 16:39:19 [13229] rsync error: received SIGINT, SIGTERM, or SIGHUP (code 20) at rsync.c(543) [Receiver=3.0.7]

I aldready update the default rsync from opensuse 11.3 to 3.0.7.7, but it does not help. How can I at least know what is going wrong? I am trying to track down the problem but don't know how to start. Last also a log of the rsync command (client) running ssh in verbose using the command "rsync -av --delete --timeout=180 -e "ssh -v -p xxxxxx -i /root/.ssh/rsync-key_eggplant" /mds root@xxxxxxxx:/volume1/autoBackup/eggplant":

OpenSSH_5.4p1, OpenSSL 1.0.0 29 Mar 2010
debug1: Reading configuration data /etc/ssh/ssh_config
debug1: Applying options for *

[code]....

View 9 Replies View Related

Debian :: Source Is Distributed In A GZipped File?

Apr 30, 2010

I'm trying to understand how deb packages work. Are there source debs?I assumed there were, but from[URL].. I see that source is distributed in a GZipped file.

View 3 Replies View Related

Ubuntu :: Distributed Computing: More Cycles Or More Cores?

Sep 1, 2011

I'm planning on setting up a new Linux box expressly for distributed computing (BOINC, SETI@home, etc.). All things being equal, what's better- More clock cycles or more cores?

View 4 Replies View Related

Applications :: Best Distributed Filesystem For Home Directories?

Oct 19, 2010

I'm looking for the best distributed filesystem to share my home directory among all my computers, and I'm interested in what advice I could get here.

Here are my requirements:
1) It must be completely POSIX compliant, because I've noticed that many programs will break if not.
1a) Must support file locking (i.e. flock()) preferably sharing lock advisories between the clients
1b) Must support hard links, and be able to recognize a hard link connection by looking at the number of references
2) It must have encryption, and security suitable for it to be exposed to the internet.
2a) I would like to use password-less authentication. Preferably SSL client certs (HTTPS style). Static keys (SSH style) are also fine. I would begrudgingly accept a password authenticated system if it used a fairly secure challenge/response algorithm if it met all of my other requirements. (Extra points if it supports PKCS#11 and thus supports smart cards)
2b) Encrypted traffic must be an option.
2c) No thanks to kerberos. It was too annoying to maintain when I tried it before and I don't like passwords.
3) Preferably, it should be stable and fairly easy to maintain.
4) Optionally, it should be tolerant of network drops, and reconnect automatically as needed, because my laptop wireless is a little flaky sometimes.

View 4 Replies View Related

General :: Book On Testing Distributed Systems?

Apr 30, 2011

I'm built an distributed application, and now I want to take some metrics to show how my application works. These metrics includes the time of computation, the time of communication and the amdhal law. I would like to know what tests can be done to show the performance of the application. So, I'm searching for a book or document that shows me what type of tests can be done to show the performance of an application.

View 2 Replies View Related

Ubuntu Servers :: Advanced Rsync - Make The Rsync Set Or Keep The User And Group Affiliations?

Nov 17, 2010

Thought I'd post it here because it's more server related than desktop... I have a script that does:

[Code]....

This is used to sync my local development snapshot with the live web server. There has to be a more compact way of doing this? Can I combine some of the rsyncs? Can I make the rsync set or keep the user and group affiliations? Can I exclude .* yet include .htaccess?

View 6 Replies View Related







Copyrights 2005-15 www.BigResource.com, All rights reserved