General :: Osx - Keep Folders Synced And Backed Up Between Two Macs Using A NAS (rsync)
Sep 16, 2011
I've got two primary computers, one Mac Pro and one MacBook Pro for when I'm on the go. I've also got a Linux sever which also acts as NAS. Currently I backup the entire computers to an external drive with Time Machine which is rather useless and doesn't sync anything. What I really want to do is to keep my important files synced between both computers and my NAS (which is running RAID 5), that way I'm not backing up easily replaceable systemfiles and I've got all my important files in 3 places where two of them are running raid so at least 5 drives would have to crash at the same time before actual data loss occur.
Folders I want to keep synced is basically my photo, documents, development, mamp and work folders and then I want to keep the user library folder backed up but not synced. I'm thinking that I'd have to use rsync but don't know how. Before suggesting Dropbox and similar suggestions I don't want to use them because of several reasons some of them being security (Dropbox obviously proved this), Speed (sometimes I'll sync gigabytes of data and that will be significantly faster locally and probably even through VPN as I have a Gigabit pipe), Space (space on my NAS is cheap and only practically limited by my needs), reliability (even if my internet were to go down I still need to be able to keep my files synced incase I'd need to go somewhere on the fly), price (I already have all the hardware and for the amount of gigabytes and bandwidth I'd need I doubt that there's any free or cheap service). Those are my main reason for wanting to keep it locally.
OK, here is the test code I am using: rsync -acrv /home/randy/Documents /media/USB2/testbackup. What should I put in the code so that when I delete something in the Documents folder, it will also be deleted in the testbackup folder when I perform a sync.
How can I have it so the code will check if USB2 is available, if it is, do the sync, if not, do nothing.
I want to synchronize my home folder from my laptop to my desktop from the local network, but i want to transfer only the visible folders/files... So i am using the following command
I need a program to run on Ubuntu that must be easily set up to do a series of different cloning operations at specific times between the USB drives on a single Ubunu pc, depending on the day of the week." So on Monday folder B is forced to match folder A, Tuesday C forced to equal D ... and on Sunday a whole bunch of these clonings happen. This must all run unattended (at 2am) and be robust with no "what do you want to do next messages" or having the whole thing give up if there is a problem with one file. Though I do need a log of success or failure. Windows programs that do this stuff are FolderClone and GoodSync. I looked at Unison and Rsync and one or two others, but none appeared set up to do what I need, or to be excessively complex / general. I don't need something that can sync two copies, or over internet ....
I am trying to create a simple bash script to rsync some folders within a directory stucture. I am using wild cards, in the rsync source directory structure, but my command always fails. I believe it is the way I am using wild cards within my for loop. Here is my command ;
Code:
for seq in `cat test.txt` ; do rsync -nvP /folder/folder/folder/folder/folder/**/$seq /folder/folder/folder/ ; done This always fails, where if I do a ls to the destination, to test the path, it always works.
what are linux kernel and linux distros able to do that macs and windows computers can'talso are there some things that freebsd and solaris can do that others can't (you don't have to answer this one)
how do I go about using rsync or grsync to sync folders to a samba share in my storage router? the samba share ip is smb://192.168.0.1/usb1-c/ tried using grsync but it says cant find smb!
I backed up all of my files last night via SFTP before I reinstalled Ubuntu *Since nobody answered my question* and I went ahead and encrypted my home folder. How do I open port 22 like Ubuntu normally has it? I've tried this guideBut it didn't work, how do I set up SSH? I really need those files.---------- Post added 07-05-11 at 10:17 AM ----------Also, my Desktop is encrypted, but I forget, but I may have encrypted my laptop since the port is also closed on that as well.
Ubuntu 10.04.1GNOME desktopOK, If you right click on the Documents folder in you home profile and select "copy to desktop" you would assume that both folders would be synced because your basically creating a short-cut for main folder to the desktop.Assuming that these folders would sync made an *** out of me, I'm fining that I have to keep copying files from one "Documents folder" to the other one.I don't want to hear about Ubuntu One because that NOT what I trying to do. I don't want to share my folder I just want them both to contain the same information. I don't understand if you make a short-cut of a folder it SHOULD contain the same information as the parent directory, you shouldn't have to open both folders and hand-sync them. That's just stupid and redundant.
I have a shared NTFS partition ("shared") that I use for data for both Windows and Ubuntu. How can I mount the music folder on shared to $Home/Music, and the Videos folder on shared to $Home/Videos? I want to mount the different folders on the partition to different folders in home.
after i solved the many other problems that plagued me as an early adopter of the new iPod touch, I took my freshly recovered device (iOS 4.1, on an ipod touch 4G) and tried syncing with Rythmbox and Banshee. It shows up on the GUI as a music player and a camera, I press sync on rythmbox or banshee and it works out. But when the sync is over and I look at my device I find no songs on there, but they're inside the itunes_control file in my ipod when I view the file contents from ubuntu.
I have succeeded in syncing with iOS 4.1 before, but an error forced me to restore my iPod. But that was when I had a jailbroken ipod with the DBversion changed to 2 as per many guides on the internet. But I thought all of these problems were solved with the new libimobiledevice 1.04.
I have what I thought would be a simple issue: I have a Linux server and a bunch of people with Macs on a small business network.I'm trying to set it up so that using AFP, people can access the Linux server and drag and drop files to our test web development server. In each person's home directory there's a sym link to the /var/www/html directory, so that they can easily plop their test files there.I've got the hard part taken care of: AFP works, the Linux server appears on the network, and the Mac users can connect and log in.However, my sym link doesn't show up as a directory inside the Mac Finder...it shows up as an application. I don't know if this is something as simple as a permissions problem or whether I need to do more configuring to get AFP to play nice.
Has anyone seen the mouse rainbow circle on Macs? I saw one in an Ubuntu derivative. What program has that in it. My mouse does a hour glass, Macs have a rotating rainbow circle
I have a lab with 1 switch and 2 machines attached. One XP station and a debian lenny server. My debian runs dhcpd with this configuration
subnet 192.168.1.0 netmask 255.255.255.0 { range 192.168.1.31 192.168.1.254; default-lease-time 345600;
[code]....
I'm trying to restrict dhcp to only provide setting for a list of MAC addresses (about 300 macs) Using the following option is not good to me because I have not a pattern in my clients mac.
class "private-hosts" { match if substring (option hardware,1,11) = "01:00:50:56"; }
[code]....
I've try using iptables with following configuration, but XP still getting IP from dhcpd:
I have a lab with 1 switch and 2 machines attached. One XP station and a debian lenny server. My debian runs dhcpd with this configuration: subnet 192.168.1.0 netmask 255.255.255.0 { range 192.168.1.31 192.168.1.254; default-lease-time 345600; max-lease-time 691200; option routers 192.168.1.1; option subnet-mask 255.255.255.0; option domain-name "lab.com"; option domain-name-servers 192.168.1.12; option netbios-name-servers 192.168.1.12; option netbios-node-type 8; option broadcast-address 192.168.1.255; option ntp-servers 192.168.1.12; ddns-updates on; ddns-update-style interim; }
I'm trying to restrict dhcp to only provide setting for a list of MAC addresses (about 300 macs) Using the following option is not good to me because I have not a pattern in my clients mac.
class "private-hosts" { match if substring (option hardware,1,11) = "01:00:50:56"; } pool { range 192.168.1.31 192.168.1.254; allow members of "private-hosts"; }
I've try using iptables with following configuration, but XP still getting IP from dhcpd: iptables -P INPUT DROP iptables -P FORWARD ACCEPT iptables -P OUTPUT ACCEPT # Full from Localhost to Localhost iptables -A INPUT -i lo -j ACCEPT # Full from My PC iptables -A INPUT -s 192.168.1.2 -j ACCEPT So I can't limit DHCP for specific macs.
Is it possible to run Linux on Macs without any additional configuration such as Boot Camp/etc?
I have a SATA storage device that has presents a GUI to the user in a simple Linux installation, and ideally it should be platform independent, i.e. boot up into the GUI in all platforms. I'm having mostly success on various PCs, however, it's not booting up in a Macbook Pro that I have. AFAIK the MBPs and all modern Mac systems use EFI rather than BIOS, could this be the problem?
I've been reading up on clustering a bit and want to create simple 2 machine cluster of which the 2nd one will turn on and take over traffic at the previous machine's IP (I'm aware there will be a couple minutes of downtime while the failover server boots). I've looked into doing a simple DNS round robin, but I think both machines would need to be online all the time for this to function correctly. I've also looked into linux-HA and GlusterFS but both seem a little intense for the simple failover I'm trying to achieve. One catch if approaching with DNS round robin... the server that I want to setup with a failover also operates as a DNS server. Anyone know the simplest way to complete this? One idea I had (that seemed like a bit of manual work): Create script that runs every 60 secs through CRON on firewall (running pfsense) and have it check if master-server is up. If it's not, it will send a WOL signal to the slave, which has a mirrored image of the first. the problem I have with that is I will also need to create a script to keep both synced properly which seems almost impossible if one is shut down until failover (my thought was periodic rsyncs.) Perhaps creating a FS to direct all files to for the master/slave would be the only way around that.
When I sync my iPod touch 2G on 4.1 (same issue on 4.0), when I try to play the music on my iPod, it will just skip the song/not play it. I didn't have this issue on Ubuntu 10.04.
I finally bought a second hard drive to back up all my files since I'm planning on wiping my hard drive completely clean and reinstalling Windows and Ubuntu once Lucid comes out. I'm just wondering, how common is it for files to become corrupt when transferring from one hard drive to another? I ask this because I usually have trouble when transferring (usually large files) onto my flash drive. I know that actual hard drives are different but I just want to make sure. Also, is there a way I can confirm that everything transferred correctly? Most of my files are music so it would be a pain to check every single one to see if it works.
I have a directory, say, of /home/user/program/sub-folder/sub-sub-folder/file. Now I take the /file and save it to a backup drive. Later I want to restore that /file to its original directory, BUT I FORGOT WHERE IT CAME FROM!!! Is there a way to know where it came from? Where are website username and passwords stored? Are these some of whats referred to as cookies?
On my Ubuntu One Personal Cloud, I did not realize that "rm -f"-ing music files on my computer itself would actually remove the files online as well!I was able to recover 10 of the songs from my iPod, but two of them are still unrecoverable. Is there any way to get them back without having to re-purchase them? I could easily purchase them myself (have a debit card, a checking account, and a job), but I would hate for my mother to have to purchase them again.Not knowing that deleting and reinstalling them (considering some of them got corrupted on my computer) would also delete them online is not enough to warrant having to lose the songs permanently.
I recently deleted my .kde4 folder and lost all the album art and lyrics I had saved in Amarok. I have a back up but openSUSE doesn't recognized the file type and won't copy the files to the new albumcovers folder in .amarok. The file name is a mixture of numbers and letters with no file extension.
I downloaded a few album covers in Amarok and openSUSE recognizes these as jpeg files, even though there's no jpg file extension in the file name. If I right click on of the files from my backup and choose to open it with Amarok, then the album art appears, and it's also added to the albumcovers folder in .amarok, and recognized as a jpeg file!
Anyone know why openSUSE doesn't recognize the files from my backup? Or how I can import all of the album art and lyrics from my back up all at the same time?
So my aim is to install openSUSEx64 11.3 onto my Macbook; but for whatever reason, upon boot-up, the system won't recognize the USB thumb drive with the expanded image of openSUSE on it. I followed steps in Terminal to expand the image onto the said USB stick and know it worked properly because Terminal said "Process Completed." Do I need a special type of USB thumb drive or am I missing something? I am using a late-2009 Macbook. By the way, these were the steps used to prep the USB thumb stick:
1. Open a Terminal (under Utilities) 2. Run diskutil list to get the current list of devices 3. Insert your flash media 4. Run diskutil list again and determine the device node assigned to your flash media (e.g. /dev/disk2) 5. Run diskutil unmountDisk /dev/diskN 6. Execute sudo dd if=/path/to/downloaded.img of=/dev/diskN bs=1m 7. Run diskutil eject /dev/diskN and remove your flash media when the command completes
How to backup in such way that, data will be backed up in every 1 hour...but every time not full data;; only the data/file which have been modified within last 1 hour. Its on locally. And how to back up local data to remote system. Because I have tried with ssh-keygen also , but everytime its requiring password.
I am wondering that if I install ubuntu as my os, will my current files be backed up to a directory like when installing a new version of windows, or would I need to back them up externally before hand. How much ram does 32bit ubuntu support upto, and which would be better for me out of 32bit + 64bit? I have 4gb of ram and a dual core 2ghz processor.
Thought I'd post it here because it's more server related than desktop... I have a script that does:
[Code]....
This is used to sync my local development snapshot with the live web server. There has to be a more compact way of doing this? Can I combine some of the rsyncs? Can I make the rsync set or keep the user and group affiliations? Can I exclude .* yet include .htaccess?
When I run rsync --recursive --times --perms --links --delete --exclude-from='Documents/exclude.txt' ./ /media/myusb/
where Documents/exclude.txt is
- /Downloads/ - /Desktop/books/
the files in those directories are still copied onto my USB.
And...
I used fetchmail to download all my gmail emails. When I run rsync -ar --exclude-from='/home/xtheunknown0/Documents/exclude.txt' ./ /media/myusb/ I get the first image at url.
I have a tiny shell script to rsync files between two servers and remove the source files.
This script works fine, when it has been initiated manually or even when the rsync command is executed on the command line.
But the same script doesn't work, when I try to automate it through crontab.
I am using 'abc' user to execute this rsync, instead of root, as root login to servers are restricted in all of our servers, by us.
As I mentioned earlier, manual execution works like charm!
When this rsync.sh is initiated through crontab, it runs the first command(chown abc.abc ...) perfectly without any issues. But the second line is not at all executed, and there is no log entry i can find at /mnt/xyz/folder/rsync.log.
