The requirements are:
SystemA must be 100% Identical to SystemB no matter what rsync runs into: symlinks, same size files with different dates, directories that no longer exist... etc.
What is your perfect rsync command?
I work for a company that rsyncs its media content to a datacentre daily for distribution via https to our clients. Unfortunately we've started to have problems with our rsync command/script.
It runs fine, but it seems to re-copy files that are already at the destination, of the same size and of the same date modified? We have hundreds of thousands of files, so this really cant happen. Our team here at the company use Windows XP to create the media, then put in on a the local suse server via SMB.
The code is
Code:
Both servers local and remote are Suse 10. The target/paths are irrelevant because they are correct and work.
Local server LS -L
Code:
For example
Remote server LS -L
Code:
As you can see local/remote files are the same, any ideas why this re-copy would happen? What's rsync playing at? We obviously just want it to sync new files and changes.
I'm trying to put a variable into the rsync command but I just get some BS error about escaping - whatever that is suppose to mean.
This is my command:
Code:
rsync -rvvuc --exclude '/Output/*' ${OPTARGS} --delete "${SOURCE}scripts/" "${DEST}scripts/"
${OPTARGS} has this value:
--rsh='ssh -p 34'
Wont work. If I type that text directly, then it works. Other then using some if statement to have two different command calls, how can I make this work?
I'm going to be using this command to back up my files:
Should I change anything or is it ok?
I'm trying to understand rsync filters .. but it isn't goig to well.I want to rsync only files with a specific extension (.gz.des3). Could someone please tell me how to add such filter to the rsync commandline (not a seperate filter filer).
View 2 Replies View RelatedI have the following rsync command for making some backups:
Code:
rsync -r --progress --delete -H --numeric-ids -a --exclude=.gvfs /source /media/Backup
If I paste that in my Terminal, it will perform a backup of all the files and show me what's going on in the Terminal window. But how can I make that into a launcher? I have made a launcher on my desktop with that code in its Properties, but double-clicking it starts the rsync process (I can see HDD activity) but a Terminal window won't open.
I'm trying to set up rsync backups on my ReadyNAS and I'm getting the following error: ERROR: The remote path must start with a module name not a / This error is accompanied by the following information:
[Code]...
Why would rsync insert a user's home directory path in variable expansion when run via cron, but not when run manually. The gory details... Red Hat Enterprise Linux AS release 4 (Nahant Update 6) Linux 2.6.9-67.0.20.ELsmp The script (parts anyway, and simplified)...
Quote:
#!/bin/bash
. /home/bea/.bash_profile
echo rsyncloc=${rsyncloc} >> ${log}
[code]....
I received the following output from an rsync (3.0.0) command that was executed:
sending incremental file list
sent 77214 bytes received 484 bytes 155396.00 bytes/sec
total size is 254531170 speedup is 3275.90
What does "sending incremental file list" mean?
I have rsync error message for this command,
Quote:
rsync -avr --delete --exclude lampp/tmp/* /opt/* /backup/opt/
rsync -avr --delete --exclude data/session/* /var/www/html/dmcatholic/* /backup/dmcatholic/
The error message is here.
[code]....
sent 1917154 bytes received 384128 bytes 5731.71 bytes/sec total size is 12220966785 speedup is 5310.50 rsync error: some files could not be transferred (code 23) at main.c(892) [sender=2.6.8]
when i use rsync command to backup my image file , it shows the following error message.
bash: line 1: /usr/bin/rsync: Argument list too long
rsync: connection unexpectedly closed (0 bytes received so far) [receiver]
rsync error: remote command could not be run (code 126) at io.c(463) [receiver=2.6.8]
The command which i used is rsync -avrl -e ssh cms@server:/data/cms/data/images/* /mnt/Backup/Intranet_cms_backup/images
Thought I'd post it here because it's more server related than desktop... I have a script that does:
[Code]....
This is used to sync my local development snapshot with the live web server. There has to be a more compact way of doing this? Can I combine some of the rsyncs? Can I make the rsync set or keep the user and group affiliations? Can I exclude .* yet include .htaccess?
When I run rsync --recursive --times --perms --links --delete --exclude-from='Documents/exclude.txt' ./ /media/myusb/
where Documents/exclude.txt is
- /Downloads/
- /Desktop/books/
the files in those directories are still copied onto my USB.
And...
I used fetchmail to download all my gmail emails. When I run rsync -ar --exclude-from='/home/xtheunknown0/Documents/exclude.txt' ./ /media/myusb/ I get the first image at url.
I have a tiny shell script to rsync files between two servers and remove the source files.
This script works fine, when it has been initiated manually or even when the rsync command is executed on the command line.
But the same script doesn't work, when I try to automate it through crontab.
I am using 'abc' user to execute this rsync, instead of root, as root login to servers are restricted in all of our servers, by us.
As I mentioned earlier, manual execution works like charm!
When this rsync.sh is initiated through crontab, it runs the first command(chown abc.abc ...) perfectly without any issues. But the second line is not at all executed, and there is no log entry i can find at /mnt/xyz/folder/rsync.log.
I just tried to sync files from one server to another. After the sync process, I found the files are bigger than original ones.
I looked up the web and found someone mentions the rsync daemon. So I have to run the daemon on one server before I run the rsync?
The command I used is rsync --partial --progress -r source destination
use rsync to cp such files and dirs under /var/www/html/mydir directory but these two files(/dir4/1.html /dir4/2.html) cant rsync to dest mechine.
rsync configure file,below...
have you ever set up the perfect ubuntu , all the softwares,games,libs,customizations... and wanted to back it up so if anything happens in the future you could just go back to "perfect one" ?
View 1 Replies View Relatedi want to create a perfect copy of my HDD. I have ubuntu and windows on here. I want to make it so that i can boot off an external HDD, and it will start up the GRUB menu, and all my files etc. will be the same on each OS as they were on the internal. is there a good way to do this?
View 3 Replies View RelatedAfter many troubles with an update, I did a clean install if 9. 10 64-bit and it seems to work really well. First thing I did, was install the restricted codec and Tweak. using tweak I added Chromium and VLC. Then I right-click the speaker icon and un-muted the system. I then opened the Sound preference and in the hardware menu and disabled the Internal Audio and the R700 Audio Device. The Sound Blaster Live Value card is the only one highlighted..the Setting is "Analog Surround 5.0 Output". But still no sound!! When I did a fresh install of 9.04 the sound was automatically installed and I got the start up drum sound but nothing now. Kinda frustrating considering everything else seems to work fine compared to others even feels a little better than 9.04 but the sound thing is not cool.
Here is the terminal output for aplay -l:
Code: **** List of PLAYBACK Hardware Devices ****
card 0: Live [Dell Sound Blaster Live!], device 0: emu10k1x [EMU10K1X Front]
Subdevices: 1/1
Subdevice #0: subdevice #0
card 0: Live [Dell Sound Blaster Live!], device 1: emu10k1x [EMU10K1X Rear]
Subdevices: 1/1
Subdevice #0: subdevice #0
card 0: Live [Dell Sound Blaster Live!], device 2: emu10k1x [EMU10K1X Center/LFE]
Subdevices: 1/1
Subdevice #0: subdevice #0
card 1: Intel [HDA Intel], device 0: ALC889A Analog [ALC889A Analog]
Subdevices: 1/1
Subdevice #0: subdevice #0
card 1: Intel [HDA Intel], device 1: ALC889A Digital [ALC889A Digital]
Subdevices: 1/1
Subdevice #0: subdevice #0
card 2: HDMI [HDA ATI HDMI], device 3: ATI HDMI [ATI HDMI]
Subdevices: 1/1
Subdevice #0: subdevice #0
How can i be perfect in Linux networking configuration?
View 2 Replies View RelatedI'm using Ubuntu 10.04 LTS server and Postgresql 8.4. I have a .sh script that is run by cron every other hour. That works fine. The .sh script includes an rsync command that copies a postgresql dump .tar file to a remote archive location via ssh. That fails when run by cron; I think because it is (quietly) asking for the remote user's password (and not getting it). I set up the public/private ssh key arrangement. The script succeeds when run manually as the same user that the cron job uses, and does not ask for the password. I am able to ssh to the remote server from the source server (using the same username) and not get the password prompt (both directions), so why doesn't rsync work? I even put a .pgpass file in the root of that user's directory with that user's password, and the user/password are identical on both servers.
I think the problem is rsync is not able to use the ssh key correctly. I tried adding this to my script but it didn't help.
Code:
Here is the rsync command embedding in the .sh script.
Code:
Here is the cron entry:
Code:
I'm looking to find a way to ensure that what I'm hearing from my computer is Bit Perfect, and can also play 24/96khz files.
Audio on Linux has always confused me, so I'm not entirely sure where to start. So if we were to say I'd be starting from a fresh install of OpenSUSE 11.3, where would I have to go to achieve my goal with an M-Audio Audiophile 24/96 Sound Card (ICE1712 Chipset)?
Ok, this is not a matter of life or death for me. I am just an experimental geek. I had a three partition HD originally, one blank, one with my home directory and one empty one. Then, I used unetbootin and put puppy on my empty partition. Now, puppy works, but I wantt a way to switch. I can reinstall, I just want a way of having several linux OS's on a hard drive.
View 2 Replies View Relatedmy ubuntu laptop is running very slowly, it was running fine until I rebooted it then it has stayed really slow. It takes 7minutes to boot and crashes alot, most of the time it takes a good 3 mins to open anything,
View 2 Replies View RelatedAnyone who has been in the world of Linux for more than a minute knows there is a good deal of choice when it comes to package manager. What is your package manager of choice and why? Why do you prefer to use RPM/dpkg/apt-get/yum/pacman/emerge/<insert random package manager here> over others out there?
View 2 Replies View Related[URL]...In this bug, you'll see that I actually fixed my own problems that surfaced when building GNOME Shell from source.
View 1 Replies View RelatedI'm looking for javascript tutorials or books that meets the following criteria:
1. Very thorough: Starts with the most fundamental concepts and progresses logically from basic to advanced concepts, without skipping over important ideas for the sake of expediency.
2. Lots of small practice exercises that parallel the concepts and syntax being learned.
I've looked at a lot of tutorials, but they all tend to be lacking in one of these areas or the other.
The more I use openSUSE 11.2, the more I love it. Today, I tried another highly recommended KDE4 distro, and while it was nice, I immediately recognized that the excellent integration and refinements SUSE includes are very much to my liking. openSUSE is nearly perfect for me in every way -- except one. The package management continues to leave me baffled.I was hoping I would eventually learn to like it as much as Synaptic, aptitude/apt-get and the other tools on Debian-based distros. But the more I read, the more I am questioning whether I will ever like it.I'm now fairly convinced that Debian-based package management is the gold standard. (Of course, I'm just going on what I have read. I'm far from expert, and I'm hoping to get educated by posting questions like this one.)
But I doubt I will find a distro that is equal to openSUSE in every way except that it uses Debian-based package management. (I wish such a distro existed.)So, if I have to live with YaST, zypper, RPMs, etc., how can I learn to have the best experience with the least amount of investment? Low investment is important because if I really wanted to invest the time to become more of an expert in operating systems, package management, etc., I would probably just jump to Arch Linux and KDEmod and enjoy a rolling release. Or maybe Gentoo, etc. What I like about openSUSE is that it just works. It works out of the box. Except for package management.
deal with the initial setup of all the stuff on another (Debian-based) distro that isn't to my liking or that just doesn't work, and then thereafter enjoy that distro's good package management..have a great out of the box experience and the overall nicest initial OS experience I ever remember, but live every day with a package management system that isn't up to what I experienced under Ubuntu.Quote from the link above: It is almost unfair to include Red Hat in the same category as Suse because, frankly, Suse makes Red Hat look like geniuses. I don't know why a company which can create arguably the most attractive and professional looking distribution available in the Linux world has such a godawful package manager.
Recently I installed Renoise demo and followed their install instructions from the Renoise 2.1 quickstart guide. It said if you get any errors to do the following:
Configuring Realtime Threads:
If you get a warning message when you start Renoise, read this section. To allow Renoise to create realtime threads, which are required for low latencies with ALSA or JACK, you have to
edit the /etc/security/limits.conf file. A realtime kernel does NOT help here, it does not set the required options automatically! To enable RT thread creation via PAM open the /etc/security/limits.conf file in a text editor as root (or sudo). Then somewhere near the end of the file add:
YOURUSERNAME - rtprio 99
YOURUSERNAME - nice -10
Replace YOURUSERNAME with your username. You can discover this with the 'whoami' command.
Alternatively you could also create a group named "Audio", add your user to that group, and use '@Audio'
instead of 'YOURUSERNAME'.
Save the file. Log Out. Login. At this point it should be working. To verify that it works, launch Renoise, select ALSA and make sure the 'Realtime threads' option is on. You will get a friendly warning like the one above. If RT creation failed. Try again.
Jack Configuration
If you don't have "Jack Control (JACK Audio Connection Kit)", we recommend that you install it.
Jack Control allows easy Audio/MIDI routing with an intuitive GUI. On Ubuntu:
$ sudo apt-get install jackd qjackctl
Now you can start it from [Applications] -> [Audio] -> [Jack Control].
Click the "Setup" button, and set following values:
Change the "Priority" value to 89. (If you use realtime kernel, also add check mark beside "Realtime")
Change the "Periods/buffer" value to 3 or more.
In addition, please configure latency and other settings according to the needs of your system. Now I don't have sound where and when I used to, for example: songbird no longer plays sound tho it plays the track and no sound in web browsers aswell, like ..... plays but no sound. It has to be something simple because audio for everything was fine until editing that one file and installing that audio jack program.
I would like to get help from experts who are experienced in the area of Linux network programming to help me to choose the proper way to create a special Firewall program.I do start reading WinSocket and tending to start BSD. I don't want to start with an API like winsock then stuck. So please, I do need a way to accomplish all features such as capturing, dropping or allowing all kinds of LAYERS as well as Intrusion detection.I am a good programmer in C++ but I am new for linux.So, what is the best Linux OS to install and start with and which is the best way to accomodate C++.
View 1 Replies View Related