I have a script that runs my daily rsync, I would like to expand it to email the output, and on a fail, an alternate email address. Also I would like to have the seconds converted to HH:MM:SS if it's not a big deal. What I have so far is the extent of my abilities.
Code:
start=$SECONDS;
if rsync_output=$(rsync ...
then echo Success;
else echo Fail;
fi;
echo "$rsync_output"
echo time in seconds =$((SECONDS-start))
I have a tiny shell script to rsync files between two servers and remove the source files.
This script works fine, when it has been initiated manually or even when the rsync command is executed on the command line.
But the same script doesn't work, when I try to automate it through crontab.
I am using 'abc' user to execute this rsync, instead of root, as root login to servers are restricted in all of our servers, by us.
As I mentioned earlier, manual execution works like charm!
When this rsync.sh is initiated through crontab, it runs the first command(chown abc.abc ...) perfectly without any issues. But the second line is not at all executed, and there is no log entry i can find at /mnt/xyz/folder/rsync.log.
I just tried to sync files from one server to another. After the sync process, I found the files are bigger than original ones.
I looked up the web and found someone mentions the rsync daemon. So I have to run the daemon on one server before I run the rsync?
The command I used is rsync --partial --progress -r source destination
use rsync to cp such files and dirs under /var/www/html/mydir directory but these two files(/dir4/1.html /dir4/2.html) cant rsync to dest mechine.
rsync configure file,below...
I'm using Ubuntu 10.04 LTS server and Postgresql 8.4. I have a .sh script that is run by cron every other hour. That works fine. The .sh script includes an rsync command that copies a postgresql dump .tar file to a remote archive location via ssh. That fails when run by cron; I think because it is (quietly) asking for the remote user's password (and not getting it). I set up the public/private ssh key arrangement. The script succeeds when run manually as the same user that the cron job uses, and does not ask for the password. I am able to ssh to the remote server from the source server (using the same username) and not get the password prompt (both directions), so why doesn't rsync work? I even put a .pgpass file in the root of that user's directory with that user's password, and the user/password are identical on both servers.
I think the problem is rsync is not able to use the ssh key correctly. I tried adding this to my script but it didn't help.
Code:
Here is the rsync command embedding in the .sh script.
Code:
Here is the cron entry:
Code:
I managed to install xubuntu-restriced-extras on my Ubuntu 10.04 server (which btw is headless and no X installed at all) Anyways, i tried to remove it with apt-get remove, but in only deleted a couple of Kb. tried with --purge, autoremove, autoclean, clean and everything else i could think of, but my poor server is still bloated with stuff like adobe-plugins and stuff i dont need.
How can i propely remove the entire package? I could also remove the package piece by piece (since its just a dummy package, no?), but I tried to search the internet for such information, but to no avail. Where to look, what to do?(btw, this happended because i was installing the package on my xubuntu laptop, but forgot i was SSH'ing to my server
iam trying to sync file server data into backup server machine by command- rsync -avu path/of/data ipaddress-of-backup-server:/path/where/to/save after running it ask for root password and manually it is successful.but i want to make it automatic.for that i also tried cronjob and also generated authentication key but iam not successful in login automatically..anybody know how to authenticate root to login for storing data in backup server.
View 14 Replies View RelatedPreface: I have just bought two new WD20EARS hard drives and have added them into my LVM and moved all my data from my old failing seagate drives to my new drives. I also have a WD10EARS in the LVM.
These are WD Caviar Green Power 4K hard drives.
Using Ubuntu 10.10 64bit and LVM2, everything is working but I want to know if I can tweak it for more performance. I am relatively new.
Questions:
1. How can I check if the 4K drives are aligned?
2. How can I check what block size LVM is using?
3. I didn't partition one of the WD20EARS when adding it to a LV, will this be problematic or effect performance? Can I partition it without losing the data that is on it now?
4. I heard XFS is better than EXT4 for large files and people tend to suggest using certain formats when they're talking about LV's, if I check the format of any of the hard drives it says they are lvm2...?
i'm following the tips from Samba and Suse: HowTo Set up an openSUSE-Windows Home Office LAN/Network. Versions 10, 11 to set up samba and tweak it to my needs.
View 9 Replies View RelatedI followed this article How To Network openSUSE 11.4 And Windows to network wired (ethernet) windows xp and wireless opensuse 11.4 and everything is working great. i can see windows from opensuse and opensuse from windows but have a few questions.
First, when i got to the section to Open firefox or Konqueror and in the address bar type localhost:901 and press the Enter key in articles photo it shows i should have, home-globals-shares-printers-wizard-status-view but i only have home-status-view-password in my firefox when i typed localhost:901, is that all i should have?
is there a way to directly open the executable text files in ubuntu without that annoying msgbox asking us to display or run in terminal mode...
View 1 Replies View RelatedIs there a linux program I can use to extract audio, tweak it and then re-insert it into the video portion? I guess there will have to be a way to also sync the audio and video.
View 2 Replies View RelatedI'm trying to rsync files and directories from a RedHat linux host(v 4.5 & 4.7) to a Windows server 2003R2 Standard Edition with cygwin running. I'm executing the rsync command from the cygwin shell. The transfer involves rsync'ing approximately 1 TB of data from the linux server to the windows server. After about 280+GB of data transfer, the transfer just dies.
There seems to be no particular file or directory that the transfer stops at. I'm able to rsync GB's of data from other linux hosts to this cygwin server with no problem. Files and directories rsync fine.The network infrastructure is essentially the same regardless of the server being rsync'ed in that it is GB Ethernet running through Cisco GB switches. There appear to be no glitches or hiccups across the network path.
I've asked the folks at rsync.samba.org if they know of any problems or issues. Their response has been neutral in that if the version of rsync that cygwin has ported is within standards then there is no rsync reason this problem should happen.I've asked the cygwin support site if they know of any issues and they have yet to reply. So, my question is whether the version of rsync that is ported to cygwin is standard. If so, is there any reason cygwin & rsync keep failing like this?
I've asked the local rsync on linux guru's and they can't see any reason this should fail from a linux perspective. Apparently I am our company cygwin knowledge base by default.
I want to run rsync on server A to copy all files from Server B when they are newer than 7 days.(find . -mtime -7) I don't want to delete the files on Server B.
View 2 Replies View RelatedI'm wondering if there is anything I can do to get the best speeds possible. I pay for 16mb/s connection (with charter) and I was getting about 4mb/s. After upgrading firmware, and changing some encryption settings on my router, that went up to about 6mb/s. It's improvement, and I'm happy with that, but I'm looking for that 10 more mb/s
So, is there anything in Ubuntu to tweak to optimize connection speeds? Also, if it affects anything, I'm using a linksys WRT320N router. I was going to use the 5.0ghz band, but my wireless adapter is an 802.11gb, so I'm stuck with 2.4.
I've recently switched from Windows to Ubuntu and have a question regarding tweaking the character order Nautilus uses for alphabetical sorting. In my music/graphics/etc folder hierarchies, I have used a hyphen at the start as a 'hack' to 'sticky' some folders above the rest for quicker access. This worked fine in Windows, but Nautilus ignores a hyphen in it's sorting calculations. Is there anyway, simple or complex to replicate this behaviour in Nautilus?
View 4 Replies View RelatedHas anyone had any experience on using SUA(Services for UNIX Applications) rsync to "pull" files down to the Win2k3R2 server from a linux rsync host?I was trying to use cygwin rsync before until I found out from cygwin that the cygwin port of rsync was "flakey" and would fail intermittently for no apparent reason. cygwin suggested I use SUA or SFU for rsync services.
I've looked for/ am looking for any experience using SUA rsync to copy files down from a linux rsync host to the Windows host via rsync on the Windows host. Also, if you have done this successfully, do you have any pointers/caveats you can share on how you got it working? What I am basically looking to do is copy files and subdirectories of files from a linux host using rsync to some static location on a Windows server on a scheduled basis so that I can backup the windows server to tape using Symantec's Backup Exec application.
I'm doing it this way to avoid deploying the Remote Agents for either linux or Windows on the target hosts. As an alternative I've seen reference to a product called DeltaCopy that uses a native Windows rsync port with the native linux port of rsync to do what I need also.I realize this is not a strictly linux question, but more of a hybrid as I'm moving data to and from Windows and linux hosts. So, if this is too Windows-y a question, please say so and I'll withdraw my question.
I installed Natty Narwhal from a pendrive I set up, which was a bit of a messy install to begin with. However, after booting into Ubuntu, this application called "Install RELEASE" appears. When I run it, it shows up just like I'm installing Ubuntu again. After following it through, it will stop and say that it must unmount /. It offers two options, Go Back, or Continue. Picking either does nothing. This hasn't seemed too big an issue. I can still run it fine. However, the Software Centre is an issue. Whenever I try to download something from it, I get this error:
[Code]...
Thought I'd post it here because it's more server related than desktop... I have a script that does:
[Code]....
This is used to sync my local development snapshot with the live web server. There has to be a more compact way of doing this? Can I combine some of the rsyncs? Can I make the rsync set or keep the user and group affiliations? Can I exclude .* yet include .htaccess?
When I run rsync --recursive --times --perms --links --delete --exclude-from='Documents/exclude.txt' ./ /media/myusb/
where Documents/exclude.txt is
- /Downloads/
- /Desktop/books/
the files in those directories are still copied onto my USB.
And...
I used fetchmail to download all my gmail emails. When I run rsync -ar --exclude-from='/home/xtheunknown0/Documents/exclude.txt' ./ /media/myusb/ I get the first image at url.
root 24527 0.3 0.3 92180 23812 ? Ss Apr13 2:30 rsync --server --sender -logDtpr . /
I found this process running, OS is RHEL 5.4 64bit.
I attempted today to Rsync data from 'serverold' to 'servernew' and also delete data on 'servernew' that has been deleted / removed from 'serverold'. When I run the Rsync command I get the following error:
[Code]...
rsync warning: some files vanished before they could be transferred (code 24) at main.c(1042) [sender=3.0.7] why this is not working? Is my command syntax wrong or missing switches? I read the 'Man' page and gathered this would be the correct command but I could be wrong.
I have two servers. #1 is the main server and #2 is only used in case the first one is down. Both of them are in the same LAN. Both are debian Lenny configured the same way. For instance, if #1 has a problem, I simply disconnect it, set #1's IPs to #2 and I have my system ready. The only matter here is that there are plenty of files that need to be syncronized between #1 and #2. I thought that rsync was the answer to this problem I have.
I wanted to create a bash script that runs every day (with cron) and syncs the files I need (.conf, and other data). I used ssh-keygen to generate a pair of keys in order to login SSH without a password. The problem is that the permitRootLogin is set to yes in my sshd_config in both servers. So I can't log in directly as root by ssh. But I need to log in as root to be able to rsync the files between the servers because some of them are .conf files and aren't accesible for non-privilege users (Only root).
I switched last summer from Windows (used it since Windows 95) to Debian. I'm using Debian Jessie for a couple of months now and I'm getting used a little.
There are problems here and there, but I can solved them with some reading on the web. Not really a big problem...till now
I run Debian 8.2 om my PC (PC1). Bought an older PC (PC2) that I want to use as a backup server.
I'm using PC2 only for making backups, after the backup I switch it off again.
So I installed Debian 8.2 (net-install without DE and with SSH) on PC2 and tried to configure it to let it work as my backup location. Made a public SSH key and exported it to the root account (no problem) and to the user account (sensdeb), but there was an error "Access Denied"
Gave the user (sensdeb) sudo-rights via visudo file
# User privilege specification
root ALL=(ALL:ALL) ALL
sensdeb ALL=(ALL:ALL) ALL
I installed rsync.
The problem is that Rsync only works when I use the root account.
Code: Select allrsync -r -n -t -v --progress --delete -u -l -H -s /media/Data/Mp3/Anastacia root@192.168.1.102:/test/Mp3
When I try to sync with he normal user account sensdeb
Code: Select allrsync -r -n -t -v --progress --delete -u -l -H -s /media/Data/Mp3/Anastacia sensdeb@192.168.1.102:/test/Mp3
I get error's. Access Denied
I don know how to give the user sensdeb the rights so that I can use that account for my backup tasks. Now it's possible to sync with the root account, but that should not be the way to do it, I read many times.
This should be a quick one. I'm trying to backup a single directory and it's subdirectories on my Lucid Server to a freenas box across my network. This is what I'm using to do that rsync -r -a -v -z * --delete freenas: DSIBackups..It almost works perfectly except for one problem. When a file is deleted at the source, this command doesn't seem to delete it on the receiving end. I assumed that the --delete would do that but aparently not.
View 1 Replies View RelatedI'm trying to set up my trusty Fedora box, with rsync over ssh to backup my windows machines at home and I need help configuring the rsync server (I'm using DeltaCopy as the rsync client on the windows side)I tried a few dry runs but it seems windows can't see the linux box, the rsync job just hangs for ever and never does anything.I should mention that ssh works fine.
View 3 Replies View RelatedHow I use rsync to setup server from any existing server, that I want to create server from my existing one server where I have installed and tune everything, I want everything replecate on new server excluding network (IP) and /proc
View 2 Replies View RelatedMy rsync takes backup of everything from the differenct linux servers to my backup device which is 2 TB only .Since it takes almost full backup of source , it consumes space lot in the backupdevice. So i wanted to keep all my backup files of one month old latest files in backup device, it should remove all files more than one month data.
View 2 Replies View RelatedIs there a way to limit the amount of data that goes in to an rysnc log. The problem I have is that I email myself the log file to make sure it went ok but sometime the log is hugeHere is what I am doing with rsyncrsync -azHK --delete-after /home/ /mnt/usbbackup/home/ >/backup-log/backup.txt
View 1 Replies View RelatedI try use Rsync authorized by LDAP, but seem as this way is not available. Is that true?
View 2 Replies View Related