Using rsync, which switch will allow rsync to suppress the "skipping non-regular file" messages in the output while still being reasonably verbose for everything else?
View 1 RepliesAccording to the man page, rsync should copy "special" and "device" files if the corresponding options are set. Also the man page says that the -a option (--archive) includes the -D option, which is "same as --devices and --specials". BUT We use the -a option, and still get the following in our report:
skipping non-regular file "pristine/dev/full"
skipping non-regular file "pristine/dev/null"
skipping non-regular file "pristine/dev/ptmx"
[code]....
Is this the expected behavior? (BTW this is copying a non-running linux-vserver called 'pristine')
Generally SSH related log messages are logged in /var/log/messages file. Is there a way to log them in another different file? I mean is there some configuration setting to enable this?
View 7 Replies View RelatedI am trying to use rsync to keep 2 machines in sync. I get the following error sometimes. If I rerun the rsync it usually works.
IO error encountered - skipping file deletion
For backup purposes, I have been trying to find out a solution for Rsync -avr sourcefolder targetfolder with Skipping 0 bytes files option.
However it seems that they are no solutions. Would someone have an idea, to skip to source files into the sourcefolder that have no content, ie. 0 bytes?
I'm getting 10000000's of syslog messages :
"eth0: PHY reset until link up"
- I have wireless and don't normally use an ethernet cable. From Googling round I found this bug report https://bugs.launchpad.net/ubuntu/+s...ux/+bug/270184 which appears to match the problem, however I do not feel happy/competent enough to recompile the driver as suggested in the bug fix. Is there a way to configure the driver so that it only tries the eth0 connection a limited number of times? This is Ubuntu 8.04 2.4.26-27 and SIS 191 chipset
I am running this command,
Code:
rsync -vrl --progress --stats --perms --delete --exclude '*~' --exclude 'Music' --exclude 'server' --exclude 'Downloads' --exclude 'Ubuntu One' --exclude 'Videos' /home/dave/ /media/server/backup/desktop/dave
It transfers files that remain unchanged. The one that I notice every time is
Code:
.VirtualBox/HardDisks/anOS.vdi
I have several OSes installed in VirtualBox, so this takes a very long time.
On both my 32-bit laptop (openSUSE 11.3) and my 64-bit desktop (openSUSE 11.2) I have been unable to find out how to prevent seeing all the "hidden files" when opening files in many applications, including (for example) GIMP, Xournal, OpenOffice, gedit.In the Control Centre "File management" options "Show hidden and backup files" is NOT checked in "File Management Preferences.
View 2 Replies View RelatedI am currently facing a problem with rsync (or maybe ssh, I don't know yet). I have daily backups that are done via cron using rsync from my computer (client) to a NAS. And systematically during these backups my computer completely freezes (no remote login possible, nothing), so I have to hard reboot. As you might imagine, I cannot do this every day. In /var/log/messages there is just a line like that :
Feb 26 17:23:53 eggplant rsyslogd: -- MARK --
right before the hang. The rsync worked well before and I don't really know what changed in my system config. In /var/log/rsyncd.log I sometimes (but not every time) I get :
2011/02/26 16:39:19 [13229] rsync error: received SIGINT, SIGTERM, or SIGHUP (code 20) at rsync.c(543) [Receiver=3.0.7]
I aldready update the default rsync from opensuse 11.3 to 3.0.7.7, but it does not help. How can I at least know what is going wrong? I am trying to track down the problem but don't know how to start. Last also a log of the rsync command (client) running ssh in verbose using the command "rsync -av --delete --timeout=180 -e "ssh -v -p xxxxxx -i /root/.ssh/rsync-key_eggplant" /mds root@xxxxxxxx:/volume1/autoBackup/eggplant":
OpenSSH_5.4p1, OpenSSL 1.0.0 29 Mar 2010
debug1: Reading configuration data /etc/ssh/ssh_config
debug1: Applying options for *
[code]....
How can we do a simple match by regular expressions on two filenames. I plan to use it in the command 'find -regex'
Code:
hosts.txt
ipaddress.txt
I have been using comm to compare two simple column lists, and suppress items that were contained in the second list (suppression list). This was extremely simple and basic, however now list1 has two columns, and I must compare the second column in list1 with my suppression list.
Basically I need to compare my user list and suppression list to suppress any users that exist in the suppression list, then remove the second column (md5).I wasn't sure the fastest way to make comparisons if there was a similar command like comm, or if I needed to create an array of users and see if any of them matched the suppression list one by one. This seemed like it would be pretty process intensive. Anyone have any less cumbersome ideas?
Referencing a previous thread in which a similar problem exists:[URL]Currently I am using grep -ivf a.txt b.txt > c.txt to get what I need.
a.txt:
user1@domain.com
uSer2@domain.com
[code]....
Write a script that will take a list of filenames as arguments and output a count of how many of them are regular files, and how many of them are scripts (if the file is executable, it will be assumed to be a script file)
Counts always come back as 0
I made a shell backup script that uses Rsync and I am trying to get rid of the password prompt because it will use a CRON to run. I have set my variable in my shell script at:
PASSWORD_FILE=rsync_password
And the password in that file only takes up 1 line.
However when I run (ignore $DESTINATION)
rsync -aRvz tmp $DESTINATION --password-file=$PASSWORD_FILE
It still gives me the prompt. How can I accomplish this? I cannot allow a prompt and I do not want to have to use keys.
I'm going to be using this command to back up my files:
Should I change anything or is it ok?
I want to copy a big file from my harddrive to a removable drive by rsync. For some other reason, the operation cannot complete in a single run. So I am trying to figure out how to use rsync to resume file copying from where was left last time.
I have tried use the option --partial or --inplace, but together with --progress, I found rsync with --partial or --inplace actually starts from the beginning instead of from what was left last time. Mannually early stopping rsync and checking the size of the received file also confirm what I found.
But with --append, rsync starts from what was left last time. I am confused as I saw on the manpage --partial, --inplace or --append seem to relate to resuming copying from what was left last time. Is someone able to explain their difference? Why --partial or --inplace do not work for resuming copying? Is it true that for resuming copying, rsync has to work with option --append?
Also if a partial file was left by mv or cp not by rsync, will rsync --append correctly resume the file copying?
I regularly rsync directories to an external usb drive. Recently I've started getting errors which look:
blah blah:Read-only file system (30)
The external usb drive has two partitions (ext3 and fat32) and I rsync to the ext3 one. The rsync command is
rsync -ahi --delete /home/mike/some_dir /media/usb_drive
People have reported this error with faulty usb cables but everything was working fine until recently so it seem unlikely a usb cable would suddenly wear off.
i am trying to transfer a file from my live linux machine to remote linux machine it is a mail server and single .tar.gz file include all data. but during transfer it stop working. how can i work and trouble shooot the matter. is there any better way then this to transfer huge 14 gb file over network,vpn,wan transfer. the speed is 1mbps,rest of the file it copy it.
rsync -avz --stats bkup_1.tar.gz root@10.1.1.22:/var/opt/bkup
[root@sa1 logs_os_backup]# less remote.log
Wed Mar 10 09:12:01 AST 2010
building file list ... done
bkup_1.tar.gz
deflate on token returned 0 (87164 bytes left)
rsync error: error in rsync protocol data stream (code 12) at token.c(274)
building file list ... done
code....
How can I disable ICMP messages through the configuration file of /proc/sys/net/ipv4/ICMP_echo_ignore_all Also how the above file can be edited?
View 1 Replies View RelatedI am facing a problem while trying to log SSH messages in a separate file, say, /var/log/ssh_logs. I have tried modifying the syslog-ng.conf file as follows:
filter f_ssh { facility(auth, authpriv) and match("sshd[[0-9]+]:"); };
destination d_ssh { file ("/var/logs/sshd_logs"); };
log {
[code]....
But still I am not able to get the ssh logs in the new file. They continue to go to /var/log/auth.
I have a samba file server that has Windows XP machines connecting to it. Fairly regularly, I get messages such as the following. Are these anything to worry about? What do they mean? Nobody ever has problems with disconnecting or losing their mapped drive or their desktop shortcut not working.
Code:
Nov 15 15:37:21 servername smbd[27516]: [2010/11/15 15:37:21, 0] lib/util_sock.c:read_socket_data(384)
Nov 15 15:37:21 servername smbd[27516]: read_socket_data: recv failure for 4. Error = No route to host
[code]....
I received the following output from an rsync (3.0.0) command that was executed:
sending incremental file list
sent 77214 bytes received 484 bytes 155396.00 bytes/sec
total size is 254531170 speedup is 3275.90
What does "sending incremental file list" mean?
We're in the process of implementing an offsite backup of all our servers to a remote Linux server. We're using rsync over ssh.What I've found is that characters such as ±, ¶,´ and £ are replaced on the Linux server with underscores.I don't mind if it changes these characters in the filenames of documents, but when it renames a language pack from Espa±ol.clx to Espa_ol.clx, it could cause issues for us further down the line.
What do I need to do differently to make the special characters copy over correctly? For the initial sync which will take place locally, before the machine is moved offsite, I have SAMBA enabled. I am able to copy files from Windows to the Samba share, retaining the original filename, though it looks different in the Linux directory listing, i.e. t̻st becomes ĻstThese files get deleted by rsync when it runs, as it does not match the filenames.
I have never used rsync before, only DD. But from what I have been reading, rsync is better becasue it will basically mirror your hard drive, thus being able to run the cloned software from the new hard drive. My problem is I do not know what is the best commands or even the basic commands to use in rsync. I am trying to make an image from a external hard drive to a usb drive. That way my chances of messing up he original software is not as risky becasue I'll just restore the image onto another hard drive. Does anyone know the best script to have rsync make an image file of a hard drive and place it on a usb drive and then restore it?
View 8 Replies View RelatedI'm configuring an rsync between 2 machines, A_Server --> B_Server, using the following script:
Code:
#!/bin/bash
#
# Script de backup a trav�s de Rsync desde RMP-1 hasta RMP-2.
#
[Code]....
The Rsyn is working OK. What i need is to change one of the lines of the /tmp/prueba.txt before sending it to the remote machine (obviously not changing the file in the local machine), i mean, send prueba.txt to the remote machine deleting one line and adding another one...how can i do this?
All my torrents go to my home/username/Download/ folder, I could read/write yesterday but now I cant even copy the files to a flash drive.The error i get is "Cannot create regular file '/home/username/Download/file' : Read only file system.
View 14 Replies View RelatedI made a script to backup file from each host with general password in local network. This script using SSH Pass and Rsync with this
syntax:
rsync --rsh="sshpass -p password ssh -l root" hostath destinationpath
Everything is okay under 9.10 version until I migrate to Ubuntu 11.04, there is always give an error:
rsync error: received SIGINT, SIGTERM, or SIGHUP (code 20) at rsync.c(541) [Receiver=3.0.7]
I am using bash version: GNU bash, version 4.2.8(1)-release (i686-pc-linux-gnu) and 2.6.38-8-generic kernel
How to suppress "Do you want to overwrite" prompt while using cp command. I tried "cp -fr", but it isn't worked
View 4 Replies View RelatedI'm trying to backup a drive with an LVM2 partition. 8 of the 10 partitions in the LVM restore fine, two do not. SDA1 is the boot partition, SDA2 is an LVM2 partition with 10 partitions inside of it. When I restore the image created by Clonezilla the partition names are there but two of the partitions are unreadable and unmountable. I'm certain Clonezilla is skipping these two partitions because its entire image is around 40G and when I TGZ these two partitions I get an 80GB file. Clonezilla doesn't appear to give any errors and as it "winds up" it shows that it's unmounting the LVM partitions and I see my missing two in its list but when Clonezilla makes the image it never mentions the two I (really) want. I'm trying Clonezilla's DD method right now but it appears to be DDing each partition (going through the LVMs right now).
View 1 Replies View RelatedI'm working on a ~1 TB disk that was loaded with all kinds of images and documents that lost it's HFS+ partition table. The person for which I'm doing the favor of running scalpel says it's likely there's 90GB of stuff. Somehow, the disk got relabeled/MBR changed to some FAT variant that works on the whole Terrabyte.
Attempts to recover the partition info failed.My first try with scalpel finds more than 90GB of image file headers alone and that blows through all of my storage. Of the headers found and recovered as images, a simple test shows most of the image files are broken. The cluster size option does not work if I use it by itself. It errors out before it gets going.I want to speed things up and skip the countless broken image files.