I need to copy a large number of files, it comes to 1 lakh from one server to another. When I tried various commands using scp , ftp etc. It is saying "Arg list too long". In which way can we copy all the files. The Two servers are under Linux.
View 4 RepliesI'm trying to copy files from my current server to a new server. Both servers have SSH installed. These are the commands I'm using. However I'm getting connection refused. I did a google search and found out that maybe the reason of this error could be due to the fact that my current server doesn't have SSH. However I use SSH often on my current server so I can say that it has SSH for sure.
OpenSSH_4.3p2, OpenSSL 0.9.8e-fips-rhel5 01 Jul 2008
debug1: Reading configuration data /etc/ssh/ssh_config
debug1: Applying options for *
debug1: Connecting to IP_OF_CURSERVER [IP_OF_CURSERVER] port 22.
debug1: connect to address IP_OF_CURSERVER port 22: Connection refused
ssh: connect to host IP_OF_CURSERVER port 22: Connection refused
I have a problem while copying files from a remote computer to my local one using the scp command. I am sure that I am using it correctly, please check it below:
---
blah@blah.com:~/g4work> scp blah2@blah2.com:IndirectMethod_Spher...s/H_1.mac.root .
---
What I get in return (instead of the statement saying 100% of file copied) is:
---
On this machine the G4SYSTEM=Linux-g++
---
The interesting point is that the above returned statement is one of the Environment variables set on both the machines that are necessary to work with a toolkit called Geant4. Here is what I get when I type 'printenv | grep G4' just to show you (note the statement in bold):
---
G4LEVELGAMMADATA=/home/blah/geant4/geant4.9.3.p02/data/PhotonEvaporation2.0
G4INSTALL=/home/blah/geant4/geant4.9.3.p02
G4LEDATA=/home/blah/geant4/geant4.9.3.p02/data/G4EMLOW6.9
G4NEUTRONHPDATA=/home/blah/geant4/geant4.9.3.p02/data/G4NDL3.13
G4VIS_BUILD_OPENGLX_DRIVER=1
G4RADIOACTIVEDATA=/home/blah/geant4/geant4.9.3.p02/data/RadioactiveDecay3.2
G4ABLADATA=/home/blah/geant4/geant4.9.3.p02/data/G4ABLA3.0
G4LIB=/home/blah/geant4/geant4.9.3.p02/lib
G4VIS_BUILD_RAYTRACERX_DRIVER=1
G4LIB_BUILD_SHARED=1
G4VIS_USE_OPENGLX=1
G4UI_USE_TCSH=1
G4VIS_USE_RAYTRACERX=1
G4REALSURFACEDATA=/home/blah/geant4/geant4.9.3.p02/data/RealSurface1.0
G4SYSTEM=Linux-g++
G4WORKDIR=/home/blah/g4work
---
The other thing that I would like to mention is that these Geant4 Env. Variables are loaded each time a new (bash) shell is started as a result of the bash login script.
Need Bulk record creating for BIND DNS server. I have information in a file I need to crate a new zone and A-record. I have 10000 domains in a file. Is there any tool available to do this @ one go
View 4 Replies View RelatedI have a server with RedHat distro which stores and updates someg files and second computer with Windows 7 on it. I must configure both machines so one can get those files from server to Win7 machine using ssh. But I have no idea how to do it.
View 3 Replies View Relatedi would like to copy all files from my server001 (/var/www/vhosts/*/httpdocs/) to my server002 (/var/www/virtual/*/htdocs/) i would do it via rsync... but i dont want to do it as root! what would be the right user with which I should login myself via rsync? www-data? its the group of each domain-folder...
Quote:
server002:/var/www/virtual# ls -lh
insgesamt 4,0K
drwxrwx--- 10 vu2001 www-data 4,0K 9. Mär 09:58 domain.com
server002:/var/www/virtual#
but the files inside htdocs are only accessable for the user!
Code:
server002:/var/www/virtual/domain.com/htdocs# ls -lh | grep index.php
-rwxr-xr-x 1 vu2001 vu2001 397 24. Feb 23:30 index.php
server002:/var/www/virtual/domain.com/htdocs#
server002 will be the backup-server if the server001 is down!
I am working with DM355 target board. Here we record. The video coming from IP cameras. Now I have to write c program for copying. The recorded avi files with date and time to NAS server using scp. I wrote a script to copy single file to NAS server.
#!/bin/bash
DATE=$(date +%Y%m%d_%H_%M_%S)
mv Camera1.avi Camera1_$DATE.avi
scp Camera1_$DATE.avi root@192.168.1.4:/root/test/
mv Camera1_$DATE.avi Camera1.av
But I have to write c program for copying multiple avi files with Date and Time to NAS server.
I've been spinning my wheels for a bit on this one not getting any traction. I have a list of pictures that have a bad extension that I would like to rename with the good extension. Here's a snippet of the list that I'm looking at:
listold
Code:
/Volumes/MyFiles/Pictures/2009/02 - February/Qeirstyn Playing Inside/._IMG_3347.JPG
/Volumes/MyFiles/Pictures/2009/02 - February/Qeirstyn Playing Inside/._IMG_3349.JPG
/Volumes/MyFiles/Pictures/2009/02 - February/Qeirstyn Playing Inside/._IMG_3350.JPG
/Volumes/MyFiles/Pictures/2009/02 - February/Qeirstyn Playing Inside/._IMG_3354.JPG
[Code]....
I have a Netgear ReadyNAS NV in the basement, that I want to use to serve up video files over my network to a TV in the living room.
Now, I have a lot of files that HandBrake encoded and it gave the files an m4v suffix. Even when the files are in a codec that the TV can handle, it refuses to load them because of this suffix... so I want to rename them all.
This is fairly simple for files on a local filesystem. I can simply cd into the directory containing the files, and do something like the commands below.
Code:
$ for a in `ls`;
> do
> stem=`echo ${a} | cut -f1 -d"."` ;
> mv ${a} ${stem}.mpg ;
[Code]....
Although there are a few smb commands available (smbstatus, smbget, etc.), I've not found any commands like smbls or smbmv.
Are there any special commands or utilities around that can do the kind of thing I'm trying to do?
I am using my Ubuntu machine to serve as a media server and network storage. The problem I have is iTunes on my desktop managed to make 2 copies of every song on the machine so instead of the 30GB I have its up to almost 100gb. I was wondering if there was a way to write a script to go through and delete the duplicates. The duplicates are the same filename as the original except a 1 or 2 following. Wasn't looking forward to deleting 12,000 files by hand.
View 1 Replies View RelatedI have a new network attached storage unit that I'm trying to transfer my data to. On this NAS, it has a very basic linux installed with SSH enabled. Browsing through the programs installed on it, i found smbclient. Am I able to copy files directly from my old NAS to my new one using smbclient?It would sure beat transfering 950GB from my old NAS through a computer then onto my new NAS.
View 1 Replies View RelatedHow can I copy some files from a windows machine to Linux machine ?
View 13 Replies View RelatedI am running openSUSE 11.2 KDE 4.3.4 on my ThinkPad R51 laptop.I would like to copy 'File A, File B, File C' (for example) that has photographs of a holiday , to a blank CD inserted into my drive and cannot find a way to 'copy and paste' into the volume.
View 3 Replies View RelatedI just read the Linux scp command issue question and it reminded me that I regularily forget to specify the colon in the host part of a scp command, and thus copying a file locally instead of copying to a remote host, e.g. I do
scp foo host
instead of
scp foo host:
But I never use scp to copy a file locally. So I wonder if there is a way to make scp fail if both (the source and destination) arguments refer to local files.
i am accessing linux through putty and i wrote somany programs in unix using putty and gedit but now i need to copy all files into windows. how to copy directory(linux) to folder(windows) without installing any softwares?If it is necessary to install software to copy files then tell me the process of using that software.
View 5 Replies View Relatedi want to copy the latest 10 files from one holder to another. All the files start with the number 2 and this is what i have so far:
lt -lt 2* | head -10
So i want to copy that output of 10 files to another folder
I have 60+ directory's each containing multiple .doc files. I need to move them to a single directory and keep their file name intact. I don't think cp will do that with out listing all the file names. I was thinking of something like: cp -r /dir/*.doc /newdir . Or should I use a combo like find -type *.doc|cp /newdir?
View 5 Replies View RelatedIs there a way to remove users in bulk? Maybe by a range of user id numbers.
I help run a school server for our Linux class. I create temp accounts for tests and now I just want to delete them. I really should delete the old users too but the Professor likes to let them have access even after the class.
I've a directory containing around 2.8 lacs of files. I want to move them to another directory.If I use cp or mv then I get an error 'argument list too long'. If I write a script like
for file in ls *; do
cp {source} to {destination}
done
then because of ls command , its performance degrades.How can I do this?
I am facing problem in copying a large number of file 18 lakh (18,000,000) files from my personal hardisk to another hardisk each file is very small and size of folder is around 3.95 GB copying files using copy given by Windows is frustrating and I am not even able to compress file its giving me error that its not readable.And problem is I am not able to open this drive in Linux it showing me error there saying do diskchk in Windows and Windows disk check is also not able to repair this drive and goes into some mode unsolvable.Is there any way to open disk with error to open in Windows and if not any way I can copy data faster?ERROR: Disk labled EDU is corrupt go to windows and chkdsk /f there and reboot into window 2 times.
View 3 Replies View RelatedHow is it possible that I get perm denied when I'm copying files in console.
View 1 Replies View RelatedI want to copy a .tgz file from my computer to an external hard drive. However, I get the following message:cp: cannot create regular file `/mnt/usbkey/ws_2008/misc/minipar-0.5-W indows.tgz': ermission deniedI get this error with any file I try to copy to the external disk. rnal disk is recognized, when I mount it, I can see the files and folder I have there, but seems that I cannot copy anything to it.When I try to copy the same files from my computer to a usb flash drive, everything works
View 9 Replies View RelatedSuppose I have a tree structure like this:
/home/mahmood/sim/a/b/file1.cpp
/home/mahmood/sim/a/b/file2.h
/home/mahmood/sim/a/c/file3.txt
/home/mahmood/sim/d/file4.txt
How can I copy all of them to /home/mahmood/sim. So that when I run "ls" in /home/mahmood/sim, I see all files:
file1.cpp
file2.h
file3.txt
file4.txt
Can 'cp' search for all file and copy them in another folder?
How can I copy multiple files, each with a slightly different name from the SOURCE in the same directory?
Example: '/home/junk' contains A.txt, B.txt
I want to copy /home/junk/A.txt to /home/junk/A1.txt and /home/junk/B.txt to /home/junk/B1.txt using a single command.
I am trying to find a command which will copy all the files in the folder with extension ".log" which is created one day before the current date. By going through other threads in this forum I found the half solution to this problem
find /mnt/hd -mtime -1 -exec scp {} /mnt/usb ;
This command copying the all the files created one day before(not only *.log) to the /mnt/usb folder. what is the modification required to above command.
I have two USB 2 external hard drives. I want to copy about 30 gigs of data from one to another. What command line command do I use ? I was thinking of using cp with the -R and -n options, but I have no idea what devices to refer to. I can't find any external hard drives in /etc/fstab and I'm not sure what /dev device each USB external hard drive uses. I just want to copy the files and the directories that they are in just as they are. There are no links and I do not want to do a backup.
View 10 Replies View Relatediam trying to scp files between two remote computers, i get the following error:
Host key verification failed.
lost connection
What i am trying to do is : scp u1@ip1:/source_path u2@op2:/destination_path
I am able to ssh into both machines fine, so i know that works. I tried google for this but couldn't make much of the results.
I record my lectures at school using my mobile phone then send them over wifi to my laptop and use a program to do volume correction all in windows. However, I want a exact copy of that folder in my home folder on my ubuntu install on a separate partition.I've been manually copying them over so far but I want to make a script that I can run to copy all new files over. I know a little bit about scripting, mounting the drive and actually copying files is easy, its figuring out how to determine new files and copy only those that I don't know how to do.
View 4 Replies View RelatedI was trying to install openSUSE11.4 using the Live CD. But when it started copying the root filesystem, it hung on 15% and waited forever. The CD stopped spinning too.
View 1 Replies View RelatedDescription: I am a newly appointed system engineer taking care of linux servers. We have a new set of data coming in which need below configuration: How to do a script with function?:
for files with ".txt" in sm
copy each of the files to folder : sm1 and sm2 (log every copy)
if succesful:
remove original
log into the log file
if not successful: (not successful copying 1 particular file to all the folders)
retain and retry
log into the log file
mail out the admin with that particular file name
I have already do try a bit:
cd /export/home/
for dir in sm1 sm2; do
cp -p sm/*.txt $dir/
done
Is my starting right? How to do the rest parts?