Programming :: Running Mysqldumps In Parallel?
Oct 1, 2010
I have a bash script with a line like this in it:
Code: mysqldump -uusername -ppassword --master-data=2 --single-transaction --quick --add-drop-table --add-drop-database somedatabase | gzip > ./somedatabase.sql.gz The problem is, I have about 16 databases I'm dumping like this, but it's dumping
[Code]....
So, does putting in a & after a command work in a bash script at all? The thought was, if I want to run them in parallel, should I do this?
Code: #!/bin/bash
./scripts/dumpthis &
./scripts/dumpthat &
./scripts/dumpsomemore & Where "dumpthis" is just the first snippet of code above.
View 3 Replies
ADVERTISEMENT
Jul 22, 2014
I am trying to replicate what is happening on this page under the tcsh shell, but using the bash shell found in Wheezy. Here is the page I am referring to:[URL] The command I am trying to replicate is on page 6 under figure 2.4. The command is "prompt> ./mem &; ./mem &".
I would like to run the same program twice, concurrently, but do not know how. Note that I am not trying to use a bash script, but rather by simply using syntax on the command line.
View 4 Replies
View Related
Apr 29, 2011
I have a script which basically does many tasks and most of them can run in parallel. The server it runs on has 4 cores, so I changed parts of it to a makefile, and then run them with "make -j 4" which helps a lot. But looking at "top" while it runs, I see it could be improved. Sometimes tasks wait for other servers, so a higher -j value would help. And sometimes multiple tasks are waiting on the same disk, then I think a lower -j value would be better.
The kernel is fairly good at sharing CPU time among the cores, but resources like memory and disks are not shared very well. As an experiment, I tried compiling the kernel with "make -j" with no number. It didn't go very well.
So I wondered if anybody know of a better tool for things like this. I think it should be possible to write something that could change the -j value while it runs.For example:
- Start as many tasks in the background as there are cores. When tasks finish, start another one until done.
- After a little while, check CPU and memory usage to decide if more tasks could run in parallel. Or maybe less?
- If different tasks iowait a lot, check if they wait on the same disk. If so, renice/ionice/suspend some of them. In these situations I think it's better to have them run one after another.
- Other ideas?
I thought of making a script like that, but I doubt I'm the first one with that problem. Also, there are probably lots of things I haven't thought of.
View 5 Replies
View Related
Apr 5, 2011
Does Debian 6 "Squeeze" automatically run boot processes in parallel if not how do I
configure it to do so. Here is the quote from my /etc/init.d/rc :
# Specify method used to enable concurrent init.d scripts.
# Valid options are 'none' and 'makefile'. Obsolete options
[code]...
View 2 Replies
View Related
Apr 5, 2010
I am a newbie user in Linux. I have installed a package were it has EMC2 software but when I run it shows parallel lines on the screen while running? What is the cause for it ? Should I reinstall ubuntu again? I had taken a screen shot and it will tell you what I really mean? This is the screenshot, [URL].
View 1 Replies
View Related
Nov 27, 2010
I use an application called redbutton-browser to access some of the things available on the redbutton digital tv channels. It compiles fine if I use a simple make but fails if I try to run parallel jobs with make -j4. I'd like some help altering the Makefile so that it does a few commands sequentially before it does the rest of the Makefile in parallel.
The relevant bit of the Makefile looks like this:
Code:
ISO13522-MHEG-5.c:xsd2c.c ISO13522-MHEG-5.xsd add_instance_vars.conf add_rtti.conf
make xsd2c
./xsd2c ISO13522-MHEG-5.xsd
./add_instance_vars ISO13522-MHEG-5.c ISO13522-MHEG-5.h
./add_rtti ISO13522-MHEG-5.c > rtti.h
[Code]....
View 7 Replies
View Related
Feb 25, 2011
I am doing a project where 2 clients connect to server and communicate (chat) and transfer data one after other using sockets. I have working code for this in C language. Now our main aim is to create a communication link where two clients transfer multiple streams data parallely. To be more precise i want to transfer images files and audio files parallel at same time, so is it possible to send data parallel using one socket connection?
View 3 Replies
View Related
May 29, 2011
i want to know whether we can write a shell script which can utilize 2 CPU's of a cluster...I heard its possible through C Shell [URL] But im familiar with bourne shell only....So is there a possibility to write Parallel Scripts.
View 5 Replies
View Related
Mar 18, 2010
I need to spawn 2 processes in parallel and each takes an hour or so to finish. Is the following one of the correct ways of using `at` in a script run by crontab?
Code:
#!/bin/bash
# define the env var, cd, etc... assume everything ok up to this point
date +"The start time is %H:%M:%S"
rm -f a.fin
at now <<END_OF_AT
do_a &> a.log
[Code]....
View 2 Replies
View Related
Jul 29, 2011
I came across some problems. I need to conduct parallel computing on CUDA. I input "uname -a"and read these: "Linux BXSJC 2.6.38.8-35.fc15.i686 #1 SMP Wed Jul 6 14:46:26 UTC 2011 i686 i686 i386 GNU/Linux". I use CUDAtoolkit 4.0. when I input: cd /home/bxsjc NVIDIA_GPU_Computing_SDK/C and "make -i ",the computer returns
[Code]...
View 7 Replies
View Related
Aug 8, 2010
I have a little hardware project and I would like to use the parallel port. I basically want to display status code on top of other custom peripheral on an headless server. I only use output as the display (7 segment) is not part of the device itself. The problem is, the parallel port only have 8 standard I/O pins. I have read somewhere that there is a way to change the mode of the port to enable more data pins using a specification not backward compatible with the "classic" mode (so not enabled by default). I didn't find any other information about this. As I would like to have all 17 non-ground pin to avoid using more circuitry than necessary, how to turn this mode on?
View 3 Replies
View Related
Sep 3, 2010
I'm looking for a way in Perl to be able to take a list of servers, ssh multiple commands to it and store the results. If I do this process serially, sometimes one server will hang the whole script and if it doesn't, it still takes hours to complete.
I'm thinking what I need to do is make a parent loop that calls out a separate process that passes the server name to the child sub process and then executes all the commands I have defined in its own process. If one server 'hangs', at least that won't stop the script from doing all the other servers in the list.
I'm guessing using the fork() command would serve me best, however, all the online descriptions I have found have been vague at best.
View 4 Replies
View Related
Oct 15, 2010
Never done it before, don't know how but its due next week. I am a computer systems student and have been required to built a hardware that will be operated by a program in G++ through the parallel ports. The hardware, thats a piece of cake, the software, now that's were the real problem is. I don't even know were to start.
View 2 Replies
View Related
Jun 27, 2010
I need to make some C program under linux to make some scripts that can talk to my Server's Parallel port by sending some quare signal as high or low, so what i can do ?
View 4 Replies
View Related
Mar 2, 2011
If multiple threads operate on a single shared resource, we can lock it using pthread_mutex_lock. Uptill that it is fine, but why again pthread_cond_wait?
int shared=0; // global
.
.
// Thread 1
pthread_mutex_lock(&mutex);
shared=1;
pthread_mutex_unlock(&mutex);
When thread1 invokes the mutex lock, no other threads can access it in parallel. So why again and what for we use, pthread_cond_wait( ).
View 2 Replies
View Related
Apr 13, 2011
I just can't find... why is my code seg-faulting?
PHP Code:
/*
Code name: Assignment #7.
File name: slice.c
Program name: Matrix multiplication (parallel version).
Version: 1.
[Code]...
Is giving my a seg-fault right at the ending point where I do the final gather from the MASTER processor.
View 9 Replies
View Related
Sep 4, 2009
Is suid disabled from running all home made bash scripts or just from running them as root or:
Who would know for sure.
I googled several combinations of Mandriva Linux how-to suid disabled setUID etc... so far all I found was "many distributions are disabling suid for security reasons" nothing specific.
View 2 Replies
View Related
Jun 1, 2010
My root Vixie cron crontab is set to perform a system snapshot via fsarchiver: 0 0 * * * fsarchiver savefs -o -A /backups/p30_root.fsa /dev/sda2 /dev/sda3 The command itself works fine, generating about a 7G snapshot of my Suse server. I then wish to rsync this to a NAS I have located in another building: 0 3 * * * rsync -av -e ssh --delete /backups/ root{at address}:/DataVolume/os_backups/
(yes, I'm rsyncing as root. I absolutely loathe it, but I got thrown into an quasi-SA position with a ridiculous to-do list and no time to do it. I'm having to make things just work and then go back and try to improve them/learn how. I couldn't make it work in a non-root way quick enough, so for now I'm having to cron rsync jobs as root because of all the differing file permissions on this samba/MySql server. I set the NAS to only accepts ssh from the server IP, and we're behind a campus firewall... It's serious trial by fire.) The crontab also has rsync commands for the samba areas, our specialized chemistry software and affiliated MySQL databases............
View 2 Replies
View Related
May 4, 2011
I have written a c program. And compiled it to make a binary. Now when i try to call this binary from php page, it is not being executed.
View 14 Replies
View Related
Dec 16, 2010
I was using ubuntu before i over to fedora, in ubuntu i had the commandline "hd + nameOfFile". what is the parallel command in fedora??
View 2 Replies
View Related
May 20, 2010
I have a script I would like to run every time a specific folder changes. I want this to be run the instant the folder is changed every time it is changed.e found some information about inotify and it sounds like it would probably do what I want,but am unsure if it can be made to watch only a single folder rather than the whole file system, and I'm unsure of how quickly it works
View 4 Replies
View Related
Nov 21, 2010
I have a script that starts a subshell
Code: #!/bin/sh
local SSPID
clean_exit() {
[Code]....
done so the script waits in the loop for the subshell to finish then does processing and starts over. If I kill the script the subshell is not killed. So I can trap the TERM event and do some cleaning but I need to know the subshell process id.
I'm using busybox so ps does not accept any parameters I cannot source subshell so it can access its parent environment
View 2 Replies
View Related
Apr 27, 2010
I was wondering why this code only returns me the same value ten times instead of valuate the conta+0.1 value code...
View 6 Replies
View Related
Aug 1, 2010
In the code segment below is a for loop I am having some considerable difficulty with. It just keeps iterating endlessly and totally ignores the 70 times limit specified. I can't ever remember having this problem before and am absolutely Clueless.
Code:
for ( x = 0; x < 70; x++ )
{
fputs ("CSN00", target);
fprintf (target, "%d", userid);
[Code].....
View 14 Replies
View Related
Aug 25, 2010
I am executing the script.
with help of cron job but it is not executing in cron job.
i check owner and chmod and create the file and execute manually it is working fine but in cron job i set below
Crontab -e
8 14 * * * /home/tplinux/webapp/tpadminhost/collect_ejxml/ejrename.sh
wq!
after that wait till that time but script is giving message no such file in directory but same thing is excute manually it is running fine and found the files.
Below is my script details
file name ejrename.sh. code...
View 3 Replies
View Related
Nov 17, 2008
I am trying to use perl to run a program using the eval command but the program runs infinitely, i just need it to run basically for one second, stop then give me the output. I tried using fork but it does not really work. The child process is not being killed.
my $pid = fork;
if ($pid == 0) {
my $results = `ngrep etc...`;
[code]...
View 6 Replies
View Related
Apr 1, 2011
I have written a small script from that iam appending the output to a file.If multiple users invoke the same script or if i invoke the same script n number of times (using &), the output file(ZZ/OUT) contains messup information.
++++++++++++++++++++++++++++++++
#!/bin/bash
#
[code]...
View 3 Replies
View Related
May 22, 2010
I have an HTML page that I want to run some PHP code. I found several "How tos" about this but I can't get it to work. The code is very simple:
Code:
cat test.html
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
[code]...
View 14 Replies
View Related
Aug 17, 2010
i want to use java as tool in which i give an input,and on the basis of this input my specific script run. for example.... if we talk about web server.. in my java page..i have to just type my web page name...say [URL] and then enter the text...say "hi how are you"
then my script will run... in the script it itself start the service,then edit the configuration file in /etc/httpd/conf/httpd.conf
and make changes according to my input in java page... i know the scripting but i dont know how java command will execute my script...
View 4 Replies
View Related
Sep 18, 2010
i want to run c graphics program on linux for that i want to install[URL]but i dont know how to install this graphic file on linux to make it un.
View 1 Replies
View Related
