General :: Command Running Multiple Jobs On Servers
Jul 26, 2010
How to submit multiple jobs onto a Linux server. The only way I know to submit and run a job on a server is using qsub, and verifying the status of the job using qstat. I usually run my scripts using qsub -cwd so that I can run it on my own directory (instead of having the results sent to a scratch folder).
1. However, assuming qsub/msub are not available, is there another way to do it? What commands can I use instead?
2. I know that some jobs can run in the background, is that an alternative? How do I do it? And would I still be able to check the status of the job or delete it?
I am having a shell script which runs perl jobs.The script is starting the perl jobs when it is executed manually from the command line , but when the same script runs from crontab it is not starting the perl jobs.I have these things in the begining of the script
I just found out that jobs -l and man jobs produce no output in my terminal. how could I fix that? How could I install jobs command and its manual on my ubuntu 10.10 ?
run a cron job to download my email logs to my laptop. But the question is HOW? Im not sure how to write the php script for the cron job. the file is on "computer A" and the file is setup to chmod I just need to know how to write the php to "access" the other computer and then download the file to a certain file on my laptop.
I know that bash can suspend and resume processes, but I am interested in forking and resuming them from different bash instances. So, for example, forking a gui app started from the console so that it will not crash when the terminal is closed. I currently know about screen, which can work, but I was wondering if there was a way similar to Ctrl+Z, bg and fg.
I've got an intel i7 920 CPU. It has 4 cores, but thanks to hyper threading technology each core could run 2 threads so in /proc/cpuinfo it shows "8 processors".
1. what would be the optimal -j flag when compiling programs on my CPU. I've come across -j7. Why 7?
2. Where and what would I put this flag to make it permanent (eg. .bashrc?)?
I currently am running 10.04.1 and have successfully setup my home web server to run a single website. My current settings are:
-I have registered the domain name annarrankings.com through godaddy -A record is - host = @ and points to = 71.114.220.3 -CName is - host = www and points to = @ -on my server I have the site running in /var/www
I've done some research and found that to run multiple websites I need to setup VirtualHost.
-So I created a folder /var/www/annarrankings.com and moved my site to that folder
-Edited Apache2.conf to add the following line
-I then went to /etc/apache2/sites-enabled and copied the default file to a new file called annarrankings.com. Here's the annarrankings.com file after I edited it
-I then created a link in /etc/apache2/sites-enabled to the annarrankings.com file in /etc/apache2/sites-available
-Next I editied /etc/hosts
-When i went to enable the site using a2ensite annarrankings.com I got the following
I figured this was ok since I had already created a symbolic link earlier (a result of trying to following multiple tutorials and ..... videos at once) so I reloaded apache2. I created an index.html file in /var/www/ just for testing purposes and when I load www.annarrankings.com I get the file located in /var/www/ instead of the website located in /var/www/annarrankings.com Do I need to change my A record or CName in godaddy or did I just do this completely wrong?
This may sound stupid but I've got to ask. Can I connect multiple computers running Ubuntu & run software from one computer from the other? I know how to connect using SSH & to copy files back & forth but I don't know how or if I can share programs.
It is correct, I want it to execute every minute. Now, I copied the same script to ubuntu maverick, and it doesn't run. Perhaps there's some ubuntu peculiarity that I'm not aware of?
I'm looking at setting up a couple automated systems: Here are a few examples:
* Internal accounting system to download and process emails * Public web server to visit
I could put each system on its own separate box -- for example, it's generally good practice to separate anything that external users have access to (such as a webserver) from internal processes such as accounting. Now, rather than dishing out the money for two separate servers, could I get away with just installing new instances of VMWare on the same box for each system?
To give you an idea, these are not large scale computationally sensitive systems. The accounting one is simply downloading and tallying emails, and the latter is just a webserver with maybe 5 hits per day on a good day. I could definitely pick up a new box for say $50, but I wanted to know the general practice of using VMWare on the same box versus two separate boxes.
I have a XEN DomU VM running Lenny and set up using debootstrap. I also have the TimeWentBackwards issue sorted using: [URL]. The problem is that my cron jobs just don't run. I've set up a cron job that simply echoes a date string to a file as a tester but it's not running. I've tried it under the root crontab, in /etc/crontab and set up in /etc/cron.daily. Is there something I'm missing?
What you do if the job takes a long time to finish and you don't want to wait.Say, I ssh to a remote server from my laptop and start a long-running job. Then few hours later I ssh again and inspect how did job run, its uotput and etc.
I tried using the jobs command in bash in F14 but nothing happens.
Code: [root@Fedora ~]# jobs -l [root@Fedora ~]# Code: [root@Fedora ~]# which jobs
[Code].....
If jobspec is given, output is restricted to information about that job. The return status is 0 unless an invalid option is encountered or an invalid jobspec is supplied.
If the -x option is supplied, jobs replaces any jobspec found in command or args with the corresponding process group ID, and executes command passing it args, returning its exit status.
Is the jobs command dropped for the ps command instead ?
i'm trying to setup my server box.. it's being setup as a web server, file server, and setup for me to be able to access it remotely (aka i do pc repair for windows users and it'd be nice to just know where ALL of my software tools are and get to them from there)anyways.. these things are almost all setup right now.. but the one thing i'm having issues with.. is the fact that this box does have 2 hard drives in it and i want to use both of them.. now i'm running straight command line and i can't find the info i need to reformat the second HDD (which is currently NTFS formated) and use it in this system... i'm running 9.04 as a server.. NO GUI INSTALLED! i need this with straight command line...What do i need to look for to figure this out? i'm having trouble figuring this out and it's really getting annoying..
We are running RHEL 5.1 on the 2.6.18.53 kernel. We are attempting to pass print jobs to a Lexmark printer with the lp -o landscape command. The print jobs continue to print "portrait". Is anyone aware of this issue and is there a work-around to get these print jobs to print in landscape format?
Have a headless server running Lucid 64 bit. Everything is working great except for a couple of Cron jos I'm trying to have run at boot.
My user crontab looks like this: # m h dom mon dow command 01 * * * * /home/ceallred/Scripts/SambaBkup.sh @reboot /usr/bin/SpiderOak --headless &The SambaBkup script works like clockwork...
The SpiderOak job doesn't start. It works if I type the command in manually. syslog only shows:Jul 13 22:45:33 RavenWing cron[1010]: (CRON) INFO (pidfile fd = 3) Jul 13 22:45:33 RavenWing cron[1022]: (CRON) STARTUP (fork ok) Jul 13 22:45:33 RavenWing cron[1022]: (CRON) INFO (Running @reboot jobs) Jul 13 22:45:33 RavenWing CRON[1048]: (ceallred) CMD (/usr/bin/SpiderOak --headless &)Yet ps -A doesn't show a running SpiderOak process. It shows after starting manually.
I recently set up exim so that I could test emails sent from my php sites. I have now been getting daily emails that either report errors from cron jobs or report a failure to send emails to root@cory-laptop or cory@cory-laptop about cron errors.I first of all don't want mail sent to the above addresses, because they are obviously not actual email addresses. Second, I'd really prefer not to get emails when an email failed to send to these addresses.
Is there any way to have x server on multiple shells at a time?(eg. Sally is logged in on shell 6 with her own desktop cube while Rob is logged in on shell 7 with his own desktop cube, etc)
We're using condor at work to have cluster processing of java jobs. I know how to tell condor to require that a given job should be run on a particular slot. You can put on the Requirements string in the submit file a "Name" value(s) -->
Example: Requirements = ".. Name == slot1@host*.domain.net || Name == slot2@host*.domain.net"
Which would tell condor to only run that job on slots 1 or 2. But what I need next is some way to have condor modify the arguments string depending on the slot it used. Our condor blades have 8 slots per machine but only two CUDA Tesla cards per host, so I want to dedicate slots 1 and 2 for using the Teslas and slots 3-8 for not using CUDA.
My java code has a java '-D' property so I can tell it to use CUDA or not, but then I have to have a way to configure condor to append that to the job arguments if the slot is 1 or 2 or not append it otherwise; So I want this arguments list passed for slot1 or 2
"Main.start -Djava.library.path=/usr/local/cuda/lib64 -Dcuda" and this for slots 3-8: "Main.start -Djava.library.path=/usr/local/cuda/lib64"
I don't want to just make the developers hack their submit files to put the -Dcuda on the arguments line in combo with their adding the Name entry for slot1 | slot2 because that seems error prone to me. I want condor itself to add the JVM -Dcuda argument when it's slot 1 or 2 to reduce errors because these jobs take a long time and a mistake wastes lots of time.
Performing commands in multiple subdirectories simultaneously. I'd like to run a program I've copied into every subdirectory which takes *.in files in the current directory as input files. I can find the program, but how do I tell it to run when I've found it?
In a script I am writing I am trying to add logic so that the script can figure out if a remote server uses rpm or dpkg and then run the appropriate command to print a list of installed packages. This works locally, but I need to get it to work through SSH and I have no idea how to do that. The relevant portion of the script is below. It would also be nice to find a way to not need the full path to the executables but I'm not real concerned about that.So anyone know how to make this code work via SSH?
Code: if [ -x /usr/bin/dpkg ]; then dpkg --get-selections
I've set up a cups printing server using ubuntu 10.04.1 LTS. The printer's a HP Laser Jet 1018 I can connect to it over vpn using openvpn from my netbook which is also running ubuntu 10.04.1. I can connect to the printer all right and test page prints without a problem. But if I try to print anything else, it take at least 5 minutes before the job is successfully send and printed out.
Also, on the client side, for example, the file size would like 500k, and when it finally prints out, the file size on the server side is less than 10k. The file is a black and white document, and from what I can tell, the printed page is not missing any information.
