This discussion is archived
2 Replies Latest reply: Nov 26, 2012 11:02 AM by 970794 RSS

Q:  how to have multiple executables run simultaneously?

970794 Newbie
Currently Being Moderated
Hi. I'm new to submitting jobs through Grid Engine, and have skimmed users guides, googled, etc., without figuring this out and could use some advice.

I need to be able to submit jobs that will start up several distinct executables that need to run at the same time. If I was doing my work in an interactive shell, I'd just do something like this:

$ foo &
$ bar &
$ baz &

. . .and so they'd all start around the same time, run in the background, and complete around the same time. The executables talk to each other through the output files, and I don't need to do any more than that.

But from what I've read in users guides, I shouldn't invoke processes in the background in jobs submitted to GE; and that makes sense to me, since then the interpreter would reach the bottom of the script while the executables are still running. But submitting

foo
bar
baz

won't work, because those are run sequentially.

The only thing I can think of to do is to separate each executable out into its own job submitted to the queue; but then I need to guarantee that they start executing at the same time.

Any advice would be very helpful. Thanks much.

Legend

  • Correct Answers - 10 points
  • Helpful Answers - 5 points