<div dir="ltr">FYI.<br><div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">---------- Forwarded message ---------<br>From: <b class="gmail_sendername" dir="auto">Leslie Hart - NOAA Federal</b> <span dir="ltr"><<a href="mailto:leslie.b.hart@noaa.gov">leslie.b.hart@noaa.gov</a>></span><br>Date: Wed, Apr 17, 2019 at 7:23 PM<br>Subject: Running Complex Jobs Under Slurm<br>To: _OAR RDHPCS theia-notify <<a href="mailto:rdhpcs.theia.notify@noaa.gov">rdhpcs.theia.notify@noaa.gov</a>><br></div><br><br><div dir="ltr">
<div>Dear Users,</div><div><br></div><div>We consider a complex job to
be any job that requires more than one executable within a single MPI
execution, a job that requires a varying number of tasks per node or a
combination of both. During the Quick Start Training, we suggested using
Heterogeneous Job submission to create a complex job request. After
working with this method for a while, we believe this is the wrong
approach. We now have another recommended method for working with
complex jobs under Slurm.</div><div><br></div><div>We have created two scripts in the /contrib area of Jet and Theia. (We believe these methods will also function well on Gaea, but have only done limited testing there.) One is called <a href="http://arbitrary.pl" target="_blank">arbitrary.pl</a> which allows for varying numbers of tasks per node. The other is <a href="http://layout.pl" target="_blank">layout.pl</a> which allows for multiple executables within a single MPI execution. They are accessible by "module load contrib sutils".</div><div><br></div><div>We
have updated the April training slides to have examples of various
situations that a user may encounter. The updated material starts
around slide 34. The new slide deck is available at <a href="https://docs.google.com/presentation/d/1OhGP1j7Irx61iqDq0jagTWCMRXIGgnUiwNrGfk9NMmM/edit?usp=sharing" target="_blank">https://docs.google.com/presentation/d/1OhGP1j7Irx61iqDq0jagTWCMRXIGgnUiwNrGfk9NMmM/edit?usp=sharing</a>. (These slides are still under development but are pretty close to final.)<br></div><div><br></div><div>We
will have a short (approximately 30 minute) training session on
Wednesday, April 24th at 11AM EDT that just discusses these updates. Details regarding location and webinar information will follow in the next few days. In
early- to mid-May we will repeat the entire quick start training
session.</div><div><br></div><div>Thanks,</div><div>Leslie Hart & Raghu Reddy (and many others)<div class="m_-628952479722956821gmail-adL"><br></div></div>
</div>
</div><br clear="all"><br>-- <br><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div> Dr. Avichal Mehra <a href="mailto:Avichal.Mehra@noaa.gov" target="_blank">Avichal.Mehra@noaa.gov</a> <br></div><div> Lead Physical Scientist NOAA/NWS/NCEP/EMC<br> 5830 University Research Court Room 2104
<br> College Park Ph. 301-683-3746<br> MD 20740 Fax: 301-683-3703</div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div>