<div dir="ltr">Zhan,<div><br></div><div>I'm going to start another email chain with fewer people to discuss this. Most of the people on this email chain don't develop pyprodutil. It is sufficient for them to know that a solution exists, that is being resurrected.</div><div><br></div><div>Sincerely,</div><div>Sam Trahan</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, 18 Apr 2019 at 11:24, Zhan Zhang - NOAA Affiliate <<a href="mailto:zhan.zhang@noaa.gov">zhan.zhang@noaa.gov</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div class="gmail_default" style="font-size:small">Sam,</div><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small">Could you point me where is the version of produtil that supports slurm with --multi-prog?</div><div class="gmail_default" style="font-size:small">Thanks.</div><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small">-Zhan </div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Apr 18, 2019 at 10:59 AM Samuel Trahan - NOAA Affiliate <<a href="mailto:samuel.trahan@noaa.gov" target="_blank">samuel.trahan@noaa.gov</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Hi all,<div><br></div><div>A few months ago, the pyprodutil package supported the --multi-prog option that the admins are now requesting we use (look inside their two perl scripts). We deliberately removed --multi-prog support from pyprodutil and replaced it with pack groups, since the admins requested that. Now that the admins found out that pack groups don't work, they're asking us to use --multi-prog again. It may be easiest to resurrect the old slurm support code.</div><div><br></div><div>Sincerely,</div><div>Sam Trahan</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, 17 Apr 2019 at 19:56, Avichal Mehra - NOAA Federal <<a href="mailto:avichal.mehra@noaa.gov" target="_blank">avichal.mehra@noaa.gov</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">FYI.<br><div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">---------- Forwarded message ---------<br>From: <b class="gmail_sendername" dir="auto">Leslie Hart - NOAA Federal</b> <span dir="ltr"><<a href="mailto:leslie.b.hart@noaa.gov" target="_blank">leslie.b.hart@noaa.gov</a>></span><br>Date: Wed, Apr 17, 2019 at 7:23 PM<br>Subject: Running Complex Jobs Under Slurm<br>To: _OAR RDHPCS theia-notify <<a href="mailto:rdhpcs.theia.notify@noaa.gov" target="_blank">rdhpcs.theia.notify@noaa.gov</a>><br></div><br><br><div dir="ltr">
<div>Dear Users,</div><div><br></div><div>We consider a complex job to
be any job that requires more than one executable within a single MPI
execution, a job that requires a varying number of tasks per node or a
combination of both. During the Quick Start Training, we suggested using
Heterogeneous Job submission to create a complex job request. After
working with this method for a while, we believe this is the wrong
approach. We now have another recommended method for working with
complex jobs under Slurm.</div><div><br></div><div>We have created two scripts in the /contrib area of Jet and Theia. (We believe these methods will also function well on Gaea, but have only done limited testing there.) One is called <a href="http://arbitrary.pl" target="_blank">arbitrary.pl</a> which allows for varying numbers of tasks per node. The other is <a href="http://layout.pl" target="_blank">layout.pl</a> which allows for multiple executables within a single MPI execution. They are accessible by "module load contrib sutils".</div><div><br></div><div>We
have updated the April training slides to have examples of various
situations that a user may encounter. The updated material starts
around slide 34. The new slide deck is available at <a href="https://docs.google.com/presentation/d/1OhGP1j7Irx61iqDq0jagTWCMRXIGgnUiwNrGfk9NMmM/edit?usp=sharing" target="_blank">https://docs.google.com/presentation/d/1OhGP1j7Irx61iqDq0jagTWCMRXIGgnUiwNrGfk9NMmM/edit?usp=sharing</a>. (These slides are still under development but are pretty close to final.)<br></div><div><br></div><div>We
will have a short (approximately 30 minute) training session on
Wednesday, April 24th at 11AM EDT that just discusses these updates. Details regarding location and webinar information will follow in the next few days. In
early- to mid-May we will repeat the entire quick start training
session.</div><div><br></div><div>Thanks,</div><div>Leslie Hart & Raghu Reddy (and many others)<div class="gmail-m_-805301250719007581gmail-m_7095529015927451820gmail-m_8473669787927757483m_-628952479722956821gmail-adL"><br></div></div>
</div>
</div><br clear="all"><br>-- <br><div dir="ltr" class="gmail-m_-805301250719007581gmail-m_7095529015927451820gmail-m_8473669787927757483gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div> Dr. Avichal Mehra <a href="mailto:Avichal.Mehra@noaa.gov" target="_blank">Avichal.Mehra@noaa.gov</a> <br></div><div> Lead Physical Scientist NOAA/NWS/NCEP/EMC<br> 5830 University Research Court Room 2104
<br> College Park Ph. 301-683-3746<br> MD 20740 Fax: 301-683-3703</div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div>
</blockquote></div>
</blockquote></div>
</blockquote></div>