<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=utf-8"><meta name=Generator content="Microsoft Word 14 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-US link=blue vlink=purple><div class=WordSection1><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Hi all,<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Thanks to Terry for showing me how to duplicate the problem, I was able to trace the problem to the following module file:<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>The file: /scratch3/NCEPDEV/nwprod/lib/modulefiles/EnvVars/v1.0.2<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>It is likely caused by one of the following settings in that file:<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Courier New";color:#1F497D'>setenv LMOD_AVAIL_STYLE "system:<en_grouped>"<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Courier New";color:#1F497D'>setenv LMOD_EXACT_MATCH yes<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Courier New";color:#1F497D'>setenv LMOD_PACKAGE_PATH $NCEPLIBS/modulefiles<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Most likely the setting and it’s causing the problem is:<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Courier New";color:#1F497D'>setenv LMOD_EXACT_MATCH yes<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>In the following file: /scratch4/NCEPDEV/global/save/Terry.McGuinness/git/global-workflow/modulefiles/module_base.theia<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>If you comment out the line:<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span></b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'> Samuel Trahan - NOAA Affiliate [mailto:samuel.trahan@noaa.gov] <br><b>Sent:</b> Tuesday, February 26, 2019 11:16 AM<br><b>To:</b> Raghu Reddy<br><b>Cc:</b> Ratko Vasic; NEMS developers<br><b>Subject:</b> Re: [Ncep.list.nems.announce] Upcoming NEMS commit<o:p></o:p></span></p><p class=MsoNormal><o:p> </o:p></p><div><p class=MsoNormal>Raghu,<o:p></o:p></p><div><p class=MsoNormal><o:p> </o:p></p></div><div><p class=MsoNormal>Both the NEMSfv3gfs compsets (AKA regression tests) and the FV3 GFS workflow have seen "module load slurm" fail to find anything, while "module load slurm/default" (or another explicit version) doesn't fail (yet).<o:p></o:p></p></div><div><p class=MsoNormal><o:p> </o:p></p></div><div><p class=MsoNormal>Sincerely,<o:p></o:p></p></div><div><p class=MsoNormal>Sam Trahan<o:p></o:p></p></div></div><p class=MsoNormal><o:p> </o:p></p><div><div><p class=MsoNormal>On Tue, 26 Feb 2019 at 10:36, Raghu Reddy <<a href="mailto:raghu.reddy@noaa.gov">raghu.reddy@noaa.gov</a>> wrote:<o:p></o:p></p></div><blockquote style='border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in'><p class=MsoNormal>Hi Ratko,<br><br>I have a quick note and a question about the last item:<br><br>>>>> 6. NEMSfv3gfs: On Jet, "module load slurm" is replaced by "module load slurm/default"<br><br>The need to load the module is a temporary one, and I agree that even if it is temporary you need to do this until this is no longer needed. The requirement to load the slurm module will be removed after the transition.<br><br>One question I have is why the change from loading "slurm" to "slurm/default"? I'm just trying to find out if from a system administration perspective if this is a difference only between Theia and Jet? We are generally trying to keep them consistent, but I agree there may be times where we cannot, but this difference should not be there. So I was just curious.<br><br>Thanks,<br>Raghu<br><br><br><br><br>-----Original Message-----<br>From: <a href="mailto:ncep.list.nems.announce-bounces@lstsrv.ncep.noaa.gov" target="_blank">ncep.list.nems.announce-bounces@lstsrv.ncep.noaa.gov</a> [mailto:<a href="mailto:ncep.list.nems.announce-bounces@lstsrv.ncep.noaa.gov" target="_blank">ncep.list.nems.announce-bounces@lstsrv.ncep.noaa.gov</a>] On Behalf Of Ratko Vasic<br>Sent: Tuesday, February 26, 2019 10:31 AM<br>To: NEMS developers<br>Subject: [Ncep.list.nems.announce] Upcoming NEMS commit<br><br>Dear NEMS developers,<br><br>Wednesday between 2-3 PM EST we will commit following changes to these <br>repositories:<br><br>The branches:<br><br>produtil repo - master is already updated<br>NEMSfv3gfs repo - pull from gaea-f2 branch into master<br>NEMS repo - pull from gaea-f2 branch into master<br><br>The changes:<br><br>1. NEMS: location of rocoto is updated to 1.3.0rc2 in nemspara or <br>hurdata areas. Note that rc2 and rc3 are the same; the increment in <br>some places was due to a miscommunication.<br><br>2. All three repos: Everything on GAEA is switched to /lustre/f2 except <br>libraries which are expected to be ready soon.<br><br>3. NEMSfv3gfs: The workaround for Theia SLURM using 12 cores per node <br>has been removed now that the bug in SLURM is fixed.<br><br>4. NEMS: Documentation in NEMS/doc is updated<br><br>5. NEMSfv3gfs: The wallclock limit on WCOSS Phase 2 is increased from 40 <br>minutes to 50 so that the expensive physics schemes will stop reaching <br>their wallclock limit.<br><br>6. NEMSfv3gfs: On Jet, "module load slurm" is replaced by "module load <br>slurm/default"<br><br>-Ratko<br><br>-- <br>Ratko Vasic<br>Meteorologist<br>301-683-3814<br>National Oceanic and Atmospheric Administration<br>NCEP/EMC, Room 2791<br>NCWCP W/NP2<br>5830 University Research Court<br>College Park, MD 20740-3818<br><br>_______________________________________________<br>Ncep.list.nems.announce mailing list<br><a href="mailto:Ncep.list.nems.announce@lstsrv.ncep.noaa.gov" target="_blank">Ncep.list.nems.announce@lstsrv.ncep.noaa.gov</a><br><a href="https://www.lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.nems.announce" target="_blank">https://www.lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.nems.announce</a><br><br><br>_______________________________________________<br>Ncep.list.nems.announce mailing list<br><a href="mailto:Ncep.list.nems.announce@lstsrv.ncep.noaa.gov" target="_blank">Ncep.list.nems.announce@lstsrv.ncep.noaa.gov</a><br><a href="https://www.lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.nems.announce" target="_blank">https://www.lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.nems.announce</a><o:p></o:p></p></blockquote></div></div></body></html>