<div dir="ltr"><div><div>Dear all,<br><br></div>I would like to clarify the status of NEMSfv3gfs. NEMSfv3gfs git master branch was updated to the modified EMSF lib on theia this morning. So <br></div><div><br></div><div>1) if you clone the NEMSfv3gfs repo, or if you check out the latest master, the code is working on theia. <br></div><div><br></div><div>2) If you are working on your own NEMSfv3gfs branch, we suggest you merge with the latest master branch by doing (<span style="font-size:12pt;font-family:Calibri;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline"> %</span><span style="font-size:12pt;font-family:Calibri;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:italic;font-variant:normal;text-decoration:none;vertical-align:baseline">git pull origin/master) . </span>If at this moment, you are not able to merge to the master branch, you can use a temporary solution by change the ESMF lib in the NEMSfv3gfs module file NEMSfv3gfs/modulefiles/theia/<wbr>fv3:</div><div><br></div><div><span style="font-family:inherit;font-size:inherit;color:rgb(255,0,0);background-color:inherit">esmf/7.0.0</span> should be replaced by <span style="font-family:inherit;font-size:inherit;color:rgb(0,0,255);background-color:inherit"><strong> esmf/7.0.2<br></strong></span></div><div><span style="color:rgb(255,0,0)"><span style="background-color:rgb(243,243,243)">esmf/7.1.0bs34</span></span> should be replaced by <span style="color:rgb(255,0,0)">esmf/7.1.0bs34.1</span></div><div><span style="color:rgb(255,0,0)"><br></span></div><div><span style="color:rgb(0,0,0)">If you are using esmf/7.1.0bs31, I would suggest you moved to </span><span style="color:rgb(255,0,0)"><span style="color:rgb(0,0,0)">esmf/7.1.0bs34.1. Thanks!</span></span></div><div><span style="color:rgb(255,0,0)"><span style="color:rgb(0,0,0)"><br></span></span></div><div><span style="color:rgb(255,0,0)"><span style="color:rgb(0,0,0)"><br></span></span></div><div><span style="color:rgb(255,0,0)"><span style="color:rgb(0,0,0)">Jun</span><br></span></div><div><br></div><div><span style="font-family:inherit;font-size:inherit;color:rgb(0,0,255);background-color:inherit"><strong></strong></span></div><br></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Nov 8, 2017 at 2:10 PM, Samuel Trahan - NOAA Affiliate <span dir="ltr"><<a href="mailto:samuel.trahan@noaa.gov" target="_blank">samuel.trahan@noaa.gov</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_quote"><div dir="ltr">FV3 developers,<div><br></div><div>See the announcement below about an issue with ESMF on Theia, and the fix. The email says "NEMS" but it actually impacts all applications that use ESMF.</div><div><br></div><div>Sincerely,</div><div>Sam Trahan</div><div><br><div><div class="gmail_quote">---------- Forwarded message ----------<br>From: <b class="gmail_sendername">Gerhard Theurich</b> <span dir="ltr"><<a href="mailto:theurich@sourcespring.net" target="_blank">theurich@sourcespring.net</a>></span><br>Date: Wed, Nov 8, 2017 at 1:23 PM<br>Subject: [Ncep.list.nems.announce] Theia upgrade impact on NEMS<br>To: NEMS developers <<a href="mailto:ncep.list.nems.announce@lstsrv.ncep.noaa.gov" target="_blank">ncep.list.nems.announce@lstsr<wbr>v.ncep.noaa.gov</a>><br>Cc: Cecelia DeLuca - NOAA Affiliate <<a href="mailto:Cecelia.Deluca@noaa.gov" target="_blank">Cecelia.Deluca@noaa.gov</a>><br><br><br>Dear NEMS developers,<br>
<br>
The Theia upgrade of 11/07/17 comes with an impact on NEMS applications.<br>
You must very likely change which ESMF module your NEMS application is<br>
pointing to, and rebuild your NEMS application.<br>
<br>
The impact on NEMS comes through the ESMF module that is loaded by the<br>
NEMS application. Until recently, ESMF instructed the NEMS application<br>
to explicitly link against Intel's Small Vector Math Library SVML (via<br>
-lsvml). However, our current understanding is that there is an<br>
incompatibility of Intel's SVML and the upgraded system libraries, that<br>
will lead to strange numerical issues when working in optimization mode<br>
-O2 or above.<br>
<br>
In order to mitigate the issue, all current ESMF installations do NOT<br>
instruct the application to explicitly link against SVML. We have also<br>
patched previous ESMF version and made them available on Theia. Old ESMF<br>
installations on Theia have been disabled in order to prevent<br>
hard-to-debug situations for when -lsvml is specified.<br>
<br>
The consequence for NEMS applications is that you must change the ESMF<br>
module your application uses if currently it accesses an ESMF module<br>
from under (they have ALL been disabled)<br>
<br>
/scratch4/NCEPDEV/nems/save/Ge<wbr>rhard.Theurich/Modulefiles/esm<wbr>f/<br>
<br>
or any of the following ESMF modules from under<br>
<br>
/home/emc.nemspara/SOFT/module<wbr>files:<br>
esmf/7.1.0bs30<br>
esmf/7.1.0bs31<br>
esmf/7.1.0bs33<br>
esmf/7.1.0bs34<br>
<br>
The currently available replacement ESMF modules are:<br>
<br>
esmf/7.0.2<br>
esmf/7.1.0bs05.1<br>
esmf/7.1.0bs24.1<br>
esmf/7.1.0bs34.1<br>
<br>
Also, any ESMF modules starting with esmf/7.1.0bs35 will work on the<br>
upgraded Theia system.<br>
<br>
Please let me know if you have questions or specific problems getting an<br>
application working on Theia since the upgrade. Thank you!<br>
<br>
Best,<br>
-Gerhard<br>
______________________________<wbr>_________________<br>
Ncep.list.nems.announce mailing list<br>
<a href="mailto:Ncep.list.nems.announce@lstsrv.ncep.noaa.gov" target="_blank">Ncep.list.nems.announce@lstsrv<wbr>.ncep.noaa.gov</a><br>
<a href="https://www.lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.nems.announce" rel="noreferrer" target="_blank">https://www.lstsrv.ncep.noaa.g<wbr>ov/mailman/listinfo/ncep.list.<wbr>nems.announce</a><br>
<br>
</div><br></div></div></div>
</div><br></div>
<br>______________________________<wbr>_________________<br>
Ncep.list.fv3-announce mailing list<br>
<a href="mailto:Ncep.list.fv3-announce@lstsrv.ncep.noaa.gov">Ncep.list.fv3-announce@lstsrv.<wbr>ncep.noaa.gov</a><br>
<a href="https://www.lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.fv3-announce" rel="noreferrer" target="_blank">https://www.lstsrv.ncep.noaa.<wbr>gov/mailman/listinfo/ncep.<wbr>list.fv3-announce</a><br>
<br></blockquote></div><br></div>