[Ncep.list.fv3-announce] Theia upgrade impact on ESMF

[Jun Wang - NOAA Affiliate]

Dear all,

I would like to clarify the status of NEMSfv3gfs. NEMSfv3gfs git master
branch was updated to the modified EMSF lib on theia this morning. So

1) if you clone the NEMSfv3gfs repo, or if you check out the latest master,
the code is working on theia.

2) If you are working on your own NEMSfv3gfs branch, we suggest you merge
with the latest master branch by doing ( %git pull origin/master) . If at
this moment, you are not able to merge to the master branch, you can use a
temporary solution by change the ESMF lib in the NEMSfv3gfs module file
NEMSfv3gfs/modulefiles/theia/fv3:

esmf/7.0.0 should be replaced by
* esmf/7.0.2*
esmf/7.1.0bs34 should be replaced by esmf/7.1.0bs34.1

If you are using esmf/7.1.0bs31, I would suggest you moved to
esmf/7.1.0bs34.1.
Thanks!


Jun



On Wed, Nov 8, 2017 at 2:10 PM, Samuel Trahan - NOAA Affiliate <
samuel.trahan at noaa.gov> wrote:

> FV3 developers,
>
> See the announcement below about an issue with ESMF on Theia, and the
> fix.  The email says "NEMS" but it actually impacts all applications that
> use ESMF.
>
> Sincerely,
> Sam Trahan
>
> ---------- Forwarded message ----------
> From: Gerhard Theurich <theurich at sourcespring.net>
> Date: Wed, Nov 8, 2017 at 1:23 PM
> Subject: [Ncep.list.nems.announce] Theia upgrade impact on NEMS
> To: NEMS developers <ncep.list.nems.announce at lstsrv.ncep.noaa.gov>
> Cc: Cecelia DeLuca - NOAA Affiliate <Cecelia.Deluca at noaa.gov>
>
>
> Dear NEMS developers,
>
> The Theia upgrade of 11/07/17 comes with an impact on NEMS applications.
> You must very likely change which ESMF module your NEMS application is
> pointing to, and rebuild your NEMS application.
>
> The impact on NEMS comes through the ESMF module that is loaded by the
> NEMS application. Until recently, ESMF instructed the NEMS application
> to explicitly link against Intel's Small Vector Math Library SVML (via
> -lsvml). However, our current understanding is that there is an
> incompatibility of Intel's SVML and the upgraded system libraries, that
> will lead to strange numerical issues when working in optimization mode
> -O2 or above.
>
> In order to mitigate the issue, all current ESMF installations do NOT
> instruct the application to explicitly link against SVML. We have also
> patched previous ESMF version and made them available on Theia. Old ESMF
> installations on Theia have been disabled in order to prevent
> hard-to-debug situations for when -lsvml is specified.
>
> The consequence for NEMS applications is that you must change the ESMF
> module your application uses if currently it accesses an ESMF module
> from under (they have ALL been disabled)
>
> /scratch4/NCEPDEV/nems/save/Gerhard.Theurich/Modulefiles/esmf/
>
> or any of the following ESMF modules from under
>
> /home/emc.nemspara/SOFT/modulefiles:
>    esmf/7.1.0bs30
>    esmf/7.1.0bs31
>    esmf/7.1.0bs33
>    esmf/7.1.0bs34
>
> The currently available replacement ESMF modules are:
>
>    esmf/7.0.2
>    esmf/7.1.0bs05.1
>    esmf/7.1.0bs24.1
>    esmf/7.1.0bs34.1
>
> Also, any ESMF modules starting with esmf/7.1.0bs35 will work on the
> upgraded Theia system.
>
> Please let me know if you have questions or specific problems getting an
> application working on Theia since the upgrade. Thank you!
>
> Best,
> -Gerhard
> _______________________________________________
> Ncep.list.nems.announce mailing list
> Ncep.list.nems.announce at lstsrv.ncep.noaa.gov
> https://www.lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.nems.announce
>
>
>
>
> _______________________________________________
> Ncep.list.fv3-announce mailing list
> Ncep.list.fv3-announce at lstsrv.ncep.noaa.gov
> https://www.lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.fv3-announce
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: https://www.lstsrv.ncep.noaa.gov/pipermail/ncep.list.fv3-announce/attachments/20171108/7649a671/attachment-0001.html