<div dir="ltr">Hi Sam, Jun, Eugene, and others for the help on the "module load" issues.<div><br></div><div>Here's an update:<br><div><br></div><div>1) I was able to build without any issues. In yesterday's version, it turns out the reason the line "module load module.fre-nctools" in the file runjob_theia.sh wasn't working was because MODULEPATH wasn't set to include the directory where "module.fre-nctools" is (which should be done using "module use -a path"). I assume you changed something for this to work now.</div><div><br></div><div>2) I ran the default case and did the comparison with baseline, and they are the same. <br></div><div><br></div><div>I will work on non-default cases now and report any problems I may find. </div><div><br></div><div>Thanks for your help.</div><div><br></div><div>Gerard</div><div><br></div></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, May 12, 2017 at 1:24 PM, Shrinivas Moorthi <span dir="ltr"><<a href="mailto:shrinivas.moorthi@noaa.gov" target="_blank">shrinivas.moorthi@noaa.gov</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<div class="m_4622827927678634457moz-cite-prefix">SJ, this is about compile time.<span class="HOEnZb"><font color="#888888"><br>
Moorthi</font></span><div><div class="h5"><br>
On 05/12/2017 03:16 PM, Shian-Jiann Lin - NOAA Federal wrote:<br>
</div></div></div><div><div class="h5">
<blockquote type="cite">
<div dir="ltr">Sam:
<div><br>
</div>
<div>I thought the timing only showed "FV_DIAG", not
GFS_diagnostics. The FV_diag involves a lot of things that
does not palatalized well.</div>
</div>
<div class="gmail_extra"><br clear="all">
<div>
<div class="m_4622827927678634457gmail_signature" data-smartmail="gmail_signature">
<div dir="ltr">
<div>
<div dir="ltr"><span><font color="#888888"><br>
Shian-Jiann Lin<br>
NOAA/Geophysical Fluid Dynamics Laboratory<br>
</font></span></div>
</div>
</div>
</div>
</div>
<br>
<div class="gmail_quote">On Fri, May 12, 2017 at 3:11 PM, Samuel
Trahan - NOAA Affiliate <span dir="ltr"><<a href="mailto:samuel.trahan@noaa.gov" target="_blank">samuel.trahan@noaa.gov</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">
<div>
<div>
<div>Jim,<br>
<br>
</div>
If you can do that, you will be my hero. Jet takes
twice as long to compile, and most of that time is the
GFS_diagnostics.<br>
<br>
</div>
Sincerely,<br>
</div>
Sam Trahan<br>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Fri, May 12, 2017 at 3:07 PM,
James Abeles - NOAA Affiliate <span dir="ltr"><<a href="mailto:james.a.abeles@noaa.gov" target="_blank">james.a.abeles@noaa.gov</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Moorthi,
<div>I ran the tests with a simple C96 grid for 48
hours and the one that compile GFS_diagnostics
with -O0 is actually faster:</div>
<div>
<div>wrk.C96/out.96:0: FV_DIAG
29.1041 0.0000 29.1041 0</div>
<div>wrk.C96.diag_O0/out.96:0: FV_DIAG
14.2025 0.0000 14.2025
0</div>
</div>
<div><br>
</div>
<div>Now I need to figure out if we can compile some
routines with different flags.</div>
</div>
<div class="m_4622827927678634457m_6031266284315886189HOEnZb">
<div class="m_4622827927678634457m_6031266284315886189h5">
<div class="gmail_extra"><br>
<div class="gmail_quote">On Fri, May 12, 2017 at
3:03 PM, Shrinivas Moorthi <span dir="ltr"><<a href="mailto:shrinivas.moorthi@noaa.gov" target="_blank">shrinivas.moorthi@noaa.gov</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<div class="m_4622827927678634457m_6031266284315886189m_110769321822141504m_-2345894083188714791moz-cite-prefix">Thanks
Jim.<br>
Moorthi<br>
On 05/12/2017 02:55 PM, James Abeles -
NOAA Affiliate wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">Resending with correct
-O0 flag.
<div><br>
</div>
<div><span style="font-size:12.8px">Moorthi,</span>
<div style="font-size:12.8px">The
slow compile is
GFS_diagnostics.F90. I have tried
many things to reduce the compile
time but the only one that worked
was compiling at -O0. There is
really nothing being done in this
routine other than storing
diagnostices so I am testing the
performance with -O0 vs -O2.</div>
<div style="font-size:12.8px"><br>
</div>
<div style="font-size:12.8px"><b><font size="4">-O2</font></b></div>
<div style="font-size:12.8px">
<div>/gpfs/hps/emc/global/noscrub/J<wbr>ames.A.Abeles/fv3gfs.v0beta/FV<wbr>3/gfsphysics>
time ftn -DNEW_TAUCTMAX
-DSMALL_PE -DNEMS_GSM -fpp
-Wp,-w
-I/opt/cray/netcdf/4.3.2/INTEL<wbr>/140/include
-I/opt/cray/netcdf/4.3.2/INTEL<wbr>/140/include
-fno-alias -auto -safe-cray-ptr
-ftz -assume byterecl -nowarn
-sox -align array64byte -i4
-real-size 32 -O2 -debug
minimal -fp-model source
-qoverride-limits -I../fms
-I../fms/include -c
GFS_layer/GFS_diagnostics.F90 -o
GFS_layer/GFS_diagnostics.o</div>
<div><br>
</div>
<div>real 10m3.761s</div>
<div>user 10m1.842s</div>
<div>sys 0m0.396s</div>
<div><br>
</div>
<div><b><font size="4">-O0</font></b></div>
<div>/gpfs/hps/emc/global/noscrub/J<wbr>ames.A.Abeles/fv3gfs.v0beta/FV<wbr>3/gfsphysics>
time ftn -DNEW_TAUCTMAX
-DSMALL_PE -DNEMS_GSM -fpp
-Wp,-w
-I/opt/cray/netcdf/4.3.2/INTEL<wbr>/140/include
-I/opt/cray/netcdf/4.3.2/INTEL<wbr>/140/include
-fno-alias -auto -safe-cray-ptr
-ftz -assume byterecl -nowarn
-sox -align array64byte -i4
-real-size 32 -O0 -debug
minimal -fp-model source
-qoverride-limits -I../fms
-I../fms/include -c
GFS_layer/GFS_diagnostics.F90 -o
GFS_layer/GFS_diagnostics.o</div>
<div>real 0m0.981s</div>
<div>user 0m0.728s</div>
<div>sys 0m0.072s</div>
</div>
<div style="font-size:12.8px"><br>
</div>
<div class="gmail_extra" style="font-size:12.8px"><br>
<div class="gmail_quote"><br>
<span class="m_4622827927678634457m_6031266284315886189m_110769321822141504HOEnZb"><font color="#888888"> </font></span></div>
<span class="m_4622827927678634457m_6031266284315886189m_110769321822141504HOEnZb"><font color="#888888"> </font></span></div>
<span class="m_4622827927678634457m_6031266284315886189m_110769321822141504HOEnZb"><font color="#888888"> </font></span></div>
<span class="m_4622827927678634457m_6031266284315886189m_110769321822141504HOEnZb"><font color="#888888"> </font></span></div>
<span class="m_4622827927678634457m_6031266284315886189m_110769321822141504HOEnZb"><font color="#888888"> </font></span></blockquote>
<span class="m_4622827927678634457m_6031266284315886189m_110769321822141504HOEnZb"><font color="#888888"> <br>
<p><br>
</p>
<pre class="m_4622827927678634457m_6031266284315886189m_110769321822141504m_-2345894083188714791moz-signature" cols="72">--
Dr. Shrinivas Moorthi
Research Meteorologist
Modeling and Data Assimilation Branch
Environmental Modeling Center / National Centers for Environmental Prediction
5830 University Research Court - (W/NP23), College Park MD 20740 USA
Tel:<a href="tel:%28301%29%20683-3718" value="+13016833718" target="_blank">(301)683-3718</a></pre>
</font></span></div>
</blockquote>
</div>
<br>
</div>
</div>
</div>
<br>
______________________________<wbr>_________________<br>
Ncep.list.fv3-announce mailing list<br>
<a href="mailto:Ncep.list.fv3-announce@lstsrv.ncep.noaa.gov" target="_blank">Ncep.list.fv3-announce@lstsrv.<wbr>ncep.noaa.gov</a><br>
<a href="https://www.lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.fv3-announce" rel="noreferrer" target="_blank">https://www.lstsrv.ncep.noaa.g<wbr>ov/mailman/listinfo/ncep.list.<wbr>fv3-announce</a><br>
<br>
</blockquote>
</div>
<br>
</div>
<br>
______________________________<wbr>_________________<br>
Ncep.list.fv3-announce mailing list<br>
<a href="mailto:Ncep.list.fv3-announce@lstsrv.ncep.noaa.gov" target="_blank">Ncep.list.fv3-announce@lstsrv.<wbr>ncep.noaa.gov</a><br>
<a href="https://www.lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.fv3-announce" rel="noreferrer" target="_blank">https://www.lstsrv.ncep.noaa.g<wbr>ov/mailman/listinfo/ncep.list.<wbr>fv3-announce</a><br>
<br>
</blockquote>
</div>
<br>
</div>
<br>
<fieldset class="m_4622827927678634457mimeAttachmentHeader"></fieldset>
<br>
<pre>______________________________<wbr>_________________
Ncep.list.fv3-announce mailing list
<a class="m_4622827927678634457moz-txt-link-abbreviated" href="mailto:Ncep.list.fv3-announce@lstsrv.ncep.noaa.gov" target="_blank">Ncep.list.fv3-announce@lstsrv.<wbr>ncep.noaa.gov</a>
<a class="m_4622827927678634457moz-txt-link-freetext" href="https://www.lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.fv3-announce" target="_blank">https://www.lstsrv.ncep.noaa.<wbr>gov/mailman/listinfo/ncep.<wbr>list.fv3-announce</a>
</pre>
</blockquote>
<br>
<p><br>
</p>
<pre class="m_4622827927678634457moz-signature" cols="72">--
Dr. Shrinivas Moorthi
Research Meteorologist
Modeling and Data Assimilation Branch
Environmental Modeling Center / National Centers for Environmental Prediction
5830 University Research Court - (W/NP23), College Park MD 20740 USA
Tel:<a href="tel:(301)%20683-3718" value="+13016833718" target="_blank">(301)683-3718</a></pre>
</div></div></div>
<br>______________________________<wbr>_________________<br>
Ncep.list.fv3-announce mailing list<br>
<a href="mailto:Ncep.list.fv3-announce@lstsrv.ncep.noaa.gov">Ncep.list.fv3-announce@lstsrv.<wbr>ncep.noaa.gov</a><br>
<a href="https://www.lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.fv3-announce" rel="noreferrer" target="_blank">https://www.lstsrv.ncep.noaa.<wbr>gov/mailman/listinfo/ncep.<wbr>list.fv3-announce</a><br>
<br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div>Gerard Ketefian</div><div>Research Scientist</div><div>NOAA/OAR/ESRL/GSD/EMB, R/GSD1</div><div>325 Broadway</div><div>Boulder, CO 80305</div><div>phone: 303-497-6209</div><div><br></div></div></div>
</div>