<div dir="ltr"><div>Jim,<br><br>GFS_diagnostics.F90 is a simple initialization routine, it is hardcoded to set up physics diagnostic field information. The file is more than 3000 lines, but I am still puzzled why it takes so long to compile, maybe instead we can save the field information in a file and just let the code read in those information. <br><br></div>Jun<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, May 12, 2017 at 3:16 PM, Shian-Jiann Lin - NOAA Federal <span dir="ltr"><<a href="mailto:shian-jiann.lin@noaa.gov" target="_blank">shian-jiann.lin@noaa.gov</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Sam:<div><br></div><div>I thought the timing only showed "FV_DIAG", not GFS_diagnostics. The FV_diag involves a lot of things that does not palatalized well.</div></div><div class="gmail_extra"><br clear="all"><div><div class="m_-3618447316783476279gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><span><font color="#888888"><br>Shian-Jiann Lin<br>
NOAA/Geophysical Fluid Dynamics Laboratory<br>
</font></span></div></div></div></div></div><div><div class="h5">
<br><div class="gmail_quote">On Fri, May 12, 2017 at 3:11 PM, Samuel Trahan - NOAA Affiliate <span dir="ltr"><<a href="mailto:samuel.trahan@noaa.gov" target="_blank">samuel.trahan@noaa.gov</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div><div>Jim,<br><br></div>If you can do that, you will be my hero. Jet takes twice as long to compile, and most of that time is the GFS_diagnostics.<br><br></div>Sincerely,<br></div>Sam Trahan<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, May 12, 2017 at 3:07 PM, James Abeles - NOAA Affiliate <span dir="ltr"><<a href="mailto:james.a.abeles@noaa.gov" target="_blank">james.a.abeles@noaa.gov</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Moorthi,<div>I ran the tests with a simple C96 grid for 48 hours and the one that compile GFS_diagnostics with -O0 is actually faster:</div><div><div>wrk.C96/out.96:0: FV_DIAG 29.1041 0.0000 29.1041 0</div><div>wrk.C96.diag_O0/out.96:0: FV_DIAG 14.2025 0.0000 14.2025 0</div></div><div><br></div><div>Now I need to figure out if we can compile some routines with different flags.</div></div><div class="m_-3618447316783476279m_6031266284315886189HOEnZb"><div class="m_-3618447316783476279m_6031266284315886189h5"><div class="gmail_extra"><br><div class="gmail_quote">On Fri, May 12, 2017 at 3:03 PM, Shrinivas Moorthi <span dir="ltr"><<a href="mailto:shrinivas.moorthi@noaa.gov" target="_blank">shrinivas.moorthi@noaa.gov</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<div class="m_-3618447316783476279m_6031266284315886189m_110769321822141504m_-2345894083188714791moz-cite-prefix">Thanks Jim.<br>
Moorthi<br>
On 05/12/2017 02:55 PM, James Abeles - NOAA Affiliate wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">Resending with correct -O0 flag.
<div><br>
</div>
<div><span style="font-size:12.8px">Moorthi,</span>
<div style="font-size:12.8px">The slow compile is
GFS_diagnostics.F90. I have tried many things to reduce the
compile time but the only one that worked was compiling at
-O0. There is really nothing being done in this routine
other than storing diagnostices so I am testing the
performance with -O0 vs -O2.</div>
<div style="font-size:12.8px"><br>
</div>
<div style="font-size:12.8px"><b><font size="4">-O2</font></b></div>
<div style="font-size:12.8px">
<div>/gpfs/hps/emc/global/noscrub/J<wbr>ames.A.Abeles/fv3gfs.v0beta/FV<wbr>3/gfsphysics>
time ftn -DNEW_TAUCTMAX -DSMALL_PE -DNEMS_GSM -fpp -Wp,-w
-I/opt/cray/netcdf/4.3.2/INTEL<wbr>/140/include
-I/opt/cray/netcdf/4.3.2/INTEL<wbr>/140/include -fno-alias
-auto -safe-cray-ptr -ftz -assume byterecl -nowarn -sox
-align array64byte -i4 -real-size 32 -O2 -debug minimal
-fp-model source -qoverride-limits -I../fms
-I../fms/include -c GFS_layer/GFS_diagnostics.F90 -o
GFS_layer/GFS_diagnostics.o</div>
<div><br>
</div>
<div>real 10m3.761s</div>
<div>user 10m1.842s</div>
<div>sys 0m0.396s</div>
<div><br>
</div>
<div><b><font size="4">-O0</font></b></div>
<div>/gpfs/hps/emc/global/noscrub/J<wbr>ames.A.Abeles/fv3gfs.v0beta/FV<wbr>3/gfsphysics>
time ftn -DNEW_TAUCTMAX -DSMALL_PE -DNEMS_GSM -fpp -Wp,-w
-I/opt/cray/netcdf/4.3.2/INTEL<wbr>/140/include
-I/opt/cray/netcdf/4.3.2/INTEL<wbr>/140/include -fno-alias
-auto -safe-cray-ptr -ftz -assume byterecl -nowarn -sox
-align array64byte -i4 -real-size 32 -O0 -debug minimal
-fp-model source -qoverride-limits -I../fms
-I../fms/include -c GFS_layer/GFS_diagnostics.F90 -o
GFS_layer/GFS_diagnostics.o</div>
<div>real 0m0.981s</div>
<div>user 0m0.728s</div>
<div>sys 0m0.072s</div>
</div>
<div style="font-size:12.8px"><br>
</div>
<div class="gmail_extra" style="font-size:12.8px"><br>
<div class="gmail_quote"><br><span class="m_-3618447316783476279m_6031266284315886189m_110769321822141504HOEnZb"><font color="#888888">
</font></span></div><span class="m_-3618447316783476279m_6031266284315886189m_110769321822141504HOEnZb"><font color="#888888">
</font></span></div><span class="m_-3618447316783476279m_6031266284315886189m_110769321822141504HOEnZb"><font color="#888888">
</font></span></div><span class="m_-3618447316783476279m_6031266284315886189m_110769321822141504HOEnZb"><font color="#888888">
</font></span></div><span class="m_-3618447316783476279m_6031266284315886189m_110769321822141504HOEnZb"><font color="#888888">
</font></span></blockquote><span class="m_-3618447316783476279m_6031266284315886189m_110769321822141504HOEnZb"><font color="#888888">
<br>
<p><br>
</p>
<pre class="m_-3618447316783476279m_6031266284315886189m_110769321822141504m_-2345894083188714791moz-signature" cols="72">--
Dr. Shrinivas Moorthi
Research Meteorologist
Modeling and Data Assimilation Branch
Environmental Modeling Center / National Centers for Environmental Prediction
5830 University Research Court - (W/NP23), College Park MD 20740 USA
Tel:<a href="tel:(301)%20683-3718" value="+13016833718" target="_blank">(301)683-3718</a></pre>
</font></span></div>
</blockquote></div><br></div>
</div></div><br>______________________________<wbr>_________________<br>
Ncep.list.fv3-announce mailing list<br>
<a href="mailto:Ncep.list.fv3-announce@lstsrv.ncep.noaa.gov" target="_blank">Ncep.list.fv3-announce@lstsrv.<wbr>ncep.noaa.gov</a><br>
<a href="https://www.lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.fv3-announce" rel="noreferrer" target="_blank">https://www.lstsrv.ncep.noaa.g<wbr>ov/mailman/listinfo/ncep.list.<wbr>fv3-announce</a><br>
<br></blockquote></div><br></div>
<br>______________________________<wbr>_________________<br>
Ncep.list.fv3-announce mailing list<br>
<a href="mailto:Ncep.list.fv3-announce@lstsrv.ncep.noaa.gov" target="_blank">Ncep.list.fv3-announce@lstsrv.<wbr>ncep.noaa.gov</a><br>
<a href="https://www.lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.fv3-announce" rel="noreferrer" target="_blank">https://www.lstsrv.ncep.noaa.g<wbr>ov/mailman/listinfo/ncep.list.<wbr>fv3-announce</a><br>
<br></blockquote></div><br></div></div></div>
<br>______________________________<wbr>_________________<br>
Ncep.list.fv3-announce mailing list<br>
<a href="mailto:Ncep.list.fv3-announce@lstsrv.ncep.noaa.gov">Ncep.list.fv3-announce@lstsrv.<wbr>ncep.noaa.gov</a><br>
<a href="https://www.lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.fv3-announce" rel="noreferrer" target="_blank">https://www.lstsrv.ncep.noaa.<wbr>gov/mailman/listinfo/ncep.<wbr>list.fv3-announce</a><br>
<br></blockquote></div><br></div>