[Ncep.list.fv3-announce] fv3gfs release beta test

Gerard Ketefian - NOAA Affiliate gerard.ketefian at noaa.gov
Fri May 12 19:38:01 UTC 2017


Hi Sam, Jun, Eugene, and others for the help on the "module load" issues.

Here's an update:

1) I was able to build without any issues.  In yesterday's version, it
turns out the reason the line "module load module.fre-nctools" in the file
runjob_theia.sh wasn't working was because MODULEPATH wasn't set to include
the directory where "module.fre-nctools" is (which should be done using
"module use -a path").  I assume you changed something for this to work now.

2) I ran the default case and did the comparison with baseline, and they
are the same.

I will work on non-default cases now and report any problems I may find.

Thanks for your help.

Gerard


On Fri, May 12, 2017 at 1:24 PM, Shrinivas Moorthi <
shrinivas.moorthi at noaa.gov> wrote:

> SJ, this is about compile time.
> Moorthi
>
> On 05/12/2017 03:16 PM, Shian-Jiann Lin - NOAA Federal wrote:
>
> Sam:
>
> I thought the timing only showed "FV_DIAG", not GFS_diagnostics. The
> FV_diag involves a lot of things that does not palatalized well.
>
>
> Shian-Jiann Lin
> NOAA/Geophysical Fluid Dynamics Laboratory
>
> On Fri, May 12, 2017 at 3:11 PM, Samuel Trahan - NOAA Affiliate <
> samuel.trahan at noaa.gov> wrote:
>
>> Jim,
>>
>> If you can do that, you will be my hero.  Jet takes twice as long to
>> compile, and most of that time is the GFS_diagnostics.
>>
>> Sincerely,
>> Sam Trahan
>>
>> On Fri, May 12, 2017 at 3:07 PM, James Abeles - NOAA Affiliate <
>> james.a.abeles at noaa.gov> wrote:
>>
>>> Moorthi,
>>> I ran the tests with a simple C96 grid for 48 hours and the one that
>>> compile GFS_diagnostics with -O0 is actually faster:
>>> wrk.C96/out.96:0:    FV_DIAG                     29.1041       0.0000
>>>    29.1041       0
>>> wrk.C96.diag_O0/out.96:0:    FV_DIAG                     14.2025
>>> 0.0000      14.2025       0
>>>
>>> Now I need to figure out if we can compile some routines with different
>>> flags.
>>>
>>> On Fri, May 12, 2017 at 3:03 PM, Shrinivas Moorthi <
>>> shrinivas.moorthi at noaa.gov> wrote:
>>>
>>>> Thanks Jim.
>>>> Moorthi
>>>> On 05/12/2017 02:55 PM, James Abeles - NOAA Affiliate wrote:
>>>>
>>>> Resending with correct -O0 flag.
>>>>
>>>> Moorthi,
>>>> The slow compile is GFS_diagnostics.F90. I have tried many things to
>>>> reduce the compile time but the only one that worked was compiling at -O0.
>>>> There is really nothing being done in this routine other than storing
>>>> diagnostices so I am testing the performance with -O0 vs -O2.
>>>>
>>>> *-O2*
>>>> /gpfs/hps/emc/global/noscrub/James.A.Abeles/fv3gfs.v0beta/FV3/gfsphysics>
>>>> time ftn -DNEW_TAUCTMAX -DSMALL_PE -DNEMS_GSM -fpp -Wp,-w
>>>> -I/opt/cray/netcdf/4.3.2/INTEL/140/include
>>>> -I/opt/cray/netcdf/4.3.2/INTEL/140/include -fno-alias -auto
>>>> -safe-cray-ptr -ftz -assume byterecl -nowarn -sox -align array64byte -i4
>>>> -real-size 32  -O2 -debug minimal -fp-model source -qoverride-limits
>>>> -I../fms -I../fms/include  -c GFS_layer/GFS_diagnostics.F90 -o
>>>> GFS_layer/GFS_diagnostics.o
>>>>
>>>> real    10m3.761s
>>>> user    10m1.842s
>>>> sys     0m0.396s
>>>>
>>>> *-O0*
>>>> /gpfs/hps/emc/global/noscrub/James.A.Abeles/fv3gfs.v0beta/FV3/gfsphysics>
>>>> time ftn -DNEW_TAUCTMAX -DSMALL_PE -DNEMS_GSM -fpp -Wp,-w
>>>> -I/opt/cray/netcdf/4.3.2/INTEL/140/include
>>>> -I/opt/cray/netcdf/4.3.2/INTEL/140/include -fno-alias -auto
>>>> -safe-cray-ptr -ftz -assume byterecl -nowarn -sox -align array64byte -i4
>>>> -real-size 32  -O0 -debug minimal -fp-model source -qoverride-limits
>>>> -I../fms -I../fms/include  -c GFS_layer/GFS_diagnostics.F90 -o
>>>> GFS_layer/GFS_diagnostics.o
>>>> real    0m0.981s
>>>> user    0m0.728s
>>>> sys     0m0.072s
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Dr. Shrinivas Moorthi
>>>> Research Meteorologist
>>>> Modeling and Data Assimilation Branch
>>>> Environmental Modeling Center / National Centers for Environmental Prediction
>>>> 5830 University Research Court - (W/NP23), College Park MD 20740 USA
>>>> Tel:(301)683-3718 <%28301%29%20683-3718>
>>>>
>>>>
>>>
>>> _______________________________________________
>>> Ncep.list.fv3-announce mailing list
>>> Ncep.list.fv3-announce at lstsrv.ncep.noaa.gov
>>> https://www.lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.fv3-announce
>>>
>>>
>>
>> _______________________________________________
>> Ncep.list.fv3-announce mailing list
>> Ncep.list.fv3-announce at lstsrv.ncep.noaa.gov
>> https://www.lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.fv3-announce
>>
>>
>
>
> _______________________________________________
> Ncep.list.fv3-announce mailing listNcep.list.fv3-announce at lstsrv.ncep.noaa.govhttps://www.lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.fv3-announce
>
>
>
> --
> Dr. Shrinivas Moorthi
> Research Meteorologist
> Modeling and Data Assimilation Branch
> Environmental Modeling Center / National Centers for Environmental Prediction
> 5830 University Research Court - (W/NP23), College Park MD 20740 USA
> Tel:(301)683-3718 <(301)%20683-3718>
>
>
> _______________________________________________
> Ncep.list.fv3-announce mailing list
> Ncep.list.fv3-announce at lstsrv.ncep.noaa.gov
> https://www.lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.fv3-announce
>
>


-- 
Gerard Ketefian
Research Scientist
NOAA/OAR/ESRL/GSD/EMB, R/GSD1
325 Broadway
Boulder, CO 80305
phone: 303-497-6209
-------------- next part --------------
An HTML attachment was scrubbed...
URL: https://www.lstsrv.ncep.noaa.gov/pipermail/ncep.list.fv3-announce/attachments/20170512/1f62c650/attachment.html 


More information about the Ncep.list.fv3-announce mailing list