[Ncep.list.fv3-announce] fv3gfs release beta test

[Rusty Benson - NOAA Federal]

Jim,

FV_DIAG counts the time for the fv_diagnstics.F90 and not any diagnostics
related to GFS physics.  I don't know if you have changed to namelist
parameter to dump diagnostics when they are created instead of buffering
them.  If you are dumping data to disk as it is created, then I expect
variability some variability.  Another source of variability is
load-imbalance from previous segments of the model as there is some
communication being done in the fv3 diagnostics that will act as an
implicit barrier.

Rusty
--
Rusty Benson, PhD
Modeling Systems Group
NOAA Geophysical Fluid Dynamics Lab
Princeton, NJ

On Fri, May 12, 2017 at 3:07 PM, James Abeles - NOAA Affiliate <
james.a.abeles at noaa.gov> wrote:

> Moorthi,
> I ran the tests with a simple C96 grid for 48 hours and the one that
> compile GFS_diagnostics with -O0 is actually faster:
> wrk.C96/out.96:0:    FV_DIAG                     29.1041       0.0000
>  29.1041       0
> wrk.C96.diag_O0/out.96:0:    FV_DIAG                     14.2025
> 0.0000      14.2025       0
>
> Now I need to figure out if we can compile some routines with different
> flags.
>
> On Fri, May 12, 2017 at 3:03 PM, Shrinivas Moorthi <
> shrinivas.moorthi at noaa.gov> wrote:
>
>> Thanks Jim.
>> Moorthi
>> On 05/12/2017 02:55 PM, James Abeles - NOAA Affiliate wrote:
>>
>> Resending with correct -O0 flag.
>>
>> Moorthi,
>> The slow compile is GFS_diagnostics.F90. I have tried many things to
>> reduce the compile time but the only one that worked was compiling at -O0.
>> There is really nothing being done in this routine other than storing
>> diagnostices so I am testing the performance with -O0 vs -O2.
>>
>> *-O2*
>> /gpfs/hps/emc/global/noscrub/James.A.Abeles/fv3gfs.v0beta/FV3/gfsphysics>
>> time ftn -DNEW_TAUCTMAX -DSMALL_PE -DNEMS_GSM -fpp -Wp,-w
>> -I/opt/cray/netcdf/4.3.2/INTEL/140/include -I/opt/cray/netcdf/4.3.2/INTEL/140/include
>> -fno-alias -auto -safe-cray-ptr -ftz -assume byterecl -nowarn -sox -align
>> array64byte -i4 -real-size 32  -O2 -debug minimal -fp-model source
>> -qoverride-limits -I../fms -I../fms/include  -c
>> GFS_layer/GFS_diagnostics.F90 -o GFS_layer/GFS_diagnostics.o
>>
>> real    10m3.761s
>> user    10m1.842s
>> sys     0m0.396s
>>
>> *-O0*
>> /gpfs/hps/emc/global/noscrub/James.A.Abeles/fv3gfs.v0beta/FV3/gfsphysics>
>> time ftn -DNEW_TAUCTMAX -DSMALL_PE -DNEMS_GSM -fpp -Wp,-w
>> -I/opt/cray/netcdf/4.3.2/INTEL/140/include -I/opt/cray/netcdf/4.3.2/INTEL/140/include
>> -fno-alias -auto -safe-cray-ptr -ftz -assume byterecl -nowarn -sox -align
>> array64byte -i4 -real-size 32  -O0 -debug minimal -fp-model source
>> -qoverride-limits -I../fms -I../fms/include  -c
>> GFS_layer/GFS_diagnostics.F90 -o GFS_layer/GFS_diagnostics.o
>> real    0m0.981s
>> user    0m0.728s
>> sys     0m0.072s
>>
>>
>>
>>
>>
>> --
>> Dr. Shrinivas Moorthi
>> Research Meteorologist
>> Modeling and Data Assimilation Branch
>> Environmental Modeling Center / National Centers for Environmental Prediction
>> 5830 University Research Court - (W/NP23), College Park MD 20740 USA
>> Tel:(301)683-3718 <(301)%20683-3718>
>>
>>
>
> _______________________________________________
> Ncep.list.fv3-announce mailing list
> Ncep.list.fv3-announce at lstsrv.ncep.noaa.gov
> https://www.lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.fv3-announce
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: https://www.lstsrv.ncep.noaa.gov/pipermail/ncep.list.fv3-announce/attachments/20170512/615da8f8/attachment-0001.html