[Ncep.list.nems.announce] Proposed NEMS commit for Performance Improvements to RRTM-G

John Michalakes john.michalakes at noaa.gov
Mon Jul 14 23:15:00 UTC 2014

Hi all,
I would like to start the process for obtaining approval to commit
performance related changes to the RRTMG in the NEMS trunk.
Performance improvement:
Performance improvement on Zeus for then NMM_CNTRL workload:
                Original (revision 42943)  :    93.5s      (0.794s)
                  With optimized RRTMG:     89.2s      (0.739s)
The first times is the time to run the atmospheric component from beginning
to end (that is, the time spent in the ATM_RUN subroutine).  In parentheses
is the time per radiation call averaged over the 1125 calls (25 calls on 45
MPI task).
Performance improvement is configuration and workload dependent and will be
the subject of ongoing work. With regard to the GFS cases, the RRTM changes
degrade performance a little bit, but assuming output is okay, I'm
requesting approval to commit the changes into the trunk now and then work
more on improving performance afterwards.  (I've been spending a lot of time
and energy keeping up with changes to the trunk).
The attached pdf file is a small sampling of "old-new" grads difference
plots at 03, 12, and 48 hours.  There are differences but generally
"snow-like" (more or less random) especially at the 03hr time period.
Since the new output does not agree bit-for-bit, I modified the regression
test script to report the difference and continue on through the next tests.
All 13 tests run to completion:
but at this point the only output I've looked at is the NMM_CNTRL test for
I would like to also do difference plots for the GFS cases but I'm not sure
how to do that since the output isn't grads (as far as I can tell).  I'm
looking for suggestions, please.
Code location and summary of changes:  
The code is my home directory on Zeus:
and is relative to Revision: 42438  (thus, a little bit behind the top of
the trunk right now, which is at Revision: 42943, but that's just Weiyu's
new changes to the regression scripts).  
A summary of the modified files is here:
M       src/atmos/nmm/module_DIAGNOSE.F90
M       src/atmos/nmm/module_RADIATION.F90
M       src/atmos/nmm/module_SOLVER_GRID_COMP.F90
M       src/atmos/phys/grrad.f
M       src/atmos/phys/grrad_nmmb.f
M       src/atmos/phys/machine.f
M       src/atmos/phys/makefile
M       src/atmos/phys/module_RA_RRTM.F90
M       src/atmos/phys/radiation_aerosols_nmmb.f
M       src/atmos/phys/radlw_main.f
M       src/atmos/phys/radsw_main.f
M       src/conf/configure.nems.Gaea.intel
M       src/conf/configure.nems.Gaea.pgi
M       src/conf/configure.nems.Jet.ifort
M       src/conf/configure.nems.Linux.g95
M       src/conf/configure.nems.Linux.gnu
M       src/conf/configure.nems.Linux.intel
M       src/conf/configure.nems.Linux.pgi
M       src/conf/configure.nems.Unicos.intel
M       src/conf/configure.nems.Wcoss.intel
M       src/conf/configure.nems.Wcoss.intel_ESMF_520rp1
M       src/conf/configure.nems.Wcoss.intel_ESMF_520rp2
M       src/conf/configure.nems.Wcoss.intel_ESMF_630r
M       src/conf/configure.nems.Yellowstone.intel
M       src/conf/configure.nems.Zeus.intel
M       src/esmf_version
M       src/makefile
M       src/module_NEMS_GRID_COMP.F90
Performing status on external item at 'src/atmos/gsm':
M       src/atmos/gsm/phys/gloopr.f
Requested action by group:
I would appreciate it if those interested could please review and get back
to me with questions, suggestions and concerns within the next week.   Then,
based on the resulting discussions, I would hope to have the modifications
committed to the trunk and passing the reg-tests (with a new set of
reference data sets) by the end of this month (July).
-------------- next part --------------
An HTML attachment was scrubbed...
URL: https://lstsrv.ncep.noaa.gov/pipermail/ncep.list.nems.announce/attachments/20140714/ba621424/attachment-0001.html 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: RRTMG plots.pdf
Type: application/pdf
Size: 470217 bytes
Desc: not available
Url : https://lstsrv.ncep.noaa.gov/pipermail/ncep.list.nems.announce/attachments/20140714/ba621424/attachment-0001.pdf 

More information about the Ncep.list.nems.announce mailing list