<html>
  <head>

    <meta http-equiv="content-type" content="text/html; charset=windows-1252">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    <p>Hi Houjun and Weiyu,<br>
    </p>
    <p><br>
    </p>
    <p>here is the failed run Bob tried with the 1hr restart compset
      that we discussed during our meeting:</p>
    <p><span style="font-family: Menlo; font-size: 11px;">/scratch3/NCEPDEV/swpc/scrub/Robert.Oehmke/rt_64184/swpc%20090115_dumprs_1hr_spacewx_gsm%wam%T62_ipe%80x170</span></p>
    <p><span style="font-family: Menlo; font-size: 11px;">We would
        really appreciate it if you could kindly give us any
        suggestions.</span></p>
    <p><span style="font-family: Menlo; font-size: 11px;">Thanks.</span></p>
    <p><span style="font-family: Menlo; font-size: 11px;">naomi<br>
      </span></p>
    <p><span style="font-family: Menlo; font-size: 11px;"><br>
      </span></p>
    <div class="moz-forward-container"><br>
      <br>
      -------- Forwarded Message --------
      <table class="moz-email-headers-table" border="0" cellpadding="0"
        cellspacing="0">
        <tbody>
          <tr>
            <th align="RIGHT" nowrap="nowrap" valign="BASELINE">Subject:
            </th>
            <td>Re: WAM-IPE ops - RESTART folders....: new idea to test
              restart compset</td>
          </tr>
          <tr>
            <th align="RIGHT" nowrap="nowrap" valign="BASELINE">Date: </th>
            <td>Mon, 3 Apr 2017 13:12:37 -0600</td>
          </tr>
          <tr>
            <th align="RIGHT" nowrap="nowrap" valign="BASELINE">From: </th>
            <td>Robert Oehmke <a class="moz-txt-link-rfc2396E" href="mailto:robert.oehmke@noaa.gov">&lt;robert.oehmke@noaa.gov&gt;</a></td>
          </tr>
          <tr>
            <th align="RIGHT" nowrap="nowrap" valign="BASELINE">To: </th>
            <td><a class="moz-txt-link-abbreviated" href="mailto:naomi.maruyama@noaa.gov">naomi.maruyama@noaa.gov</a></td>
          </tr>
          <tr>
            <th align="RIGHT" nowrap="nowrap" valign="BASELINE">CC: </th>
            <td>George Millward - NOAA Affiliate
              <a class="moz-txt-link-rfc2396E" href="mailto:george.millward@noaa.gov">&lt;george.millward@noaa.gov&gt;</a>, Tim Fuller-Rowell - NOAA
              Affiliate <a class="moz-txt-link-rfc2396E" href="mailto:tim.fuller-rowell@noaa.gov">&lt;tim.fuller-rowell@noaa.gov&gt;</a>, Rashid
              Akmaev <a class="moz-txt-link-rfc2396E" href="mailto:Rashid.Akmaev@noaa.gov">&lt;Rashid.Akmaev@noaa.gov&gt;</a></td>
          </tr>
        </tbody>
      </table>
      <br>
      <br>
      <meta http-equiv="Content-Type" content="text/html;
        charset=windows-1252">
      Hi Naomi,
      <div><br>
      </div>
      <div>   I originally started with a 1hr run, but when I tried to
        do a 1hr run with the WAM restart interval set to 1hr, the run
        stopped almost immediately. Valery speculated that maybe WAM
        won’t work with that short of a restart interval (he said that
        he’s never tried it and maybe it causes a problem with the
        digital filters), so I switched to the 1day run, where it at
        least ran for 18 hours. </div>
      <div><br>
      </div>
      <div>If you’re curious here’s that 1hr run: </div>
      <div><span style="font-family: Menlo; font-size: 11px;">/scratch3/NCEPDEV/swpc/scrub/Robert.Oehmke/rt_64184/swpc%20090115_dumprs_1hr_spacewx_gsm%wam%T62_ipe%80x170</span></div>
      <div><br>
      </div>
      <div>If you see anything that I should change, let me know. I’m
        happy to try that run again. </div>
      <div><br>
      </div>
      <div>Thanks,</div>
      <div><br>
      </div>
      <div>- Bob</div>
      <div><br>
        <div>
          <div>
            <div>On Apr 3, 2017, at 12:03 PM, Naomi Maruyama &lt;<a
                moz-do-not-send="true"
                href="mailto:naomi.maruyama@noaa.gov">naomi.maruyama@noaa.gov</a>&gt;
              wrote:</div>
            <br class="Apple-interchange-newline">
            <blockquote type="cite">
              <meta content="text/html; charset=windows-1252"
                http-equiv="Content-Type">
              <div bgcolor="#FFFFFF" text="#000000">
                <div class="moz-cite-prefix">George and Bob,<br>
                  <br>
                  I understand that Bob's new compset cannot be tested
                  until the problem of failing WAM-IPE run at 18UT will
                  be solved (which I am working on right now). It seems
                  both Bob and Weiyu are having the same problem.<br>
                  <br>
                  I checked the Weiyu's results as you saw in the other
                  thread: it looks like the IPE electron density looks
                  ok until 18UT (when the runs crashed) by comparing the
                  two runs between before vs. after Weiyu's new commit.
                  Also I compared to my old run on jan 13: The Weiyu's
                  results appeared identical until 16UT.<br>
                  <br>
                  If running WAM-IPE is holding the test, how about
                  testing the new compset with using 1hr WAM-IPE run,
                  instead of 1day run(i.e., restart at 1UT instead of
                  24UT)? It would be also helpful for our future debug
                  task because it takes much shorter to run only for
                  1hr.<br>
                  <br>
                  Just a thought.<br>
                  Thanks.<br>
                  naomi<br>
                  <br>
                  <br>
                   <br>
                  <br>
                  On 3/30/17 4:02 PM, Tim Fuller-Rowell - NOAA Affiliate
                  wrote:<br>
                </div>
                <blockquote
cite="mid:CAM5=TX_g5HuPUJYJNnau-B+9anCDJkOKjc2N5w0Q9dBYBMc+Dw@mail.gmail.com"
                  type="cite">
                  <div dir="ltr">Good.</div>
                  <div class="gmail_extra"><br>
                    <div class="gmail_quote">On Thu, Mar 30, 2017 at
                      11:58 AM, George Millward - NOAA Affiliate <span
                        dir="ltr">&lt;<a moz-do-not-send="true"
                          href="mailto:george.millward@noaa.gov"
                          target="_blank">george.millward@noaa.gov</a>&gt;</span>
                      wrote:<br>
                      <blockquote class="gmail_quote" style="margin:0 0
                        0 .8ex;border-left:1px #ccc
                        solid;padding-left:1ex">
                        <div dir="ltr">
                          <div>All</div>
                          <div><br>
                          </div>
                          <div>One thing we did with SWMF was, for
                            operations, we wrote all of the relevant
                            restart data into </div>
                          <div>a directory that was timestamped - like
                            this:</div>
                          <div><br>
                          </div>
                          SWMF_RESTART.20161013_122800
                          <div><br>
                          </div>
                          <div>These were produced every minute -
                            whether we do it that frequent - or less (5
                            mins) I think this is a good approach</div>
                          <div><br>
                          </div>
                          <div>..so in the directory:</div>
                          <div><br>
                          </div>
                          <div>WAM-IPE_RESTART.20161013_<wbr>121500</div>
                          <div><br>
                          </div>
                          <div>we then have other subdirectories for the
                            IPE and WAM needed datasets.</div>
                          <div><br>
                          </div>
                          <div>What this means is this: IPE output files
                            like plasma00, plasma01 etc. just contain
                            data from a single time....this is not how
                            it currently works (plasma00 can contain
                            multiple times and these are referenced by
                            another file ut_rec). T</div>
                          <div><br>
                          </div>
                          <div>This timestamped RESTART folder system
                            might only be applicable to operations, so
                            we may need to be introducing another new
                            variable here such as:</div>
                          <div><br>
                          </div>
                          <div>$RUN_MODE=OPERATIONAL.</div>
                          <div><br>
                          </div>
                          <div>Anyhow, any comments?  Having a set of
                            files clearly timestamped is a much better
                            system for ops than one where files can
                            contain multiple times - it yields to the
                            sort of order that is needed.</div>
                          <div><br>
                          </div>
                          <div>Cheers</div>
                          <div><br>
                          </div>
                          <div>George.</div>
                          <div><br>
                          </div>
                          <div><br clear="all">
                            <div><br>
                            </div>
                            -- <br>
                            <div
                              class="m_-6075220065160488618gmail_signature"><span><span></span><span></span>-- <br>
                              </span>------------------------------<wbr>------------------------------<wbr>----
                              <br>
                              Dr. George Millward <br>
                              Cooperative Institute for Research in
                              Environmental Sciences (CIRES) <br>
                              University of Colorado, Boulder <br>
                              <br>
                              Visiting scientist at <br>
                              NOAA Space Weather Prediction Center <br>
                              325 Broadway, Boulder, CO 80305 <br>
                              Tel: 303-497-6775 <br>
                              <br>
                              <a moz-do-not-send="true"
                                href="mailto:george.millward@noaa.gov"
                                target="_blank">george.millward@noaa.gov</a>
                              <br>
                              ------------------------------<wbr>------------------------------<wbr>----</div>
                          </div>
                        </div>
                      </blockquote>
                    </div>
                    <br>
                  </div>
                </blockquote>
                <br>
                <p><br>
                </p>
                <pre class="moz-signature" cols="72">-- 
--------------
Naomi Maruyama
CIRES, Univ. of Colorado Boulder
NOAA Space Weather Prediction Center
phone: +1 303.497.4857
email: <a moz-do-not-send="true" class="moz-txt-link-abbreviated" href="mailto:naomi.maruyama@noaa.gov">naomi.maruyama@noaa.gov</a>
</pre>
              </div>
            </blockquote>
          </div>
          <br>
        </div>
      </div>
    </div>
  </body>
</html>