<div dir="ltr">Hi Kevin,<div><br></div><div>So, do you have a single data request? Or do you have multiple discrete data requests? </div><div><br></div><div>I'm asking because I have a number of discrete requests and I am getting some with no problem, but not others. </div><div><br></div><div>Also, you mention the latency -- can you confirm that you are seeing latency on your end but no latency in the upstream queue?</div><div><br></div><div>Lastly, my problems did not seem too bad until 11/04-2340 (from MRMS OPS). I have not looked closely at prior data for latency. </div></div><br><div class="gmail_quote"><div dir="ltr">On Tue, Nov 6, 2018 at 10:19 AM Kevin W. Thomas <<a href="mailto:kwthomas@wizard.caps.ou.edu">kwthomas@wizard.caps.ou.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi Karen...<br>
<br>
>Hi Kevin,<br>
><br>
>I'm working with Jay on a similar problem.<br>
><br>
>Could you tell me what your requests look like? Are certain requests being<br>
>dropped or ignored?<br>
<br>
I think the problem is that the data transfer is so slow, the LDM circular<br>
buffer on the NOAA end is wrapping around so the unsent data is overwritten.<br>
<br>
My guess is that it holds 30-35 minutes of data.<br>
<br>
I know LDM will log problems if the receiving end us too slow processing<br>
the data.<br>
<br>
>I'm asking because I have multiple requests to get MRMS data for our<br>
>archive and web pages and some requests are fine while others are failing.<br>
><br>
>Also, I can see that the data is being created and getting into the LDM<br>
>queues on the NCO end, so there has to be something going on with the<br>
>connections.<br>
<br>
Can you track down when problems started? 00Z Saturday was fine. By 01Z,<br>
we were behind.<br>
<br>
== kwthomas ==<br>
<br>
>On Mon, Nov 5, 2018 at 3:53 PM Kevin W. Thomas <<a href="mailto:kwthomas@wizard.caps.ou.edu" target="_blank">kwthomas@wizard.caps.ou.edu</a>=<br>
>><br>
>wrote:<br>
><br>
>><br>
>> Jay...<br>
>><br>
>> I've noticed something strange. We're not getting a lot of MRMS data<br>
>> files. The ones that we get are timestamped over 30 minutes old. LDM is<br>
>> showing zero complaints. I've restarted LDM, but I see no signs of<br>
>> improvement.<br>
>><br>
>> The problems started between 00Z and 01Z Saturday night and has just<br>
>> gotten worse.<br>
>><br>
>> It's always possible there is a problem at our end, however, none of my<br>
>> other LDM connections have problems with delayed data.<br>
>><br>
>> Kevin W. Thomas<br>
>> Center for Analysis and Prediction of Storms<br>
>> University of Oklahoma<br>
>> Norman, Oklahoma<br>
>><br>
>> On Mon, 5 Nov 2018, 'Bath, Kenneth' via _NCEP.List.idp.mrms.users wrote:<br>
>><br>
>> > Jay,<br>
>> ><br>
>> > We saw the switch to College Park on Friday at 1909Z. However, the<br>
>> hourly dropped & delayed products on LDM continued until about 0020Z on<br>
>> Saturday, Nov. 3. Since then, the dropped & missing product have generall=<br>
>y<br>
>> been around 0210Z and 1410Z daily, and also during the 03Z hour.<br>
>> ><br>
>> > Ken<br>
>> ><br>
>> > From: <a href="mailto:ncep.list.idp.mrms.users-bounces@lstsrv.ncep.noaa.gov" target="_blank">ncep.list.idp.mrms.users-bounces@lstsrv.ncep.noaa.gov</a> <<br>
>> <a href="mailto:ncep.list.idp.mrms.users-bounces@lstsrv.ncep.noaa.gov" target="_blank">ncep.list.idp.mrms.users-bounces@lstsrv.ncep.noaa.gov</a>> On Behalf Of Jay<br>
>> Iyer<br>
>> > Sent: Friday, November 02, 2018 3:06 PM<br>
>> > To: <a href="mailto:ncep.list.idp.mrms.users@noaa.gov" target="_blank">ncep.list.idp.mrms.users@noaa.gov</a><br>
>> > Cc: <a href="mailto:idp-support@noaa.gov" target="_blank">idp-support@noaa.gov</a><br>
>> > Subject: [Marketing] [Ncep.list.idp.mrms.users] MRMS Failover to Colleg=<br>
>e<br>
>> Park - ~19Z 11/02/2018<br>
>> ><br>
>> > MRMS Customers,<br>
>> ><br>
>> > MRMS will be moved to the College Park data center shortly at/around 19=<br>
>Z<br>
>> today. We expect only a minimal disruption of data associated with this<br>
>> failover.<br>
>> ><br>
>> > If you experience a longer loss of data or any other issues with the<br>
>> failover and upgrade, please let the IDP team know and we will work throu=<br>
>gh<br>
>> any issues.<br>
>> ><br>
>> > Thanks much,<br>
>> ><br>
>> > -Jay Iyer<br>
>> ><br>
>> ><br>
>> > --<br>
>> > Jay Iyer CyberData Technologies, Inc.<br>
>> > National Oceanic and Atmospheric Administration NWS | NCEP | NCO | IDSB<br>
>> > U.S. Department of Commerce<br>
>> > 5830 University Research Court<br>
>> > College Park, Maryland 20740<br>
>> > 301.683.1483<tel:301.683.1483> | <a href="mailto:jaysankar.iyer@noaa.gov" target="_blank">jaysankar.iyer@noaa.gov</a><mailto:<br>
>> <a href="mailto:jaysankar.iyer@noaa.gov" target="_blank">jaysankar.iyer@noaa.gov</a>><br>
>> ><br>
>> _______________________________________________<br>
>> Ncep.list.idp.mrms.users mailing list<br>
>> <a href="mailto:Ncep.list.idp.mrms.users@lstsrv.ncep.noaa.gov" target="_blank">Ncep.list.idp.mrms.users@lstsrv.ncep.noaa.gov</a><br>
>> <a href="https://www.lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.idp.mrms.user=" rel="noreferrer" target="_blank">https://www.lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.idp.mrms.user=</a><br>
>s<br>
>><br>
><br>
><br>
>--=20<br>
>=E2=80=9CThe presence of those seeking the truth is infinitely to be prefer=<br>
>red to<br>
>the presence of those who think they=E2=80=99ve found it."<br>
> -- Terry Prachett<br>
><br>
>-------------------------------------------<br>
><a href="mailto:Karen.Cooper@noaa.gov" target="_blank">Karen.Cooper@noaa.gov</a><br>
><br>
>Phone#: 405-325-6456<br>
>Cell: 405-834-8559<br>
>National Severe Storms Laboratory<br>
><br>
>--000000000000fb75c6057a01254b<br>
>Content-Type: text/html; charset="UTF-8"<br>
>Content-Transfer-Encoding: quoted-printable<br>
><br>
><div dir=3D"ltr">Hi Kevin,<div><br></div><div>I&#39;m working with Jay on a=<br>
> similar problem.=C2=A0=C2=A0</div><div><br></div><div>Could you tell me wh=<br>
>at your requests look like?=C2=A0 Are certain requests being dropped or ign=<br>
>ored?=C2=A0</div><div><br></div><div>I&#39;m asking because I have multiple=<br>
> requests to get MRMS data for our archive and web pages and some requests =<br>
>are fine while others are failing.=C2=A0=C2=A0</div><div><br></div><div>Als=<br>
>o, I can see that the data is being created and getting into the LDM queues=<br>
> on the NCO end, so there has to be something going on with the connections=<br>
>.=C2=A0=C2=A0</div></div><br><div class=3D"gmail_quote"><div dir=3D"ltr">On=<br>
> Mon, Nov 5, 2018 at 3:53 PM Kevin W. Thomas &lt;<a href=3D"mailto:<a href="mailto:kwthomas" target="_blank">kwthomas</a>=<br>
>@<a href="http://wizard.caps.ou.edu" rel="noreferrer" target="_blank">wizard.caps.ou.edu</a>"><a href="mailto:kwthomas@wizard.caps.ou.edu" target="_blank">kwthomas@wizard.caps.ou.edu</a></a>&gt; wrote:<br></div><b=<br>
>lockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px =<br>
>#ccc solid;padding-left:1ex"><br><br>
>Jay...<br><br>
><br><br>
>I&#39;ve noticed something strange.=C2=A0 We&#39;re not getting a lot of MR=<br>
>MS data<br><br>
>files.=C2=A0 The ones that we get are timestamped over 30 minutes old.=C2=<br>
>=A0 LDM is<br><br>
>showing zero complaints.=C2=A0 I&#39;ve restarted LDM, but I see no signs o=<br>
>f<br><br>
>improvement.<br><br>
><br><br>
>The problems started between 00Z and 01Z Saturday night and has just<br><br>
>gotten worse.<br><br>
><br><br>
>It&#39;s always possible there is a problem at our end, however, none of my=<br>
><br><br>
>other LDM connections have problems with delayed data.<br><br>
><br><br>
>Kevin W. Thomas<br><br>
>Center for Analysis and Prediction of Storms<br><br>
>University of Oklahoma<br><br>
>Norman, Oklahoma<br><br>
><br><br>
>On Mon, 5 Nov 2018, &#39;Bath, Kenneth&#39; via _NCEP.List.idp.mrms.users w=<br>
>rote:<br><br>
><br><br>
>&gt; Jay,<br><br>
>&gt;<br><br>
>&gt; We saw the switch to College Park on Friday at 1909Z. However, the hou=<br>
>rly dropped &amp; delayed products on LDM continued until about 0020Z on Sa=<br>
>turday, Nov. 3. Since then, the dropped &amp; missing product have generall=<br>
>y been around 0210Z and 1410Z daily, and also during the 03Z hour.<br><br>
>&gt;<br><br>
>&gt; Ken<br><br>
>&gt;<br><br>
>&gt; From: <a href=3D"mailto:<a href="mailto:ncep.list.idp.mrms.users-bounces@lstsrv.ncep.n" target="_blank">ncep.list.idp.mrms.users-bounces@lstsrv.ncep.n</a>=<br>
><a href="http://oaa.gov" rel="noreferrer" target="_blank">oaa.gov</a>" target=3D"_blank">ncep.list.idp.mrms.users-bounces@lstsrv.ncep.noa=<br>
><a href="http://a.gov" rel="noreferrer" target="_blank">a.gov</a></a> &lt;<a href=3D"mailto:<a href="mailto:ncep.list.idp.mrms.users-bounces@lstsrv.nce" target="_blank">ncep.list.idp.mrms.users-bounces@lstsrv.nce</a>=<br>
><a href="http://p.noaa.gov" rel="noreferrer" target="_blank">p.noaa.gov</a>" target=3D"_blank">ncep.list.idp.mrms.users-bounces@lstsrv.ncep.=<br>
><a href="http://noaa.gov" rel="noreferrer" target="_blank">noaa.gov</a></a>&gt; On Behalf Of Jay Iyer<br><br>
>&gt; Sent: Friday, November 02, 2018 3:06 PM<br><br>
>&gt; To: <a href=3D"mailto:<a href="mailto:ncep.list.idp.mrms.users@noaa.gov" target="_blank">ncep.list.idp.mrms.users@noaa.gov</a>" target=3D"_bl=<br>
>ank"><a href="mailto:ncep.list.idp.mrms.users@noaa.gov" target="_blank">ncep.list.idp.mrms.users@noaa.gov</a></a><br><br>
>&gt; Cc: <a href=3D"mailto:<a href="mailto:idp-support@noaa.gov" target="_blank">idp-support@noaa.gov</a>" target=3D"_blank">idp-supp=<br>
><a href="mailto:ort@noaa.gov" target="_blank">ort@noaa.gov</a></a><br><br>
>&gt; Subject: [Marketing] [Ncep.list.idp.mrms.users] MRMS Failover to Colle=<br>
>ge Park - ~19Z 11/02/2018<br><br>
>&gt;<br><br>
>&gt; MRMS Customers,<br><br>
>&gt;<br><br>
>&gt; MRMS will be moved to the College Park data center shortly at/around 1=<br>
>9Z today. We expect only a minimal disruption of data associated with this =<br>
>failover.<br><br>
>&gt;<br><br>
>&gt; If you experience a longer loss of data or any other issues with the f=<br>
>ailover and upgrade, please let the IDP team know and we will work through =<br>
>any issues.<br><br>
>&gt;<br><br>
>&gt; Thanks much,<br><br>
>&gt;<br><br>
>&gt; -Jay Iyer<br><br>
>&gt;<br><br>
>&gt;<br><br>
>&gt; --<br><br>
>&gt; Jay Iyer CyberData Technologies, Inc.<br><br>
>&gt; National Oceanic and Atmospheric Administration NWS | NCEP | NCO | IDS=<br>
>B<br><br>
>&gt; U.S. Department of Commerce<br><br>
>&gt; 5830 University Research Court<br><br>
>&gt; College Park, Maryland 20740<br><br>
>&gt; 301.683.1483&lt;tel:301.683.1483&gt; | <a href=3D"mailto:<a href="mailto:jaysankar.iye" target="_blank">jaysankar.iye</a>=<br>
><a href="mailto:r@noaa.gov" target="_blank">r@noaa.gov</a>" target=3D"_blank"><a href="mailto:jaysankar.iyer@noaa.gov" target="_blank">jaysankar.iyer@noaa.gov</a></a>&lt;mailto:<a href=<br>
>=3D"mailto:<a href="mailto:jaysankar.iyer@noaa.gov" target="_blank">jaysankar.iyer@noaa.gov</a>" target=3D"_blank">jaysankar.iyer@noaa.g=<br>
>ov</a>&gt;<br><br>
>&gt;<br><br>
>_______________________________________________<br><br>
>Ncep.list.idp.mrms.users mailing list<br><br>
><a href=3D"mailto:<a href="mailto:Ncep.list.idp.mrms.users@lstsrv.ncep.noaa.gov" target="_blank">Ncep.list.idp.mrms.users@lstsrv.ncep.noaa.gov</a>" target=3D"=<br>
>_blank"><a href="mailto:Ncep.list.idp.mrms.users@lstsrv.ncep.noaa.gov" target="_blank">Ncep.list.idp.mrms.users@lstsrv.ncep.noaa.gov</a></a><br><br>
><a href=3D"<a href="https://www.lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.idp.=" rel="noreferrer" target="_blank">https://www.lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.idp.=</a><br>
>mrms.users" rel=3D"noreferrer" target=3D"_blank"><a href="https://www.lstsrv.ncep.no" rel="noreferrer" target="_blank">https://www.lstsrv.ncep.no</a>=<br>
><a href="http://aa.gov/mailman/listinfo/ncep.list.idp.mrms.users" rel="noreferrer" target="_blank">aa.gov/mailman/listinfo/ncep.list.idp.mrms.users</a></a><br><br>
></blockquote></div><br clear=3D"all"><div><br></div>-- <br><div dir=3D"ltr"=<br>
> class=3D"gmail_signature" data-smartmail=3D"gmail_signature"><div dir=3D"l=<br>
>tr"><div><div dir=3D"ltr"><div><div dir=3D"ltr"><div><div dir=3D"ltr"><div>=<br>
><div dir=3D"ltr">=E2=80=9CThe presence of those seeking the truth is infini=<br>
>tely to be preferred to the presence of those who think they=E2=80=99ve fou=<br>
>nd it.&quot;<br></div><div>=C2=A0-- Terry Prachett<br></div><div dir=3D"ltr=<br>
>"><br>-------------------------------------------<br><a href=3D"mailto:<a href="mailto:Kare" target="_blank">Kare</a>=<br>
><a href="mailto:n.Cooper@noaa.gov" target="_blank">n.Cooper@noaa.gov</a>" target=3D"_blank"><a href="mailto:Karen.Cooper@noaa.gov" target="_blank">Karen.Cooper@noaa.gov</a></a><br><br><span=<br>
> style=3D"color:rgb(0,0,0)">Phone#:=C2=A0 405-325-6456</span><br>Cell:=C2=<br>
>=A0=C2=A0 405-834-8559<br>National Severe Storms Laboratory<br><br></div></=<br>
>div></div></div></div></div></div></div></div></div><br>
><br>
>--000000000000fb75c6057a01254b--<br>
><br>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr">“The presence of those seeking the truth is infinitely to be preferred to the presence of those who think they’ve found it."<br></div><div> -- Terry Prachett<br></div><div dir="ltr"><br>-------------------------------------------<br><a href="mailto:Karen.Cooper@noaa.gov" target="_blank">Karen.Cooper@noaa.gov</a><br><br><span style="color:rgb(0,0,0)">Phone#: 405-325-6456</span><br>Cell: 405-834-8559<br>National Severe Storms Laboratory<br><br></div></div></div></div></div></div></div></div></div></div>