Topic: GAC Data Gaps or Missing in POES-EL Operations 


Date/Time Issued: July 10, 2024 0034Z 


Product or Data Impacted: NOAA L1b GAC Data


Date/Time of Initial Impact:  See far right column below


Date/Time of Expected End:  See far right column below


Length of the Outage/Event: N/A


Details/Specifics of Change: Partial GAC / Missed GAC  


Vehicle Pass PlanPass TypeLoad NotesOperator
Workstation
IRONSiteJulian DayDateAOS (UTC)DateLOS (UTC)Rev NumberMax El (deg)Pass ResultOperator Actions/ Intervention
NOAA-19
HRPT, GAC, Encrypted CMD
Automated
String 3
System
5
33591
SG189
24191
7/9/2024
18:12
7/9/2024
18:27
79481.1
61.09
Failed (HRPT not received, GAC not received, DAU Reset not verified)Telemetry was not received during the entire contact. OX AceCP showed that Site TLM was red, indicating a potential interferance with our telemetry connection to KSAT. KSAT's portal showed that telemetry was received.

During the pass, the PEL Operator disconnected, then reconnected their TLM string. HRPT/GAC frames did not sync so PEL Operator closed/opened AceCP. Still, telemetry was not received. 
NOAA-15
HRPT, GAC, Encrypted CMD
Automated
String 2
System
5
25338
SG184
24191
7/9/2024
18:15
7/9/2024
18:30
36065.1
34.89
Failed (HRPT not received, GAC not received, DAU Reset not verified)Telemetry was not received during the entire contact. OX AceCP showed that Site TLM was red, indicating a potential interferance with our telemetry connection to KSAT. KSAT's portal showed that telemetry was received.

During the pass, the PEL Operator disconnected, then reconnected their TLM string. HRPT/GAC frames did not sync so PEL Operator closed/opened AceCP. Still, telemetry was not received.

After the contact, PEL Operator reset the TFE services on all GSFEP and GSGTW VMs as well as the CCT service on all P-OX-OPS VMs
NOAA-18
HRPT, GAC, Encrypted CMD
Automated
String 1
System
4
28654
SG185
24191
7/9/2024
19:17
7/9/2024
19:32
98645.1
72.16
Failed (HRPT not received, GAC not received, DAU Reset not verified)Telemetry was not received during the entire contact. OX AceCP showed that Site TLM was red, indicating a potential interferance with our telmetry connection out to KSAT. KSAT's portal shows that telemetry was received during the contact. During the pass, the PEL Operator disconnected, then reconnected their TLM string. HRPT/GAC frames did not sync so PEL Operator closed/opened AceCP. Still, telemetry was not received.

Parsons IT will reset all VMs at 19:40 UTC
NOAA-19
HRPT, GAC, Encrypted CMD
Automated
String 3
System
3
33591
SG189
24191
7/9/2024
19:53
7/9/2024
20:08
79482.1
35.6
Failed (HRPT not received, GAC not received, DAU Reset not verified)OX CCT logs show that we are unable to make a connection to KSAT's Rest Server. Parsons is currently troubleshooting. 
NOAA-15
HRPT, GAC, Encrypted CMD
Automated
String 2
System
3
25338
SG184
24191
7/9/2024
19:57
7/9/2024
20:10
36066.1
20.29
Failed (HRPT not received, GAC not received, DAU Reset not verified)OX CCT logs show that we are unable to make a connection to KSAT's Rest Server. Parsons is currently troubleshooting. 
NOAA-18
HRPT, GAC, Encrypted CMD
Automated
String 1
System
4
28654
SG185
24191
7/9/2024
20:58
7/9/2024
21:14
98646.1
42.7
Failed (HRPT not received, GAC not received, DAU Reset not verified)OX CCT logs show that we are unable to make a connection to KSAT's Rest Server. Parsons is currently troubleshooting.

Hereth contacted Maggie A. and sent email to NOAA
NOAA-19
HRPT, GAC, Encrypted CMD
Automated
String 3
System
33591
SG189
24191
7/9/2024
21:36
7/9/2024
21:50
79483.1
20.9
Failed (HRPT not received, GAC not received, DAU Reset not verified)OX CCT logs show that we are unable to make a connection to KSAT's Rest Server. Parsons is currently troubleshooting. 
NOAA-15


Contact Information for Further Information: ESPC Operations at ESPCOperations@noaa.gov or 301-817-3880 24x7


Web Site(s) for Applicable Information: https://www.ospo.noaa.gov/Products/ppp/monitor/index.html


This message was sent by ESPC.Notification@noaa.gov. You have been sent this and other notifications because you have opted in to receive it. If for any reason, you wish to unsubscribe, please contact ESPC Help Desk at ESPCOperations@noaa.gov or (301) 817-3880. Please note: it may take up to two business days to process your unsubscribe request.