BigPanda incident

OIM Latencies

Minor Resolved View vendor source →

BigPanda experienced a minor incident on August 7, 2024 affecting Data Consumption, lasting 1h 28m. The incident has been resolved; the full update timeline is below.

Started
Aug 07, 2024, 01:48 PM UTC
Resolved
Aug 07, 2024, 03:17 PM UTC
Duration
1h 28m
Detected by Pingoru
Aug 07, 2024, 01:48 PM UTC

Affected components

Data Consumption

Update timeline

  1. investigating Aug 07, 2024, 01:48 PM UTC

    Some OIM events are queued and not making it to the BigPanda console. The team are engaged and we are currently investigating this issue.

  2. investigating Aug 07, 2024, 01:59 PM UTC

    We are continuing to investigate. We have determined that this is not a complete outage in OIM as many events are still being processed. Only some events are being held in a queue.

  3. investigating Aug 07, 2024, 02:23 PM UTC

    The queue is now starting to clear and latencies dropping

  4. monitoring Aug 07, 2024, 02:41 PM UTC

    A fix has been implemented and we are monitoring the results.

  5. monitoring Aug 07, 2024, 03:07 PM UTC

    The latency is now resolved and our OIM service is fully operational. We are continuing to monitor.

  6. resolved Aug 07, 2024, 03:17 PM UTC

    This incident has been resolved.