Nobl9 experienced a minor incident on September 23, 2022 affecting Web App, lasting 14h 54m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Sep 23, 2022, 02:29 AM UTC
We are currently investigating intermittent latency spikes on our ingest service due to an upstream dependency. During this time there may be degraded web app performance. We will provide updates as new information surfaces. Please reach out to [email protected] if you have any questions or concerns.
- investigating Sep 23, 2022, 07:17 AM UTC
We are still investigating this issue.
- identified Sep 23, 2022, 09:11 AM UTC
We have established that there are two issues at hand, one on the side of an upstream dependency which we are trying to mitigate on our end by stopping latency spikes caused by that dependency, and the second one connected to our UI, fixes are in progress. but there is no ETA yet.
- identified Sep 23, 2022, 02:50 PM UTC
We are currently testing a hotfix to mitigate issues with latency spikes on our ingest service and degraded UI performance.
- monitoring Sep 23, 2022, 03:55 PM UTC
We have released a hotfix that resolves UI degraded performance and mitigates issues of latency spikes from an upstream dependency.
- resolved Sep 23, 2022, 05:24 PM UTC
No additional issues were observed during the monitoring phase. All known issues have been mitigated at this time and we will continue to work with our upstream dependency for further tweaks. In case of any questions or concerns please reach out to [email protected]