Labor Ticket Form Ourate
Timeline · 1 update
- resolved Oct 06, 2026, 08:47 PM UTC
There was an issue with displaying the Submit Work form for MES enabled customers. The incident has been resolved.
MachineMetrics Outage History
MachineMetrics is up right nowMachineMetrics had 27 outages in the last 2 years totaling 58h 23m of downtime, averaging 1.1 incidents per month.
There were 27 MachineMetrics outages since October 29, 2024 totaling 58h 23m of downtime. Each is summarised below. Incident details, duration, and resolution information.
Shift Based Reporting Inaccurate
Affected: Data Processing Services
Timeline · 3 updates
- identified Aug 19, 2026, 01:54 PM UTC
We have an issue impacting a subset of customers where shift based reporting has become unreliable for data from the last few days. A fix has been identified and we are working on applying it.
- monitoring Aug 19, 2026, 03:24 PM UTC
A fix has been implemented and we are monitoring the results.
- resolved Aug 19, 2026, 04:15 PM UTC
This incident has been resolved.
Machine Data Ingest Lagging
Affected: Data Processing Services
Timeline · 4 updates
- identified Aug 12, 2026, 03:36 PM UTC
We are currently experiencing delayed processing in our data pipeline for some of our customers. This may affect real-time data being displayed on dashboards and the operator view for the affected customers. We have identified the issue and are working on a solution.
- identified Aug 12, 2026, 05:36 PM UTC
We are continuing to work on a fix for this issue.
- monitoring Aug 12, 2026, 06:29 PM UTC
A fix has been implemented and we are monitoring the results.
- resolved Aug 12, 2026, 06:51 PM UTC
This incident has been resolved. All machine data has been processed.
Machine Data Processing Delayed for Some Systems
Affected: Web ApplicationData Processing ServicesOperator Dashboard
Timeline · 3 updates
- investigating Jul 26, 2026, 06:50 PM UTC
We are currently investigating an issue which is causing data processing to be delayed. Some areas of the product that are impacted are Timelines, Operator View, and others.
- monitoring Jul 26, 2026, 08:16 PM UTC
A fix has been implemented and we are monitoring the results.
- resolved Jul 26, 2026, 08:39 PM UTC
This incident has been resolved.
Historical Reporting Delayed, Investigating
Affected: Data Processing Services
Timeline · 2 updates
- identified Jul 10, 2026, 06:11 PM UTC
We are experiencing downstream affects from an outage at one of our providers. This is resulting in historical reporting to be delayed. A fix has been identified and we are working to implement it now.
- resolved Jul 10, 2026, 06:38 PM UTC
This incident has been resolved.
Some Web Pages Failing
Affected: Web Application
Timeline · 3 updates
- identified Jun 18, 2026, 05:29 PM UTC
We are currently implementing fixes for an issue which is impacting some pages of the application. ShopPulse is unaffected, API endpoints and data ingestion are not impacted. There are a small number of pages that are failing to load.
- identified Jun 18, 2026, 06:07 PM UTC
The fixes impacting page loads are deploying at this time
- resolved Jun 18, 2026, 06:27 PM UTC
The fix has been deployed to all production environments and pages should be loading normally now. A page reload may be required for the fix to apply in some cases.
Historical Reporting is Behind
Affected: Data Processing Services
Timeline · 4 updates
- investigating Jun 09, 2026, 12:40 AM UTC
"We are currently investigating an issue affecting historical reporting, which is lagging further behind real-time than expected. Some customers may be impacted. We will provide an update shortly.
- identified Jun 09, 2026, 04:48 AM UTC
The issue has been identified and a fix is being implemented.
- monitoring Jun 09, 2026, 05:20 AM UTC
A fix has been implemented and we are monitoring the results.
- resolved Jun 09, 2026, 05:25 AM UTC
This incident has been resolved.
Data Ingest Lagging and Higer Response Times
Affected: Web ApplicationData Processing ServicesOperator Dashboard
Timeline · 3 updates
- identified Jun 04, 2026, 04:22 AM UTC
We are currently experiencing delayed processing in our data pipeline and slower response times. This may affect real-time data being displayed on dashboards and the operator view for the affected customers. We have identifed the root cause and are working on a solution.
- monitoring Jun 04, 2026, 04:35 AM UTC
A fix has been implemented and we are monitoring the results.
- resolved Jun 04, 2026, 04:44 AM UTC
This incident has been resolved.
Increased Error Rate
Affected: Web ApplicationData Processing ServicesOperator Dashboard
Timeline · 2 updates
- investigating Jun 02, 2026, 11:55 AM UTC
We are investigating increased application error rates.
- resolved Jun 02, 2026, 12:03 PM UTC
This incident has been resolved.
Intermittent Errors and Degraded Performance
Affected: Web ApplicationData Processing ServicesOperator Dashboard
Timeline · 2 updates
- monitoring Jun 02, 2026, 12:44 AM UTC
Beginning around 5:30 PM EDT, some users experienced intermittent errors and slower-than-normal performance in the web application and Operator Dashboard, and some real-time data and reporting may have been delayed. We identified the cause and reverted a recent change. The system has largely recovered, and we are monitoring to confirm full stability.
- resolved Jun 02, 2026, 01:11 AM UTC
The incident is resolved at this time.
Central Querying System Down
Affected: Web ApplicationData Processing ServicesOperator Dashboard
Timeline · 4 updates
- investigating May 28, 2026, 12:42 PM UTC
We are currently investigating an issue that is causing some core data systems to be unavailable. This impacts most areas of our product including Labor Ticket submission, ERP sync, Operator View, Timeline and other real-time reporting applications in the core product and in external systems.
- identified May 28, 2026, 12:43 PM UTC
We are still investigating the cause; however, we were able to identify a workaround and are now implementing a fix.
- monitoring May 28, 2026, 12:54 PM UTC
A fix has been implemented and we are monitoring the results.
- resolved May 28, 2026, 01:02 PM UTC
This incident has been resolved.
App and ShopPulse Response Times Slow
Affected: Web Application
Timeline · 3 updates
- investigating May 20, 2026, 02:29 PM UTC
Response times for all endpoints are slow. We have been investigating the issue. We will post updates as more information is available.
- investigating May 20, 2026, 05:05 PM UTC
Response times have come down considerably but we are still working to make additional improvements.
- resolved May 20, 2026, 06:16 PM UTC
Application performance has improved to acceptable levels. While we are closing this incident, we will continue to make improvements to application performance and stability.
Machine Data Not Reporting for Some Companies
Affected: Data Processing Services
Timeline · 4 updates
- investigating May 04, 2026, 01:54 PM UTC
We are currently investigating an issue that is impacting some customers where edge devices are not properly sending data to our cloud. We will post updates as more information is available.
- monitoring May 04, 2026, 04:53 PM UTC
For affected customers, data is beginning to flow again. We are working to accelerate data processing.
- monitoring May 04, 2026, 09:58 PM UTC
All machines are reporting; however, historical reporting via the Report Builder and some other dashboard widgets may still take longer than usual to update as changes are made to categorized downtime, edits to production runs, and other historical edits.
- resolved May 05, 2026, 12:47 AM UTC
All data is reporting normally.
Categorized Downtime in Historical Reporting Lagging
Affected: Web Application
Timeline · 2 updates
- identified Apr 01, 2026, 04:30 PM UTC
An issue has been identified leading to categorized downtime lag for historical reporting. This would impact downtime categorized after March 31st 6:15am EST. A fix has been implemented and the reporting data processing is being expedited.
- resolved Apr 01, 2026, 07:26 PM UTC
This incident has been resolved.
Historical Reporting Lagging
Affected: Web Application
Timeline · 4 updates
- investigating Mar 31, 2026, 04:46 PM UTC
We are currently working to address an issue which is causing all data for historical reporting to fall behind after 11:30AM EST. Data from these reports will be inaccurate while we address this issue. This data will be made available at that time.
- monitoring Mar 31, 2026, 06:34 PM UTC
A fix has been implemented and we are monitoring the results.
- monitoring Mar 31, 2026, 06:50 PM UTC
We are continuing to monitor for any further issues.
- resolved Mar 31, 2026, 07:00 PM UTC
This incident has been resolved.
System Outage
Affected: Web ApplicationData Processing ServicesOperator Dashboard
Timeline · 3 updates
- identified Mar 18, 2026, 06:00 PM UTC
The issue has been identified and a fix is being implemented.
- monitoring Mar 18, 2026, 06:02 PM UTC
A fix has been implemented and we are monitoring the results.
- resolved Mar 18, 2026, 06:05 PM UTC
This incident has been resolved.
Data Processing Lag
Affected: Data Processing Services
Timeline · 3 updates
- identified Feb 25, 2026, 05:57 AM UTC
We have identified an issue our part of our data processing pipeline impacting some features such as automatic ideal cycle time, auto downtime and automatic part rejections. Steps to resolution are in progress
- monitoring Feb 25, 2026, 07:52 AM UTC
A fix has been implemented and we are in the process of catching up lag.
- resolved Feb 25, 2026, 08:42 AM UTC
Data processing is operating as expected for the impacted services.
Data Ingest Lagging
Affected: Data Processing Services
Timeline · 3 updates
- investigating Jan 22, 2026, 04:31 PM UTC
We are currently experiencing delayed processing in our data pipeline for some of our customers. This may affect real-time data being displayed on dashboards and the operator view for the affected customers.
- monitoring Jan 22, 2026, 04:38 PM UTC
A fix has been implemented and we are monitoring the results.
- resolved Jan 22, 2026, 04:41 PM UTC
This incident has been resolved.
Historical Reporting Delayed
Affected: Data Processing Services
Timeline · 3 updates
- identified Nov 03, 2025, 11:19 AM UTC
We are currently working to address an issue which is causing all data for historical reporting to be unavailable after 3:30AM EST. Data from these reports will be inaccurate while we address this issue. This data will be made available at that time.
- identified Nov 03, 2025, 11:19 AM UTC
We are continuing to work on a fix for this issue.
- resolved Nov 03, 2025, 04:56 PM UTC
This incident has been resolved.
AWS Outage
Affected: Web ApplicationData Processing ServicesOperator Dashboard
Timeline · 4 updates
- identified Oct 20, 2025, 07:40 PM UTC
Outage with AWS
- monitoring Oct 20, 2025, 07:45 PM UTC
All systems are operational at this moment; however, due to instability reported by our cloud services provider throughout the day, we will leave this incident open and will post updates as more information is available.
- monitoring Oct 20, 2025, 07:58 PM UTC
We are continuing to monitor for any further issues.
- resolved Oct 21, 2025, 01:19 AM UTC
Our services were affected earlier today by a widespread AWS outage that caused disruptions across multiple providers. We implemented a the necessary workarounds based on updated guidance, and this restored all systems to normal operation. Everything is now fully operational. We’ll continue to monitor the situation.
Interrupted Delivery of Text Message Notifications
Affected: Data Processing Services
Timeline · 2 updates
- identified Oct 20, 2025, 10:36 AM UTC
We are currently experiencing issues with our notification service, resulting in some notifications not being sent to customers. We will post again here when the issue has been resolved.
- resolved Oct 20, 2025, 01:08 PM UTC
This incident has been resolved.
Data Collection Lagging
Affected: Web ApplicationData Processing ServicesOperator Dashboard
Timeline · 3 updates
- identified Jul 29, 2025, 03:29 AM UTC
We are currently experiencing delayed processing in our data pipeline for a small fraction of our customers. This may affect real-time data being displayed on dashboards and the operator view for the affected customers.
- monitoring Jul 29, 2025, 03:36 AM UTC
A fix has been implemented and we are monitoring the results.
- resolved Jul 29, 2025, 04:23 AM UTC
This incident has been resolved.
Elevated Query Execution Times
Affected: Web ApplicationOperator Dashboard
Timeline · 4 updates
- investigating May 05, 2025, 12:09 PM UTC
We are currently experiencing elevated query execution times on one of our databases. This might cause some features of our user interface (e.g., the timelines) to load slower.
- identified May 05, 2025, 12:42 PM UTC
The issue has been identified and a fix is being implemented.
- monitoring May 05, 2025, 02:03 PM UTC
A fix has been implemented and we are monitoring the results.
- resolved May 05, 2025, 02:09 PM UTC
This incident has been resolved.
Data Processing Pipeline Delayed
Affected: Data Processing Services
Timeline · 4 updates
- investigating Apr 03, 2025, 10:17 AM UTC
We are currently investigating an issue that is resulting in machine data processing being delayed.
- monitoring Apr 03, 2025, 10:29 AM UTC
Data is now being processed at a normal rate and the system is recovering. Our team is actively monitoring the situation to ensure continued stability. We will provide another update once all data processing is fully caught up and the issue has been resolved.
- monitoring Apr 03, 2025, 10:55 AM UTC
We are continuing to monitor for any further issues.
- resolved Apr 03, 2025, 10:56 AM UTC
This incident has been resolved.
Data Stream Processing Delayed
Affected: Data Processing Services
Timeline · 4 updates
- investigating Feb 05, 2025, 04:46 PM UTC
One of our data processing services is currently affected by a partial outage. This potentially affects APM, part reject services, and other services.
- identified Feb 05, 2025, 05:19 PM UTC
The issue has been identified and a fix is being implemented.
- monitoring Feb 05, 2025, 07:44 PM UTC
A fix has been implemented and we are monitoring the results.
- resolved Feb 05, 2025, 09:09 PM UTC
This incident has been resolved.