» Published on
The on-call engineering team was alerted to an intermittent spike in errors in the EU Multi-tenant environment at 04:00 UTC. This progressed to intermittent Dashboard inaccessibility at 04:26 UTC. Working through the incident the team identified an anomaly with the databases underpinning the environment and performed mitigations to restore service. Full operations resumed at 05:41 UTC.
During this incident, customers experienced intermittent increases in error rates on all API endpoints, dashboard inaccessibility, and campaign delays and failures. All issues have been resolved as of 05:41 UTC.
» UpdatedThe environment has been stabilised and full service has been restored. The team will continue to monitor the environment but no further issues are expected.
» UpdatedThe team have isolated an anomaly with the databases underpinning the environment and are working to stabilise fully. The volume of errors has already been reduced by mitigation steps performed.
» UpdatedThe team is responding to an alert about spikes in errors in the EU multi-tenant environment. They are working to stabilise the environment and will update with more info here as soon as possible.
» Updated