All systems are operational

Past Incidents

Thursday 19th April 2018

MySQL cluster issues

Due issues with our MySQL server we are seeing an increased number of failed DNS queries and an increased latency for customers with a High Available solution. Both AMS and DHG are having issues, and so we're currently running on a single MySQL server. All our load balancers are routing all queries to location SPN.

We are working with a fix and will plan a urgent maintenance this night starting at 1AM to resolve the AMS and DHG locations with MySQL.

  • We have fixed the MySQL cluster without any interruptions. All locations are handling queries again and our load balancers are balancing the load accordingly.

    In the next couple of days we will watch the MySQL cluster closely to ensure smooth operational, after which our improved monitoring system will continue to monitor it.