System operational

Past Incidents

20th September 2017

No incidents reported

19th September 2017

No incidents reported

18th September 2017

Network Network outage

We couldn't possibly call it a day without another (this time 2 minute only) outage. Human errors strikes again at our ISP, and sysadmins come to the rescue.

Times:

  • 18:15 UTC
  • 14:15 EDT
  • 20:15 CEST
Servers ISP Failure

Unplanned service disruption lasted for 40 minutes due to human error at our ISP (affected: login, error reporting).

All systems are operational. Status update couldn't be issued because status page was down as well.

Times:

  • 17:00 UTC
  • 13:00 EDT
  • 19:00 CEST

17th September 2017

No incidents reported

16th September 2017

Database (adult) Increased database load

Frontend application on a1 system (mostly impacted) was unstable due to a query which hit database master instead of slave.

This has caused no downtime, but made some requests take longer than usual.

Also, it took us a bit to identify the issue as it had weird manifestations.

This might have been caused by enabling some feature, as all systems were stable up until:

  • 04:00 UTC
  • 00:00 EDT
  • 06:00 CEST

https://www.youtube.com/watch?v=Vhh_GeBPOhs have sorted it.

15th September 2017

No incidents reported

14th September 2017

No incidents reported