System operational

Past Incidents

22nd September 2017

No incidents reported

21st September 2017

No incidents reported

20th September 2017

No incidents reported

19th September 2017

No incidents reported

18th September 2017

Network Network outage

We couldn't possibly call it a day without another (this time 2 minute only) outage. Human errors strikes again at our ISP, and sysadmins come to the rescue.

Times:

  • 18:15 UTC
  • 14:15 EDT
  • 20:15 CEST
Servers ISP Failure

Unplanned service disruption lasted for 40 minutes due to human error at our ISP (affected: login, error reporting).

All systems are operational. Status update couldn't be issued because status page was down as well.

Times:

  • 17:00 UTC
  • 13:00 EDT
  • 19:00 CEST

17th September 2017

No incidents reported

16th September 2017

Database (adult) Increased database load

Frontend application on a1 system (mostly impacted) was unstable due to a query which hit database master instead of slave.

This has caused no downtime, but made some requests take longer than usual.

Also, it took us a bit to identify the issue as it had weird manifestations.

This might have been caused by enabling some feature, as all systems were stable up until:

  • 04:00 UTC
  • 00:00 EDT
  • 06:00 CEST

https://www.youtube.com/watch?v=Vhh_GeBPOhs have sorted it.