Past Incidents

Frontend sites have experienced a brief downtime (5 minutes or so).

PHP-FPM services have been restarted and everything is currently operational. Looks like database hit max connections, we'll be investigating the reason behind it.

Timetable:

• 16:00 CET
• 15:00 UTC
• 10:00 EDT

Redis Master storage has used all of available RAM.

Machine is being upgraded, service is interrupted.

This has caused a major outage starting at approx:

• 18:40 CEST
• 16:40 UTC
• 12:40 EDT

EDIT: service is back to normal after some 40 minutes

At around:

• 17:00 UTC
• 13:00 EDT
• 19:00 CEST

Server that's hosting Payment application database (master instance) crashed and rebooted on it's own. This caused about 5 minute disruption of service. Payment application became operational as soon as machine booted.

Sysadmin team is investigating the case and preparing a replacement machine. Replacement should happen tomorrow morning with no downtime expected.