Past Incidents

Redis Master storage has used all of available RAM.

Machine is being upgraded, service is interrupted.

This has caused a major outage starting at approx:

• 18:40 CEST
• 16:40 UTC
• 12:40 EDT

EDIT: service is back to normal after some 40 minutes

At around:

• 17:00 UTC
• 13:00 EDT
• 19:00 CEST

Server that's hosting Payment application database (master instance) crashed and rebooted on it's own. This caused about 5 minute disruption of service. Payment application became operational as soon as machine booted.

Sysadmin team is investigating the case and preparing a replacement machine. Replacement should happen tomorrow morning with no downtime expected.

One of physical servers that is a host to a variety of virtual nodes has failed.

This caused some service interruption (eg, prolonged login time). In first iteration, it crashed and service was recovered after reboot. However, it seems it has issues with CPU so existing virtual machines are being migrated to another instance.

Timetable:

• 10:00 UTC
• 06:00 EST
• 12:00 CEST

Our ISP (CyberWurx) was down 45 min, We have contacted them a got response:

Hello,

We have just resolved an issue with a network attack. Hopefully your service should be back to normal at this point. If you are still having problems after about 10-15 minutes, send us a traceroute and we can take another look for you.

Apologies for the inconvenience!

Time of incident:

• 22:00 UTC
• 18:00 EST
• 00:00 CEST