After deployment of a fix one (out of four) PHP machines had a failure resolving opcache, which caused roughly one quarter of requests towards frontend sites to fail. Issue is resolved.
19th January 2017
No incidents reported
18th January 2017
No incidents reported
17th January 2017
No incidents reported
16th January 2017
CDNCDN outage
We had our BelugaCDN defunct for a bit for yet unidentified reason.
We'll be monitoring it and switch all static content serving from origin if issue persists.
Times when service was disrupted were: 9:40-9:57 EST (or 14:40 till 14:57 UTC).
15th January 2017
No incidents reported
14th January 2017
No incidents reported
13th January 2017
StatisticsMongoDB on Statistics
MongoDB managed to crash due to lack of space prior to scheduled maintenance move. It was down for about two hours.
Issue is resolved by sysadmin team. Stats in given period are lost.