Incident History
History
June 21 12:18 AM PDTrootly.com is down
Cloudflare fixed the issue and we are seeing Rootly web UI/Slack and services back up.
Due to Cloudflare outage https://www.cloudflarestatus.com/ our web API and Slack client are partially available.
Slack outage impacting incident creation on Slack
Incident creation is back up and running on Slack. Thank you for your patience.
Slack is currently experiencing an outage that is causing interactions with the Rootly Slack app to fail, namely around incident creation. https://status.slack.com/2022-03/8a9e98bfaa32ef5f
Reminder - Our web app continues to run normally as a backup.
Heroku outage impacting all apps
Heroku outage caused degraded service on both Slack and Web. It has been resolved and everything has returned to normal.
Slack channel creation failing
Everything is back up and running wrt to Slack
Confirmed outage on Slack end causing Rootly app connections to be degraded: https://status.slack.com/
Incident creation via Web continues to work as expected, just degraded experience on Slack. Please use Web to create your incidents until this is resolved, thanks!
Reports that channel creation is not working. It appears Slack itself is suffering from an outage.
AWS outage impacting Slack
Slack appears to be back up and running. Incident channel creation is also working.
AWS currently having an outage that is impacting the Rootly Slack application.
More details from Slack: https://status.slack.com/
Elasticsearch cluster is down
Elasticsearch is back up and running. This would have impacted the loading of incidents on web but does not appear to have affected incident creation.
We identified an issue with our Elasticsearch cluster and are currently recovering it.
Some users aren't able to login through SSO
Everything is back in order!
We are looking at this issue with our different identity providers