Hi All,

The site is having issues. Something is up with either the Linode internal network or Amazon S3. I'm working to figure it out.

Thanks,
Mark

Hi All,

The site is having issues. Something is up with either the Linode internal network or Amazon S3. I'm working to figure it out.

Thanks,
Mark

On Wed, Dec 15, 2021 at 9:31 AM Glenn Glazer <glenn.glazer@...> wrote:

Since we were also dealing with this at work, AWS had a "connectivity outage" in US-WEST-1, US-WEST-2 and US-GOV-WEST-1. Our first message from their bot was at 1558 UTC, seems to have started resolving approximately 15 minutes ago.

Good to know. Our issues started at around 7:19am pacific time, so a bit before AWS's issues were reported to you (we only use S3 from AWS). I did see a lot of connection issues to S3, but I don't know yet if that was because of an S3 issue or because of an internal Linode network issue. I do know that I never got a page about the problems, because Pagerduty (the service we use to send me pages) had problems at the same time we did (which makes me think it was a much wider issue with AWS and not Linode). Fortunately I was on the system when it started to happen, so I saw it immediately.

I'm still working through all the outage data and doing a postmortem, which I'll post here probably tomorrow. We've been back and normal since 7:57am pacific time. 

Thanks,

Mark