|
Event: Database loadbalancer failure #outage - Thursday, 23 July 2020
#outage
#cal-invite
Database loadbalancer failure #outage When: Thursday, 23 July 2020 8:11am to 8:15am (UTC-07:00) America/Los Angeles Description: The site was down for approximately 4 minutes because the machine insta
|
Database loadbalancer failure #outage When: Thursday, 23 July 2020 8:11am to 8:15am (UTC-07:00) America/Los Angeles Description: The site was down for approximately 4 minutes because the machine insta
|
By
...
· #25773
·
|
|
moderated
Delayed email delivery
#outage
It was taking up to three hours as of last night.
|
It was taking up to three hours as of last night.
|
By
J_Catlady
· #24603
·
|
|
moderated
Delayed email delivery
#outage
Yep, I just sent a message to one of my groups via the web interface, and it immediately appeared in the online message list ... but the e-mailed version of the message still hasn't arrived. Mark
|
Yep, I just sent a message to one of my groups via the web interface, and it immediately appeared in the online message list ... but the e-mailed version of the message still hasn't arrived. Mark
|
By
Mark
· #24602
·
|
|
moderated
Delayed email delivery
#outage
Mark, Just letting you know that something is still awry (which may or may not be related to the glitch). About 10 minutes ago, I ran a test with a test member subscribing via email to a restricted gr
|
Mark, Just letting you know that something is still awry (which may or may not be related to the glitch). About 10 minutes ago, I ran a test with a test member subscribing via email to a restricted gr
|
By
J_Catlady
· #24589
·
|
|
moderated
Delayed email delivery
#outage
Hi All, We're through the backlog now and delivery should be more or less back to normal with perhaps some continuing delays for cox.net and comcast customers because we have to strictly limit how man
|
Hi All, We're through the backlog now and delivery should be more or less back to normal with perhaps some continuing delays for cox.net and comcast customers because we have to strictly limit how man
|
By
Mark Fletcher
· #24586
·
|
|
moderated
Delayed email delivery
#outage
Patience is one thing I tend to sorely lack.;) Thanks.
|
Patience is one thing I tend to sorely lack.;) Thanks.
|
By
J_Catlady
· #24585
·
|
|
moderated
Delayed email delivery
#outage
Mark's message said, "We're now working through that immense backlog." Some folks on GMF are reporting that things are starting to come through. Maybe by tomorrow? ;>) Duane
|
Mark's message said, "We're now working through that immense backlog." Some folks on GMF are reporting that things are starting to come through. Maybe by tomorrow? ;>) Duane
|
By
Duane
· #24584
·
|
|
moderated
Delayed email delivery
#outage
FWIW we are now receiving some "subscription approval needed" emails multiple times.
|
FWIW we are now receiving some "subscription approval needed" emails multiple times.
|
By
J_Catlady
· #24583
·
|
|
moderated
Delayed email delivery
#outage
I'm still getting emails from online posts that I can see were done hours ago so it's obviously still catching up. Patience is a virtue :-) Hopefully Mark will confirm when he thinks all is fully OK a
|
I'm still getting emails from online posts that I can see were done hours ago so it's obviously still catching up. Patience is a virtue :-) Hopefully Mark will confirm when he thinks all is fully OK a
|
By
Andy Wedge
· #24582
·
|
|
moderated
Delayed email delivery
#outage
Ok, I didn't realize it was still working on catching up. Our pending subscription notices and confirmation notices are not going out at all.
|
Ok, I didn't realize it was still working on catching up. Our pending subscription notices and confirmation notices are not going out at all.
|
By
J_Catlady
· #24580
·
|
|
moderated
Delayed email delivery
#outage
I had this for a new member I had added. It got updated as messages were delivered. They came out of the normal sequence but they all got there in the end. I'm sure it'll all be OK once the back end s
|
I had this for a new member I had added. It got updated as messages were delivered. They came out of the normal sequence but they all got there in the end. I'm sure it'll all be OK once the back end s
|
By
Andy Wedge
· #24579
·
|
|
moderated
Delayed email delivery
#outage
Mark,I think there might still be a delay. I resent several confirmation emails a few minutes ago and the people are showing no email deliveries in their history.
|
Mark,I think there might still be a delay. I resent several confirmation emails a few minutes ago and the people are showing no email deliveries in their history.
|
By
J_Catlady
· #24578
·
|
|
moderated
Delayed email delivery
#outage
p.s. Mark: Actually I think the display order problem was probably also caused by the same glitch, so you can ignore/delete my bug report about it. Thanks.
|
p.s. Mark: Actually I think the display order problem was probably also caused by the same glitch, so you can ignore/delete my bug report about it. Thanks.
|
By
J_Catlady
· #24577
·
|
|
moderated
Delayed email delivery
#outage
This appears to have affected things besides sent messages. Our six invites last night were marked as "sending" instead of "sent" until this morning, causing me to think something else was the cause.
|
This appears to have affected things besides sent messages. Our six invites last night were marked as "sending" instead of "sent" until this morning, causing me to think something else was the cause.
|
By
J_Catlady
· #24576
·
|
|
moderated
Delayed email delivery
#outage
All, Last night at 9:31pm Pacific Time, the database that stores email messages in the process of being delivered corrupted itself. I don't know how. Because of that, we stopped processing/delivering
|
All, Last night at 9:31pm Pacific Time, the database that stores email messages in the process of being delivered corrupted itself. I don't know how. Because of that, we stopped processing/delivering
|
By
Mark Fletcher
· #24575
·
|
|
moderated
Event: Unplanned downtime #outage - Tuesday, 11 February 2020
#outage
#cal-invite
Unplanned downtime #outage When: Tuesday, 11 February 2020 8:17pm to 8:23pm (UTC-08:00) America/Los Angeles Description: An upgrade to one of the database tables unexpectedly ended up locking the data
|
Unplanned downtime #outage When: Tuesday, 11 February 2020 8:17pm to 8:23pm (UTC-08:00) America/Los Angeles Description: An upgrade to one of the database tables unexpectedly ended up locking the data
|
By
...
· #24162
·
|
|
moderated
Email queue corruption
#outage
Not sure if I lost any mails but a couple we posted last night (around 2000z UK) took around 20 minutes before they were delivered. Dave http://davesergeant.com
|
Not sure if I lost any mails but a couple we posted last night (around 2000z UK) took around 20 minutes before they were delivered. Dave http://davesergeant.com
|
By
Dave Sergeant
· #23942
·
|
|
moderated
Email queue corruption
#outage
Hi All, During one of the normal site upgrades today (something I generally do 5-20 times a day), the database storing emails to be sent out became corrupted. This led to the loss of some emails that
|
Hi All, During one of the normal site upgrades today (something I generally do 5-20 times a day), the database storing emails to be sent out became corrupted. This led to the loss of some emails that
|
By
Mark Fletcher
· #23939
·
|
|
moderated
Event: Database server crash #outage - Wednesday, 22 January 2020
#outage
#cal-invite
Database server crash #outage When: Wednesday, 22 January 2020 4:54am to 5:06am (UTC-08:00) America/Los Angeles Description: The main database server froze up for reasons unknown. Rebooting the machin
|
Database server crash #outage When: Wednesday, 22 January 2020 4:54am to 5:06am (UTC-08:00) America/Los Angeles Description: The main database server froze up for reasons unknown. Rebooting the machin
|
By
...
· #23907
·
|
|
moderated
Downtime this morning
#outage
Hi All, Well that was fun. Here's what I know right now. At 8:28am pacific time, one of the back end machines appeared to freeze up in a weird way. This machine takes all changes to the main database
|
Hi All, Well that was fun. Here's what I know right now. At 8:28am pacific time, one of the back end machines appeared to freeze up in a weird way. This machine takes all changes to the main database
|
By
Mark Fletcher
· #20720
·
|
