Date   

moderated Re: Site updates #changelog

debbie
 

Wow, that IS a lot of work! Just got one question: " BUGFIX: Fixed line breaks in the index in the plain text digest."

Is this supposed to mean that it is returned to the original single spacing, or it's the "fix" to make it double spaced (which I don't like). My digests are still coming with the index double spaced.


On Sat, Jan 11, 2020 at 1:51 AM Mark Fletcher <markf@corp.groups.io> wrote:

Changes to the site the past few weeks:

  • BUGFIX: When a poll was created and moderated, if a group moderator edited the poll before approving it, the poll ownership was mistakenly changed to the moderator.
  • CHANGE: All premium groups now have 20GB of storage.
  • CHANGE: The 'Note Sent To Attendees' email sent to people reply yes to an event, as well as the email notifying someone they have been moved from the waitlist to the attending list, were sent from the +owner email address. They are now sent as coming from the creator of the event.
  • INTERNAL: Wrote a new utility to do some consistency checking and cleanups of the various databases.
  • API: We are now ratelimiting the /downloadarchives endpoint because of abuse.
  • INTERNAL: Developed a new system to make it easier to grep through all the various logs to research problems in the system.
  • INTERNAL: Switched from a redis-based rate limiting system to a custom system.
  • BUGFIX: When changing your email address, we were sending the warning email to the new email address when we should have been sending it to the old email address.
  • CHANGE: Display the updated date in the 'Uploaded' column in the files section.
  • CHANGE: Previously, when a group had separate footers checked, we would not try to strip out any remnant footers from incoming replies. Because some mailers combine multiple text parts when replying, we still need to look for these footers in replies, otherwise unsubscribe links could be inadvertently sent out.
  • BUGFIX: For some reason, a few people started receiving duplicate summaries the last couple of days. I refactored the code that generates the summaries and that fixed the problem even though that code hadn't been touched in months.
  • NEW: Added new Event Summary Email interval: Bi-Weekly on Fridays.
  • CHANGE: Changed Zendesk to send back an acknowledgement when a support email is received.
  • BUGFIX: For enterprise groups without a custom home page, setting disable sign up to true would result in an endless redirect.
  • CHANGE: Modified message import code to support mbox files from Yahoo Group's export system.
  • API: Added /updatewikipage, /deletewikipage and /deletewikirevision endpoints.
  • BUGFIX: For people on special messages only, the message footers wrongly said You receive all messages sent to this group.
  • NEW: Special messages are now sent with the subject tag [Special].
  • API: Changed moderated to moderation in the Group object.
  • NEW: Added additional information to the Sent message requiring approval activity log line, specifying exactly why a message was moderated. This duplicated the Message from member required approval because of virus line, which I have removed.
  • SYSADMIN: Upgraded hot spare database instance to have the same resources as our main database.
  • INTERNAL: Switched from a redis-based session tracking system to a custom system.
  • BUGFIX: Fixed line breaks in the index in the plain text digest.
  • API: Added plan field to group object.
  • API: Added nice_group_name, cover_photo_url, icon_url, subs_count, most_recent_message fields to the member_info object.
  • API: Changed the sort options for the /getsubs endpoint and added the set_home_page parameter.
  • API: First pass at /getdatabaserows endpoint.
  • NEW: Added 'Deleted Account' activity log entry for when people delete their accounts.
  • API: Added is_reply field to Message object.
  • INTERNAL: Lots of technical debt formatting issues cleaned up.
  • API: Added /getdatabases endpoint.
  • INTERNAL: Split smtpauthd from smtpd server to make things more clear.

Have a good weekend everyone.

Mark


moderated Re: Message summary a mess - but not due to IO

 

On Sat, Jan 11, 2020 at 09:03 PM, Gerald Boutin wrote:
I restarted my computer and it was fixed
That totally threw me, too. :)
 
--
J

Messages are the sole opinion of the author, especially the fishy ones.
My humanity is bound up in yours, for we can only be human together. - Desmond Tutu


moderated Re: Message summary a mess - but not due to IO

Gerald Boutin <groupsio@...>
 

On Sun, Jan 12, 2020 at 12:48 AM, J_Catlady wrote:
Gerald,

I'm pretty sure Tom is seeing what we all are seeing. But he wants this instead:

"When the message is returned from a search it should appear just as it would if you were scrolling through messages.  The title followed with first couple lines of the message." 

That's the issue. I finally get what he's asking for and, like Shal, I vehemently disagree. :)
--
J

 

OK, understood. I got thrown by "After pulling my hair out, I restarted my computer and it was fixed" and "random collection of the text".

I also prefer it as is. 

--
Gerald


moderated Re: Message summary a mess - but not due to IO

 

Gerald,

I'm pretty sure Tom is seeing what we all are seeing. But he wants this instead:

"When the message is returned from a search it should appear just as it would if you were scrolling through messages.  The title followed with first couple lines of the message." 

That's the issue. I finally get what he's asking for and, like Shal, I vehemently disagree. :)
--
J

Messages are the sole opinion of the author, especially the fishy ones.
My humanity is bound up in yours, for we can only be human together. - Desmond Tutu


moderated Re: Message summary a mess - but not due to IO

Gerald Boutin <groupsio@...>
 

On Sat, Jan 11, 2020 at 11:21 PM, Tom Vail wrote:
Not sure why it went away when I restarted, but it is back doing the same thing and a second restart did not fix it this time.

I view this as a bug.  When the message is returned from a search it should appear just as it would if you were scrolling through messages.  The title followed with first couple lines of the message.  Not some random collection of the text which makes it unintelligible.  And the text it is collecting does not necessarily have the search argument in it.

Hope this can be fixed quickly as it is holding up a project for me.

Peace,
Tom
Tom,

I (and others) are seeing what looks like rational results. Here is what I see on a search for "cookies" in this group. Please do this same search and let us know the results. If the results are random, please let us see exactly what they are.


 
--
Gerald


moderated Re: Message summary a mess - but not due to IO

 

In other words, it looks like it's behaving completely appropriately and correctly. The only possible improvement I can see would be to increase the snippet space to allow more than one context, in case the occurrences of the search terms are far apart in the message. But that's a trade-off. And it does seem like an appropriate trade-off has been made in that respect.
--
J

Messages are the sole opinion of the author, especially the fishy ones.
My humanity is bound up in yours, for we can only be human together. - Desmond Tutu


moderated Re: Message summary a mess - but not due to IO

 

On Sat, Jan 11, 2020 at 08:00 PM, J_Catlady wrote:
It does not return
should read "it does not highlight"
 
--
J

Messages are the sole opinion of the author, especially the fishy ones.
My humanity is bound up in yours, for we can only be human together. - Desmond Tutu


moderated Re: Message summary a mess - but not due to IO

 

Shal/Tom,

I agree that it should show the search term in context, and it does. But I'm not sure I'm understanding the behavior Tom is describing.

From my test this morning, it finds and highlights the first occurrence of the search term, and it also highlights any occurrences after the first one *that occur within that particular context* (which consists of about a line and a half). It does not return any occurrences beyond that first context.

So if a message contains the term a couple of times in lines 4-5, say, and then a couple more times in lines 8, 10, 11, or whatever, the snippet shows only the occurrences in lines 4-5.

You can see this by doing a search in beta on the word "search," which has been used many times in the current thread.
--
J

Messages are the sole opinion of the author, especially the fishy ones.
My humanity is bound up in yours, for we can only be human together. - Desmond Tutu


moderated Re: Message summary a mess - but not due to IO

 

Tom,

I view this as a bug. When the message is returned from a search it
should appear just as it would if you were scrolling through messages.
I vehemently disagree.

When I search for something I want to be shown the search target in context. That often lets me easily weed out by eye irrelevant matches.

Showing some unrelated part of the message would require me to open each result message to see if it has the hit I'm looking for.

Shal


moderated Re: Message summary a mess - but not due to IO

Tom Vail
 

Not sure why it went away when I restarted, but it is back doing the same thing and a second restart did not fix it this time.

I view this as a bug.  When the message is returned from a search it should appear just as it would if you were scrolling through messages.  The title followed with first couple lines of the message.  Not some random collection of the text which makes it unintelligible.  And the text it is collecting does not necessarily have the search argument in it.

Hope this can be fixed quickly as it is holding up a project for me.

Peace,
Tom


moderated Re: Site updates #changelog

Ginny T.
 

You took the words right out of my mouth, Bob.
Catch your breath, Mark!
Ginny
--
Ginny T.  gttemari21@...
========
TemariKai.com


moderated Re: More attachment size selections requested

Glenn
 

On Fri, Jan 10, 2020 at 09:24 AM, Mark Fletcher wrote:
1) We don't track users.
Excellent. But staying logged in still requires the cookie, and if the browser was hacked they could learn cookie, and continue hacking to the group.

2) If we didn't require a login to access attachments, that would be a rather large security hole for private groups.
Oh absolutely! You _need_ the login to access attachments!  But it does make it more cumbersome to access the attachment, for people that do delete the cookies, but could receive larger emails... if only there were options larger than 5MB, but smaller than unlimited, to avoid bounces.

Another idea I've had, but realize it would be significant work, would be to make groups.io accessible via email protocols, such as IMAP, particularly.  A user logging in via their email client could see one IMAP folder for each group they belong to, with the emails in the folder being the postings for that group. Posters wouldn't be limited by ISP limits on email size, distribution wouldn't either. IMAP clients & servers already have options (as Duane pointed out) to download attachments in advance or only when requested. The SMTP half of this email server would restrict To: to groups.io group email addresses, and From: to members of those groups, as per the group and member settings.

The benefits of this idea would be fewer limits on communications, fewer ISPs getting feathers ruffled by the volume of Bcc: addressed email traffic.  Besides the complexity of adding such an email server, the costs would be to teach users how to have one more email address, used only for groups.io; extra bandwidth usage as emails would be retrieved from groups.io for each user, instead of the (assumed) bundled approach of sending one message to each ISP, where one (or hopefully more) group member has an account, it would be more point-to-point.

This could live alongside the current mechanisms, so there would be no requirement that group member switch to using a new email server. It would make it easier to post large attachments without ISP limits, when that is appropriate, and it would make it possible to retrieve large attachments without ISP limits, when they exist.

But simply having a couple extra limits of 10MB and 25MB would probably meet most of the needs, or configurable number of MB with a maximum of 25MB.  In fact, the maximums for the bulk of email addresses are publicly documented, and don't change very often, so for common email domains, the limit could be that of the documented domain limit.


moderated Re: Premium groups now have more storage, basic group subgroups change

 

Our subgroups they come and they go,
So we wonder if storage is low.
We have lots of doubt how to
Figure it out cuz
Our limit we don't wanna blow
-- 

J

Messages are the sole opinion of the author, especially the fishy ones.
My humanity is bound up in yours, for we can only be human together. - Desmond Tutu


moderated Re: Site updates #changelog

Bob Bellizzi
 

Ho Boy, Mark,
You sure have been busy  on our behalf.
--

Bob Bellizzi


moderated Re: Premium groups now have more storage, basic group subgroups change

Bob Bellizzi
 

Beth,
What do you mean by "many groups that come and go"?
Please be more specific
--

Bob Bellizzi


moderated Re: Message summary a mess - but not due to IO

 

I just tested this using a message with several instances of the word "the" and searching on "the." Apparently, search will find and return the first instance of the term, within its context, but only continue with further instances if they occur contiguously to the first one and within the allowable space (which seems to be a couple of lines). You are right that it does not jump around and return much later occurrences if the space in between does not fit (however, it will return results towards the bottom of the message, not just at the top, if the first instance of the term occurs towards the message bottom). So I don't know what was happening in your case.
--
J

Messages are the sole opinion of the author, especially the fishy ones.
My humanity is bound up in yours, for we can only be human together. - Desmond Tutu


moderated Re: Message summary a mess - but not due to IO

 

The only strange part about this was that it was "fixed" after you restarted your computer.  Search looks for instances of your search term within the message body. So if the term occurs more than one in the message body, it returns all the "bits and pieces" in which it occurs.
--
J

Messages are the sole opinion of the author, especially the fishy ones.
My humanity is bound up in yours, for we can only be human together. - Desmond Tutu


moderated Message summary a mess - but not due to IO

Tom Vail
 

Just an FYI:  I just had a strange deal with our group.  When you did a search the resulting messages came up with the correct title, but the message summary was taken from bits and pieces within the body, not the opening lines, so made no sense.  After pulling my hair out, I restarted my computer and it was fixed.  So it was not an IO problem, but something within my system.  I'm using a Mac with Mojave and Safari.


moderated Re: Infinite Scroll on Databases

Maria McGrath
 

Hi Duane,

Yes I updated preferences but ti still stays at only 20.  I asked a few members to try it ans its the same thing, it stays at 20 but I can scroll to 100 or infinite.
Maria


moderated Re: Infinite Scroll on Databases

Jim Wilson
 

I have Infinite Scroll on both my admin and test user accounts and I get the same thing. We have an a large database with more than 4K entries and it is very annoying. It is also very annoying that I can't jump to a specific line number!

Another problem with Infinite Scroll for people using a UHD 3840 x 2160 monitors and Chrome with a  a window larger than 1920x1080, Infinite Scroll just stops after 40 or so entries and will not replenish until you make the Chrome window  size smaller and refresh the page. It's a really weird bug. Point being, there may be other bugs I have not yet encountered.

br
Jim