Date   

moderated Re: Deleting attachments when out of space #update

 

On Wed, Jan 8, 2020 at 05:29 AM, Bruce Bowman wrote:

Mark -- Thanks for the heads-up...such is generally my understanding of how the "Out of Space" setting was intended to function. I'm assuming the extra 5% is to allow file and photo uploads to continue to work?

Yes, that's correct.

What happens if 95% of your quota is being used by other items -- would ALL of the group's attachments then be deleted? Not saying that's wrong behavior, but want to clarify.

Yes, all attachments would be deleted.

Also, will upload restrictions now be enforced at the quota level (exactly 1 GB, 10 GB, etc)? In the past, some have reported substantial "grace storage" before such uploads were actually inhibited.

Yes. The "grace storage" was only for attachments, because this process wasn't working. It's always been the case that if your group is over the limit, you could not upload additional photos or files.

Thanks, Mark


moderated Re: Deleting attachments when out of space #update

 

How about deduplication first? Eliminate multiple instances of
the same file . . .
Right, that too would be very valuable. If I understand it correctly
your idea is roughly equivalent to (3) here:
https://beta.groups.io/g/main/message/15545
In my experience, this is the source of much of the wasted space. We have members who read and share by email, and they just click on reply. The result is the duplication of the same image a number of times. Even if the system just checked for the same image more than once in a thread would be an improvement.

I also agree as well about posters who put a small image in their signature. By itself they add very little, but they can add up quickly and some posters don't understand they're not saved with the message, but separately. I'm wondering if any image in a signature shouldn't be stored in a members profile where it could be accessed by the system, and all images otherwise in signatures be deleted automatically.

Another 2¢ worth.

Dano


moderated Re: change or add "updated" date for updated files

 

On Wed, Jan 8, 2020 at 08:49 AM, J_Catlady wrote:
The request is inapplicable to them.
I should say the request *as stated* is inapplicable to them. There's nothing preventing having an optional update notification for Group Guidelines, if Mark sees fit to implement that. But I'd say it's in the "don't hold your breath category." The request as stated here is a five-second fix.
 
--
J

Messages are the sole opinion of the author, especially the fishy ones.
My humanity is bound up in yours, for we can only be human together. - Desmond Tutu


moderated Re: change or add "updated" date for updated files

 

On Wed, Jan 8, 2020 at 08:46 AM, Ann Wild wrote:
I agree as well.  I have updated our Guidelines several times
I'm talking about Files, not Member Notices. There's already an update date at the bottom of the Guidelines and members don't see any "upload date" for Member Notices anyway. The request is inapplicable to them. 
 
--
J

Messages are the sole opinion of the author, especially the fishy ones.
My humanity is bound up in yours, for we can only be human together. - Desmond Tutu


moderated Re: change or add "updated" date for updated files

Ann Wild
 

I agree as well.  I have updated our Guidelines several times of late, but having the old original upload date remaining is misleading to readers.  My only option is to add the update date in the description.  But readers may miss that.


moderated Re: Deleting attachments when out of space #update

 

Larry,

How about deduplication first? Eliminate multiple instances of the
same file--perhaps even annotating the messages to indicate where the
file has been retained--reducing space with no loss of information.
Right, that too would be very valuable. If I understand it correctly your idea is roughly equivalent to (3) here:
https://beta.groups.io/g/main/message/15545

The only downside I can think of is what Bruce mentioned: it may be too much to implement and test before this sweep.

Shal


moderated Re: Feature Request---Group Buys

Dale Hardin
 

Now that the Yahoo debacle is over, can we get the database options updated so that a member can post their address and hide it from all but the owner/moderators and the database creator?  This would REALLY help when we have group buys or someone is providing a product to the members.  Thanks, Dale


moderated Re: Deleting attachments when out of space #update

Bruce Bowman
 

On Tue, Jan 7, 2020 at 06:58 PM, Mark Fletcher wrote:
In two weeks, for those groups that are over their limit, attachments will be deleted to get each group under the storage limit. Attachments will be deleted from the oldest messages first. The text in the messages will not be deleted, just the attachments themselves. I will delete enough attachments to get the group to 95% of their storage limit. After that, the process will run nightly to keep each group under their storage limit.
Mark -- Thanks for the heads-up...such is generally my understanding of how the "Out of Space" setting was intended to function. I'm assuming the extra 5% is to allow file and photo uploads to continue to work?

What happens if 95% of your quota is being used by other items -- would ALL of the group's attachments then be deleted? Not saying that's wrong behavior, but want to clarify.

Also, will upload restrictions now be enforced at the quota level (exactly 1 GB, 10 GB, etc)? In the past, some have reported substantial "grace storage" before such uploads were actually inhibited.

In this context I hope we can focus on completion of the bug-fix (and minimizing its "surprise factor" on existing groups currently over quota) before attempting to introduce new, indirectly-related features. It seems as if this thing could get complicated enough without going down that road.

My $0.02,
Bruce


moderated Re: Deleting attachments when out of space #update

Laurence Marks <marks@...>
 

How about deduplication first? Eliminate multiple instances of the same file--perhaps even annotating the messages to indicate where the file has been retained--reducing space with no loss of information.

To carry this thought a little further (and this may be out of scope), there are schemes where files differing only slightly have the common parts deduplicated. Riverbed was one of the first firms to provide hardware appliances that do this, but now it's a complete industry. See   Deduplication Appliance Buying Guide


Larry


--
Larry Marks


moderated Re: Deleting attachments when out of space #update

Duane
 

On Tue, Jan 7, 2020 at 11:25 PM, Mark Fletcher wrote:
That is indeed an existing group setting, at the bottom of the `Message Policies` section of the Group Settings page.
 
Not to get too far offtrack, but it might be better if the Out Of Space choice said "Bounce Messages With Attachments" to make it clear.  As is, "Bounce Messages", sounds like all messages would be bounced (though I know they wouldn't.)

Having the 'Keep' option Shal mentioned in his other message, that moderators could use to prevent an attachment from being deleted during the purge, might be less work than moving?  This way there'd be no need to keep things related, as with a move, but I can see situations where being able to save the information elsewhere would be useful.  I don't think it should be a member option because most likely everyone would feel that their attachment needed to be saved.

Thanks,
Duane


moderated Re: Deleting attachments when out of space #update

Chris Jones
 

On Wed, Jan 8, 2020 at 08:56 AM, Michael Pavan wrote:
It would be great to be able to move attachments from messages to Files or Photos
I think that would be a very popular option! However, IIRC non - photo format attachments cannot be found in the emailed photos album (although they are in there somewhere) so there would IMHO need to be a way of finding them more easily.

Chris


moderated Re: Deleting attachments when out of space #update

Michael Pavan
 

Mark,

On Jan 8, 2020, at 1:39 AM, Shal Farley <@Shal> wrote:

Mark,

My thought is for the initial deletion that I will not log each of
those messages, to avoid a mass spamming of everyone's activity log.
Would it be possible during the initial deletion to have a single log entry showing the high-water mark of the deletion (date and/or message number) and the number of affected messages?
Yes, please.

Possibly this could be used in lieu of individual entries any time a deletion batch exceeds some (large) number of affected messages.
Perhaps with a link (or drop down menu) to the list of individual deletions...


Also, bump: https://beta.groups.io/g/main/message/14338
Agreed.
It would be great to be able to move attachments from messages to Files or Photos, where they could be rationally organized - not only would this help to preserve valued attachments, but make them easier to find or access. It would be a bonus if a link to the attachment remained with the message should someone happen to be looking at old messages.

Attachments when moved to Files or Photos could be titled intuitively, rather than having to edit message Subject lines which often aren't (and the notifications that message editing can trigger).

Michael


moderated Re: Deleting attachments when out of space #update

 

Mark,

My thought is for the initial deletion that I will not log each of
those messages, to avoid a mass spamming of everyone's activity log.
Would it be possible during the initial deletion to have a single log entry showing the high-water mark of the deletion (date and/or message number) and the number of affected messages?

Possibly this could be used in lieu of individual entries any time a deletion batch exceeds some (large) number of affected messages.

Also, bump: https://beta.groups.io/g/main/message/14338

Shal


moderated Re: Deleting attachments when out of space #update

 

On Tue, Jan 7, 2020 at 7:57 PM Gerald Boutin <groupsio@...> wrote:

What if part two was when the 100% limit was reached and new uploads were no longer allowed? This would give group owners control on prioritization as to what got deleted.


That is indeed an existing group setting, at the bottom of the `Message Policies` section of the Group Settings page.

Thanks,
Mark 


moderated Re: Deleting attachments when out of space #update

Gerald Boutin <groupsio@...>
 

On Tue, Jan 7, 2020 at 07:58 PM, Mark Fletcher wrote:
Please let me know if you have any questions or suggestions.
This almost sounds cumbersome.

What if part two was when the 100% limit was reached and new uploads were no longer allowed? This would give group owners control on prioritization as to what got deleted.

--
Gerald


moderated Re: Infinite Scroll on Databases

Maria McGrath
 

It now works on Databases - THANK YOU


moderated Deleting attachments when out of space #update

 

Hi All,

The process that deletes attachments from messages when a group runs out of space has had a bug in it for quite some time, preventing it from working (insert Homer Simpson DOH! here). I have fixed that bug and will start up the process again soon, but I wanted to outline it before I did so.

There are two parts to this system, the one time notification part, and the nightly deletion part.

Starting in the next day or so, I will turn on the notification part. This part looks at all groups every night and the *first time* a group goes over 80% of their storage limit, it sends the following email to the group owners telling them this and outlining the options:

This email message is a notification to let you know that your group GROUPNAME is using over 80% of its available storage of XXGBs. The storage space is used by attachments, files, photos, database images and wiki images. You can view the usage statistics for your group here.
Based on your group settings, when the storage limit is reached, messages to the group that contain attachments will be bounced./the oldest attachments will be automatically deleted to make space.
Note: If your group is already over its storage allotment, we will delete attachments starting in two weeks from when you received this notice.
If you would like to increase the amount of storage space available for your group, please visit:
GROUPURL/plans
Alternatively, you can set your group to bounce messages that contain attachments.
If you have any questions, please visit our help center or contact us at support@groups.io.


In two weeks, for those groups that are over their limit, attachments will be deleted to get each group under the storage limit. Attachments will be deleted from the oldest messages first. The text in the messages will not be deleted, just the attachments themselves. I will delete enough attachments to get the group to 95% of their storage limit. After that, the process will run nightly to keep each group under their storage limit.

There is a new activity log entry, "Attachments deleted for space." That will log each message whose attachments have been deleted. My thought is for the initial deletion that I will not log each of those messages, to avoid a mass spamming of everyone's activity log. But after that I will turn it on.

To view how much space your group is using, click on the Billing or Upgrade tab under Admin for your group.

Please let me know if you have any questions or suggestions.

Thanks,
Mark


moderated Personal comments on beta

 

Hi All,

I am back from vacation and digging through my email. I will have thoughts about what to do instead of Canny and a few other things over the next few days, but I wanted to quickly address something that I saw over the past month.

Please keep comments on beta focused on the service and on ideas on how to improve it. Resist any urge to make personal comments about other members. Sarcasm is also not a good idea; I've been burned several times by people misunderstanding my sarcasm. Comments like 'this thread should be closed' are also not helpful.

We all want the same thing, to make Groups.io better, and to have free (possibly gluten free) donuts on Sunday. And yes, I know I've made that joke before on here, in a similar email to this. I think we'd all like it if I didn't have to make that joke again. :-)

Thanks,
Mark


moderated Re: Infinite Scroll on Databases

Maria McGrath
 

Thank you,
I had change dit in preferences but the Database does not work and only shows 20 rows at a time.
Will this be on the to do list ?
Maria


moderated Re: change or add "updated" date for updated files

 

On Tue, Jan 7, 2020 at 11:40 AM, Gerald Boutin wrote:
my preference would be just the latest date
Agreed. Also would be nice to add a description of the update to the (already existing) optional notification to members that the file has been updated.
 
--
J

Messages are the sole opinion of the author, especially the fishy ones.
My humanity is bound up in yours, for we can only be human together. - Desmond Tutu