Date   
Re: [feature request] Add start_msg_date param to endpoint /downloadarchives

valcos
 

Thank you Mark for adding the start_time param for https://groups.io/api#download-archives

Re: [feature request] Add start_msg_date param to endpoint /downloadarchives

 

On Tue, Jan 21, 2020 at 4:02 AM valcos <valcos@...> wrote:
Thank you Mark for answering.

I don't see the X-Groupsio-MsgNum in the response headers (see them below) or as part of the messages, I'm using the group onap+onap-zoom-hosts to test it. Please let me know if I'm missing something, or if you can point me to a group that uses the X-Groupsio-MsgNum header line. 

That line appears in the email headers of every email message downloaded. Look for the largest, which should be in the last message downloaded, and use that next time.

I may be able to add start_msg_date, but I'm not sure when.

Thanks,
Mark 

Re: [feature request] Add start_msg_date param to endpoint /downloadarchives

valcos
 

Thank you Mark for answering.

I don't see the X-Groupsio-MsgNum in the response headers (see them below) or as part of the messages, I'm using the group onap+onap-zoom-hosts to test it. Please let me know if I'm missing something, or if you can point me to a group that uses the X-Groupsio-MsgNum header line. 

{
    "Connection": "keep-alive",
    "Content-Disposition": "attachment; filename=\"messages.zip\"",
    "Content-Type": "application/octet-stream",
    "Date": "Tue, 21 Jan 2020 11:30:39 GMT",
    "Server": "nginx/1.17.6",
    "Set-Cookie": "groupsio=MTU3O...aClXhs=; Path=/; Domain=groups.io; Expires=Thu, 20 Feb 2020 11:30:39 GMT; Max-Age=2592000; HttpOnly; Secure",
    "Transfer-Encoding": "chunked",
    "X-Frame-Options": "DENY"

}

The main reason to ask for a start_msg_date is because the way I collect mailing list data is time-based (it leverages on the field `Date` of the emails). Since the information is already included in each email, it isn't needed to add any extra information (e.g., response headers or additional headers in the original emails) to perform incremental fetching.

I would say that start_msg_date and start_msg_num are equivalent in terms of guaranteeing to fetch all messages, however I understand that the offset-based solution performs better for corner cases when there are N messages sent out at the same date for a given group. From a user point of view, I think it makes more sense to get all messages after a given date, since the user doesn't probably know the start_msg_num.


In any case, it would be great if you can include the start_msg_date. If this isn't possible, I'll figure out how to use the start_msg_num in my scenario.

Best,
Valerio

Re: [feature request] Add start_msg_date param to endpoint /downloadarchives

 

On Mon, Jan 20, 2020 at 7:11 AM valcos <valcos@...> wrote:

It would be great if the endpoint /downloadarchives could have an optional parameter to download messages after a given date. The param (e.g., start_msg_date) would be similar to start_msg_num and would return the messages
sent after a given date (in isoformat, UTC).

It would be more reliable for you to use the start_msg_num parameter in coordination with the X-Groupsio-MsgNum header line. That way you are guaranteed to fetch all messages, with no overlap. Is there any reason you can't use that? I am going to start more aggressively ratelimiting /downloadarchives access, as it puts a load on our system.

Thanks,
Mark

[feature request] Add start_msg_date param to endpoint /downloadarchives

valcos
 

Hi Mark,

It would be great if the endpoint /downloadarchives could have an optional parameter to download messages after a given date. The param (e.g., start_msg_date) would be similar to start_msg_num and would return the messages
sent after a given date (in isoformat, UTC).

Do you think it's possible to implement this feature?

Best,
Valerio

Re: getfiledirectory

Samuel Murrayy
 

On Sun, Jan 19, 2020 at 12:00 PM, Samuel Murray wrote:
Do I understand correctly that getfiledirectory does not get a list of files but only a list of folders...
No, wait, I just forgot to set the limit high enough, which is why I only got a list of folders (there were more than 10 folders in my test folder).

, *and* that it gets only a list of folder within the specified path (not folders within those folders)?
See, when I ask for a list of files in "/", and there are only two subfolders (no files) in "/", then the response tells me only the names of those two folders, regardless of the limit setting.  I don't get the subfolders and all the files in them.

Samuel

getfiledirectory

Samuel Murrayy
 

Hello

Do I understand correctly that getfiledirectory does not get a list of files but only a list of folders, *and* that it gets only a list of folder within the specified path (not folders within those folders)?

I'm trying to see if there is a way to get a list of all files (for a specific group), so getfiledirectory seemed a first obvious choice, but it doesn't seem to give me a list of files, and it appears to show only the children folders, not grandchildren folders etc.

Thanks
Samuel
(not a programmer)

addfiles API still in development?

Christopher Warrington
 

I'm trying to automate uploading files from a now-defunct Yahoo Group. The
/api/v1/addfiles API looks like it will work for this, but it's
documentation says "IN DEVELOPMENT. DO NOT USE YET."

Is this still the case (I'll admit, I haven't tried it yet.)?
Any sense for when it will be ready to use?

--
Christopher W. <lists@...>

Re: direct_add Changes

 

Hello,

On Wed, Jan 8, 2020 at 3:45 PM Jordan Evans <jevans@...> wrote:

The direct_add_results (https://groups.io/api#the-direct-add-results-object) definition seems to show the full member_info object, but when I call the API I get a shorter form of the object, see below for an example result I now get. I noticed this because we used to pull the "email" field from each member_info object, but sometime late last year that field disappeared from the member_info object returned in the direct_add_results object.

This should be fixed now.

Thanks,
Mark 

direct_add Changes

Jordan Evans
 

Hello,

I noticed a small change in the response to direct_add (https://groups.io/api#direct_add) that appeared sometime around November 2019 or maybe a earlier.

The direct_add_results (https://groups.io/api#the-direct-add-results-object) definition seems to show the full member_info object, but when I call the API I get a shorter form of the object, see below for an example result I now get. I noticed this because we used to pull the "email" field from each member_info object, but sometime late last year that field disappeared from the member_info object returned in the direct_add_results object.

Is this a bug in the documentation or the API?

I get (I removed the IDs before posting):

{
    "object""direct_add_results",
    "total_emails"1,
    "errors"null,
    "added_members": [
        {
            "id": 0,
            "object""member_info",
            "created""2020-01-08T15:18:28.015726497-08:00",
            "updated""2020-01-08T15:18:28.015726497-08:00",
            "user_id"0,
            "group_id"58878,
            "group_name""lftestglobalowners",
            "user_name""",
            "full_name""Jordan Evans",
            "cover_photo_url""",
            "icon_url""",
            "nice_group_name""",
            "subs_count"0,
            "most_recent_message""0001-01-01T00:00:00Z"
        }
    ]
}

What are the possible values for sort_field with the Get Topic method? #api

Graham Lawrence
 

I have deduced that the sort-dir may be desc but I have been unable to deduce what the sort_field values may be.  I have tried 'Updated' and 'updated' but they get converted to 'Created'.  I would like them sorted by the date updated and not the date created.  How do I do that please?

Graham

Re: API and enterprise endpoint

 

Hello Nicolas,

On Tue, Dec 17, 2019 at 6:52 AM Nicolas Dechesne <ndec13@...> wrote:

however, what I really want to do is access our enterprise endpoint (lists.yoctoproject.org), but on that endpoint, I can't authenticate, or get anything to work. I am always getting "404 page not found". I am sure that I am using the right email/password.

Sorry about that. You should be able to access the API via that URL now.

Thanks,
Mark 

API and enterprise endpoint

Nicolas Dechesne
 

hi,

I am trying to use the API for the first time.. I managed to authenticate using groups.io/api/v1/login, and could make some queries.

however, what I really want to do is access our enterprise endpoint (lists.yoctoproject.org), but on that endpoint, I can't authenticate, or get anything to work. I am always getting "404 page not found". I am sure that I am using the right email/password.

Do we need to change a setting on our groups.io instance to enable the use of the API?

thanks!

Donation Payment Methods

somaspack <somaspack@...>
 

Any chance we could get something other than Stripe for accepting donations (venmo, paypal, patreon)? Stripe is a heavy weight tool for the job; I'm just hearding a group of outdoor enthusiast - not a business.

Scott

Re: authentication question

Eric di Domenico
 

On Wed, Dec 4, 2019 at 10:13 AM, <ajomccauley@...> wrote:
I'm especially interested in what folks might do if they use the API in an "ongoing" way, like a custom signup for
It would be nice if the API offered an OAuth option because handling user passwords on a sever sucks. This only works if you make a client app, and even then why trust 3rd parties apps with your user's passwords.

As far as ongoing use, someone in our group is thinking about organizing information from various sources on the same topic. I am thinking about backup and archiving. Still all server-side things that would be done with a single user

Re: authentication question

ajomccauley@...
 

Thank you so much, Eric!

I'm especially interested in what folks might do if they use the API in an "ongoing" way, like a custom signup form -- so they'd need to re-authenticate pretty regularly (so I'm trying to imagine where/how ppl might use their login creds in code in a secure way).

Thanks again!

Re: authentication question

Eric di Domenico
 

I am migrating from Yahoo so I created a special user to use for this.

I guess it depends on what your application is going to do.

authentication question

ajomccauley@...
 

Hi!  I've decided to move this question to its own topic :)

Do y'all use your own email/password combos for this stuff (and then figure out securing the info depending on your server/software situation, so it isn't just, in your code)?  I'd love to know if that's the norm, b/c right now I feel like I've *got* to be missing something, but maybe I'm not...

Thank you!
-Alison

Re: Login produces an error of invalid email

Graham Lawrence
 

Thank you, Mark, I have found the correct way to use the API.  It was simpler than I had assumed.
Graham

Re: Login produces an error of invalid email

 

On Sun, Dec 1, 2019 at 10:10 PM Graham Lawrence <Graham@...> wrote:
I have tried to login using POST with my email address and password but I get
array(3) {
  ["object"]=>
  string(5) "error"
  ["type"]=>
  string(13) "invalid email"
  ["extra"]=>
  string(0) ""
}
returned.


I saw some calls where no email address was sent. That would result in that error.

Mark