moderated Re: Re= Re: [beta] Yahoo Groups transfers on and extended to December 5th
On Mon, Dec 2, 2019 at 9:13 AM Patty Stokes <sandkittens@...> wrote:
This is a manifestation of Yahoo's latest issues. My changes yesterday to our crawler mostly work around this, and I'm seeing very few unretrievable messages since the changes went into effect yesterday. Basically, I'm hammering Yahoo's servers; I massively parallelized the crawler and also if it gets a failure, it retries a lot more times than before, in rapid succession. These are admittedly hostile behaviors, and if I was running Yahoo's servers, I'd not be pleased. But it seems to do the trick. Mark
|
|