5 ms·
I wonder if a small scraper script that an existing member of the group could download and run under their existing, valid account, would work? Like a TCL lang
by shrubble 7y ago
I wonder if a small scraper script that an existing member of the group could download and run under their existing, valid account, would work?
Like a TCL language 'starpack' , a single binary Go program or something else?
Can you script a browser to do some crawling for you?
- y4mi 7y agoLike.... Selenium or puppeteer?
- Diagon 7y agoThere's way too much data. Many group owners did not know of the shutdown (Yahoo was negligent regarding informing owners), and even if they did many group owners have little or no technical capability. That's why so many requested of the Archive Team that their groups be archived.
- shrubble 7y ago1000 members of a group each downloading 20 messages every 4 hours (a dribble that wouldn't be noticed) can pull down ... 20k messages in 4 hours.
- mulmen 7y agoIs that enough? What about groups with only a few members? Or members that have passed away in the last 20 years? Will those WWII vet groups have 1000 responsive members with the technical skill to run an archive script in the next week?
- lucb1e 7y agoThat's exactly what they're doing, and then they get CAPTCHAs and accounts banned.