4 ms·
Never heard of this initiative but kudos for bringing it up. I run a popular news site[0] and merely aggregating ~150 sources costs me upwards of $1k/m just to
by marban 6y ago
Never heard of this initiative but kudos for bringing it up.
I run a popular news site[0] and merely aggregating ~150 sources costs me upwards of $1k/m just to crawl the basics.
[0] https://upstract.com/ https://upstract.com/
- knuckleheads 6y agoYes!! Exactly!! Crawling is super expensive to do and it's hard to even get the money to start doing the crawling. And even then once you get started, a lot of websites block you out or only let Googlebot through the paywall. And we are launching the club today with the publishing of the NYT article, we have been pretty quiet about it so far for the last two years or so, doing the research in private.