4 ms·
If every AI company pointed their scrapers to archive.org, that site would go down immediately as well. This is just kicking the can down the road. We have a
by mbrochh 3y ago
If every AI company pointed their scrapers to archive.org, that site would go down immediately as well.
This is just kicking the can down the road.
We have a major structural problem now. We want data to be free and machine readable, but no startup (and even a giant like Twitter) can afford the server cost to withstand all those machines.