7 ms·
Why would they need to scrape fediverse when they can just get all of the data and more just through federation? Also this anti-scraping stance for a public, tr
by wraptile 1y ago
Why would they need to scrape fediverse when they can just get all of the data and more just through federation? Also this anti-scraping stance for a public, transparent protocol is really weird - that's the whole point of the protocol.
- UltraSane 1y agoComplaining that data available on the public internet is being read seems very strange. Whatever happened to "Information wants to be free" or "The Net Interprets Censorship As Damage and Routes Around It."
- nicbou 1y agoThe information is used to build monopolies that strangle the independent web.
- wraptile 1y agoBut restricting the flow of information is a really weird way of handling this issue. It's like digging pot holes on the road just because you're upset that Teslas are on it.
- Mars008 1y agoIt's not that important now as AI took off the ground. New models can be trained completely on generated data. That will give them core abilities. Real world knowledge... whatever humans can get models can.
- nicbou 1y ago> New models can be trained completely on generated data. How does that account for all the things that change in the world, but in ways only humans can observe? How can AI discover that a beloved tourist destination has turned to crap, or that the best vacuum cleaner of 2022 has a new challenger, or that German tipping culture is shifting, or that the café down the road has great banana bread but is a little loud on Saturdays?
- Mars008 1y agoThe same way most humans do, from internet. Generated data can be the result of processing yesterday's new by old model. It can be multiplied, repeated from different angles. This will make it more likely to stick in new model. But the best way is to add latest data to some storage which can act as a long term memory. In this case even old model will look fresh and up to date. I'm sure we'll get it soon. RAG can be considered as a primitive form of it.
- nicbou 1y agoMultiplication requires something to multiply. My point again is that if you destroy any incentives to put useful things on the internet, we'll have nothing to train AI on.
- UltraSane 1y agoOr it is being used to build the most useful information indexing and search algorithms ever created.
- Mars008 1y agoThere can be only one monopoly in each domain by definition. In AI world it's more like several 'fortresses'. Together they ruin click economy. Which almost eliminated printed books and magazines. Well, attention is limited resource.
- nicbou 1y agoThe main difference is that the click economy did not rely on printed books and magasines' continued existence. It could produce its own original information. A magasine author could become a blogger, and they could still write their own café reviews. Generative AI still relies on the work of the creators whose livelihood it threatens for its training data. It still relies on someone else experiencing the real world, and describing it for them. It just denies them their audience or the fruit of their labour. Someone here put it nicely: AI companies are eating their seed corn.