3 ms·
Just my opinion. Web scrapping isn't important for AI or AGI anymore. It's important only for the facts, like news. But not for the logic. With current datasets
by two_in_one 3y ago
Just my opinion. Web scrapping isn't important for AI or AGI anymore. It's important only for the facts, like news. But not for the logic. With current datasets it should be possible to move forward, beyond GPT-4. Blocking access now is like investing in aluminum was, when it was more expensive than gold. And suddenly it's not.
When we get facts separated from the model it will be enough to have just one article about, say, landing on the Mars for the model to be able to actively use this new knowledge. In this case 'AI providers' will need to cooperate with one news agency, buy right for only for a few classic books. Judging by how fast everything is moving this will happen within a couple of years if not a few months.