3 ms·
At this point asking whether GTP should exist is a bit like asking if money should exist - lots of opinions but it really doesn't matter. The people who use it
by roenxi 4y ago
At this point asking whether GTP should exist is a bit like asking if money should exist - lots of opinions but it really doesn't matter. The people who use it are going to have such a huge advantage that it will crush everything in its path.
One of the interesting things about AlphaGo back in 2016 was it demonstrated that the algorithms for all this are simple. Once Google demonstrated that an outcome was possible, other superhuman Go playing AI began appearing in a matter of years. ChatGTP is similar - now that the world knows this tech can be built there isn't a regulatory framework big enough to shut it down everywhere. And whoever deploys AI as a tool will have an advantage over those that don't.
"AI safety" would now involve banning general purpose computing. Nothing less can stop the systems that are now in motion, and even that probably wouldn't be enough. The future is here.
- Sol- 4y agoIt desired, I feel like it would be in the power of governments to regulate the use of high-performance accelerators to slow AI progress significantly. Training a large language model is no small feat, taking months or years of continuous data center compute. Sure, GPT-3 scale models are out of the bag, but you can slow down the progress. And if they go after the financial incentives and ban using large language models in production, then the desire of the big tech labs to train them might go down anyway. Whether that's desirable or not is the question in the article, but it does seem possible.
- barking_biscuit 4y agoThe problem being you need all governments on planet earth to agree to that simultaneously, which you're not getting.
- visarga 4y agoSo you need to register your GPU with the govt. and fill forms to be able to train a model?