10 ms·
AI shows signs of general intelligence (e.g. can generate proper text in generated pictures) after about 20 billion of parameters. IMHO, 1 trillion of parameter
by drran 4y ago
AI shows signs of general intelligence (e.g. can generate proper text in generated pictures) after about 20 billion of parameters. IMHO, 1 trillion of parameters can be enough to simulate human-like behaviour after reading lot of text, watching of lot of video, and playing lot of games and robotic simulations. It will be able to understand commands, understand video and audio from cameras, will be able to control equipment and robots, e.g. to repair itself, to reach a goal.
- simiones 4y agoYou're only looking at the parameters, when in fact such algorithms are also heavily limited by the amount of training data. It may well be that, even if you were right with your 1 trillion parameters for AGI, we might just not have enough training data to avoid under/over fitting. Note that I am extremely skeptical of your 1T parameters claim - there is much much more to AGI than natural-looking natural language processing + image recognition.