3 ms·
> GPT-3 is about a thousand times less complex than a human Also note that it takes the 'brute force' approach to architecture by using a transformer model, ba
by BobbyJo 3y ago
> GPT-3 is about a thousand times less complex than a human
Also note that it takes the 'brute force' approach to architecture by using a transformer model, basically learning a connection graph from scratch. If you want that to scale to human complexity in function, you're probably going to have to overshoot in size by an order of magnitude.