3 ms·
It’s extremely strong almost to the point of absurdity to say that transformers are the optimal architecture. As far as we know, human minds are not transformer
by markisus 2y ago
It’s extremely strong almost to the point of absurdity to say that transformers are the optimal architecture. As far as we know, human minds are not transformer networks and outperform them in many respects. And it’s even absurd to me to say that the human mind has optimal architecture even though we haven’t seen a better one in billions of years.