4 ms·
And? Our brains aren't just doing the exact same things all over, we have centers focused on certain tasks. For example we have[1] neurons that do addition and
by magicalhippo 4y ago
And? Our brains aren't just doing the exact same things all over, we have centers focused on certain tasks. For example we have[1] neurons that do addition and some others that do subtraction.
Our brains are limited to using neurons as building blocks, but why should an AI be limited in the same way?
[1]: https://www.sciencedaily.com/releases/2022/02/220214121241.htm https://www.sciencedaily.com/releases/2022/02/220214121241.h...
- eru 4y agoFurthermore, people also use tools like an abacus, without any detriment to their intelligence.
- rng_civ 4y agoThe whole point of this post is that we are trying to: * Classify the computational power of Transformers (when it stumbles on certain easier problems but can solve harder ones) * Find a "minimal" change to the Transformer that would allow it to compute these problems. Solving these 2 problems by giving LLMs arbitrary access to external plugins is a cop out. You would not: * Call youself a chef just because you own a restaraunt (you need to cook too!) * Or (more program-y), say that C code meets Rust's memory safety standards simply because you can write the main function in C and write the rest of the program in Rust Allowing arbitrary external plugins seems absurdly overkill and not 'minimal' (although that doesn't mean it isn't interesting from a practical perspective!), which is what I assumed that the rain1 was originally pointing out.
- magicalhippo 4y agoMy point is why must transformers be able to do everything? edit: I don't mean to dismiss the work trying to figure out what they can do. That seems reasonable and valuable. It's just, we're not trying to figure out how to tweak QR decomposition to solve arbitrary equations. It's a tool, a powerful tool, but it has some clear limitations.