4 ms·
It is absolutely not obvious it can't do the recursive steps to multiply two numbers. In fact, you can just teach it the proper algorithm and ask it to apply i
by r0uv3n 4y ago
It is absolutely not obvious it can't do the recursive steps to multiply two numbers. In fact, you can just teach it the proper algorithm and ask it to apply it: https://twitter.com/random_walker/status/1600336556425826304?s=20 https://twitter.com/random_walker/status/1600336556425826304...
- m_ke 4y agoThe feedforward nature of transformers means that it can only do a limited number of computational steps. Having it explain an algorithm is a good way to have it use its output as a tape during inference/decoding, but even then it just fudges things and makes mistakes for largish numbers.