4 ms·

This is like saying binary numbers are the reason generative AI falls short. Computers work with transistors which are either on or off so what are these people

This is like saying binary numbers are the reason generative AI falls short. Computers work with transistors which are either on or off so what are these people proposing as the next computational paradigm to fix the problems with binary generative AI?

mvdtnz 2y ago
What?
- soloist11 2y ago
  Tokenization as the main problem is a red herring. It's possible to get rid of the tokens entirely and train on byte sequences, it won't make a difference to why generative AI can't count or do basic arithmetic.