3 ms·
God love you, your idea of "not very complicated" is absolutely fascinating.
by mastersummoner 4y ago
God love you, your idea of "not very complicated" is absolutely fascinating.
- benjismith 4y agoLol, good point! I just meant "this isn't related to Thinking Fast and Slow. It's just the tokenizer". But yeah, the inner workings of the language model are so complicated as to be almost completely incomprehensible, even after years of study. Touche!
- mastersummoner 4y agoI suspect it's "not very complicated" for anybody with a decent grounding in the tech. Which is very much not me!