4 ms·
Lol, good point! I just meant "this isn't related to Thinking Fast and Slow. It's just the tokenizer". But yeah, the inner workings of the language model are
by benjismith 4y ago
Lol, good point!
I just meant "this isn't related to Thinking Fast and Slow. It's just the tokenizer".
But yeah, the inner workings of the language model are so complicated as to be almost completely incomprehensible, even after years of study. Touche!
- mastersummoner 4y agoI suspect it's "not very complicated" for anybody with a decent grounding in the tech. Which is very much not me!