3 ms·
Modern LLMs are large token models. I believe you can model the world at a sufficient granularity with token sequences. You can pack a lot of information into a
by energy123 9mo ago
Modern LLMs are large token models. I believe you can model the world at a sufficient granularity with token sequences. You can pack a lot of information into a sequence of 1 million tokens.
- andsoitis 9mo ago> I believe you can model the world at a sufficient granularity with token sequences. Sufficient for what?
- weregiraffe 9mo agoSufficient to fool a lot of investors, at least.
- weregiraffe 9mo agoLet's be accurate. LLMs are large text-corpus models. The texts are encoded as tokens, but that's just implementation detail.