3 ms·
LLMs generate responses by randomly sampling words based in part on probabilities. Their “language” consists of numbers that map to tokens. Something about the
by inference-lord 3y ago
LLMs generate responses by randomly sampling words based in part on probabilities. Their “language” consists of numbers that map to tokens.
Something about the language used this post mortem seems to degrade hype which you'd otherwise find on the most product focus announcements on their front page. It's almost disappointing.
It needs to say:
"We noticed the model was becoming sentient and then pulled the plug when we realized ChatGPT-4 was actually building ChatGPT-5.
Sam Altman is now on his way to the whitehouse to demand the government introduces stricter regulation to squash any competition"