3 ms·
People keep underestimating what next-token prediction can do, but they’re not wrong that it’s how LLM’s work. It’s actually a good question: what will next-to
by skybrian 4y ago
People keep underestimating what next-token prediction can do, but they’re not wrong that it’s how LLM’s work.
It’s actually a good question: what will next-token prediction be able to do on new datasets? The error is thinking you can answer it, even in broad terms.