6 ms·
With LLMs, having questions is more important than having answers. When you run out of questions, the exploration stops.
by sitkack 2y ago
With LLMs, having questions is more important than having answers. When you run out of questions, the exploration stops.
- nathanasmith 2y agoI just keep prompting with "continue" when that happens.
- sitkack 2y ago"continue" is now the most important word in the english language right after "No" right now. This causes the LLM to orbit around some point in the latent space, but doesn't cause it to explore. You have to tell it to pick a direction and there is no better direction than a question.