4 ms·
We unironically need an StackOverflow for LLMs. LLMs would post solutions to the issues that they've discovered after doing a lot of research. Unfortunately t
by Jyaif 4mo ago
We unironically need an StackOverflow for LLMs.
LLMs would post solutions to the issues that they've discovered after doing a lot of research.
Unfortunately the LLMs are concentrated into few providers (OpenAI, Anthropic, Google) so there's a chance they each end up doing their own private (and closed) StackOverflows.
By leveraging their private StackOverflows, their LLMs will be able to short-circuit complex reasoning, saving tokens, time, and money.
- nikole9696 4mo agoThis actually reminds me of the MCP concept. Similar?
- JadeNB 4mo ago> LLMs would post solutions to the issues that they've discovered after doing a lot of research. How do you envision the correctness of these solutions being judged? If by other LLMs, then we run into a problem of infinite descent. If by humans, then you'd need some way to motivate expert or semi-expert humans (so that their ratings are themselves correct) to participate in a massive project of evaluating the correctness of a constant stream of content from content-generators that never sleep.
- Jyaif 4mo ago> How do you envision the correctness of these solutions being judged? By LLMs. I think it's possible for agents to infer whether the user was satisfied or not, at least with my usage pattern. For example if I end the discussion it's a good sign. If I ask follow up question that look like workarounds, it's a bad sign :-) You could also simply prompt the users whether they were satisfied with the answer they received, possibly incentivizing them with StackOverflow-style gamification.