3 ms·
My experience with AI is that prompting LLMs tends to fail when the task involves returning a long list of alternatives and/or selecting niche options unless th
by wslh 1y ago
My experience with AI is that prompting LLMs tends to fail when the task involves returning a long list of alternatives and/or selecting niche options unless the user explicitly names them.
- arrowsmith 1y agoDo it iteratively. Ask the LLM for a long list of alternatives but without detail, only the names. Then start a new chat, paste in the list of names, and ask for more detail.
- wslh 1y agoI've done this several times when benchmarking lesser-known companies, and manual compilation using a search engine consistently outperformed LLMs even when those companies are part of the model's training data. My intuition (could be completely wrong) is that lesser-known companies have much less density around them that popular brands, except if you are very specific. It would be great if this could be tweaked somehow.