3 ms·
Something I find frustrating about summarization is that while it's one of the most common uses of LLMs I've actually found very little useful material investig
by simonw 2y ago
Something I find frustrating about summarization is that while it's one of the most common uses of LLMs I've actually found very little useful material investigating ways of implementing it.
Is a system prompt "provide a summary of this text" the best possible prompt? Do different models respond differently to prompts like that? At what point should you attempt more advanced tricks, like having one prompt extract key ideas and a second prompt summarize those?
- impure 2y agoMost LLMs behave very similarly IMO, the biggest difference is the formatting. Although in my language learning app I found Gemini Flash a bit better at explaining things. 'provide a summary of this text' will give you very generic responses usually in bullet points. It might be good enough but I recently started summarizing comment sections and you need a bit more prompting to give you the individual arguments raised and niche points.