3 ms·
>they all are great at the initial response and slowly degrade add the conversation continues I've noticed this too. I give the llm 3 or 4 prompts before a new
by stirfish 1y ago
>they all are great at the initial response and slowly degrade add the conversation continues
I've noticed this too. I give the llm 3 or 4 prompts before a new session is opened and code is repasted. My work flow is a lot like
1. Here's a schema, what would you change? I assume nothing, because my schemas are perfect.
2. Given this schema, make me some structs
3. Given these structs, make me some endpoints
1.(New session) Given these endpoints that return data like this, make me a ui
1. while true: (New session), An llm wrote me this ui, what would you change?
If I try to steamroll ahead from schema to ui, I find it starts having trouble with context, like hallucinating functions it meant to write but didn't, or just straight up dropping functions it wrote before.
- nopelynopington 1y agoIt makes me think back to "attention is all you need". Most of the LLMs seem to have quite limited attention, at least while coding. I suspect replit probably had similar issues while talking to itself, before it even gave me the first response.