3 ms·
My experience is that as the prompt gets longer, performance decreases. Having such a long prompt with each request cannot be good. I remember in the early day
by jongjong 1y ago
My experience is that as the prompt gets longer, performance decreases. Having such a long prompt with each request cannot be good.
I remember in the early days of OpenAI, they had made the text completion feature available directly and it was much smarter than ChatGPT... I couldn't understand why people were raving about ChatGPT instead of the raw davinci text completion model.
Ir sucks how legal restrictions are dumbing down the models.
- jedimastert 1y ago> Ir sucks how legal restrictions are dumbing down the models Can you expand on this? I'm not sure I understand what you mean
- jongjong 1y agoIt seems that a lot of the Claude system prompts are there just to cover themselves from liabilities... I noticed a few prompts related to not quoting source material directly like music lyrics. This is to prevent copyright violation. A lot of these prompts would distract Claude from what the end user asked. In my experience working with LLMs, each prompt has a certain amount of 'intellectual capacity' and the more different questions and ideas you try to cram in a single prompt, the dumber the response, the more likely it makes mistakes. These formatting rules and constraints are orthogonal to what the user will ask so likely highly distracting. It's kind of like a human; if you give someone more work to complete within the same amount of time, they will do worse. But then I'm not sure how those system prompts are used. Are they trained into Claude or are they prepended to the start of the user's own prompt? What I'm saying applies to the latter which is what I suspect is happening.