4 ms·
> multiple times, and results always same Not my experience at all. With smaller models, whenever I see a response that is going into wrong direction, I would
by kees99 2mo ago
> multiple times, and results always same
Not my experience at all.
With smaller models, whenever I see a response that is going into wrong direction, I would just redo that step, and more often that not that brings improvement.
This effect is less pronounced with SOTA, but still there.
- shunia_huang 2mo agoYes not my experience either. I've tried or sometimes be stupid to work on bugs/features and ask with almost identical prompts with same modal and harness set, and yes, they generate totally different results. Sometimes the output is unusable and even with extended guidance it will still drift away from what I was expecting. Sometimes the output is just one shot and follows almost whatever I want. I then be used to work like this, if the model and harness set does not work for one time, I just start a new session and do it again. And currently there is one of my task working like this.