3 ms·
8x is a big gap. I feel that it might be better to just use few-shot prompting and supply some examples (not applicable to every use case ofc) every prompt to s
by msp26 3y ago
8x is a big gap. I feel that it might be better to just use few-shot prompting and supply some examples (not applicable to every use case ofc) every prompt to steer the output.
But it's worth experimenting with at least.
Edit: no function calling (until later this fall) too. That's most of my usage right now so I'll pass. Curious on what the verdict on the OAI finetunes are. I remember reading this thread which indicated it wasn't really necessary: https://news.ycombinator.com/item?id=37174850 https://news.ycombinator.com/item?id=37174850
- jondwillis 3y agoThat’ll add latency.
- explaininjs 3y agoand reduce maximum output length
- sheepscreek 3y agoThere’s a place for this. Like fine tuning the model on advanced particle physics so that it can decipher cutting edge research papers more accurately, without teaching the model particle physics every time in the prompt.