3 ms·

I'd also ask how you're dealing with the idiosyncrasies across model families (its very different to prompt gemini vs claude vs gpt4o) when you are routing thes

by htrp 2y ago

I'd also ask how you're dealing with the idiosyncrasies across model families (its very different to prompt gemini vs claude vs gpt4o) when you are routing these lm inputs

swyx 2y ago
> The engine automatically enhances the initial prompt to improve accuracy, reduce token usage, and prevent output structure breakage. <handwaving> the prompt will just adapt to model :)
- yoeven 2y ago
  Basically ^ - Prompt style is starting to standardize across models. Something we see happening more and more. - There are keyword triggers and prompt styles that perform better in certain models over others. Prompt Engine first runs your prompt across 5-6 different models, then ranks the output over each run. The pool of models gets smaller, and we pick one that best fits, and the prompt gets more optimized towards that model.