In this comment I was referring to POS tagging and feature extraction. Another use case for fine tuning we have as well is to reduce a 5-shot prompt that we ha

In this comment I was referring to POS tagging and feature extraction. Another use case for fine tuning we have as well is to reduce a 5-shot prompt that we have to run hundreds of times per request down to a “0-shot” (heavy emphasis on the double quotes. Run five shot on gpt-4o a couple thousand times, then fine tune on cohere’s command-r or haiku or llama3 8b or whichever small but mighty llm. You can reduce costs by 99%, or somewhere in that ballpark, without really sacrificing quality on 99% of the queries.