Yes. You can also do retrieval on your set of classified examples so the prompt only contains the most similar examples, and as your set grows, the prompt becom

Yes. You can also do retrieval on your set of classified examples so the prompt only contains the most similar examples, and as your set grows, the prompt becomes more useful. (Even if this is still not as good as finetuning would be.) Note that you can do multiple prompts if you are willing to pay for even more accuracy, to ensemble different prompts.