Just the models available for fine tunings are waay behind gpt4. I have much better performance by "prompt tuning" - when question arises, I search 30 similiar

Just the models available for fine tunings are waay behind gpt4. I have much better performance by "prompt tuning" - when question arises, I search 30 similiar examples in training set, and send it to non-tuned GPT and ask the question and get much better performance than fine-tuned older models.