I’ve tried a bunch of different models that are essentially different instruction tuning on base models, and that seems to be generally true in my experience. I

I’ve tried a bunch of different models that are essentially different instruction tuning on base models, and that seems to be generally true in my experience. I don’t think you can fine tune your way into a significantly better code model. At best, one that can follow instructions better, but not one that can usually write noticeably better code or solve harder problems.