Fine tuning a model isn't that hard and the tradeoff he described is real. I was on the fine tuning team of a multi-team hackathon to make a specialized chatbo

Fine tuning a model isn't that hard and the tradeoff he described is real. I was on the fine tuning team of a multi-team hackathon to make a specialized chatbot once a few years ago and despite working technically well our output had very little impact on end to end output.