Fine-tuning could be useful to get a high text completion quality out of a small model within a specific domain. You would still use the resulting model alongsi

Fine-tuning could be useful to get a high text completion quality out of a small model within a specific domain. You would still use the resulting model alongside an info retrieval system to prompt with real context (unless you have a use case where hallucination is a feature).