4 ms·
> I can't wait for software that will take my notes each day and fine tune a LLM model on them so I can use entire context length for my question/answers Probl
by ankit219 3y ago
> I can't wait for software that will take my notes each day and fine tune a LLM model on them so I can use entire context length for my question/answers
Problem is finetuning does not work that way. Finetuning is useful when you want to teach a model about a certain pattern, not when you want it output it right. Eg: With enough finetuning and prompts, a model will be able to output the result in a certain format that you need, but it does not guarantee that it would not be hallucination prone. The best way to minimize hallucination is still embedding based retrieval passed along with the question/prompt.
In future, there can be a system where you can build a knowledge base for LLMs, and tell it to access that for any knowledge, and finetune it for the patterns you want the output in.