2 ms·

I've seen this described as the common approach and argued for it but with my limited knowledge I have difficulties countering the argument that it would be bes

I've seen this described as the common approach and argued for it but with my limited knowledge I have difficulties countering the argument that it would be best to just finetune the model with your own data. I don't think it is as much the context window size because you would chunk your data anyways. I think the counter argument is either that finetuning is limited by the risk of overfitting and catastrophic forgetting or cost prohibitive. I think it is more of the former. Am I on the right track with this arguments? Another point to consider is probably the vector DB contains an exact version of your data you get that as a result whereas the model will only be able answer vaguely or by paraphrasing.

moneywoes 3y ago
In contrast, What’s the flow for training or fine tuning your own model
- kaycebasques 3y ago
  Once I dug in to the fine-tuning APIs [1] I realized that the phrase "training the model on your docs" often doesn't make sense for the use case people are trying to solve. You provide hundreds of input examples and tell the model how it should complete those prompts. Fine-tuning has a lot of use cases, but "keeping the LLM generally grounded in the facts of my website" is not one of them. [1] https://platform.openai.com/docs/guides/fine-tuning/prepare-training-data https://platform.openai.com/docs/guides/fine-tuning/prepare-...
  - weinzierl 3y ago
    Fine-tuning has a lot of use cases, but "keeping the LLM generally grounded in the facts of my website" is not one of them. Yes, that's what everyone says and it makes total sense to me. I'm looking for (technical, but not too technical) arguments why it is not possible. There I'm not so much interested in the "grounded in the facts of my website" point but more in the similar "take the data from my large private knowledge base into consideration" point. In other words I don't want to restrict the knowledge the model has or the answers it gives. I want to add a considerable amount of my own knowledge. This seems not to be possible without training from scratch. The question is "Why?"

moneywoes 3y ago

In contrast, What’s the flow for training or fine tuning your own model

kaycebasques 3y ago
Once I dug in to the fine-tuning APIs [1] I realized that the phrase "training the model on your docs" often doesn't make sense for the use case people are trying to solve. You provide hundreds of input examples and tell the model how it should complete those prompts. Fine-tuning has a lot of use cases, but "keeping the LLM generally grounded in the facts of my website" is not one of them. [1] https://platform.openai.com/docs/guides/fine-tuning/prepare-training-data https://platform.openai.com/docs/guides/fine-tuning/prepare-...
- weinzierl 3y ago
  Fine-tuning has a lot of use cases, but "keeping the LLM generally grounded in the facts of my website" is not one of them. Yes, that's what everyone says and it makes total sense to me. I'm looking for (technical, but not too technical) arguments why it is not possible. There I'm not so much interested in the "grounded in the facts of my website" point but more in the similar "take the data from my large private knowledge base into consideration" point. In other words I don't want to restrict the knowledge the model has or the answers it gives. I want to add a considerable amount of my own knowledge. This seems not to be possible without training from scratch. The question is "Why?"