4 ms·

Finetuning would never add any new knowledge. For internal corporate data, use RAG or train a model from scratch. Finetuning would not help anyone answer a ques

Finetuning would never add any new knowledge. For internal corporate data, use RAG or train a model from scratch. Finetuning would not help anyone answer a question from that data.

Exuma 2y ago
How does one do RAG? I see it mentioned like 20 times
- meiraleal 2y ago
  you supply to the LLM the subset of data that you need for a specific prompt. That's RAG.
- behnamoh 2y ago
  This article reviews some of the most advanced RAG methods: https://medium.com/@krtarunsingh/advanced-rag-techniques-unlocking-the-next-level-040c205b95bc https://medium.com/@krtarunsingh/advanced-rag-techniques-unl... (not mine)
qeternity 2y ago
This isn’t true at all. Fine tune with a single sample and see what happens to your model.
- ankit219 2y ago
  Will share a longer post on this once I finish it. I have tested this multiple times, on bigger models, on custom smaller models, and it does not work. In a strict sense, finetuning can add new knowledge but for that you need millions of tokens and multiple runs without using LoRA or Peft. For practical purposes, it does not.
  - F-Lexx 2y ago
    Bring on the new post and more details, this stuff is interesting.
  - zwaps 2y ago
    PEFT is not for adding knowledge, that's obvious
  - qeternity 2y ago
    I get the sense that you want to do the anti-RAG: take some relatively small corpus of data, train a lora, and then magically have a chatbot that knows your stuff...yeah, that will not work. But chatbots are only one single use-case. And broadly I think this pattern of LLM-as-store-of-knowledge is a bad one (of course, until ASI, and then it isn't). That said, you absolutely can impart new knowledge through fine-tuning. Millions of tokens is a rather small hurdle to overcome. And if you're not retraining with original/general data, then your model will become very specialized and possibly overfit...which is not an issue in many instances, and may even be desirable.

Finetuning would never add any new knowledge. For internal corporate data, use RAG or train a model from scratch. Finetuning would not help anyone answer a question from that data.

Exuma 2y ago

How does one do RAG? I see it mentioned like 20 times

meiraleal 2y ago
you supply to the LLM the subset of data that you need for a specific prompt. That's RAG.
behnamoh 2y ago
This article reviews some of the most advanced RAG methods: https://medium.com/@krtarunsingh/advanced-rag-techniques-unlocking-the-next-level-040c205b95bc https://medium.com/@krtarunsingh/advanced-rag-techniques-unl... (not mine)

qeternity 2y ago

This isn’t true at all. Fine tune with a single sample and see what happens to your model.

ankit219 2y ago
Will share a longer post on this once I finish it. I have tested this multiple times, on bigger models, on custom smaller models, and it does not work. In a strict sense, finetuning can add new knowledge but for that you need millions of tokens and multiple runs without using LoRA or Peft. For practical purposes, it does not.
- F-Lexx 2y ago
  Bring on the new post and more details, this stuff is interesting.
- zwaps 2y ago
  PEFT is not for adding knowledge, that's obvious
- qeternity 2y ago
  I get the sense that you want to do the anti-RAG: take some relatively small corpus of data, train a lora, and then magically have a chatbot that knows your stuff...yeah, that will not work. But chatbots are only one single use-case. And broadly I think this pattern of LLM-as-store-of-knowledge is a bad one (of course, until ASI, and then it isn't). That said, you absolutely can impart new knowledge through fine-tuning. Millions of tokens is a rather small hurdle to overcome. And if you're not retraining with original/general data, then your model will become very specialized and possibly overfit...which is not an issue in many instances, and may even be desirable.