3 ms·

There is no citation needed. It is indeed trivial to fine-tune. Doing a good job is another matter, but the claim is correct. Google around and find a blog post

There is no citation needed. It is indeed trivial to fine-tune. Doing a good job is another matter, but the claim is correct. Google around and find a blog post showing how. The claim that RAG is dead is obviously wrong.

simonw 3y ago
For "citation needed", read "please link me to a blog post showing how, don't just tell me to Google for one". The internet is full of blog posts about this. That doesn't mean they're actually good - I'd love to be pointed at one that has proven itself useful for someone (and definitely isn't just LLM blog-spam). I don't care if it's trivial to fine-tune and get crap results - I care about fine-tuning where the result was worth the effort. For the record, my favourite guide to fine-tuning is the section of this Jeremy Howard video that shows how to train a text-to-SQL model: https://www.youtube.com/watch?v=jkrNMKz9pWU&t=4850s https://www.youtube.com/watch?v=jkrNMKz9pWU&t=4850s
- danielmarkbruce 3y ago
  It's an internet forum, not an academic journal. Water tight arguments are not needed. If one wants to call bs, they can just do it, no need to dance around the topic by asking for a citation.
  - simonw 3y ago
    OK, I call BS. Fine-tuning an LLM is not "trivial" - especially if you want to get useful results, as opposed to just being able to say "look, I fine-tuned an LLM".
    - danielmarkbruce 3y ago
      Yup, largely agree.
  - wakaru44 3y ago
    Exactly, it's a forum not Twitter/reddit. Without references and citations this is no better than a bunch of random words, and it's hard to make any argument of substance. The person asked for citations, leave it be, stop dudexplaining how Internet works for you please. I call bs on your 2 comments.
    - danielmarkbruce 3y ago
      They didn't ask for citations. They pointed out a citation was needed. It was a clever sounding way of calling bs. They admit as much. Even when people sincerely ask for a citation on a debatable topic, on an internet forum, it's effectively saying "I won't be hear any opinion that doesn't match my own unless it's as water tight as a law of physics". Another form of this is "show me the data".

simonw 3y ago

For "citation needed", read "please link me to a blog post showing how, don't just tell me to Google for one". The internet is full of blog posts about this. That doesn't mean they're actually good - I'd love to be pointed at one that has proven itself useful for someone (and definitely isn't just LLM blog-spam). I don't care if it's trivial to fine-tune and get crap results - I care about fine-tuning where the result was worth the effort. For the record, my favourite guide to fine-tuning is the section of this Jeremy Howard video that shows how to train a text-to-SQL model: https://www.youtube.com/watch?v=jkrNMKz9pWU&t=4850s https://www.youtube.com/watch?v=jkrNMKz9pWU&t=4850s

danielmarkbruce 3y ago
It's an internet forum, not an academic journal. Water tight arguments are not needed. If one wants to call bs, they can just do it, no need to dance around the topic by asking for a citation.
- simonw 3y ago
  OK, I call BS. Fine-tuning an LLM is not "trivial" - especially if you want to get useful results, as opposed to just being able to say "look, I fine-tuned an LLM".
  - danielmarkbruce 3y ago
    Yup, largely agree.
- wakaru44 3y ago
  Exactly, it's a forum not Twitter/reddit. Without references and citations this is no better than a bunch of random words, and it's hard to make any argument of substance. The person asked for citations, leave it be, stop dudexplaining how Internet works for you please. I call bs on your 2 comments.
  - danielmarkbruce 3y ago
    They didn't ask for citations. They pointed out a citation was needed. It was a clever sounding way of calling bs. They admit as much. Even when people sincerely ask for a citation on a debatable topic, on an internet forum, it's effectively saying "I won't be hear any opinion that doesn't match my own unless it's as water tight as a law of physics". Another form of this is "show me the data".