3 ms·

I recently saw an article arguing that waiting for overall LLM improvements actually beats fine-tuning in most cases as well. What are your feeling on this? (ap

I recently saw an article arguing that waiting for overall LLM improvements actually beats fine-tuning in most cases as well. What are your feeling on this? (apologies that I can’t remember the source)

resource_waste 3y ago
>waiting for overall LLM improvements actually beats fine-tuning in most cases My real world case is basically this. I couldn't fine tune(I think my problem was too hard, or Mistral sucks, or I suck). ChatGPT4 could do the job with me speaking gibberish and a single shot example, couldn't use mistral + 10k examples for the life of me. My project comes due at the end of April and I've been waiting since February...