4 ms·
How does one efficiently learn how to do such things, and what kinds of problems such approaches are fruitful for? I find there to be a giant gap in learning a
by sanderjd 3y ago
How does one efficiently learn how to do such things, and what kinds of problems such approaches are fruitful for?
I find there to be a giant gap in learning about this stuff between material that boils down to "use magic words and system prompts to improve results from one of the big models" and "how do LLMs work from first principles".
I still haven't found a great resource that covers this middle ground, which seems to me to be where a lot of the power of these approaches is going to reside.
- Swizec 3y ago> I still haven't found a great resource that covers this middle ground, which seems to me to be where a lot of the power of these approaches is going to reside. Read papers, build intuition, experiment. That last part may be the most important.
- sanderjd 3y agoI think this is the disconnect: It doesn't strike me that what I'm talking about has anything to do with "papers". So from your comment, I'm once again left wondering what you mean. My sense is that I have a much better grasp of the foundational material here, having read in depth books and papers about that, but still can't quite wrap my head around the question of how people are actually "operationalizing" this into useful software. But to your point about experimentation, it might just be the kind of thing where there is no path to enlightenment besides working on a project and running into and overcoming all the hurdles along the way.
- deleted 3y ago[deleted]
- kcorbitt 3y agoIf you're looking for a practical guide to getting started with fine tuning, I wrote one a couple of months ago that got pretty popular here on HN. Might be helpful if you're interested in playing around with it! https://news.ycombinator.com/item?id=37484135 https://news.ycombinator.com/item?id=37484135
- Tostino 3y agoSo I described my approach to how I fine tune a specific task below to another user, but I'll copy it here: > Design your tasks to be repeatable and small steps, call the OpenAI API and log all requests/responses. > Filter out any bad responses and take a representative sample of the data you have collected from OpenAI,and train a Mistral or Llama2 model with the request/response pairs. > Measure the quality of your model vs OpenAI for the same inputs, and then swap out the model in your workflow once happy with the results.
- capableweb 3y agoIf you do this, be careful how/if you publish your weights trained on OpenAI output as if they look into how it was generated and it becomes clear you broke the ToS, they'll most likely ban you from the platform.
- leereeves 3y agoHow would they "look into how it was generated"?
- capableweb 3y agoYou train your model, publish it on huggingface and then write in the README: > This is how I made this model: Design your tasks to be repeatable and small steps, call the OpenAI API and log all requests/responses. > Filter out any bad responses and take a representative sample of the data you have collected from OpenAI,and train a Mistral or Llama2 model with the request/response pairs. Just one example.
- Tostino 3y agoI'm not competing with OpenAI in any sense of the word.
- jiveturkey 3y agoI haven't read the ToS, but it may not specifically require competing to be a violation.
- jachee 3y agoThe industry term for that middle ground is a “moat”, and the people who are most familiar with it are getting paid for what they know, so they’re not giving it away.
- sanderjd 3y agoI think that may be right, but if so, that seems pretty unusual to me. I've gone through a few of these "new kinds of software becoming useful" transition periods - most notably applications moving to the web, and then native smart phone applications - and in none of those transitions was there a dearth of resources on how to spin up on doing useful things due to this "moat" concern. Nobody was protecting their iphone app dev moat by not publishing books and training courses on Objective-C and XCode...
- danielmarkbruce 3y agohuggingface is your friend.