4 ms·
The easiest stepping stone will involve deploying on HuggingFace, think of it, in this case, of basically a mashup of GitHub x Heroku. You'll upload your model,
by refulgentis 3y ago
The easiest stepping stone will involve deploying on HuggingFace, think of it, in this case, of basically a mashup of GitHub x Heroku. You'll upload your model, they'll already have a repo for the model you fine-tuned somewhere, you'll tweak 20 lines of Python to run your version instead of theirs.
The next easiest step would be OpenAI. They offer extremely easy finetuning, more or less you'll upload a file with training data to their web app, then a few hours later it's done, and you just use your API key + a model ID for your particular fine-tuned model.
- ipsum2 3y agoHe mentioned he already has a fine-tuned model. OpenAI does not host user-created models.
- refulgentis 3y agoThey do not have a finetuned model and don't claim to, beyond that...this is just some filler text I'm writing because it felt aggro when I ended with a period. but I do want to correct the record because post flipped from +3 to -1 within 20 minutes of your post. have a good Tuesday!
- ipsum2 3y ago"If I've managed to build my own model, say a fine-tuned version of Llama"
- refulgentis 3y ago"If", "say" are diametrically opposed to certainty in US English vernacular. Only thought left after that is if you've gotten to the point you've finetuned a model it'd be very difficult to have this level of question. Frankly, I don't like asserting that because it's not guaranteed, and I really don't want to get in a pissing match about this. Bad vibes for no reason. I wrote a informative comment, from direct experience, that will help them. It wasn't just OpenAI...but I did enable them or anyone else who HuggingFace would also be too much for, to find an intermediate step.
- hyperadvanced 3y agoI think you underestimate the skill/knowledge gap present in people who can download and tinker with an existing program vs. deploy it in a sensible way so that people can interact with it. I have friends in different areas of tech who might be able to complete basic projects but would struggle to get them out there without a little guidance.
- refulgentis 3y ago- There's absolutely no reason to think they have a fine-tuned model ready. - There are multiple strong indicators from the poster themself they specifically do not. - It's dispiriting to see a long comment chain dedicated to picking apart a good, helpful, response. - It's uncomfortable to be told I'm underestimating skill/knowledge gap, after I purposely bracketed it. - It's uncomfortable to be told I'm underestimating skill/knowledge gap, after I specifically said "I don't like asserting that because it's not guaranteed, and I really don't want to get in a pissing match about this."
- smokel 3y agoWhen this stuff happens to me, I try to imagine that people accidentally tapped the down arrow, because it is so close to the up arrow. Enjoy my upvote!
- theGeatZhopa 3y agoI'm pissed too, when such happens. But that's the way it goes. One can choose between two questions: - Am I important, ain't I? - what can I buy of the HN KarmaPoints? I mostly choose the second question and answer it briefly: Nothing. And then I realize, for what it's worth: it's worth nothing and I can't buy anything with it. I learn to be not pissed on the Internet. I think it's an important skill.
- refulgentis 3y agoNo, actually, you're allowed to post and tease people who are saying nothing. The karma is just a useful framing as to why, people don't like it when you tease for no reason. (I only mentioned it once briefly lol, 4 comments up, relax buddy)