4 ms·

Congratulations! Elon's team over at X.ai, who I'm helping advise, is choosing between Hugging Face and a locally hosted alternative. What would HN recommend?

Congratulations! Elon's team over at X.ai, who I'm helping advise, is choosing between Hugging Face and a locally hosted alternative. What would HN recommend? I prefer Hugging Face as it has a stronger community built in but others prefer a open source project we can customize.

espadrine 3y ago
What does X.ai seek: democratization or centralization? If it wants everyone to fork its models, having the model on Huggingface and using its libraries will increase adoption, as people are used to that format, having the quantization built-in, etc. Having to perform model conversions slows things down, despite TheBloke’s constant efforts to convert every format to every other. If the model will only be accessible through CLI, APIs, or a website UI, then custom can make sense.
brucethemoose2 3y ago
Why not both? Y'all could host models on HF, and use the HF format/download code (which is quite good). But make a pretty frontend for it. Down the road you could just host your own backend implementing the HF API, if such a thing is necessary.
dbish 3y ago
If you’re hosting for your own use, unclear why you wouldn’t just do that directly on cloud instances. If you’re trying to share models with others publicly, then HF is the best option right now.
jprd 3y ago
Goodness, good luck and congrats! I am curious however, why name drop Elon and X.ai when asking this question? With all due respect, I'm not sure how that is going to advance the technical conversation, and in some regards may indeed de-rail it and hinder the mentoring you might receive? I hope I do not sound combative! I am generally curious, as I see this behavior at $JOB, but in reverse. "My customer is seeing this." "I have a customer that is asking Y." I am generally curious on the different perspectives that teammates can come from, that can drive them to take wildly non-congruent approaches, even with similar career experiences.
- fulladder 3y ago
  >I am generally curious, as I see this behavior at $JOB, but in reverse. "My customer is seeing this." "I have a customer that is asking Y." You work at a business and you think it's name dropping for a colleague to bring up specific customers' needs? I'm trying to see the steel man version of your argument, but I'm not getting it. GP is working for a well publicized AI startup and shared that they are evaluating HF versus alternatives. I thought it was useful information, and it's germane to this thread.
nmfisher 3y ago
Are you able to provide a bit more detail on what they're doing, or is it still all hush-hush?

espadrine 3y ago

What does X.ai seek: democratization or centralization? If it wants everyone to fork its models, having the model on Huggingface and using its libraries will increase adoption, as people are used to that format, having the quantization built-in, etc. Having to perform model conversions slows things down, despite TheBloke’s constant efforts to convert every format to every other. If the model will only be accessible through CLI, APIs, or a website UI, then custom can make sense.

brucethemoose2 3y ago

Why not both? Y'all could host models on HF, and use the HF format/download code (which is quite good). But make a pretty frontend for it. Down the road you could just host your own backend implementing the HF API, if such a thing is necessary.

dbish 3y ago

If you’re hosting for your own use, unclear why you wouldn’t just do that directly on cloud instances. If you’re trying to share models with others publicly, then HF is the best option right now.

jprd 3y ago

Goodness, good luck and congrats! I am curious however, why name drop Elon and X.ai when asking this question? With all due respect, I'm not sure how that is going to advance the technical conversation, and in some regards may indeed de-rail it and hinder the mentoring you might receive? I hope I do not sound combative! I am generally curious, as I see this behavior at $JOB, but in reverse. "My customer is seeing this." "I have a customer that is asking Y." I am generally curious on the different perspectives that teammates can come from, that can drive them to take wildly non-congruent approaches, even with similar career experiences.

fulladder 3y ago
>I am generally curious, as I see this behavior at $JOB, but in reverse. "My customer is seeing this." "I have a customer that is asking Y." You work at a business and you think it's name dropping for a colleague to bring up specific customers' needs? I'm trying to see the steel man version of your argument, but I'm not getting it. GP is working for a well publicized AI startup and shared that they are evaluating HF versus alternatives. I thought it was useful information, and it's germane to this thread.

nmfisher 3y ago

Are you able to provide a bit more detail on what they're doing, or is it still all hush-hush?