4 ms·
What does X.ai seek: democratization or centralization? If it wants everyone to fork its models, having the model on Huggingface and using its libraries will i
by espadrine 3y ago
What does X.ai seek: democratization or centralization?
If it wants everyone to fork its models, having the model on Huggingface and using its libraries will increase adoption, as people are used to that format, having the quantization built-in, etc. Having to perform model conversions slows things down, despite TheBloke’s constant efforts to convert every format to every other.
If the model will only be accessible through CLI, APIs, or a website UI, then custom can make sense.