4 ms·
Not in love with axolotl but appreciate the advantages. This is an interesting approach, but you can also finetune easily on providers who wrap axolotl like Rep
by cuuupid 3y ago
Not in love with axolotl but appreciate the advantages. This is an interesting approach, but you can also finetune easily on providers who wrap axolotl like Replicate [1], Modal [2], or if you want to run the infra, LLM Engine [3].
My only gripe with Helix would be that it's smaller than the above and my org would be peeved about data security. The ability to self host is cool, but too much can go wrong too quickly with plain Docker ML. Would love to see, for example, a `cog` version of the images that we can deploy distributed with more confidence/bravado.
[1] https://replicate.com/mistralai/mistral-7b-instruct-v0.2 https://replicate.com/mistralai/mistral-7b-instruct-v0.2
[2] https://modal.com https://modal.com
[3] https://llm-engine.scale.com/ https://llm-engine.scale.com/
- josh-sematic 3y agoI’ll add https://airtrain.ai https://airtrain.ai to that list of push-button fine tunes using axolotl. Disclaimer: I’m the engineer who built it.