4 ms·
Have you tried the HF version which is linked on the main page? It is transformer based after all and it is converted to HF format. Just use QLoRA to fine-tune
by pk-protect-ai 3y ago
Have you tried the HF version which is linked on the main page? It is transformer based after all and it is converted to HF format. Just use QLoRA to fine-tune whatever you want on the top of that model. They handed you hundreds of GPU hours, without asking anything in return. You may throw it away and train the model from scratch. Be ready to throw $70k-$150k into air warming.
- monocasa 3y ago> Have you tried the HF version which is linked on the main page? It is transformer based after all and it is converted to HF format. Just use QLoRA to fine-tune whatever you want on the top of that model. Is that how their engineers built this model in the first place? Just because they're giving the build artifact of there hard work away doesn't make it open source. > Be ready to throw $70k-$150k into air warming. Just because builds are expensive, doesn't mean releasing the build artifacts counts as open source.
- pk-protect-ai 3y ago[flagged]
- monocasa 3y ago> I see dozens of your posts here complaining about "not open source." You are either a paid provocateur or a troll. I can't reply in my one tree without being called a troll? Also, accusing someone of being a paid provocateur is against HN guidelines. > What exactly is missing in your opinion in this release that is making this model not open source? The source the engineers at Mistral used to build it.