3 ms·
Google's Flan-T5, Flan-UL2 and derivatives, are so far the most promising open (including commercial use) models that I have tried, however they are very "gener
by Garcia98 4y ago
Google's Flan-T5, Flan-UL2 and derivatives, are so far the most promising open (including commercial use) models that I have tried, however they are very "general purpose" and don't perform well in specific tasks like code understanding or generation. You could fine-tune Flan-T5 with a dataset that suits your specific task and get much better results, as shown by Flan-Alpaca.
Sadly, there's no open model yet that acts like a Swiss knife and gets good-enough results for multiple use cases.
- capableweb 4y agoIterating on the question, what model/weights would be the most appropriate for the specific use case of code generation right now?
- Garcia98 4y agoSorry for the late reply, as I said Flan-UL2 (or Flan-T5 if you want lighter models) fine-tuned against a dataset like CodeAlpaca's[0] is probably the best solution if it's intended for commercial use (otherwise LLaMa should perform better). [0]: https://github.com/sahil280114/codealpaca https://github.com/sahil280114/codealpaca