3 ms·
This model looks much too small to be effective. They announced an open model of 1.5B parameters [0] coming soon. Contrast this with davinci-003 or BigScience
by binarymax 4y ago
This model looks much too small to be effective. They announced an open model of 1.5B parameters [0] coming soon. Contrast this with davinci-003 or BigScience BLOOM, both with ~176 params.
I don't see how this will generate text that is comprehensive or useful. The open GPT models of that size aren't useable for text generation for anything serious. Adding the sensitivity of health/clinical I'd steer clear of this. Even BLOOM's model card specifically calls out biomedical as a misuse of the model [1].
[0] https://github.com/microsoft/BioGPT#news https://github.com/microsoft/BioGPT#news
[1] See "Out-of-scope" in https://huggingface.co/bigscience/bloom https://huggingface.co/bigscience/bloom