2 ms·
Training costs of large models are prohibitive. Only the big tech can afford to make insanely large models.
by behnamoh 4y ago
Training costs of large models are prohibitive. Only the big tech can afford to make insanely large models.
- smoldesu 4y agoYou don't need to. As I said, there are freely-available, pre-trained GPT models you can run on your own computer: https://huggingface.co/EleutherAI/gpt-neo-2.7B https://huggingface.co/EleutherAI/gpt-neo-2.7B No one has a monopoly on LLMs. You just can't run OpenAI's latest-and-greatest, because... why should you?
- behnamoh 4y agoGPT-3's performance is much much better than any open-source alternative that I've tried (Bloom, GPT-J, etc.) which is mostly due to parameter size. Like I said, OpenAI has the monopoly in "large" language models, but of course you can have smaller models.
- deleted 4y ago[deleted]