3 ms·
Do they make profit from GPT4? Do they have IP that makes it impossible for someone with money (e.g. a bored saudi 'businessman') to train 8 220B LLama models
by seydor 3y ago
Do they make profit from GPT4?
Do they have IP that makes it impossible for someone with money (e.g. a bored saudi 'businessman') to train 8 220B LLama models and some RLHF?
Do they have exclusive content to feed their model?
Everything seems to point no, transformers are a common model, data is still available, and the limiting factor seems to be consumer-facing GPU time.
Plus there is no indication that GPT is the "final" model for language, this is still active research field