3 ms·
Sure, but you will get better results at a smaller number of parameters from a specifically trained model right now if you are trying to train/host it yourself.
by Closi 4y ago
Sure, but you will get better results at a smaller number of parameters from a specifically trained model right now if you are trying to train/host it yourself.
Remember that GPT3 is 175 billion parameters so many times bigger than both the above models (and gpt4 is rumoured to be bigger still), which also allows it to be more generalisable.
If GPT3 was trained at 7 billion parameters it might also lose it's language translation capabilities.