2 ms·
> You need at least 10 trillion tokens to make an 8 billion parameter model Are you sure it is not just very inefficient?
by mdp2021 2y ago
> You need at least 10 trillion tokens to make an 8 billion parameter model
Are you sure it is not just very inefficient?
- GTP 2y agoI'm not an AI expert, but it seems to me that the common consensus is that current LLMs are quite inefficient and that there's room for improvement.