2 ms·
You will need 100s of billions to make a viable POC.
by kubb 5mo ago
You will need 100s of billions to make a viable POC.
- dgellow 5mo agoFor a PoC? That sounds very unlikely. I think you’re off by at least 2–3 orders of magnitude
- AlexCoventry 5mo agoYou only need to train a range of small models in order to establish a plausible scaling law, IMO.