2 ms·
Why not both? You don’t need 1trillion allocated before you have a proof of concept to demonstrate your non-LLM model, and once you have a PoC you will definite
by dgellow 6mo ago
Why not both? You don’t need 1trillion allocated before you have a proof of concept to demonstrate your non-LLM model, and once you have a PoC you will definitely have the larger investors interested
- kubb 6mo agoYou will need 100s of billions to make a viable POC.
- dgellow 6mo agoFor a PoC? That sounds very unlikely. I think you’re off by at least 2–3 orders of magnitude
- AlexCoventry 6mo agoYou only need to train a range of small models in order to establish a plausible scaling law, IMO.