4 ms·
The barrier of entry to building a "foundational model" is less than $400 of compute time (72 hours) on a handful of rental A100 using widely available open sou
by hadlock 3y ago
The barrier of entry to building a "foundational model" is less than $400 of compute time (72 hours) on a handful of rental A100 using widely available open source data sets. Open source projects by ICs are already on par with GPT3. It's gonna be really hard to regulate stuff in its current form, which is already commercially beneficial