3 ms·

Also https://x.com/karpathy/status/1811467135279104217#m https://x.com/karpathy/status/1811467135279104217#m

• iforiq 2y ago
  How much did gpt2 training cost when it came out in 2019?
  • ozr 2y ago
    About $50,000.
  • withinboredom 2y ago
    They probably spent more on the training data, to be honest. They had to get it the hard way.