2 ms·
Pretty unimpressive article. If compute to train PaLM costs millions, and Google has billions, and you use this as evidence that LLM development is bottlenecked
by QuadmasterXLII 4y ago
Pretty unimpressive article. If compute to train PaLM costs millions, and Google has billions, and you use this as evidence that LLM development is bottlenecked on compute cost, then I don’t know what to say.
- QuadmasterXLII 4y agoThis does add evidence to my thesis that the internet’s IQ would go up by ten points if million, billion, and trillion didn’t rhyme