3 ms·
According to Kaparthy, in his LLM talk, he mentions the limitation right now is compute and there are no signs otherwise. So in a sense, it is moores law all ov
by jejeyyy77 2y ago
According to Kaparthy, in his LLM talk, he mentions the limitation right now is compute and there are no signs otherwise. So in a sense, it is moores law all over again for GPUs + these models.