2 ms·
900 kcal/day ~ 50 Watts It is more than phones/laptops consume. Certainly, we can only run small LLMs on such edge devices, but we getting to the level of com
by oezi 2y ago
900 kcal/day ~ 50 Watts
It is more than phones/laptops consume.
Certainly, we can only run small LLMs on such edge devices, but we getting to the level of compute efficiency that output indeed is comparable.