3 ms·
The AI hardware requirements are currently insane; the models are doing with Megawatts of power and warehouses full of hardware what an average Joe does in 20
by briansm 1y ago
The AI hardware requirements are currently insane; the models are doing with Megawatts of power and warehouses full of hardware what an average Joe does in 20 Watts and a 'bowl of noodles'.
- KineticLensman 1y agoThey handle many more requests per second than an average Joe
- otabdeveloper4 1y agoNot really. They have large contexts and lack of proper caching for "reasons".