2 ms·
My main concern with running LLMs locally so far is that it absolutely kills your battery if you're constantly inferencing.
by jerryliu12 1y ago
My main concern with running LLMs locally so far is that it absolutely kills your battery if you're constantly inferencing.
- seanmcdirmid 1y agoIt really does. On the other hand, if you have a power outlet handy, you can inference on the plane even without a net connection.