4 ms·
tried doing exactly this with ollama on a cross-country flight last month. my macbook basically turned into a jet engine and the battery died in under an hour.
by builderminkyu 5mo ago
tried doing exactly this with ollama on a cross-country flight last month. my macbook basically turned into a jet engine and the battery died in under an hour.
curious if you had to heavily throttle the cpu or stick to super small quants (like 4 bit phi3) to actually make it through 10 hours without a power outlet?
- julianlam 5mo agoUsing an LLM to code without AC power is ... certainly a choice. On my framework 13 a couple exploratory prompts and a code writing step drained my battery to 85% in about 5 minutes.