4 ms·
Local Agent, 100%. If I'm just exploring ideas for fun or scratching my own itch, I have no desire to be thinking about a continuous stream of expenditure happ
by eutropia 2y ago
Local Agent, 100%.
If I'm just exploring ideas for fun or scratching my own itch, I have no desire to be thinking about a continuous stream of expenditure happening in the background when I have an apple silicon mac with 64GB of ram fully capable of running an agentic stack with tool calling etc.
Please make it trivial to setup and use a llamafile or similar as the LLM for this.
- janpaul123 2y agoI agree, this would be good to have soon, especially as good models keep getting smaller, and hardware keeps getting cheaper.