3 ms·
Some users are moving to local models, I think, because they want to avoid the agent's cost, or they think it'll be more secure (not). The mac mini has unified
by kator 8mo ago
Some users are moving to local models, I think, because they want to avoid the agent's cost, or they think it'll be more secure (not). The mac mini has unified memory and can dynamically allocate memory to the GPU by stealing from the general RAM pool so you can run large local LLMs without buying a massive (and expensive) GPU.
- ErneX 8mo agoI think any of the decent open models that would be useful for this claw frency require way more ram than any Mac Mini you can possibly configure. The whole point of the Mini is that the agent can interact with all your Apple services like reminders, iMessage, iCloud. If you don’t need any just use whatever you already have or get a cheap VPS for example.
- duskdozer 8mo ago>they think it'll be more secure (not) for these types of tasks or LLMs in general?
- trcf23 8mo agoIf the idea is to have a few claws instances running non stop and scrapping every bit of the web, emails, etc, it would probably cost quite a lot of money. But if still feels safer to not have openAI access all my emails directly no?