3 ms·
How many tokens per second would you even get on them?
by amelius 2mo ago
How many tokens per second would you even get on them?
- kennywinker 2mo agoAfaik most openclaw users aren’t running their llm locally - just using a mac mini as an always-on sandbox for agents.
- xhkkffbf 2mo agoA sandbox with access to iMessage. Can't have your agent texting with green boxes.
- kennywinker 2mo agoNono it’s ok iMessage is actually an open standard - steve promised.
- frollogaston 2mo agoThis is why my wife's iPhone 6 is still better in real life usage than the latest flagship Android phone. Playing high-end 3D game vs not screwing up the group chat.
- copperx 2mo agoCool, like a $5 VPS?
- kennywinker 2mo agoYes, but 100 times more expensive.
- o_m 2mo agoA $5 VPS is easy to block. It's way harder to block a stock mac mini from a residential IP address
- kennywinker 2mo agoTailscale the vps into your home network, and have it use that as an exit node.
- o_m 2mo agoThe bot blocking services are more advanced than that. They will do stuff like checking how your fonts are rendered in a canvas element to determine your browser and OS. A stock mac circumvent all that by hiding in plain sight.
- DaSHacka 2mo agoBut why a Mac mini over a $30 raspberry pi on the same residential connection?
- frollogaston 2mo agoGuess cause it'll still do local builds and stuff, and probably do a lot more of those if the agents are spamming builds and it's something like Swift or Rust that takes a lot to compile
- kennywinker 2mo agoSo a $100 optiplex?
- simonh 2mo agoOpenClaw was originally designed to run on a Mac, but using remote LLMs accessed via API. Running the LLM locally on beefier hardware came later.