2 ms·
Using local models or external? If external, aren't they pricey? How much tokens they generate? If local, what runs on such hardware that gives reasonable res
by krzyk 6mo ago
Using local models or external?
If external, aren't they pricey? How much tokens they generate?
If local, what runs on such hardware that gives reasonable results?
- storus 6mo agoLocal models on different machines with multiple RTX Pro 6000 or multiple DGX Sparks or a 512GB RAM Macstudio; the agents themselves run on that Pentium J NUC and just use exposed endpoints for local models. Forgejo for Git runs on another server. Therefore I don't really care if that NUC goes kaboom and can test everything quickly (OpenClaw, Hermes, Claude Code, Codex, OpenCode, Pi etc.). Or I can just use OpenRouter API key and access 10-100x cheaper models than Opus.