3 ms·
antirez's ds4-agent works quite fine. It runs on any Apple Silicon device with 96GB RAM or more.
by zozbot234 5mo ago
antirez's ds4-agent works quite fine. It runs on any Apple Silicon device with 96GB RAM or more.
- rjh29 5mo agoI wonder how many years it'll take for the API token cost to exceed the money spent on ram.
- zozbot234 5mo agoThe DS4 folks are unofficially testing ways to run the model with lower performance on lower-RAM machines. Similar efforts are going on with llama.cpp. The results are a bit of a challenge, prefill time tends to explode which is a limitation if you care about agentic workflows.
- vrganj 5mo agoAnything that runs with 64?
- zozbot234 5mo agoYou can just try it yourself, it will probably run with a heavy slowdown using SSD offload.