2 ms·
The 397B model can be run at home with the weights stored on an SSD (or on 2 SSDs, for double throughput). Probably too slow for chat, but usable as a coding a
by adrian_b 7mo ago
The 397B model can be run at home with the weights stored on an SSD (or on 2 SSDs, for double throughput).
Probably too slow for chat, but usable as a coding assistant.
- xienze 7mo agoI think you have that backwards. Agentic coding is way more demanding than simple chat. The request/response loops (tool calling) are much tighter and more numerous, and the context is waaaaay bigger in general.
- fragmede 7mo agoIn processing power, but chat is interactive. Agentic coding, you come up with a plan and sign off on it, and then just let it go for a while. It's the difference between speed and latency.