4 ms·

Huh? Toys? You can run DeepSeek 70b on 36GB ram Macbook pro.. You can run Phi4, Qwen2.5, or llama3.3. They work great for coding tasks

• 3s 2y ago
  Yeah but as one of the replies points out the resulting tokens/second would be unusable in production environments
  • vanillax 2y ago
    What? Literally use it at work to write code.
    • jt_b 2y ago
      I think they're talking about using it to power inference for self hosted user facing applications.
      • vanillax 2y ago
        ahhhhh yes ok. Totally agree here.