6 ms·

Tangent, but: > The open source models are extraordinarily effective. Which models are you referring to? (And in particular, which sizes/versions?)

• ChicagoDave 8mo ago
  It’s a fast moving science so I’m still in the middle of defining what my at-home setup will be. I think there will be a tipping point where cheaper hardware plus new models reaches a pro-consumer effectiveness level.
  • am17an 8mo ago
    They already have with qwen3.5
    • mft_ 8mo ago
      I agree with the previous post that there's hope that there's a convergence point in the not too distant future where consumer hardware can run powerful models. At the moment, the 397Bn Qwen3.5 model (which I assume is what you're referring to) is still out of reach of most consumers to run locally: the only relatively straightforward path (i.e. discounting custom Threadripper builds) to running it would be a 512Gb Mac Studio. However, in a generation or two (of hardware and models) maybe we'll see convergence with more hardware available with 3-400Gb of memory for more approachable money (a tough sell right now, I accept, with memory prices as they are) and models offering great performance in this size range.
      • am17an 8mo ago
        I was referring to the 35B version. It is surprisingly good for its size. You can use it for implementation tasks without it going off the rails