3 ms·
... and the advantage of the frontier models over anything you can possibly self-host continues to increase at an even more insane pace.
by Hizonner 24d ago
... and the advantage of the frontier models over anything you can possibly self-host continues to increase at an even more insane pace.
- serf 24d agoIt's my perspective that open models are closing the gap faster than the frontier is widening it. I'm not alone in that opinion.
- Hizonner 23d agoBy "open models", do you perhaps mean the approximately trillion-parameter open models that have been getting released recently? Because basically nobody can actually self-host those. And even at that size it's debatable that they're closing the gap. Talk to me when you can do it with a 24B model quantized to 8 bits.